2024-05-14T11:57:36.302 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-14T11:57:36.302 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770 --name vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/orig.config.yaml 2024-05-14T11:57:36.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T11:57:36.464 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770 branch: wip-vshankar-testing-20240509.053109-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} email: vshankar@redhat.com first_in_suite: false job_id: '7705770' kernel: client: branch: testing flavor: default kdb: true sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240509.053109-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - SLOW_OPS - slow request sha1: e2b755a64f0d72176b57299d02e880cf0620d780 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: e2b755a64f0d72176b57299d02e880cf0620d780 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240509.053109-debug sha1: e2b755a64f0d72176b57299d02e880cf0620d780 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6285 sha1: e2b755a64f0d72176b57299d02e880cf0620d780 sleep_before_teardown: 0 subset: 548/1024 suite: fs suite_branch: wip-vshankar-testing-20240509.053109-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2b755a64f0d72176b57299d02e880cf0620d780 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIzKtlXFHDHk17XHGZXVA1Zq/qXEFGWG8oYM+rDzNzlm6zbK/zURy9JiPcC3v+r5YYkJy3gIoAtgXDDwwLspebk= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQVPhvmCDpxdqug4SajaMXX6Zs0/RF3KkRa501KmSvUgYnHhsq4g9KX+NdxZrNiLjE7WLlMB7EfPmoojbgCoYQ= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsVQaov3vxA+nxdLol/3+lofBWffPe3HP/9qnEuzhJ/7215RYjXdkqYFopNPg7ED2WupDiQBkS7e3DaqHr+TPQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-14_07:04:04 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-14T11:57:36.464 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa; will attempt to use it 2024-05-14T11:57:36.465 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks 2024-05-14T11:57:36.465 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-14T11:57:36.467 INFO:teuthology.task.internal:Checking packages... 2024-05-14T11:57:36.490 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e2b755a64f0d72176b57299d02e880cf0620d780' 2024-05-14T11:57:36.490 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-14T11:57:36.490 INFO:teuthology.packaging:ref: None 2024-05-14T11:57:36.490 INFO:teuthology.packaging:tag: None 2024-05-14T11:57:36.490 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240509.053109-debug 2024-05-14T11:57:36.490 INFO:teuthology.packaging:sha1: e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T11:57:36.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240509.053109-debug 2024-05-14T11:57:36.630 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3588.ge2b755a6 2024-05-14T11:57:36.632 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-14T11:57:36.638 INFO:teuthology.task.internal:no buildpackages task found 2024-05-14T11:57:36.639 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-14T11:57:36.680 INFO:teuthology.task.internal:Saving configuration 2024-05-14T11:57:36.701 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-14T11:57:36.707 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T11:57:36.733 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 11:51:36.424736', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIzKtlXFHDHk17XHGZXVA1Zq/qXEFGWG8oYM+rDzNzlm6zbK/zURy9JiPcC3v+r5YYkJy3gIoAtgXDDwwLspebk='} 2024-05-14T11:57:36.757 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 11:51:36.426755', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQVPhvmCDpxdqug4SajaMXX6Zs0/RF3KkRa501KmSvUgYnHhsq4g9KX+NdxZrNiLjE7WLlMB7EfPmoojbgCoYQ='} 2024-05-14T11:57:36.782 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 11:51:36.428518', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsVQaov3vxA+nxdLol/3+lofBWffPe3HP/9qnEuzhJ/7215RYjXdkqYFopNPg7ED2WupDiQBkS7e3DaqHr+TPQ='} 2024-05-14T11:57:36.782 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-14T11:57:36.788 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-14T11:57:36.789 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-14T11:57:36.789 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-14T11:57:36.789 INFO:teuthology.run_tasks:Running task console_log... 2024-05-14T11:57:36.899 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc9dc8d10d0>, signals=[15]) 2024-05-14T11:57:36.899 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-14T11:57:36.907 INFO:teuthology.task.internal:Opening connections... 2024-05-14T11:57:36.907 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T11:57:36.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T11:57:36.986 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-05-14T11:57:36.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T11:57:37.062 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-05-14T11:57:37.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T11:57:37.135 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-14T11:57:37.142 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-05-14T11:57:37.161 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-05-14T11:57:37.161 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T11:57:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-05-14T11:57:37.220 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T11:57:37.220 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T11:57:37.220 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T11:57:37.220 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-05-14T11:57:37.250 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-05-14T11:57:37.268 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-05-14T11:57:37.268 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-05-14T11:57:37.326 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-05-14T11:57:37.326 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-05-14T11:57:37.326 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-05-14T11:57:37.326 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T11:57:37.327 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T11:57:37.327 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-05-14T11:57:37.350 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-05-14T11:57:37.368 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-05-14T11:57:37.368 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-05-14T11:57:37.425 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-05-14T11:57:37.425 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T11:57:37.426 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T11:57:37.427 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-05-14T11:57:37.450 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-14T11:57:37.461 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-14T11:57:37.488 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-14T11:57:37.488 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-05-14T11:57:37.491 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-05-14T11:57:37.493 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-05-14T11:57:37.509 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-14T11:57:37.516 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-14T11:57:37.516 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-05-14T11:57:37.548 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-05-14T11:57:37.551 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-05-14T11:57:37.655 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-14T11:57:37.734 INFO:teuthology.run_tasks:Running task kernel... 2024-05-14T11:57:37.750 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'} 2024-05-14T11:57:37.750 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-14T11:57:37.750 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-14T11:57:37.750 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T11:57:37.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T11:57:37.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-14T11:57:37.923 DEBUG:teuthology.task.kernel:sha1 for client.0 is e8b10e4a18b1bb5760aa273548d0a7e626b2532f 2024-05-14T11:57:37.923 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "e8b10e4a18b1bb5760aa273548d0a7e626b2532f"... 2024-05-14T11:57:37.923 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-14T11:57:37.941 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-437.el9.x86_64 2024-05-14T11:57:37.941 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs e8b10e4a18b1bb5760aa273548d0a7e626b2532f 2024-05-14T11:57:37.941 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T11:57:37.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum upgrade -y linux-firmware 2024-05-14T11:57:41.831 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.1 MB 00:02 2024-05-14T11:57:59.106 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:16 2024-05-14T11:58:04.856 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-14T11:58:06.491 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-05-14T11:58:08.077 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-14T11:58:13.458 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-05-14T11:58:15.604 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-14T11:58:15.605 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-05-14T11:58:15.605 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-14T11:58:15.726 INFO:teuthology.task.kernel:Downloading kernel e8b10e4a18b1bb5760aa273548d0a7e626b2532f on client.0... 2024-05-14T11:58:15.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8b10e4a18b1bb5760aa273548d0a7e626b2532f 2024-05-14T11:58:15.873 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/e8b10e4a18b1bb5760aa273548d0a7e626b2532f/centos/9/flavors/default/x86_64/ 2024-05-14T11:58:15.874 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_ge8b10e4a18b1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/e8b10e4a18b1bb5760aa273548d0a7e626b2532f/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T11:58:15.876 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi047.front.sepia.ceph.com to complete... 2024-05-14T11:58:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14 11:58:30 URL:https://2.chacra.ceph.com/r/kernel/testing/e8b10e4a18b1bb5760aa273548d0a7e626b2532f/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_ge8b10e4a18b1-1.x86_64.rpm [357672914/357672914] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T11:58:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:FINISHED --2024-05-14 11:58:30-- 2024-05-14T11:58:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:Total wall clock time: 15s 2024-05-14T11:58:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:Downloaded: 1 files, 341M in 15s (23.1 MB/s) 2024-05-14T11:58:30.934 INFO:teuthology.task.kernel:Installing kernel e8b10e4a18b1bb5760aa273548d0a7e626b2532f on client.0... 2024-05-14T11:58:30.934 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T11:58:33.120 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying... ######################################## 2024-05-14T11:58:33.231 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing... ######################################## 2024-05-14T11:58:33.337 INFO:teuthology.orchestra.run.smithi047.stdout:Updating / installing... 2024-05-14T11:58:41.669 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-6.9.0_rc3_ge8b10e4a18b1-1 ######################################## 2024-05-14T11:59:21.489 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T11:59:21.490 DEBUG:teuthology.orchestra.run.smithi047:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/System.map-6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/config-6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/vmlinuz-6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/System.map 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/config 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T11:59:21.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T11:59:21.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kernel 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kernel/cpu 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kernel/cpu/mce 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kvm 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/arch/x86/kvm/kvm.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/ansi_cprng.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/anubis.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/arc4.ko 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/async_tx 2024-05-14T11:59:21.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/async_tx/async_pq.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/async_tx/async_tx.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/async_tx/async_xor.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/async_tx/raid6test.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/authenc.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/authencesn.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/blake2b_generic.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/blowfish_common.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/blowfish_generic.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/camellia_generic.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/cast5_generic.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/cast6_generic.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/cast_common.ko 2024-05-14T11:59:21.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/ccm.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/cmac.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/crc32_generic.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/crypto_engine.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/crypto_user.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/cts.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/des_generic.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/dh_generic.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/echainiv.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/essiv.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/fcrypt.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/khazad.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/lz4.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/lz4hc.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/md4.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/michael_mic.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/pcbc.ko 2024-05-14T11:59:21.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/pcrypt.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/rmd160.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/seed.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/serpent_generic.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/tcrypt.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/tea.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/twofish_common.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/twofish_generic.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/vmac.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/wp512.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/xcbc.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/xor.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/crypto/xxhash_generic.ko 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers 2024-05-14T11:59:21.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi/ec_sys.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi/platform_profile.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi/sbs.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi/sbshc.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/acpi/video.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/acard-ahci.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/ahci_platform.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/ata_generic.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/libahci_platform.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_acpi.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_ali.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_amd.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_artop.ko 2024-05-14T11:59:21.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_cypress.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_efar.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_it8213.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_it821x.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_marvell.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_netcell.ko 2024-05-14T11:59:21.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_opti.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_optidma.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_rdc.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_sch.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_sil680.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_sis.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T11:59:21.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_triflex.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pata_via.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/pdc_adma.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_mv.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_nv.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_promise.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_qstor.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_sil.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_sil24.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_sis.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_svw.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_sx4.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_uli.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_via.ko 2024-05-14T11:59:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ata/sata_vsc.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/auxdisplay 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/base 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/base/regmap 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/bcma 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/bcma/bcma.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/aoe 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/aoe/aoe.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/brd.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/drbd 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/drbd/drbd.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/floppy.ko 2024-05-14T11:59:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/loop.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/mtip32xx 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/nbd.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/null_blk 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/pktcdvd.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/rbd.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/virtio_blk.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/xen-blkback 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/xen-blkfront.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/zram 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/block/zram/zram.ko 2024-05-14T11:59:21.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/hw_random 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ipmi 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/lp.ko 2024-05-14T11:59:21.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/mwave 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/mwave/mwave.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/ppdev.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tlclk.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tpm 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tpm/tpm.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/char/virtio_console.ko 2024-05-14T11:59:21.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/cpufreq 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/ccp 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/intel 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/intel/qat 2024-05-14T11:59:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/virtio 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/dca 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/dca/dca.ko 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/devfreq 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/dma 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/dma/dw 2024-05-14T11:59:21.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/dma/ioat 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/amd64_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/e752x_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/i3000_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/i3200_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/i5100_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/i5400_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/i7300_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/i7core_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T11:59:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/sb_edac.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/edac/x38_edac.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/firmware 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/firmware/edd.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/gpio 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-appleir.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-aureal.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-axff.ko 2024-05-14T11:59:21.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-dr.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-elecom.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-elo.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-emsff.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-gaff.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-gyration.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-icade.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-kye.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T11:59:21.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-led.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-ortek.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-penmount.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-pl.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-primax.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-rmi.ko 2024-05-14T11:59:21.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-roccat.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-saitek.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-samsung.ko 2024-05-14T11:59:21.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-sony.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-tivo.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-tmff.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-topseed.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-waltop.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T11:59:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-zpff.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/uhid.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hid/wacom.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hv 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hv/hv_balloon.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hv/hv_utils.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/abituguru.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ad7414.ko 2024-05-14T11:59:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ad7418.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adm1025.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adm1026.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adm1029.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adm1031.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adm9240.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ads7828.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adt7410.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adt7411.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adt7462.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adt7470.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adt7475.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/amc6821.ko 2024-05-14T11:59:21.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/applesmc.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/asb100.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/asc7621.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/atxp1.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/coretemp.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/dme1737.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ds1621.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ds620.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/emc1403.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/f71805f.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/f75375s.ko 2024-05-14T11:59:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/fschmd.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/g760a.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/g762.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ina209.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/it87.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/k10temp.ko 2024-05-14T11:59:21.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/k8temp.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm63.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm73.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm75.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm77.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm78.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm80.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm83.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm85.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm87.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm90.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm92.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm93.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm95234.ko 2024-05-14T11:59:21.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm95241.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/lm95245.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/max16065.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/max1619.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/max1668.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/max197.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/max6639.ko 2024-05-14T11:59:21.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/max6650.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/max6697.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/nct6683.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/nct6775.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/nct7802.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pc87360.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pc87427.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T11:59:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/powr1220.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/sch5627.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/sch5636.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/sht15.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/sht21.ko 2024-05-14T11:59:21.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/shtc1.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/sis5595.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/thmc50.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/tmp102.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/tmp103.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/tmp401.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/tmp421.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/via686a.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/vt1211.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/vt8231.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T11:59:21.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83781d.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83791d.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83792d.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83793.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83795.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/algos 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T11:59:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T11:59:21.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T11:59:21.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/mlx4 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/mlx5 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/mthca 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp 2024-05-14T11:59:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/iser 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/isert 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/srp 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/srpt 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/gameport 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/gameport/gameport.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/joydev.ko 2024-05-14T11:59:21.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/keyboard 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/rmi4 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/serio 2024-05-14T11:59:21.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/input/sparse-keymap.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T11:59:21.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/bcache 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/bcache/bcache.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-cache.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-crypt.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-delay.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-flakey.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-multipath.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-queue-length.ko 2024-05-14T11:59:21.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-raid.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-round-robin.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-service-time.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-switch.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/dm-verity.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/persistent-data 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/raid0.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/raid1.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/raid10.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/md/raid456.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T11:59:21.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd/mfd-core.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd/sm501.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd/viperboard.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd/vx855.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/altera-stapl 2024-05-14T11:59:21.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/apds9802als.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/apds990x.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/bh1770glc.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/cb710 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/eeprom 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/enclosure.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/hpilo.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/isl29003.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/isl29020.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/lis3lv02d 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T11:59:21.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/mei 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/mei/mei.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/sgi-gru 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/sgi-xp 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/tifm_core.ko 2024-05-14T11:59:21.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/tsl2550.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/vmw_vmci 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/bonding 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/bonding/bonding.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dsa 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dsa/b53 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/dummy.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/eql.ko 2024-05-14T11:59:21.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/3com 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/8390 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/adaptec 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/agere 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T11:59:21.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/alteon 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/altera 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/amd 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T11:59:21.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/brocade 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T11:59:21.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/cisco 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T11:59:21.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dlink 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/emulex 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T11:59:21.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/igb 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T11:59:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/jme.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/marvell 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/mellanox 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T11:59:21.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/micrel 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/myricom 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/natsemi 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/neterion 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/nvidia 2024-05-14T11:59:21.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/packetengines 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/qlogic 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/rdc 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/realtek 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T11:59:21.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/rocker 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sfc 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/silan 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sis 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/smsc 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/stmicro 2024-05-14T11:59:21.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sun 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/tehuti 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/ti 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/via 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T11:59:21.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/wiznet 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/xircom 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/geneve.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/hyperv 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ieee802154 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ifb.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ipvlan 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/macvlan.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/macvtap.ko 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/mdio 2024-05-14T11:59:21.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/mdio.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/mii.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/net_failover.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/netconsole.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/nlmon.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/pcs 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/amd.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T11:59:21.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/broadcom.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/cicada.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/davicom.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/dp83640.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/et1011c.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/icplus.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/lxt.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/marvell.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/micrel.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/national.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/phylink.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/qsemi.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/realtek.ko 2024-05-14T11:59:21.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/smsc.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/phy/vitesse.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/pppox.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/ppp/pptp.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/slip 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/slip/slhc.ko 2024-05-14T11:59:21.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/slip/slip.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/sungem_phy.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/tap.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/team 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/team/team.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/tun.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/veth.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/virtio_net.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/vmxnet3 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/vxlan 2024-05-14T11:59:21.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/xen-netback 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/net/xen-netfront.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ntb 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ntb/ntb.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/nvme 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/nvme/host 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/nvme/host/nvme.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/parport 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/parport/parport.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/parport/parport_cs.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/parport/parport_pc.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/parport/parport_serial.ko 2024-05-14T11:59:21.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pci 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pci/hotplug 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pci/pcie 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pcmcia 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pcmcia/i82092.ko 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pinctrl 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pinctrl/intel 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform 2024-05-14T11:59:21.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/intel 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T11:59:21.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/platform/x86/wmi.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/powercap 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pps 2024-05-14T11:59:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pps/clients 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/pps/pps_core.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ptp 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ptp/ptp.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ras 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ras/amd 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ras/amd/atl 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T11:59:21.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T11:59:21.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T11:59:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/3w-sas.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/BusLogic.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/a100u2w.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/aacraid 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/advansys.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/aic7xxx 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T11:59:21.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/am53c974.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/arcmsr 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/atp870u.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/be2iscsi 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/bfa 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/bnx2fc 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/bnx2i 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/ch.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/csiostor 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T11:59:21.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/cxgbi 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/dc395x.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/device_handler 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/esas2r 2024-05-14T11:59:21.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/fcoe 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/fnic 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/hpsa.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/hptiop.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/initio.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/ipr.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/ips.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/isci 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/isci/isci.ko 2024-05-14T11:59:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/libfc 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/libiscsi.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/libsas 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/lpfc 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/megaraid 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/megaraid.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/mpt3sas 2024-05-14T11:59:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/mvsas 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/mvumi.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/pm8001 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/pmcraid.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/qla1280.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/qla2xxx 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/qla4xxx 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/raid_class.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T11:59:21.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/ses.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/st.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/stex.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/scsi/wd719x.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ssb 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ssb/ssb.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/iscsi 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T11:59:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/loopback 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/target_core_file.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/target_core_iblock.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/target_core_mod.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/target_core_user.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/tcm_fc 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T11:59:21.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T11:59:21.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/ipwireless 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/n_gsm.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/n_hdlc.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/nozomi.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/serial 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/serial/8250 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/serial/jsm 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ufs 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ufs/core 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ufs/host 2024-05-14T11:59:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/uio 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/uio/uio.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/uio/uio_aec.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/uio/uio_cif.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/class 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/class/usblp.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/host 2024-05-14T11:59:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/image 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/image/mdc800.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/image/microtek.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/adutux.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/emi26.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/emi62.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/sisusbvga 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T11:59:21.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/uss720.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/misc/yurex.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/phy 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/aircable.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ch341.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T11:59:21.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/empeg.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ipw.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T11:59:21.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/navman.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/omninet.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/opticon.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/option.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/sierra.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T11:59:21.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/visor.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/uas.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T11:59:21.655 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/usbip 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vfio 2024-05-14T11:59:21.656 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vfio/pci 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vfio/vfio.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vhost 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vhost/vhost.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vhost/vhost_net.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/video 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/video/backlight 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/video/backlight/lcd.ko 2024-05-14T11:59:21.657 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio/virtio.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/masters 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves 2024-05-14T11:59:21.658 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/w1/wire.ko 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog 2024-05-14T11:59:21.659 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/machzwd.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T11:59:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/softdog.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T11:59:21.661 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xen-pciback 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xenfs 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/9p 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/9p/9p.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/affs 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/affs/affs.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/befs 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/befs/befs.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/binfmt_misc.ko 2024-05-14T11:59:21.662 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/btrfs 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/btrfs/btrfs.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/cachefiles 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ceph 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ceph/ceph.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/coda 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/coda/coda.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/cramfs 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/cramfs/cramfs.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/dlm 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/dlm/dlm.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ecryptfs 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/f2fs 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/f2fs/f2fs.ko 2024-05-14T11:59:21.663 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/fat 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/fat/fat.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/fat/msdos.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/fat/vfat.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/fuse 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/fuse/cuse.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/fuse/fuse.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/gfs2 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/gfs2/gfs2.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/hfs 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/hfs/hfs.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/hfsplus 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/isofs 2024-05-14T11:59:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/isofs/isofs.ko 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/jfs 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/jfs/jfs.ko 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/lockd 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/lockd/lockd.ko 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/minix 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/minix/minix.ko 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/netfs 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/netfs/netfs.ko 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/blocklayout 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/filelayout 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/flexfilelayout 2024-05-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/nfs.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/nfsv3.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs/nfsv4.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs_common 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs_common/grace.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfsd 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nfsd/nfsd.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nilfs2 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-celtic.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-centeuro.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-croatian.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T11:59:21.666 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-gaelic.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-greek.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-iceland.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-inuit.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-roman.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-romanian.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/mac-turkish.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp1250.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp1251.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp1255.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp737.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp775.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp850.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp852.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp855.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp857.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp860.ko 2024-05-14T11:59:21.667 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp861.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp862.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp863.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp864.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp865.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp866.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp869.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp874.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp932.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp936.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp949.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_cp950.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T11:59:21.668 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/nls/nls_utf8.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/cluster 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/dlm 2024-05-14T11:59:21.669 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/dlmfs 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/overlayfs 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/overlayfs/overlay.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/pstore 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/pstore/ramoops.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/reiserfs 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/romfs 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/romfs/romfs.ko 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/smb 2024-05-14T11:59:21.670 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/smb/client 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/smb/client/cifs.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/smb/common 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/squashfs 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/squashfs/squashfs.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/sysv 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/sysv/sysv.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/udf 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/udf/udf.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ufs 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/ufs/ufs.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/xfs 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/fs/xfs/xfs.ko 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/kernel 2024-05-14T11:59:21.671 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/kernel/rcu 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/kernel/rcu/rcutorture.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/kernel/torture.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/kernel/trace 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/asn1_encoder.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/crc-itu-t.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/crc8.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/crypto 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/crypto/libarc4.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/crypto/libdes.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/libcrc32c.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/lru_cache.ko 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/lz4 2024-05-14T11:59:21.672 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/lz4/lz4_compress.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/math 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/math/cordic.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/raid6 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/raid6/raid6_pq.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/reed_solomon 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/ts_bm.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/ts_fsm.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/ts_kmp.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/zstd 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/lib/zstd/zstd_compress.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/mm 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/mm/hwpoison-inject.ko 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan 2024-05-14T11:59:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/6lowpan.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/802 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/802/garp.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/802/mrp.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/802/p8022.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/802/psnap.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/802/stp.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/8021q 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/8021q/8021q.ko 2024-05-14T11:59:21.674 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/9p 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/9p/9pnet.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/9p/9pnet_fd.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/9p/9pnet_rdma.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/9p/9pnet_virtio.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/batman-adv 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/batman-adv/batman-adv.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/br_netfilter.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/bridge.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T11:59:21.675 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T11:59:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ceph 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ceph/libceph.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/core 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/core/failover.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/core/pktgen.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dccp 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dccp/dccp.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dccp/dccp_diag.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dns_resolver 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dsa 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dsa/dsa_core.ko 2024-05-14T11:59:21.677 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dsa/tag_brcm.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dsa/tag_dsa.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dsa/tag_none.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/dsa/tag_trailer.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ieee802154 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ieee802154/6lowpan 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ieee802154/ieee802154.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/ah4.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/esp4.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/fou.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/gre.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/inet_diag.ko 2024-05-14T11:59:21.678 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/ip_gre.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/ip_vti.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/ipcomp.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/ipip.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T11:59:21.679 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_bic.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_diag.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T11:59:21.680 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_lp.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_veno.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/tunnel4.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/udp_diag.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/ah6.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/esp6.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/fou6.ko 2024-05-14T11:59:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/ip6_vti.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/ipcomp6.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T11:59:21.682 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/sit.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/tunnel6.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T11:59:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/key 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/key/af_key.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp/l2tp_core.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/llc 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/llc/llc.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/mac802154 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/mac802154/mac802154.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/mpls 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/mpls/mpls_gso.ko 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter 2024-05-14T11:59:21.684 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T11:59:21.685 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T11:59:21.686 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conncount.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T11:59:21.687 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_nat.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nf_tables.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nfnetlink.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T11:59:21.688 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_compat.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_ct.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_fib.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_hash.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_limit.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_log.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_masq.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_nat.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_numgen.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_queue.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_quota.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_redir.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_reject.ko 2024-05-14T11:59:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_socket.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_CT.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_HL.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_LED.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_LOG.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T11:59:21.690 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_TEE.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_bpf.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_cluster.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_comment.ko 2024-05-14T11:59:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_connmark.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_cpu.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_dccp.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_dscp.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_ecn.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_esp.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_helper.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_hl.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T11:59:21.692 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_iprange.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_length.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_limit.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_mac.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_mark.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_multiport.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_nat.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_osf.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_owner.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_physdev.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T11:59:21.693 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_policy.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_quota.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_rateest.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_realm.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_recent.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_sctp.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_set.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_socket.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_state.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_statistic.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_string.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_time.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netfilter/xt_u32.ko 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netlink 2024-05-14T11:59:21.694 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/netlink/netlink_diag.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/nsh 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/nsh/nsh.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/openvswitch 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/openvswitch/openvswitch.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/openvswitch/vport-gre.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/packet 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/packet/af_packet_diag.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/rds 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/rds/rds.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/rds/rds_rdma.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/rds/rds_tcp.ko 2024-05-14T11:59:21.695 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_csum.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_gact.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_mirred.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_nat.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_pedit.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_police.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_simple.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_skbedit.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/act_vlan.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/cls_basic.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/cls_bpf.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/cls_flow.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/cls_fw.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/cls_route.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/cls_u32.ko 2024-05-14T11:59:21.696 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/em_cmp.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/em_ipset.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/em_meta.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/em_nbyte.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/em_text.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/em_u32.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_choke.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_codel.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_drr.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_fq.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_gred.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_hfsc.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_hhf.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_htb.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_ingress.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_mqprio.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T11:59:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_multiq.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_netem.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_pie.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_plug.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_prio.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_qfq.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_red.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_sfb.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_sfq.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_tbf.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sched/sch_teql.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sctp 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sctp/sctp.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sctp/sctp_diag.ko 2024-05-14T11:59:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sunrpc 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sunrpc/auth_gss 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sunrpc/sunrpc.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sunrpc/xprtrdma 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/tipc 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/tipc/tipc.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/tipc/tipc_diag.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/unix 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/unix/unix_diag.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/vmw_vsock 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/vmw_vsock/vsock.ko 2024-05-14T11:59:21.699 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/xfrm 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/security 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/security/keys 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/security/keys/encrypted-keys 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/security/keys/trusted-keys 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.alias 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.alias.bin 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.builtin 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.builtin.alias.bin 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.builtin.bin 2024-05-14T11:59:21.700 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.builtin.modinfo 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.dep 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.dep.bin 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.devname 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.order 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.softdep 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.symbols 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.symbols.bin 2024-05-14T11:59:21.701 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-ge8b10e4a18b1/vmlinuz 2024-05-14T11:59:21.705 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:21.705 DEBUG:teuthology.orchestra.run.smithi047:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/bin/kernel-install add 6.9.0-rc3-ge8b10e4a18b1 /lib/modules/6.9.0-rc3-ge8b10e4a18b1/vmlinuz 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:for file in vmlinuz System.map config; do 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-ge8b10e4a18b1/${file}" "/boot/${file}-6.9.0-rc3-ge8b10e4a18b1"; then 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout: cp "/lib/modules/6.9.0-rc3-ge8b10e4a18b1/${file}" "/boot/${file}-6.9.0-rc3-ge8b10e4a18b1" 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout: fi 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -d "/lib/modules/6.9.0-rc3-ge8b10e4a18b1/dtb" ] && \ 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-ge8b10e4a18b1/dtb" "/boot/dtb-6.9.0-rc3-ge8b10e4a18b1" >/dev/null 2>&1; then 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout: rm -rf "/boot/dtb-6.9.0-rc3-ge8b10e4a18b1" 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout: cp -r "/lib/modules/6.9.0-rc3-ge8b10e4a18b1/dtb" "/boot/dtb-6.9.0-rc3-ge8b10e4a18b1" 2024-05-14T11:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-14T11:59:21.731 INFO:teuthology.orchestra.run.smithi047.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-ge8b10e4a18b1/modules.dep" ]; then 2024-05-14T11:59:21.731 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/sbin/depmod 6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:21.731 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-14T11:59:21.731 INFO:teuthology.orchestra.run.smithi047.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T11:59:21.731 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T11:59:21.731 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-install remove 6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:21.731 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-14T11:59:21.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-05-14T11:59:21.807 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T11:59:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T11:59:21.809 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T11:59:21.809 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:21.809 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T11:59:22.388 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-05-14T11:59:23.800 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T11:59:23.827 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-05-14T11:59:23.829 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-14T11:59:23.867 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.l3wYpqohME 2024-05-14T11:59:23.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.l3wYpqohME 2024-05-14T11:59:23.934 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.l3wYpqohME 2024-05-14T11:59:24.071 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.l3wYpqohME is 6KB 2024-05-14T11:59:24.120 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.l3wYpqohME 2024-05-14T11:59:24.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T11:59:24.196 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T11:59:24.197 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T11:59:24.197 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T11:59:24.197 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-ge8b10e4a18b1.conf 2024-05-14T11:59:24.198 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-ge8b10e4a18b1 2024-05-14T11:59:24.414 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-05-14T11:59:54.417 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-14T11:59:54.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-14T11:59:54.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T12:00:12.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-05-14T12:00:21.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-14T12:00:21.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T12:01:21.835 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T12:01:33.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-14T12:01:33.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T12:01:34.260 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-14T12:01:34.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-14T12:01:34.888 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-ge8b10e4a18b1"... 2024-05-14T12:01:34.888 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-14T12:01:34.946 INFO:teuthology.orchestra.run.smithi047.stdout:6.9.0-rc3-ge8b10e4a18b1 2024-05-14T12:01:34.946 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-ge8b10e4a18b1 vs 6.9.0-rc3-ge8b10e4a18b1 2024-05-14T12:01:34.946 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T12:01:34.946 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T12:01:35.947 DEBUG:teuthology.parallel:result is None 2024-05-14T12:01:35.947 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-14T12:01:35.955 INFO:teuthology.task.internal:Creating test directory... 2024-05-14T12:01:35.955 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T12:01:35.963 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T12:01:35.965 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T12:01:36.016 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-14T12:01:36.025 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-14T12:01:36.052 INFO:teuthology.task.internal:Creating archive directory... 2024-05-14T12:01:36.053 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T12:01:36.060 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T12:01:36.063 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T12:01:36.131 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-14T12:01:36.138 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-14T12:01:36.138 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T12:01:36.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:01:36.155 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T12:01:36.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:01:36.172 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T12:01:36.179 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T12:01:36.198 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T12:01:36.230 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T12:01:36.248 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T12:01:36.265 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T12:01:36.267 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T12:01:36.301 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T12:01:36.360 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T12:01:36.365 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-14T12:01:36.373 INFO:teuthology.task.internal:Configuring sudo... 2024-05-14T12:01:36.373 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T12:01:36.379 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T12:01:36.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T12:01:36.466 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-14T12:01:36.475 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-14T12:01:36.475 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T12:01:36.482 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T12:01:36.485 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T12:01:36.535 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T12:01:36.621 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T12:01:36.716 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T12:01:36.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T12:01:36.902 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:01:36.903 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T12:01:36.993 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T12:01:37.037 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T12:01:37.094 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T12:01:37.179 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T12:01:37.222 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:01:37.222 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T12:01:37.289 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T12:01:37.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T12:01:37.390 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T12:01:37.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T12:01:37.516 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:01:37.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T12:01:37.581 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-05-14T12:01:37.589 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-05-14T12:01:37.591 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-05-14T12:01:37.624 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T12:01:37.660 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T12:01:37.699 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T12:01:38.112 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-14T12:01:38.120 INFO:teuthology.task.internal:Starting timer... 2024-05-14T12:01:38.121 INFO:teuthology.run_tasks:Running task pcp... 2024-05-14T12:01:38.148 INFO:teuthology.run_tasks:Running task selinux... 2024-05-14T12:01:38.179 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-14T12:01:38.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-05-14T12:01:38.288 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-05-14T12:01:38.292 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-05-14T12:01:38.353 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-05-14T12:01:38.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-05-14T12:01:38.401 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-05-14T12:01:38.403 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-14T12:01:38.403 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-05-14T12:01:38.462 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-05-14T12:01:38.463 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-05-14T12:01:38.486 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-05-14T12:01:38.486 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-05-14T12:01:38.506 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-05-14T12:01:38.506 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2024-05-14T12:01:38.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T12:01:38.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:01:38.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T12:01:38.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:01:38.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T12:01:38.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:01:38.635 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-14T12:01:38.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-05-14T12:01:38.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-05-14T12:01:38.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-05-14T12:01:38.768 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-14T12:01:38.778 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-14T12:01:38.795 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-14T12:01:38.797 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi066.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-14T12:07:48.043 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2024-05-14T12:07:48.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-14T12:07:48.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T12:07:48.168 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-14T12:07:48.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-14T12:07:48.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-14T12:07:48.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T12:07:48.411 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-05-14T12:07:48.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-05-14T12:07:48.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-05-14T12:07:48.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T12:07:48.581 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-05-14T12:07:48.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-05-14T12:07:48.614 INFO:teuthology.run_tasks:Running task clock... 2024-05-14T12:07:48.628 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-14T12:07:48.629 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T12:07:48.629 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:07:48.637 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T12:07:48.637 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:07:48.639 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T12:07:48.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:07:48.670 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T12:07:48.682 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T12:07:48.686 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T12:07:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T12:07:48.711 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-05-14T12:07:48.717 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-05-14T12:07:48.723 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-05-14T12:07:48.727 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-05-14T12:07:48.732 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T12:07:48.738 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T12:07:48.740 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T12:07:48.752 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T12:07:48.753 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T12:07:48.776 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T12:07:48.809 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-05-14T12:07:48.812 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T12:07:48.812 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-05-14T12:07:48.812 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.812 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.813 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.813 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.813 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-05-14T12:07:48.816 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T12:07:48.817 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-05-14T12:07:48.817 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.817 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.817 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.817 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:48.852 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-05-14T12:07:48.886 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-05-14T12:07:48.929 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T12:07:48.973 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T12:07:49.110 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-05-14T12:07:49.119 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T12:07:49.119 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-14T12:07:49.119 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:49.119 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:49.120 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:49.120 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:07:49.121 INFO:teuthology.run_tasks:Running task install... 2024-05-14T12:07:49.131 DEBUG:teuthology.task.install:project ceph 2024-05-14T12:07:49.131 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}} 2024-05-14T12:07:49.131 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'} 2024-05-14T12:07:49.131 INFO:teuthology.task.install:Using flavor: default 2024-05-14T12:07:49.137 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-14T12:07:49.137 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-14T12:07:49.138 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T12:07:49.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:07:49.140 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T12:07:49.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:07:49.141 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T12:07:49.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:07:49.293 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T12:07:49.294 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T12:07:49.297 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T12:07:49.297 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T12:07:49.300 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T12:07:49.300 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T12:07:49.566 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T12:07:49.566 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:07:49.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T12:07:49.592 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T12:07:49.593 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T12:07:49.621 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T12:07:49.622 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:07:49.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T12:07:49.642 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T12:07:49.642 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:07:49.642 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T12:07:49.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T12:07:49.672 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T12:07:49.673 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T12:07:49.718 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T12:07:49.719 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T12:07:49.731 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T12:07:49.742 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T12:07:49.795 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-05-14T12:07:49.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-05-14T12:07:49.821 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T12:07:49.852 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T12:07:49.887 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-05-14T12:07:49.889 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-05-14T12:07:49.968 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T12:07:50.026 INFO:teuthology.orchestra.run.smithi073.stdout:57 files removed 2024-05-14T12:07:50.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T12:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-05-14T12:07:50.058 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-05-14T12:07:50.131 INFO:teuthology.orchestra.run.smithi066.stdout:57 files removed 2024-05-14T12:07:50.159 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T12:07:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:57 files removed 2024-05-14T12:07:50.435 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T12:07:51.167 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 98 kB/s | 84 kB 00:00 2024-05-14T12:07:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 85 kB/s | 84 kB 00:00 2024-05-14T12:07:51.713 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 100 kB/s | 84 kB 00:00 2024-05-14T12:07:51.784 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-05-14T12:07:52.031 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-05-14T12:07:52.389 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-05-14T12:07:52.418 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2024-05-14T12:07:52.748 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-05-14T12:07:53.203 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2024-05-14T12:07:53.426 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.1 MB 00:00 2024-05-14T12:07:53.932 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.1 MB 00:01 2024-05-14T12:07:55.395 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.1 MB 00:02 2024-05-14T12:07:56.827 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 19 MB 00:02 2024-05-14T12:07:57.441 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 19 MB 00:02 2024-05-14T12:07:58.805 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 19 MB 00:02 2024-05-14T12:08:02.308 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.2 MB 00:01 2024-05-14T12:08:02.519 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.2 MB 00:02 2024-05-14T12:08:03.817 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 16 kB 00:00 2024-05-14T12:08:03.855 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.2 MB 00:01 2024-05-14T12:08:03.953 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-05-14T12:08:05.244 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-14T12:08:05.590 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-05-14T12:08:06.422 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 21 MB 00:02 2024-05-14T12:08:07.080 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-14T12:08:10.752 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-14T12:08:11.688 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-05-14T12:08:13.113 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T12:08:13.114 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T12:08:13.125 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T12:08:13.126 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T12:08:13.127 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T12:08:13.127 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T12:08:13.129 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T12:08:13.131 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T12:08:13.132 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T12:08:13.197 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-05-14T12:08:13.212 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-05-14T12:08:13.212 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T12:08:13.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T12:08:13.214 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T12:08:13.214 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T12:08:13.214 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T12:08:13.214 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T12:08:13.214 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T12:08:13.215 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T12:08:13.215 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T12:08:13.215 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T12:08:13.215 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T12:08:13.215 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T12:08:13.217 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T12:08:13.217 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T12:08:13.217 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T12:08:13.217 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T12:08:13.217 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T12:08:13.218 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T12:08:13.218 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T12:08:13.218 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T12:08:13.218 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T12:08:13.218 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T12:08:13.218 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T12:08:13.219 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T12:08:13.220 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T12:08:13.221 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T12:08:13.222 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T12:08:13.223 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T12:08:13.224 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T12:08:13.225 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T12:08:13.226 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T12:08:13.227 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T12:08:13.228 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout:Install 148 Packages 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 8 Packages 2024-05-14T12:08:13.229 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:08:13.230 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 219 M 2024-05-14T12:08:13.230 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-05-14T12:08:13.625 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-14T12:08:13.998 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T12:08:13.998 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T12:08:14.010 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T12:08:14.011 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T12:08:14.012 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T12:08:14.012 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T12:08:14.014 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T12:08:14.016 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T12:08:14.017 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T12:08:14.078 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T12:08:14.100 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T12:08:14.101 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T12:08:14.102 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T12:08:14.103 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T12:08:14.104 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T12:08:14.105 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T12:08:14.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T12:08:14.107 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T12:08:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T12:08:14.109 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T12:08:14.110 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T12:08:14.111 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout:Install 148 Packages 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 8 Packages 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:08:14.112 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 219 M 2024-05-14T12:08:14.113 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-05-14T12:08:14.170 INFO:teuthology.orchestra.run.smithi066.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-05-14T12:08:14.714 INFO:teuthology.orchestra.run.smithi073.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-05-14T12:08:14.821 INFO:teuthology.orchestra.run.smithi066.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.3 MB/s | 863 kB 00:00 2024-05-14T12:08:14.955 INFO:teuthology.orchestra.run.smithi066.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 1.1 MB/s | 147 kB 00:00 2024-05-14T12:08:15.540 INFO:teuthology.orchestra.run.smithi073.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.0 MB/s | 863 kB 00:00 2024-05-14T12:08:15.707 INFO:teuthology.orchestra.run.smithi073.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 882 kB/s | 147 kB 00:00 2024-05-14T12:08:16.319 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T12:08:16.321 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T12:08:16.344 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T12:08:16.345 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T12:08:16.346 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T12:08:16.348 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T12:08:16.351 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T12:08:16.354 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T12:08:16.356 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T12:08:16.433 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-14T12:08:16.466 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-14T12:08:16.466 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-05-14T12:08:16.466 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-14T12:08:16.466 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T12:08:16.467 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T12:08:16.468 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T12:08:16.469 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T12:08:16.470 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T12:08:16.471 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T12:08:16.472 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T12:08:16.473 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T12:08:16.474 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T12:08:16.475 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T12:08:16.476 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T12:08:16.477 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T12:08:16.478 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout:Install 148 Packages 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 8 Packages 2024-05-14T12:08:16.479 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:08:16.480 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 219 M 2024-05-14T12:08:16.480 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-05-14T12:08:16.571 INFO:teuthology.orchestra.run.smithi066.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 1.4 MB/s | 2.3 MB 00:01 2024-05-14T12:08:17.132 INFO:teuthology.orchestra.run.smithi073.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 1.6 MB/s | 2.3 MB 00:01 2024-05-14T12:08:17.380 INFO:teuthology.orchestra.run.smithi066.stdout:(5/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-05-14T12:08:17.688 INFO:teuthology.orchestra.run.smithi066.stdout:(6/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-05-14T12:08:17.832 INFO:teuthology.orchestra.run.smithi073.stdout:(5/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-05-14T12:08:17.968 INFO:teuthology.orchestra.run.smithi047.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-05-14T12:08:18.855 INFO:teuthology.orchestra.run.smithi066.stdout:(7/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 3.3 MB/s | 4.9 MB 00:01 2024-05-14T12:08:19.576 INFO:teuthology.orchestra.run.smithi047.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 537 kB/s | 863 kB 00:01 2024-05-14T12:08:19.876 INFO:teuthology.orchestra.run.smithi047.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 492 kB/s | 147 kB 00:00 2024-05-14T12:08:19.948 INFO:teuthology.orchestra.run.smithi073.stdout:(6/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 2.3 MB/s | 4.9 MB 00:02 2024-05-14T12:08:20.185 INFO:teuthology.orchestra.run.smithi047.stdout:(4/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 2.0 MB/s | 5.4 MB 00:02 2024-05-14T12:08:20.760 INFO:teuthology.orchestra.run.smithi047.stdout:(5/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-05-14T12:08:20.790 INFO:teuthology.orchestra.run.smithi073.stdout:(7/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 864 kB/s | 5.4 MB 00:06 2024-05-14T12:08:22.394 INFO:teuthology.orchestra.run.smithi047.stdout:(6/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 3.0 MB/s | 4.9 MB 00:01 2024-05-14T12:08:22.847 INFO:teuthology.orchestra.run.smithi066.stdout:(8/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el9 2.5 MB/s | 10 MB 00:03 2024-05-14T12:08:22.955 INFO:teuthology.orchestra.run.smithi066.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 233 kB/s | 25 kB 00:00 2024-05-14T12:08:23.011 INFO:teuthology.orchestra.run.smithi047.stdout:(7/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 739 kB/s | 2.3 MB 00:03 2024-05-14T12:08:24.940 INFO:teuthology.orchestra.run.smithi073.stdout:(8/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 1.9 MB/s | 20 MB 00:10 2024-05-14T12:08:25.032 INFO:teuthology.orchestra.run.smithi073.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 275 kB/s | 25 kB 00:00 2024-05-14T12:08:25.211 INFO:teuthology.orchestra.run.smithi047.stdout:(8/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 2.5 MB/s | 20 MB 00:07 2024-05-14T12:08:25.311 INFO:teuthology.orchestra.run.smithi047.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 255 kB/s | 25 kB 00:00 2024-05-14T12:08:27.616 INFO:teuthology.orchestra.run.smithi073.stdout:(10/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 2.3 MB/s | 18 MB 00:07 2024-05-14T12:08:27.741 INFO:teuthology.orchestra.run.smithi073.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 1.8 MB/s | 224 kB 00:00 2024-05-14T12:08:27.849 INFO:teuthology.orchestra.run.smithi073.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 250 kB/s | 27 kB 00:00 2024-05-14T12:08:27.941 INFO:teuthology.orchestra.run.smithi073.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 346 kB/s | 32 kB 00:00 2024-05-14T12:08:28.258 INFO:teuthology.orchestra.run.smithi073.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 2.3 MB/s | 756 kB 00:00 2024-05-14T12:08:28.361 INFO:teuthology.orchestra.run.smithi047.stdout:(10/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 3.0 MB/s | 18 MB 00:05 2024-05-14T12:08:28.393 INFO:teuthology.orchestra.run.smithi073.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 1.1 MB/s | 157 kB 00:00 2024-05-14T12:08:28.487 INFO:teuthology.orchestra.run.smithi047.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 1.8 MB/s | 224 kB 00:00 2024-05-14T12:08:28.501 INFO:teuthology.orchestra.run.smithi073.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 1.2 MB/s | 127 kB 00:00 2024-05-14T12:08:28.554 INFO:teuthology.orchestra.run.smithi047.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 411 kB/s | 27 kB 00:00 2024-05-14T12:08:28.629 INFO:teuthology.orchestra.run.smithi047.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 431 kB/s | 32 kB 00:00 2024-05-14T12:08:28.759 INFO:teuthology.orchestra.run.smithi073.stdout:(17/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 1.3 MB/s | 10 MB 00:07 2024-05-14T12:08:28.784 INFO:teuthology.orchestra.run.smithi073.stdout:(18/156): libradosstriper1-19.0.0-3588.ge2b755a 1.7 MB/s | 497 kB 00:00 2024-05-14T12:08:28.868 INFO:teuthology.orchestra.run.smithi073.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 542 kB/s | 45 kB 00:00 2024-05-14T12:08:28.903 INFO:teuthology.orchestra.run.smithi047.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 2.7 MB/s | 756 kB 00:00 2024-05-14T12:08:28.952 INFO:teuthology.orchestra.run.smithi073.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 1.6 MB/s | 135 kB 00:00 2024-05-14T12:08:28.979 INFO:teuthology.orchestra.run.smithi047.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 2.0 MB/s | 157 kB 00:00 2024-05-14T12:08:29.044 INFO:teuthology.orchestra.run.smithi073.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.7 MB/s | 162 kB 00:00 2024-05-14T12:08:29.063 INFO:teuthology.orchestra.run.smithi047.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 1.5 MB/s | 127 kB 00:00 2024-05-14T12:08:29.194 INFO:teuthology.orchestra.run.smithi073.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 2.1 MB/s | 321 kB 00:00 2024-05-14T12:08:29.247 INFO:teuthology.orchestra.run.smithi047.stdout:(17/156): libradosstriper1-19.0.0-3588.ge2b755a 2.7 MB/s | 497 kB 00:00 2024-05-14T12:08:29.344 INFO:teuthology.orchestra.run.smithi073.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 2.0 MB/s | 301 kB 00:00 2024-05-14T12:08:29.461 INFO:teuthology.orchestra.run.smithi073.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 854 kB/s | 100 kB 00:00 2024-05-14T12:08:29.570 INFO:teuthology.orchestra.run.smithi073.stdout:(25/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 793 kB/s | 86 kB 00:00 2024-05-14T12:08:29.780 INFO:teuthology.orchestra.run.smithi047.stdout:(18/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 1.5 MB/s | 10 MB 00:06 2024-05-14T12:08:29.905 INFO:teuthology.orchestra.run.smithi047.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 364 kB/s | 45 kB 00:00 2024-05-14T12:08:30.047 INFO:teuthology.orchestra.run.smithi047.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 965 kB/s | 135 kB 00:00 2024-05-14T12:08:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.4 MB/s | 162 kB 00:00 2024-05-14T12:08:30.340 INFO:teuthology.orchestra.run.smithi047.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 1.8 MB/s | 321 kB 00:00 2024-05-14T12:08:30.497 INFO:teuthology.orchestra.run.smithi066.stdout:(10/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 1.4 MB/s | 18 MB 00:12 2024-05-14T12:08:30.531 INFO:teuthology.orchestra.run.smithi047.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 1.5 MB/s | 301 kB 00:00 2024-05-14T12:08:30.648 INFO:teuthology.orchestra.run.smithi047.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 864 kB/s | 100 kB 00:00 2024-05-14T12:08:30.662 INFO:teuthology.orchestra.run.smithi073.stdout:(26/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 2.8 MB/s | 3.0 MB 00:01 2024-05-14T12:08:30.722 INFO:teuthology.orchestra.run.smithi066.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 999 kB/s | 224 kB 00:00 2024-05-14T12:08:30.740 INFO:teuthology.orchestra.run.smithi047.stdout:(25/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 945 kB/s | 86 kB 00:00 2024-05-14T12:08:30.770 INFO:teuthology.orchestra.run.smithi073.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.5 MB/s | 170 kB 00:00 2024-05-14T12:08:30.822 INFO:teuthology.orchestra.run.smithi066.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 271 kB/s | 27 kB 00:00 2024-05-14T12:08:30.879 INFO:teuthology.orchestra.run.smithi073.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 316 kB/s | 34 kB 00:00 2024-05-14T12:08:30.922 INFO:teuthology.orchestra.run.smithi066.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 317 kB/s | 32 kB 00:00 2024-05-14T12:08:31.096 INFO:teuthology.orchestra.run.smithi073.stdout:(29/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 2.2 MB/s | 5.2 MB 00:02 2024-05-14T12:08:31.121 INFO:teuthology.orchestra.run.smithi073.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 588 kB/s | 142 kB 00:00 2024-05-14T12:08:31.224 INFO:teuthology.orchestra.run.smithi047.stdout:(26/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 2.6 MB/s | 5.2 MB 00:01 2024-05-14T12:08:31.473 INFO:teuthology.orchestra.run.smithi066.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 1.3 MB/s | 756 kB 00:00 2024-05-14T12:08:31.614 INFO:teuthology.orchestra.run.smithi066.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 1.1 MB/s | 157 kB 00:00 2024-05-14T12:08:31.749 INFO:teuthology.orchestra.run.smithi047.stdout:(27/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 3.0 MB/s | 3.0 MB 00:01 2024-05-14T12:08:31.756 INFO:teuthology.orchestra.run.smithi066.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 896 kB/s | 127 kB 00:00 2024-05-14T12:08:31.774 INFO:teuthology.orchestra.run.smithi047.stdout:(28/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 309 kB/s | 170 kB 00:00 2024-05-14T12:08:31.858 INFO:teuthology.orchestra.run.smithi047.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3588.g 318 kB/s | 34 kB 00:00 2024-05-14T12:08:31.942 INFO:teuthology.orchestra.run.smithi047.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 855 kB/s | 142 kB 00:00 2024-05-14T12:08:32.132 INFO:teuthology.orchestra.run.smithi066.stdout:(17/156): libradosstriper1-19.0.0-3588.ge2b755a 1.3 MB/s | 497 kB 00:00 2024-05-14T12:08:32.755 INFO:teuthology.orchestra.run.smithi073.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 2.1 MB/s | 3.5 MB 00:01 2024-05-14T12:08:32.842 INFO:teuthology.orchestra.run.smithi047.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 3.6 MB/s | 3.5 MB 00:00 2024-05-14T12:08:32.946 INFO:teuthology.orchestra.run.smithi073.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 1.4 MB/s | 274 kB 00:00 2024-05-14T12:08:32.950 INFO:teuthology.orchestra.run.smithi047.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 2.5 MB/s | 274 kB 00:00 2024-05-14T12:08:33.047 INFO:teuthology.orchestra.run.smithi073.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 493 kB/s | 49 kB 00:00 2024-05-14T12:08:33.067 INFO:teuthology.orchestra.run.smithi047.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 424 kB/s | 49 kB 00:00 2024-05-14T12:08:33.147 INFO:teuthology.orchestra.run.smithi073.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 165 kB/s | 16 kB 00:00 2024-05-14T12:08:33.168 INFO:teuthology.orchestra.run.smithi047.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 166 kB/s | 16 kB 00:00 2024-05-14T12:08:33.822 INFO:teuthology.orchestra.run.smithi073.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 405 kB/s | 273 kB 00:00 2024-05-14T12:08:34.043 INFO:teuthology.orchestra.run.smithi047.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 312 kB/s | 273 kB 00:00 2024-05-14T12:08:34.082 INFO:teuthology.orchestra.run.smithi066.stdout:(18/156): ceph-common-19.0.0-3588.ge2b755a6.el9 990 kB/s | 20 MB 00:20 2024-05-14T12:08:34.190 INFO:teuthology.orchestra.run.smithi066.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 418 kB/s | 45 kB 00:00 2024-05-14T12:08:34.318 INFO:teuthology.orchestra.run.smithi047.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 2.7 MB/s | 763 kB 00:00 2024-05-14T12:08:34.356 INFO:teuthology.orchestra.run.smithi073.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 1.4 MB/s | 763 kB 00:00 2024-05-14T12:08:34.366 INFO:teuthology.orchestra.run.smithi066.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 774 kB/s | 135 kB 00:00 2024-05-14T12:08:34.436 INFO:teuthology.orchestra.run.smithi047.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 157 kB/s | 18 kB 00:00 2024-05-14T12:08:34.439 INFO:teuthology.orchestra.run.smithi073.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 219 kB/s | 18 kB 00:00 2024-05-14T12:08:34.524 INFO:teuthology.orchestra.run.smithi066.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.0 MB/s | 162 kB 00:00 2024-05-14T12:08:34.544 INFO:teuthology.orchestra.run.smithi047.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 749 kB/s | 80 kB 00:00 2024-05-14T12:08:34.607 INFO:teuthology.orchestra.run.smithi073.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 482 kB/s | 80 kB 00:00 2024-05-14T12:08:34.750 INFO:teuthology.orchestra.run.smithi066.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 1.4 MB/s | 321 kB 00:00 2024-05-14T12:08:34.773 INFO:teuthology.orchestra.run.smithi073.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-05-14T12:08:34.778 INFO:teuthology.orchestra.run.smithi047.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-05-14T12:08:34.828 INFO:teuthology.orchestra.run.smithi047.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-05-14T12:08:34.832 INFO:teuthology.orchestra.run.smithi073.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-05-14T12:08:34.879 INFO:teuthology.orchestra.run.smithi047.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-05-14T12:08:34.899 INFO:teuthology.orchestra.run.smithi073.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-05-14T12:08:34.950 INFO:teuthology.orchestra.run.smithi066.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 1.5 MB/s | 301 kB 00:00 2024-05-14T12:08:34.962 INFO:teuthology.orchestra.run.smithi047.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-05-14T12:08:35.004 INFO:teuthology.orchestra.run.smithi047.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.6 MB/s | 106 kB 00:00 2024-05-14T12:08:35.017 INFO:teuthology.orchestra.run.smithi066.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.5 MB/s | 100 kB 00:00 2024-05-14T12:08:35.054 INFO:teuthology.orchestra.run.smithi047.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-05-14T12:08:35.074 INFO:teuthology.orchestra.run.smithi073.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-05-14T12:08:35.101 INFO:teuthology.orchestra.run.smithi066.stdout:(25/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.0 MB/s | 86 kB 00:00 2024-05-14T12:08:35.158 INFO:teuthology.orchestra.run.smithi073.stdout:(43/156): ceph-mgr-diskprediction-local-19.0.0- 1.8 MB/s | 7.4 MB 00:04 2024-05-14T12:08:35.183 INFO:teuthology.orchestra.run.smithi073.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-05-14T12:08:35.196 INFO:teuthology.orchestra.run.smithi047.stdout:(45/156): ceph-mgr-diskprediction-local-19.0.0- 2.3 MB/s | 7.4 MB 00:03 2024-05-14T12:08:35.230 INFO:teuthology.orchestra.run.smithi047.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 715 kB/s | 125 kB 00:00 2024-05-14T12:08:35.242 INFO:teuthology.orchestra.run.smithi073.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-14T12:08:35.284 INFO:teuthology.orchestra.run.smithi066.stdout:(26/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 1.6 MB/s | 5.2 MB 00:03 2024-05-14T12:08:35.301 INFO:teuthology.orchestra.run.smithi073.stdout:(46/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-14T12:08:35.355 INFO:teuthology.orchestra.run.smithi047.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-05-14T12:08:35.360 INFO:teuthology.orchestra.run.smithi073.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 673 kB/s | 135 kB 00:00 2024-05-14T12:08:35.384 INFO:teuthology.orchestra.run.smithi066.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.7 MB/s | 170 kB 00:00 2024-05-14T12:08:35.435 INFO:teuthology.orchestra.run.smithi066.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 683 kB/s | 34 kB 00:00 2024-05-14T12:08:35.460 INFO:teuthology.orchestra.run.smithi073.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-05-14T12:08:35.502 INFO:teuthology.orchestra.run.smithi073.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-05-14T12:08:35.535 INFO:teuthology.orchestra.run.smithi073.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-05-14T12:08:35.544 INFO:teuthology.orchestra.run.smithi066.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 1.3 MB/s | 142 kB 00:00 2024-05-14T12:08:35.561 INFO:teuthology.orchestra.run.smithi073.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-05-14T12:08:35.581 INFO:teuthology.orchestra.run.smithi047.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-05-14T12:08:35.586 INFO:teuthology.orchestra.run.smithi073.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-05-14T12:08:35.611 INFO:teuthology.orchestra.run.smithi073.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-05-14T12:08:35.647 INFO:teuthology.orchestra.run.smithi047.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-14T12:08:35.653 INFO:teuthology.orchestra.run.smithi073.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-05-14T12:08:35.706 INFO:teuthology.orchestra.run.smithi047.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-05-14T12:08:35.712 INFO:teuthology.orchestra.run.smithi073.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-05-14T12:08:35.731 INFO:teuthology.orchestra.run.smithi047.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 260 kB/s | 21 kB 00:00 2024-05-14T12:08:35.737 INFO:teuthology.orchestra.run.smithi073.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-05-14T12:08:35.762 INFO:teuthology.orchestra.run.smithi073.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-14T12:08:35.773 INFO:teuthology.orchestra.run.smithi047.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-05-14T12:08:35.787 INFO:teuthology.orchestra.run.smithi073.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-05-14T12:08:35.821 INFO:teuthology.orchestra.run.smithi073.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-14T12:08:35.832 INFO:teuthology.orchestra.run.smithi047.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 33 kB 00:00 2024-05-14T12:08:35.855 INFO:teuthology.orchestra.run.smithi073.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-05-14T12:08:35.880 INFO:teuthology.orchestra.run.smithi073.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-05-14T12:08:35.905 INFO:teuthology.orchestra.run.smithi073.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-05-14T12:08:35.907 INFO:teuthology.orchestra.run.smithi047.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 246 kB/s | 18 kB 00:00 2024-05-14T12:08:35.931 INFO:teuthology.orchestra.run.smithi073.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-14T12:08:35.956 INFO:teuthology.orchestra.run.smithi073.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-14T12:08:35.981 INFO:teuthology.orchestra.run.smithi073.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-05-14T12:08:35.982 INFO:teuthology.orchestra.run.smithi047.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 150 kB/s | 11 kB 00:00 2024-05-14T12:08:36.073 INFO:teuthology.orchestra.run.smithi073.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2024-05-14T12:08:36.083 INFO:teuthology.orchestra.run.smithi047.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-05-14T12:08:36.150 INFO:teuthology.orchestra.run.smithi073.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-05-14T12:08:36.199 INFO:teuthology.orchestra.run.smithi073.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-14T12:08:36.232 INFO:teuthology.orchestra.run.smithi073.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-05-14T12:08:36.257 INFO:teuthology.orchestra.run.smithi073.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-14T12:08:36.316 INFO:teuthology.orchestra.run.smithi073.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-05-14T12:08:36.363 INFO:teuthology.orchestra.run.smithi047.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-05-14T12:08:36.391 INFO:teuthology.orchestra.run.smithi073.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-05-14T12:08:36.402 INFO:teuthology.orchestra.run.smithi066.stdout:(30/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 2.3 MB/s | 3.0 MB 00:01 2024-05-14T12:08:36.408 INFO:teuthology.orchestra.run.smithi047.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 139 kB/s | 45 kB 00:00 2024-05-14T12:08:36.417 INFO:teuthology.orchestra.run.smithi073.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-05-14T12:08:36.459 INFO:teuthology.orchestra.run.smithi073.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-05-14T12:08:36.525 INFO:teuthology.orchestra.run.smithi047.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.0 MB/s | 662 kB 00:00 2024-05-14T12:08:36.597 INFO:teuthology.orchestra.run.smithi073.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-05-14T12:08:36.601 INFO:teuthology.orchestra.run.smithi047.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 340 kB/s | 25 kB 00:00 2024-05-14T12:08:36.626 INFO:teuthology.orchestra.run.smithi073.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-05-14T12:08:36.652 INFO:teuthology.orchestra.run.smithi073.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 475 kB/s | 26 kB 00:00 2024-05-14T12:08:36.676 INFO:teuthology.orchestra.run.smithi047.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 641 kB/s | 47 kB 00:00 2024-05-14T12:08:36.677 INFO:teuthology.orchestra.run.smithi073.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-05-14T12:08:36.702 INFO:teuthology.orchestra.run.smithi073.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-14T12:08:36.710 INFO:teuthology.orchestra.run.smithi047.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 1.9 MB/s | 582 kB 00:00 2024-05-14T12:08:36.719 INFO:teuthology.orchestra.run.smithi073.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 828 kB/s | 35 kB 00:00 2024-05-14T12:08:36.761 INFO:teuthology.orchestra.run.smithi073.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-05-14T12:08:36.819 INFO:teuthology.orchestra.run.smithi066.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 2.8 MB/s | 3.5 MB 00:01 2024-05-14T12:08:36.828 INFO:teuthology.orchestra.run.smithi073.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 5.1 MB 00:00 2024-05-14T12:08:36.853 INFO:teuthology.orchestra.run.smithi073.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-14T12:08:36.879 INFO:teuthology.orchestra.run.smithi073.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-14T12:08:36.904 INFO:teuthology.orchestra.run.smithi073.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-05-14T12:08:36.911 INFO:teuthology.orchestra.run.smithi066.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 2.9 MB/s | 274 kB 00:00 2024-05-14T12:08:36.929 INFO:teuthology.orchestra.run.smithi073.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-05-14T12:08:36.946 INFO:teuthology.orchestra.run.smithi073.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-05-14T12:08:36.970 INFO:teuthology.orchestra.run.smithi066.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 847 kB/s | 49 kB 00:00 2024-05-14T12:08:36.971 INFO:teuthology.orchestra.run.smithi073.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 6.5 MB/s | 279 kB 00:00 2024-05-14T12:08:36.996 INFO:teuthology.orchestra.run.smithi073.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-14T12:08:37.020 INFO:teuthology.orchestra.run.smithi066.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 331 kB/s | 16 kB 00:00 2024-05-14T12:08:37.022 INFO:teuthology.orchestra.run.smithi073.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-14T12:08:37.064 INFO:teuthology.orchestra.run.smithi073.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-05-14T12:08:37.096 INFO:teuthology.orchestra.run.smithi066.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 3.6 MB/s | 273 kB 00:00 2024-05-14T12:08:37.106 INFO:teuthology.orchestra.run.smithi073.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-05-14T12:08:37.148 INFO:teuthology.orchestra.run.smithi073.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-05-14T12:08:37.190 INFO:teuthology.orchestra.run.smithi073.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 863 kB/s | 36 kB 00:00 2024-05-14T12:08:37.263 INFO:teuthology.orchestra.run.smithi066.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 4.5 MB/s | 763 kB 00:00 2024-05-14T12:08:37.313 INFO:teuthology.orchestra.run.smithi066.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 366 kB/s | 18 kB 00:00 2024-05-14T12:08:37.327 INFO:teuthology.orchestra.run.smithi047.stdout:(63/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 3.6 MB/s | 43 MB 00:12 2024-05-14T12:08:37.349 INFO:teuthology.orchestra.run.smithi073.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-05-14T12:08:37.369 INFO:teuthology.orchestra.run.smithi047.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 423 kB/s | 292 kB 00:00 2024-05-14T12:08:37.374 INFO:teuthology.orchestra.run.smithi073.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 258 kB/s | 47 kB 00:00 2024-05-14T12:08:37.394 INFO:teuthology.orchestra.run.smithi047.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 276 kB/s | 188 kB 00:00 2024-05-14T12:08:37.399 INFO:teuthology.orchestra.run.smithi073.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-05-14T12:08:37.424 INFO:teuthology.orchestra.run.smithi073.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-14T12:08:37.449 INFO:teuthology.orchestra.run.smithi073.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-14T12:08:37.461 INFO:teuthology.orchestra.run.smithi047.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 265 kB/s | 35 kB 00:00 2024-05-14T12:08:37.475 INFO:teuthology.orchestra.run.smithi073.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-14T12:08:37.500 INFO:teuthology.orchestra.run.smithi073.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-05-14T12:08:37.526 INFO:teuthology.orchestra.run.smithi073.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 441 kB/s | 22 kB 00:00 2024-05-14T12:08:37.559 INFO:teuthology.orchestra.run.smithi073.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-05-14T12:08:37.928 INFO:teuthology.orchestra.run.smithi047.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-05-14T12:08:38.001 INFO:teuthology.orchestra.run.smithi073.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 699 kB/s | 309 kB 00:00 2024-05-14T12:08:38.013 INFO:teuthology.orchestra.run.smithi066.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 115 kB/s | 80 kB 00:00 2024-05-14T12:08:38.026 INFO:teuthology.orchestra.run.smithi073.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-14T12:08:38.045 INFO:teuthology.orchestra.run.smithi047.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 7.7 MB/s | 911 kB 00:00 2024-05-14T12:08:38.077 INFO:teuthology.orchestra.run.smithi073.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-05-14T12:08:38.112 INFO:teuthology.orchestra.run.smithi047.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-14T12:08:38.160 INFO:teuthology.orchestra.run.smithi073.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-05-14T12:08:38.162 INFO:teuthology.orchestra.run.smithi047.stdout:(70/156): postgresql-13.14-1.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-05-14T12:08:38.286 INFO:teuthology.orchestra.run.smithi073.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 389 kB/s | 49 kB 00:00 2024-05-14T12:08:38.403 INFO:teuthology.orchestra.run.smithi073.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-05-14T12:08:38.497 INFO:teuthology.orchestra.run.smithi066.stdout:(39/156): ceph-mgr-diskprediction-local-19.0.0- 3.5 MB/s | 7.4 MB 00:02 2024-05-14T12:08:38.528 INFO:teuthology.orchestra.run.smithi073.stdout:(110/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-05-14T12:08:38.537 INFO:teuthology.orchestra.run.smithi047.stdout:(71/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.1 MB/s | 4.7 MB 00:01 2024-05-14T12:08:38.553 INFO:teuthology.orchestra.run.smithi073.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-05-14T12:08:38.621 INFO:teuthology.orchestra.run.smithi047.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-05-14T12:08:38.637 INFO:teuthology.orchestra.run.smithi073.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-05-14T12:08:38.762 INFO:teuthology.orchestra.run.smithi073.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-05-14T12:08:38.787 INFO:teuthology.orchestra.run.smithi073.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 289 kB/s | 43 kB 00:00 2024-05-14T12:08:38.805 INFO:teuthology.orchestra.run.smithi047.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.6 MB/s | 1.0 MB 00:00 2024-05-14T12:08:38.863 INFO:teuthology.orchestra.run.smithi073.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2024-05-14T12:08:38.888 INFO:teuthology.orchestra.run.smithi073.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-05-14T12:08:38.972 INFO:teuthology.orchestra.run.smithi073.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-14T12:08:38.997 INFO:teuthology.orchestra.run.smithi073.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-14T12:08:39.030 INFO:teuthology.orchestra.run.smithi047.stdout:(74/156): postgresql-server-13.14-1.el9.x86_64. 6.3 MB/s | 5.8 MB 00:00 2024-05-14T12:08:39.063 INFO:teuthology.orchestra.run.smithi047.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 947 kB/s | 244 kB 00:00 2024-05-14T12:08:39.089 INFO:teuthology.orchestra.run.smithi073.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-05-14T12:08:39.114 INFO:teuthology.orchestra.run.smithi047.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-05-14T12:08:39.114 INFO:teuthology.orchestra.run.smithi073.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 302 kB/s | 35 kB 00:00 2024-05-14T12:08:39.139 INFO:teuthology.orchestra.run.smithi047.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 343 kB/s | 26 kB 00:00 2024-05-14T12:08:39.173 INFO:teuthology.orchestra.run.smithi047.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 332 kB/s | 19 kB 00:00 2024-05-14T12:08:39.173 INFO:teuthology.orchestra.run.smithi073.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-05-14T12:08:39.222 INFO:teuthology.orchestra.run.smithi066.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 665 kB/s | 803 kB 00:01 2024-05-14T12:08:39.231 INFO:teuthology.orchestra.run.smithi047.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 604 kB/s | 35 kB 00:00 2024-05-14T12:08:39.239 INFO:teuthology.orchestra.run.smithi073.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2024-05-14T12:08:39.256 INFO:teuthology.orchestra.run.smithi047.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-05-14T12:08:39.265 INFO:teuthology.orchestra.run.smithi073.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-05-14T12:08:39.323 INFO:teuthology.orchestra.run.smithi073.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-05-14T12:08:39.349 INFO:teuthology.orchestra.run.smithi073.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2024-05-14T12:08:39.357 INFO:teuthology.orchestra.run.smithi047.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-05-14T12:08:39.408 INFO:teuthology.orchestra.run.smithi073.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-05-14T12:08:39.433 INFO:teuthology.orchestra.run.smithi073.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-05-14T12:08:39.463 INFO:teuthology.orchestra.run.smithi066.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 202 kB/s | 195 kB 00:00 2024-05-14T12:08:39.465 INFO:teuthology.orchestra.run.smithi047.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-05-14T12:08:39.475 INFO:teuthology.orchestra.run.smithi073.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-05-14T12:08:39.541 INFO:teuthology.orchestra.run.smithi047.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-05-14T12:08:39.558 INFO:teuthology.orchestra.run.smithi073.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 557 kB/s | 46 kB 00:00 2024-05-14T12:08:39.601 INFO:teuthology.orchestra.run.smithi073.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-05-14T12:08:39.608 INFO:teuthology.orchestra.run.smithi047.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 642 kB/s | 42 kB 00:00 2024-05-14T12:08:39.676 INFO:teuthology.orchestra.run.smithi073.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 672 kB/s | 79 kB 00:00 2024-05-14T12:08:39.709 INFO:teuthology.orchestra.run.smithi073.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 530 kB/s | 58 kB 00:00 2024-05-14T12:08:39.825 INFO:teuthology.orchestra.run.smithi047.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.6 MB/s | 5.1 MB 00:00 2024-05-14T12:08:39.867 INFO:teuthology.orchestra.run.smithi047.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 1.0 MB/s | 269 kB 00:00 2024-05-14T12:08:39.900 INFO:teuthology.orchestra.run.smithi047.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-14T12:08:40.018 INFO:teuthology.orchestra.run.smithi047.stdout:(88/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.3 MB/s | 6.0 MB 00:01 2024-05-14T12:08:40.043 INFO:teuthology.orchestra.run.smithi047.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 362 kB/s | 51 kB 00:00 2024-05-14T12:08:40.076 INFO:teuthology.orchestra.run.smithi047.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-05-14T12:08:40.093 INFO:teuthology.orchestra.run.smithi073.stdout:(133/156): ceph-test-19.0.0-3588.ge2b755a6.el9. 2.9 MB/s | 43 MB 00:15 2024-05-14T12:08:40.101 INFO:teuthology.orchestra.run.smithi047.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 647 kB/s | 54 kB 00:00 2024-05-14T12:08:40.118 INFO:teuthology.orchestra.run.smithi073.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 40 kB/s | 16 kB 00:00 2024-05-14T12:08:40.135 INFO:teuthology.orchestra.run.smithi047.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 719 kB/s | 42 kB 00:00 2024-05-14T12:08:40.139 INFO:teuthology.orchestra.run.smithi066.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 276 kB/s | 253 kB 00:00 2024-05-14T12:08:40.143 INFO:teuthology.orchestra.run.smithi073.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 583 kB/s | 272 kB 00:00 2024-05-14T12:08:40.161 INFO:teuthology.orchestra.run.smithi047.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 761 kB/s | 44 kB 00:00 2024-05-14T12:08:40.185 INFO:teuthology.orchestra.run.smithi073.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-05-14T12:08:40.219 INFO:teuthology.orchestra.run.smithi047.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 622 kB/s | 36 kB 00:00 2024-05-14T12:08:40.236 INFO:teuthology.orchestra.run.smithi073.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 475 kB/s | 31 kB 00:00 2024-05-14T12:08:40.245 INFO:teuthology.orchestra.run.smithi047.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-14T12:08:40.261 INFO:teuthology.orchestra.run.smithi073.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-05-14T12:08:40.295 INFO:teuthology.orchestra.run.smithi073.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-14T12:08:40.328 INFO:teuthology.orchestra.run.smithi073.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-05-14T12:08:40.362 INFO:teuthology.orchestra.run.smithi073.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 761 kB/s | 51 kB 00:00 2024-05-14T12:08:40.378 INFO:teuthology.orchestra.run.smithi047.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 300 kB/s | 47 kB 00:00 2024-05-14T12:08:40.412 INFO:teuthology.orchestra.run.smithi073.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-14T12:08:40.437 INFO:teuthology.orchestra.run.smithi073.stdout:(143/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 262 kB/s | 90 kB 00:00 2024-05-14T12:08:40.445 INFO:teuthology.orchestra.run.smithi047.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-05-14T12:08:40.462 INFO:teuthology.orchestra.run.smithi073.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2024-05-14T12:08:40.470 INFO:teuthology.orchestra.run.smithi047.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 636 kB/s | 58 kB 00:00 2024-05-14T12:08:40.496 INFO:teuthology.orchestra.run.smithi073.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-14T12:08:40.512 INFO:teuthology.orchestra.run.smithi047.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-05-14T12:08:40.521 INFO:teuthology.orchestra.run.smithi073.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-05-14T12:08:40.522 INFO:teuthology.orchestra.run.smithi066.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-05-14T12:08:40.537 INFO:teuthology.orchestra.run.smithi047.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 962 kB/s | 64 kB 00:00 2024-05-14T12:08:40.555 INFO:teuthology.orchestra.run.smithi073.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-05-14T12:08:40.580 INFO:teuthology.orchestra.run.smithi047.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-05-14T12:08:40.639 INFO:teuthology.orchestra.run.smithi073.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-14T12:08:41.064 INFO:teuthology.orchestra.run.smithi066.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 115 kB/s | 106 kB 00:00 2024-05-14T12:08:41.072 INFO:teuthology.orchestra.run.smithi073.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 5.3 MB/s | 2.3 MB 00:00 2024-05-14T12:08:41.164 INFO:teuthology.orchestra.run.smithi047.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 36 kB/s | 22 kB 00:00 2024-05-14T12:08:41.281 INFO:teuthology.orchestra.run.smithi073.stdout:(150/156): NetworkManager-libnm-1.47.90-1.el9.x 8.7 MB/s | 1.8 MB 00:00 2024-05-14T12:08:41.340 INFO:teuthology.orchestra.run.smithi073.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 711 kB/s | 41 kB 00:00 2024-05-14T12:08:41.407 INFO:teuthology.orchestra.run.smithi073.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 3.6 MB/s | 248 kB 00:00 2024-05-14T12:08:41.473 INFO:teuthology.orchestra.run.smithi066.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 142 kB/s | 135 kB 00:00 2024-05-14T12:08:41.564 INFO:teuthology.orchestra.run.smithi047.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-05-14T12:08:41.565 INFO:teuthology.orchestra.run.smithi073.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 8.5 MB/s | 1.3 MB 00:00 2024-05-14T12:08:41.772 INFO:teuthology.orchestra.run.smithi047.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 903 kB/s | 548 kB 00:00 2024-05-14T12:08:41.831 INFO:teuthology.orchestra.run.smithi047.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-05-14T12:08:41.856 INFO:teuthology.orchestra.run.smithi047.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 243 kB/s | 19 kB 00:00 2024-05-14T12:08:41.906 INFO:teuthology.orchestra.run.smithi047.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 651 kB/s | 863 kB 00:01 2024-05-14T12:08:41.940 INFO:teuthology.orchestra.run.smithi066.stdout:(46/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 2.3 MB/s | 43 MB 00:18 2024-05-14T12:08:41.949 INFO:teuthology.orchestra.run.smithi073.stdout:(154/156): librados2-19.0.0-3588.ge2b755a6.el9. 2.3 MB/s | 3.3 MB 00:01 2024-05-14T12:08:41.999 INFO:teuthology.orchestra.run.smithi073.stdout:(155/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 2.1 MB/s | 3.1 MB 00:01 2024-05-14T12:08:42.049 INFO:teuthology.orchestra.run.smithi073.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.0 MB/s | 2.4 MB 00:00 2024-05-14T12:08:42.055 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-05-14T12:08:42.056 INFO:teuthology.orchestra.run.smithi073.stdout:Total 7.8 MB/s | 219 MB 00:27 2024-05-14T12:08:42.073 INFO:teuthology.orchestra.run.smithi047.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-14T12:08:42.098 INFO:teuthology.orchestra.run.smithi047.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 108 kB/s | 26 kB 00:00 2024-05-14T12:08:42.123 INFO:teuthology.orchestra.run.smithi047.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 244 kB/s | 49 kB 00:00 2024-05-14T12:08:42.140 INFO:teuthology.orchestra.run.smithi066.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 116 kB/s | 125 kB 00:01 2024-05-14T12:08:42.190 INFO:teuthology.orchestra.run.smithi047.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-14T12:08:42.224 INFO:teuthology.orchestra.run.smithi047.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-14T12:08:42.257 INFO:teuthology.orchestra.run.smithi047.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 839 kB 00:00 2024-05-14T12:08:42.300 INFO:teuthology.orchestra.run.smithi047.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.4 MB/s | 548 kB 00:00 2024-05-14T12:08:42.325 INFO:teuthology.orchestra.run.smithi047.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 717 kB/s | 43 kB 00:00 2024-05-14T12:08:42.350 INFO:teuthology.orchestra.run.smithi047.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 376 kB/s | 32 kB 00:00 2024-05-14T12:08:42.375 INFO:teuthology.orchestra.run.smithi047.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 203 kB/s | 15 kB 00:00 2024-05-14T12:08:42.417 INFO:teuthology.orchestra.run.smithi047.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.6 MB/s | 172 kB 00:00 2024-05-14T12:08:42.459 INFO:teuthology.orchestra.run.smithi047.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-05-14T12:08:42.484 INFO:teuthology.orchestra.run.smithi047.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-05-14T12:08:42.526 INFO:teuthology.orchestra.run.smithi047.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 346 kB/s | 35 kB 00:00 2024-05-14T12:08:42.560 INFO:teuthology.orchestra.run.smithi047.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-14T12:08:42.652 INFO:teuthology.orchestra.run.smithi047.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-14T12:08:42.665 INFO:teuthology.orchestra.run.smithi066.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 180 kB/s | 215 kB 00:01 2024-05-14T12:08:42.677 INFO:teuthology.orchestra.run.smithi047.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 973 kB/s | 144 kB 00:00 2024-05-14T12:08:42.719 INFO:teuthology.orchestra.run.smithi047.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 75 kB/s | 11 kB 00:00 2024-05-14T12:08:42.761 INFO:teuthology.orchestra.run.smithi047.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 214 kB/s | 18 kB 00:00 2024-05-14T12:08:42.803 INFO:teuthology.orchestra.run.smithi047.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 187 kB/s | 23 kB 00:00 2024-05-14T12:08:42.845 INFO:teuthology.orchestra.run.smithi047.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2024-05-14T12:08:42.905 INFO:teuthology.orchestra.run.smithi047.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 199 kB/s | 20 kB 00:00 2024-05-14T12:08:42.949 INFO:teuthology.orchestra.run.smithi066.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 683 kB/s | 689 kB 00:01 2024-05-14T12:08:42.953 INFO:teuthology.orchestra.run.smithi047.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 6.9 MB/s | 1.0 MB 00:00 2024-05-14T12:08:43.021 INFO:teuthology.orchestra.run.smithi047.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 288 kB/s | 46 kB 00:00 2024-05-14T12:08:43.046 INFO:teuthology.orchestra.run.smithi047.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 872 kB/s | 79 kB 00:00 2024-05-14T12:08:43.087 INFO:teuthology.orchestra.run.smithi047.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 438 kB/s | 58 kB 00:00 2024-05-14T12:08:43.121 INFO:teuthology.orchestra.run.smithi047.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-05-14T12:08:43.141 INFO:teuthology.orchestra.run.smithi066.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 943 kB/s | 943 kB 00:01 2024-05-14T12:08:43.188 INFO:teuthology.orchestra.run.smithi047.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 169 kB/s | 16 kB 00:00 2024-05-14T12:08:43.213 INFO:teuthology.orchestra.run.smithi047.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 738 kB/s | 90 kB 00:00 2024-05-14T12:08:43.236 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-05-14T12:08:43.255 INFO:teuthology.orchestra.run.smithi047.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 212 kB/s | 28 kB 00:00 2024-05-14T12:08:43.306 INFO:teuthology.orchestra.run.smithi047.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 340 kB/s | 31 kB 00:00 2024-05-14T12:08:43.339 INFO:teuthology.orchestra.run.smithi047.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-14T12:08:43.381 INFO:teuthology.orchestra.run.smithi047.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 473 kB/s | 59 kB 00:00 2024-05-14T12:08:43.385 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-05-14T12:08:43.385 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-05-14T12:08:43.423 INFO:teuthology.orchestra.run.smithi047.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 315 kB/s | 36 kB 00:00 2024-05-14T12:08:43.458 INFO:teuthology.orchestra.run.smithi066.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 135 kB/s | 107 kB 00:00 2024-05-14T12:08:43.482 INFO:teuthology.orchestra.run.smithi047.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 516 kB/s | 51 kB 00:00 2024-05-14T12:08:43.515 INFO:teuthology.orchestra.run.smithi047.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-05-14T12:08:43.541 INFO:teuthology.orchestra.run.smithi047.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 769 kB/s | 90 kB 00:00 2024-05-14T12:08:43.582 INFO:teuthology.orchestra.run.smithi047.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.3 MB/s | 427 kB 00:00 2024-05-14T12:08:43.632 INFO:teuthology.orchestra.run.smithi047.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 225 kB/s | 20 kB 00:00 2024-05-14T12:08:43.650 INFO:teuthology.orchestra.run.smithi066.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 31 kB/s | 21 kB 00:00 2024-05-14T12:08:43.674 INFO:teuthology.orchestra.run.smithi047.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-05-14T12:08:43.733 INFO:teuthology.orchestra.run.smithi047.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-14T12:08:43.934 INFO:teuthology.orchestra.run.smithi047.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-05-14T12:08:44.034 INFO:teuthology.orchestra.run.smithi047.stdout:(150/156): NetworkManager-libnm-1.47.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-05-14T12:08:44.076 INFO:teuthology.orchestra.run.smithi047.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-05-14T12:08:44.124 INFO:teuthology.orchestra.run.smithi066.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-05-14T12:08:44.143 INFO:teuthology.orchestra.run.smithi066.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 313 kB/s | 313 kB 00:01 2024-05-14T12:08:44.143 INFO:teuthology.orchestra.run.smithi047.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 3.7 MB/s | 248 kB 00:00 2024-05-14T12:08:44.234 INFO:teuthology.orchestra.run.smithi047.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 15 MB/s | 1.3 MB 00:00 2024-05-14T12:08:44.352 INFO:teuthology.orchestra.run.smithi047.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-05-14T12:08:44.519 INFO:teuthology.orchestra.run.smithi047.stdout:(155/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 3.7 MB/s | 3.1 MB 00:00 2024-05-14T12:08:44.602 INFO:teuthology.orchestra.run.smithi047.stdout:(156/156): librados2-19.0.0-3588.ge2b755a6.el9. 3.5 MB/s | 3.3 MB 00:00 2024-05-14T12:08:44.611 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-05-14T12:08:44.611 INFO:teuthology.orchestra.run.smithi047.stdout:Total 7.8 MB/s | 219 MB 00:28 2024-05-14T12:08:44.650 INFO:teuthology.orchestra.run.smithi066.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 34 kB/s | 18 kB 00:00 2024-05-14T12:08:44.684 INFO:teuthology.orchestra.run.smithi066.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-05-14T12:08:44.776 INFO:teuthology.orchestra.run.smithi066.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-05-14T12:08:45.135 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-05-14T12:08:45.135 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-05-14T12:08:45.335 INFO:teuthology.orchestra.run.smithi066.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-05-14T12:08:45.460 INFO:teuthology.orchestra.run.smithi066.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 198 kB/s | 160 kB 00:00 2024-05-14T12:08:45.785 INFO:teuthology.orchestra.run.smithi066.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 657 kB/s | 662 kB 00:01 2024-05-14T12:08:46.152 INFO:teuthology.orchestra.run.smithi066.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 37 kB/s | 25 kB 00:00 2024-05-14T12:08:46.361 INFO:teuthology.orchestra.run.smithi066.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 568 kB/s | 582 kB 00:01 2024-05-14T12:08:46.469 INFO:teuthology.orchestra.run.smithi066.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 69 kB/s | 47 kB 00:00 2024-05-14T12:08:47.011 INFO:teuthology.orchestra.run.smithi066.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 341 kB/s | 292 kB 00:00 2024-05-14T12:08:47.070 INFO:teuthology.orchestra.run.smithi066.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 59 kB/s | 35 kB 00:00 2024-05-14T12:08:47.162 INFO:teuthology.orchestra.run.smithi066.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 235 kB/s | 188 kB 00:00 2024-05-14T12:08:47.673 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-05-14T12:08:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-05-14T12:08:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-05-14T12:08:48.196 INFO:teuthology.orchestra.run.smithi066.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.0 MB/s | 4.7 MB 00:01 2024-05-14T12:08:48.237 INFO:teuthology.orchestra.run.smithi066.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-14T12:08:48.304 INFO:teuthology.orchestra.run.smithi066.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-14T12:08:49.048 INFO:teuthology.orchestra.run.smithi066.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 164 kB/s | 133 kB 00:00 2024-05-14T12:08:49.190 INFO:teuthology.orchestra.run.smithi066.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 916 kB/s | 911 kB 00:00 2024-05-14T12:08:49.608 INFO:teuthology.orchestra.run.smithi066.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.4 MB/s | 5.8 MB 00:01 2024-05-14T12:08:49.942 INFO:teuthology.orchestra.run.smithi066.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 116 kB/s | 87 kB 00:00 2024-05-14T12:08:50.126 INFO:teuthology.orchestra.run.smithi066.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 959 kB/s | 1.0 MB 00:01 2024-05-14T12:08:50.542 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-05-14T12:08:50.543 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-05-14T12:08:50.817 INFO:teuthology.orchestra.run.smithi066.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 279 kB/s | 244 kB 00:00 2024-05-14T12:08:50.901 INFO:teuthology.orchestra.run.smithi066.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-05-14T12:08:50.976 INFO:teuthology.orchestra.run.smithi066.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 292 kB/s | 248 kB 00:00 2024-05-14T12:08:51.212 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-05-14T12:08:51.298 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T12:08:51.336 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T12:08:51.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T12:08:51.402 INFO:teuthology.orchestra.run.smithi066.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 44 kB/s | 26 kB 00:00 2024-05-14T12:08:51.432 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T12:08:51.451 INFO:teuthology.orchestra.run.smithi066.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-05-14T12:08:51.457 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T12:08:51.500 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T12:08:51.744 INFO:teuthology.orchestra.run.smithi066.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 225 kB/s | 172 kB 00:00 2024-05-14T12:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T12:08:51.959 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:08:52.035 INFO:teuthology.orchestra.run.smithi066.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 55 kB/s | 35 kB 00:00 2024-05-14T12:08:52.085 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:08:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:08:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:08:52.231 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T12:08:52.380 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T12:08:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T12:08:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:08:52.577 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:08:52.586 INFO:teuthology.orchestra.run.smithi066.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 298 kB/s | 250 kB 00:00 2024-05-14T12:08:52.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T12:08:52.644 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T12:08:52.661 INFO:teuthology.orchestra.run.smithi066.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-14T12:08:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T12:08:52.687 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T12:08:52.845 INFO:teuthology.orchestra.run.smithi066.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 275 kB/s | 222 kB 00:00 2024-05-14T12:08:52.866 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T12:08:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T12:08:53.155 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T12:08:53.215 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T12:08:53.317 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:08:53.336 INFO:teuthology.orchestra.run.smithi066.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 103 kB/s | 77 kB 00:00 2024-05-14T12:08:53.362 INFO:teuthology.orchestra.run.smithi066.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 60 kB/s | 42 kB 00:00 2024-05-14T12:08:53.400 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:08:53.618 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:08:53.695 INFO:teuthology.orchestra.run.smithi066.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 328 kB/s | 269 kB 00:00 2024-05-14T12:08:53.722 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T12:08:53.746 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T12:08:53.781 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T12:08:53.854 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T12:08:53.888 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T12:08:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T12:08:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T12:08:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T12:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T12:08:54.104 INFO:teuthology.orchestra.run.smithi066.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-05-14T12:08:54.123 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T12:08:54.154 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T12:08:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T12:08:54.212 INFO:teuthology.orchestra.run.smithi066.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 328 kB/s | 279 kB 00:00 2024-05-14T12:08:54.264 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T12:08:54.300 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T12:08:54.343 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T12:08:54.372 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T12:08:54.379 INFO:teuthology.orchestra.run.smithi066.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 75 kB/s | 51 kB 00:00 2024-05-14T12:08:54.441 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T12:08:54.486 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T12:08:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T12:08:54.693 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T12:08:54.746 INFO:teuthology.orchestra.run.smithi066.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-05-14T12:08:54.756 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T12:08:55.038 INFO:teuthology.orchestra.run.smithi066.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 63 kB/s | 42 kB 00:00 2024-05-14T12:08:55.275 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T12:08:55.368 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T12:08:55.380 INFO:teuthology.orchestra.run.smithi066.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 70 kB/s | 44 kB 00:00 2024-05-14T12:08:55.397 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T12:08:55.440 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T12:08:55.478 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T12:08:55.519 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T12:08:55.666 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T12:08:55.723 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T12:08:55.764 INFO:teuthology.orchestra.run.smithi066.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-14T12:08:55.814 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T12:08:55.878 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T12:08:55.951 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T12:08:55.981 INFO:teuthology.orchestra.run.smithi066.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 234 kB/s | 221 kB 00:00 2024-05-14T12:08:55.991 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T12:08:56.027 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T12:08:56.074 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T12:08:56.110 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T12:08:56.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T12:08:56.181 INFO:teuthology.orchestra.run.smithi066.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 45 kB/s | 36 kB 00:00 2024-05-14T12:08:56.195 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T12:08:56.331 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T12:08:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T12:08:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T12:08:56.414 INFO:teuthology.orchestra.run.smithi066.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-05-14T12:08:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T12:08:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T12:08:56.573 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T12:08:56.613 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T12:08:56.638 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T12:08:56.662 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T12:08:56.737 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T12:08:56.815 INFO:teuthology.orchestra.run.smithi066.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 366 kB/s | 305 kB 00:00 2024-05-14T12:08:56.848 INFO:teuthology.orchestra.run.smithi066.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 87 kB/s | 58 kB 00:00 2024-05-14T12:08:56.863 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T12:08:56.895 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T12:08:56.914 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T12:08:56.949 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T12:08:56.988 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T12:08:57.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T12:08:57.050 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T12:08:57.084 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T12:08:57.117 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T12:08:57.132 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-05-14T12:08:57.150 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T12:08:57.157 INFO:teuthology.orchestra.run.smithi066.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 131 kB/s | 94 kB 00:00 2024-05-14T12:08:57.185 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T12:08:57.226 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T12:08:57.272 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T12:08:57.307 INFO:teuthology.orchestra.run.smithi066.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 150 kB/s | 22 kB 00:00 2024-05-14T12:08:57.309 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T12:08:57.323 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T12:08:57.354 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T12:08:57.402 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T12:08:57.427 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T12:08:57.474 INFO:teuthology.orchestra.run.smithi066.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-05-14T12:08:57.495 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T12:08:57.499 INFO:teuthology.orchestra.run.smithi066.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-05-14T12:08:57.500 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T12:08:57.528 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T12:08:57.533 INFO:teuthology.orchestra.run.smithi066.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-05-14T12:08:57.556 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T12:08:57.608 INFO:teuthology.orchestra.run.smithi066.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 260 kB/s | 19 kB 00:00 2024-05-14T12:08:57.639 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T12:08:57.642 INFO:teuthology.orchestra.run.smithi066.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.1 MB/s | 309 kB 00:00 2024-05-14T12:08:57.676 INFO:teuthology.orchestra.run.smithi066.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.7 MB/s | 548 kB 00:00 2024-05-14T12:08:57.692 INFO:teuthology.orchestra.run.smithi066.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-05-14T12:08:57.740 INFO:teuthology.orchestra.run.smithi066.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 754 kB/s | 49 kB 00:00 2024-05-14T12:08:57.768 INFO:teuthology.orchestra.run.smithi066.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 894 kB/s | 67 kB 00:00 2024-05-14T12:08:57.793 INFO:teuthology.orchestra.run.smithi066.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.8 MB/s | 151 kB 00:00 2024-05-14T12:08:57.844 INFO:teuthology.orchestra.run.smithi066.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-05-14T12:08:57.877 INFO:teuthology.orchestra.run.smithi066.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-05-14T12:08:57.903 INFO:teuthology.orchestra.run.smithi066.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-05-14T12:08:57.928 INFO:teuthology.orchestra.run.smithi066.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 644 kB/s | 32 kB 00:00 2024-05-14T12:08:57.953 INFO:teuthology.orchestra.run.smithi066.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-05-14T12:08:57.978 INFO:teuthology.orchestra.run.smithi066.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-14T12:08:58.004 INFO:teuthology.orchestra.run.smithi066.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-05-14T12:08:58.037 INFO:teuthology.orchestra.run.smithi066.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-05-14T12:08:58.066 INFO:teuthology.orchestra.run.smithi066.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 604 kB/s | 35 kB 00:00 2024-05-14T12:08:58.088 INFO:teuthology.orchestra.run.smithi066.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-14T12:08:58.095 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T12:08:58.163 INFO:teuthology.orchestra.run.smithi066.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-05-14T12:08:58.188 INFO:teuthology.orchestra.run.smithi066.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-05-14T12:08:58.201 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:08:58.214 INFO:teuthology.orchestra.run.smithi066.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-05-14T12:08:58.239 INFO:teuthology.orchestra.run.smithi066.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-05-14T12:08:58.264 INFO:teuthology.orchestra.run.smithi066.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-05-14T12:08:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T12:08:58.289 INFO:teuthology.orchestra.run.smithi066.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-05-14T12:08:58.315 INFO:teuthology.orchestra.run.smithi066.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-05-14T12:08:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T12:08:58.353 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T12:08:58.373 INFO:teuthology.orchestra.run.smithi066.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-05-14T12:08:58.378 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:08:58.399 INFO:teuthology.orchestra.run.smithi066.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-05-14T12:08:58.410 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:08:58.424 INFO:teuthology.orchestra.run.smithi066.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-14T12:08:58.449 INFO:teuthology.orchestra.run.smithi066.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-14T12:08:58.454 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T12:08:58.483 INFO:teuthology.orchestra.run.smithi066.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-05-14T12:08:58.508 INFO:teuthology.orchestra.run.smithi066.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-05-14T12:08:58.520 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T12:08:58.529 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:08:58.542 INFO:teuthology.orchestra.run.smithi066.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2024-05-14T12:08:58.566 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T12:08:58.567 INFO:teuthology.orchestra.run.smithi066.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-05-14T12:08:58.593 INFO:teuthology.orchestra.run.smithi066.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-05-14T12:08:58.607 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T12:08:58.618 INFO:teuthology.orchestra.run.smithi066.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 669 kB/s | 90 kB 00:00 2024-05-14T12:08:58.635 INFO:teuthology.orchestra.run.smithi066.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-05-14T12:08:58.647 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T12:08:58.652 INFO:teuthology.orchestra.run.smithi066.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-05-14T12:08:58.669 INFO:teuthology.orchestra.run.smithi066.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-14T12:08:58.686 INFO:teuthology.orchestra.run.smithi066.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-14T12:08:58.711 INFO:teuthology.orchestra.run.smithi066.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-05-14T12:08:58.736 INFO:teuthology.orchestra.run.smithi066.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-05-14T12:08:58.761 INFO:teuthology.orchestra.run.smithi066.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-05-14T12:08:58.787 INFO:teuthology.orchestra.run.smithi066.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-14T12:08:58.812 INFO:teuthology.orchestra.run.smithi066.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-05-14T12:08:58.826 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T12:08:58.855 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T12:08:58.870 INFO:teuthology.orchestra.run.smithi066.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-14T12:08:58.903 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T12:08:58.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T12:08:58.970 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T12:08:58.997 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:08:59.152 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:08:59.182 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T12:08:59.278 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T12:08:59.308 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T12:08:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T12:08:59.579 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T12:08:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T12:08:59.722 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T12:08:59.946 INFO:teuthology.orchestra.run.smithi066.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 2.1 MB/s | 2.3 MB 00:01 2024-05-14T12:09:00.045 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T12:09:00.267 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T12:09:00.361 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T12:09:00.480 INFO:teuthology.orchestra.run.smithi066.stdout:(150/156): librados2-19.0.0-3588.ge2b755a6.el9. 2.0 MB/s | 3.3 MB 00:01 2024-05-14T12:09:00.556 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:09:00.676 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:09:00.905 INFO:teuthology.orchestra.run.smithi066.stdout:(151/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 1.5 MB/s | 3.1 MB 00:02 2024-05-14T12:09:00.905 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T12:09:00.977 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T12:09:01.005 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T12:09:01.038 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T12:09:01.044 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:09:01.080 INFO:teuthology.orchestra.run.smithi066.stdout:(152/156): NetworkManager-libnm-1.47.90-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-05-14T12:09:01.122 INFO:teuthology.orchestra.run.smithi066.stdout:(153/156): NetworkManager-team-1.47.90-1.el9.x8 65 kB/s | 41 kB 00:00 2024-05-14T12:09:01.244 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T12:09:01.281 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T12:09:01.357 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T12:09:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T12:09:01.471 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T12:09:01.492 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T12:09:01.523 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T12:09:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T12:09:01.652 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T12:09:01.713 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T12:09:01.730 INFO:teuthology.orchestra.run.smithi066.stdout:(154/156): NetworkManager-tui-1.47.90-1.el9.x86 300 kB/s | 248 kB 00:00 2024-05-14T12:09:01.792 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T12:09:01.843 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T12:09:01.881 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T12:09:02.005 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T12:09:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T12:09:02.079 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T12:09:02.106 INFO:teuthology.orchestra.run.smithi066.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-05-14T12:09:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T12:09:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T12:09:02.202 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T12:09:02.242 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T12:09:02.264 INFO:teuthology.orchestra.run.smithi066.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-05-14T12:09:02.268 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-05-14T12:09:02.269 INFO:teuthology.orchestra.run.smithi066.stdout:Total 4.5 MB/s | 219 MB 00:49 2024-05-14T12:09:02.301 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T12:09:02.421 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T12:09:02.462 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T12:09:02.513 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T12:09:02.576 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T12:09:02.708 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T12:09:02.767 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T12:09:02.883 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T12:09:03.076 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T12:09:03.142 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T12:09:03.478 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-05-14T12:09:03.647 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-05-14T12:09:03.647 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-05-14T12:09:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T12:09:03.992 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T12:09:04.032 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T12:09:04.077 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T12:09:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T12:09:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T12:09:04.384 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:04.409 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T12:09:04.419 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:04.476 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T12:09:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T12:09:04.672 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T12:09:04.758 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T12:09:04.801 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T12:09:04.834 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T12:09:04.915 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T12:09:04.959 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T12:09:04.973 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:05.015 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T12:09:05.023 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T12:09:05.090 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T12:09:05.106 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T12:09:05.106 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T12:09:05.106 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T12:09:05.107 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:05.141 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T12:09:05.299 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T12:09:05.348 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T12:09:05.386 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T12:09:05.443 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T12:09:05.523 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-05-14T12:09:05.523 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-05-14T12:09:05.583 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T12:09:05.627 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T12:09:05.676 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T12:09:05.709 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T12:09:05.742 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T12:09:05.931 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T12:09:06.109 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T12:09:06.148 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T12:09:06.194 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T12:09:06.233 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T12:09:06.292 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T12:09:06.344 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T12:09:06.385 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T12:09:06.426 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T12:09:06.472 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T12:09:06.537 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T12:09:06.578 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T12:09:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T12:09:06.796 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T12:09:06.837 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T12:09:06.909 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T12:09:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T12:09:07.134 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T12:09:08.176 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T12:09:08.232 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T12:09:08.265 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T12:09:08.395 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T12:09:08.461 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T12:09:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T12:09:08.608 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T12:09:08.852 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T12:09:08.879 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T12:09:09.000 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T12:09:09.902 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T12:09:10.058 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T12:09:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T12:09:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-05-14T12:09:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T12:09:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T12:09:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T12:09:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T12:09:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T12:09:11.982 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T12:09:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T12:09:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T12:09:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T12:09:12.388 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T12:09:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T12:09:12.431 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T12:09:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:09:12.555 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T12:09:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T12:09:12.646 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T12:09:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:09:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:09:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:09:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T12:09:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T12:09:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T12:09:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:09:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:09:13.177 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T12:09:13.235 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T12:09:13.240 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T12:09:13.261 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T12:09:13.267 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T12:09:13.287 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T12:09:13.350 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T12:09:13.377 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T12:09:13.478 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T12:09:13.612 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T12:09:13.792 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T12:09:13.852 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T12:09:13.939 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:09:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:09:14.212 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T12:09:14.320 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T12:09:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T12:09:14.393 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T12:09:14.469 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T12:09:14.509 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T12:09:14.561 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T12:09:14.593 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T12:09:14.621 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T12:09:14.692 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T12:09:14.752 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T12:09:14.782 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T12:09:14.826 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T12:09:14.903 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T12:09:14.936 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T12:09:14.980 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T12:09:15.008 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T12:09:15.080 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T12:09:15.123 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T12:09:15.208 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T12:09:15.353 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T12:09:15.410 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T12:09:15.962 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T12:09:16.048 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T12:09:16.058 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:16.075 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T12:09:16.107 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:16.118 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T12:09:16.156 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T12:09:16.198 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T12:09:16.359 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T12:09:16.418 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T12:09:16.512 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T12:09:16.574 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T12:09:16.647 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T12:09:16.685 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T12:09:16.721 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-05-14T12:09:16.745 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:16.769 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T12:09:16.806 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:16.812 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T12:09:16.856 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T12:09:16.898 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T12:09:16.924 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T12:09:16.940 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T12:09:16.940 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:16.940 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T12:09:16.940 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:16.952 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T12:09:17.039 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T12:09:17.087 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T12:09:17.117 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T12:09:17.139 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T12:09:17.139 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T12:09:17.139 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T12:09:17.139 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:17.159 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T12:09:17.169 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T12:09:17.255 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T12:09:17.291 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T12:09:17.332 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T12:09:17.356 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T12:09:17.389 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T12:09:17.469 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T12:09:17.604 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T12:09:17.638 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T12:09:17.667 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T12:09:17.701 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T12:09:17.740 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T12:09:17.772 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T12:09:17.801 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T12:09:17.827 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T12:09:17.860 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T12:09:17.902 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T12:09:17.936 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T12:09:18.026 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T12:09:18.076 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T12:09:18.106 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T12:09:18.163 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T12:09:18.274 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T12:09:18.334 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T12:09:18.520 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T12:09:18.546 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T12:09:18.546 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:18.547 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T12:09:18.547 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T12:09:18.547 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T12:09:18.547 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:18.770 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T12:09:18.793 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T12:09:18.794 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:18.794 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T12:09:18.794 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T12:09:18.794 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T12:09:18.794 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:19.094 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T12:09:19.138 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T12:09:19.172 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T12:09:19.247 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T12:09:19.269 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T12:09:19.269 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:19.269 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T12:09:19.270 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T12:09:19.270 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T12:09:19.270 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:19.274 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T12:09:19.322 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T12:09:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T12:09:19.412 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T12:09:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T12:09:19.449 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T12:09:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T12:09:19.632 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T12:09:19.663 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T12:09:19.673 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T12:09:19.728 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T12:09:19.742 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T12:09:19.805 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T12:09:19.901 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T12:09:20.040 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T12:09:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T12:09:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T12:09:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T12:09:20.427 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T12:09:20.521 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T12:09:20.540 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T12:09:20.551 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T12:09:20.583 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T12:09:20.645 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T12:09:20.682 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T12:09:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T12:09:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T12:09:21.834 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T12:09:21.910 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T12:09:21.938 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T12:09:21.971 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T12:09:22.307 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T12:09:22.342 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T12:09:22.433 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T12:09:22.472 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T12:09:22.509 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T12:09:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T12:09:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T12:09:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T12:09:23.023 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T12:09:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T12:09:23.053 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T12:09:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T12:09:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T12:09:23.093 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:23.093 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T12:09:23.093 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T12:09:23.093 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T12:09:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:23.107 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T12:09:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T12:09:23.138 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T12:09:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T12:09:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T12:09:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T12:09:24.236 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T12:09:24.265 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T12:09:24.288 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T12:09:24.288 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:24.288 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T12:09:24.288 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T12:09:24.288 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T12:09:24.288 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T12:09:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T12:09:24.354 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:24.354 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T12:09:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:24.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T12:09:24.422 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T12:09:24.422 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:24.422 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T12:09:24.422 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T12:09:24.422 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T12:09:24.422 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:24.733 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T12:09:24.756 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T12:09:24.756 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:24.756 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T12:09:24.756 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T12:09:24.757 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T12:09:24.757 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:25.440 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:25.485 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:26.073 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T12:09:26.114 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T12:09:26.205 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T12:09:26.205 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T12:09:26.205 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T12:09:26.205 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:26.231 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T12:09:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T12:09:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T12:09:29.127 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T12:09:29.159 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T12:09:29.187 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T12:09:29.368 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T12:09:29.408 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T12:09:29.439 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T12:09:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T12:09:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T12:09:30.126 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:30.170 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:30.190 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-05-14T12:09:30.675 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:30.909 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T12:09:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T12:09:30.961 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:30.961 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T12:09:30.961 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:31.015 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T12:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T12:09:31.141 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T12:09:31.221 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T12:09:31.270 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T12:09:31.296 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T12:09:31.296 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T12:09:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T12:09:31.405 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T12:09:31.405 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T12:09:31.481 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T12:09:31.506 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T12:09:31.511 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:31.511 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:31.691 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:31.691 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T12:09:31.758 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T12:09:31.829 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:32.753 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T12:09:32.838 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T12:09:32.838 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:32.838 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T12:09:32.838 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T12:09:32.838 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T12:09:32.838 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:33.095 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T12:09:33.169 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T12:09:33.169 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:33.169 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T12:09:33.169 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T12:09:33.169 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T12:09:33.169 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:33.712 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T12:09:33.785 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T12:09:33.785 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:33.786 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T12:09:33.786 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T12:09:33.786 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T12:09:33.786 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:33.932 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T12:09:33.997 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T12:09:34.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T12:09:34.334 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T12:09:34.394 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T12:09:34.478 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T12:09:34.607 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T12:09:34.799 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T12:09:34.851 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T12:09:34.891 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T12:09:34.948 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T12:09:35.780 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T12:09:35.819 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T12:09:35.878 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T12:09:35.994 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T12:09:36.028 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T12:09:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T12:09:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T12:09:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T12:09:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T12:09:37.401 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T12:09:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T12:09:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T12:09:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T12:09:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T12:09:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T12:09:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T12:09:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T12:09:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T12:09:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T12:09:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T12:09:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T12:09:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T12:09:37.446 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T12:09:38.021 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-05-14T12:09:38.022 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:38.202 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T12:09:38.219 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T12:09:38.219 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:38.219 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T12:09:38.219 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:38.618 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T12:09:38.646 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T12:09:38.810 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T12:09:39.000 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T12:09:39.031 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T12:09:39.105 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T12:09:39.105 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:39.105 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T12:09:39.105 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T12:09:39.106 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T12:09:39.106 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:39.166 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T12:09:39.206 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T12:09:39.353 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T12:09:39.427 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T12:09:39.846 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T12:09:39.874 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T12:09:39.874 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:39.874 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T12:09:39.874 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T12:09:39.874 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T12:09:39.875 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:40.110 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T12:09:40.111 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.112 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.113 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T12:09:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.115 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T12:09:40.116 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.117 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T12:09:40.118 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T12:09:40.119 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T12:09:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T12:09:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:40.122 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T12:09:40.123 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T12:09:40.123 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T12:09:40.123 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T12:09:40.123 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T12:09:40.123 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T12:09:40.123 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T12:09:40.124 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T12:09:40.124 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:09:40.124 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-05-14T12:09:40.147 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T12:09:40.147 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:40.147 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T12:09:40.147 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T12:09:40.147 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T12:09:40.147 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:40.543 DEBUG:teuthology.parallel:result is None 2024-05-14T12:09:40.543 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T12:09:40.585 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T12:09:40.631 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T12:09:40.656 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T12:09:40.656 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:40.656 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T12:09:40.656 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T12:09:40.656 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T12:09:40.656 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:40.657 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T12:09:40.657 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:40.657 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T12:09:40.657 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T12:09:40.657 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T12:09:40.657 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:40.711 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T12:09:40.763 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T12:09:40.787 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T12:09:40.788 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:40.788 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T12:09:40.788 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:40.820 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T12:09:40.870 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T12:09:40.893 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T12:09:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T12:09:40.947 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:40.947 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T12:09:40.947 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T12:09:40.947 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T12:09:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:41.090 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T12:09:41.142 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T12:09:41.223 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T12:09:41.311 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T12:09:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T12:09:41.421 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T12:09:41.421 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:41.421 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T12:09:41.422 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T12:09:41.422 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T12:09:41.422 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:41.455 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T12:09:41.492 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T12:09:41.526 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T12:09:41.553 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T12:09:41.973 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T12:09:42.002 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T12:09:42.034 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T12:09:42.097 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T12:09:42.124 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T12:09:43.216 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T12:09:43.251 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T12:09:44.264 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T12:09:44.293 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T12:09:44.411 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T12:09:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T12:09:44.612 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T12:09:44.637 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T12:09:44.637 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:44.637 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T12:09:44.637 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T12:09:44.637 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T12:09:44.637 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:44.687 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T12:09:44.699 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T12:09:44.801 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T12:09:44.853 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T12:09:45.838 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T12:09:45.873 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T12:09:45.897 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T12:09:45.898 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:45.898 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T12:09:45.898 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T12:09:45.898 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T12:09:45.898 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:45.940 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T12:09:45.964 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T12:09:45.964 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:45.964 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T12:09:45.964 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:46.016 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T12:09:46.041 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T12:09:46.041 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:46.041 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T12:09:46.041 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T12:09:46.041 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T12:09:46.041 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:46.366 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T12:09:46.391 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T12:09:46.391 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T12:09:46.391 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T12:09:46.391 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T12:09:46.391 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T12:09:46.392 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:09:46.438 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T12:09:46.496 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T12:09:46.580 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T12:09:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T12:09:46.660 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T12:09:46.993 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T12:09:47.048 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T12:09:47.069 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T12:09:47.112 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T12:09:47.161 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T12:09:48.238 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:48.284 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:48.350 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:49.759 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T12:09:49.874 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T12:09:49.944 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T12:09:50.131 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T12:09:50.168 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T12:09:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T12:09:50.205 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T12:09:50.333 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T12:09:50.380 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T12:09:50.380 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T12:09:50.517 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T12:09:50.556 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T12:09:50.591 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:50.591 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:50.904 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T12:09:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T12:09:50.947 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T12:09:50.986 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T12:09:51.018 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T12:09:51.045 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T12:09:51.072 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T12:09:51.238 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T12:09:51.243 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:51.282 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T12:09:51.312 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T12:09:51.342 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T12:09:51.388 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T12:09:51.524 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:51.525 INFO:teuthology.orchestra.run.smithi047.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T12:09:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:52.023 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:52.061 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:52.082 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T12:09:52.993 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T12:09:53.073 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T12:09:53.116 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T12:09:53.208 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T12:09:53.243 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T12:09:53.353 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T12:09:53.782 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:57.318 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T12:09:57.318 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T12:09:57.318 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T12:09:57.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T12:09:57.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T12:09:57.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T12:09:57.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T12:09:57.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T12:09:57.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T12:09:57.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T12:09:57.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T12:09:57.333 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T12:09:57.334 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T12:09:57.335 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T12:09:57.336 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T12:09:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T12:09:57.338 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T12:09:57.339 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T12:09:57.340 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T12:09:57.341 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T12:09:57.342 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T12:09:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T12:09:59.281 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:59.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T12:09:59.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T12:09:59.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T12:09:59.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T12:09:59.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T12:09:59.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T12:09:59.297 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T12:09:59.298 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T12:09:59.299 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T12:09:59.300 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T12:09:59.301 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T12:09:59.302 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T12:09:59.303 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T12:09:59.304 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T12:09:59.305 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T12:09:59.306 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T12:09:59.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T12:09:59.477 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:09:59.477 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:59.477 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T12:09:59.478 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.479 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:09:59.480 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.481 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T12:09:59.482 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T12:09:59.483 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T12:09:59.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T12:09:59.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T12:09:59.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T12:09:59.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T12:09:59.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T12:09:59.489 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T12:09:59.490 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T12:09:59.490 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T12:09:59.490 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T12:09:59.490 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T12:09:59.490 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T12:09:59.490 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:09:59.490 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-14T12:10:00.264 DEBUG:teuthology.parallel:result is None 2024-05-14T12:10:01.872 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T12:10:01.872 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:10:01.873 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-05-14T12:10:01.873 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T12:10:01.874 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.875 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T12:10:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T12:10:01.877 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T12:10:01.878 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T12:10:01.879 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T12:10:01.880 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T12:10:01.881 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T12:10:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T12:10:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T12:10:01.884 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T12:10:01.885 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T12:10:01.886 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T12:10:01.886 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-05-14T12:10:01.886 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-05-14T12:10:02.265 DEBUG:teuthology.parallel:result is None 2024-05-14T12:10:02.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:10:02.421 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T12:10:02.478 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T12:10:02.479 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T12:10:02.479 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T12:10:02.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:10:02.704 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T12:10:02.727 INFO:teuthology.orchestra.run.smithi066.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T12:10:02.728 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T12:10:02.728 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T12:10:02.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:10:02.951 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T12:10:02.976 INFO:teuthology.orchestra.run.smithi073.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T12:10:02.976 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T12:10:02.976 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T12:10:02.978 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-14T12:10:02.978 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:10:02.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T12:10:03.058 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:10:03.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T12:10:03.089 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:10:03.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T12:10:03.119 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-14T12:10:03.120 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:10:03.120 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T12:10:03.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T12:10:03.294 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:10:03.295 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T12:10:03.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T12:10:03.393 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:10:03.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T12:10:03.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T12:10:03.489 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-14T12:10:03.489 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:10:03.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T12:10:03.560 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T12:10:03.669 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:10:03.670 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T12:10:03.698 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T12:10:03.767 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:10:03.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T12:10:03.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T12:10:03.865 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-14T12:10:03.865 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:10:03.865 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T12:10:03.935 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T12:10:04.043 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:10:04.043 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T12:10:04.072 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T12:10:04.140 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:10:04.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T12:10:04.164 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T12:10:04.227 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-14T12:10:04.357 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'SLOW_OPS', 'slow request'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-14T12:10:04.357 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:10:04.358 INFO:tasks.cephadm:Cluster fsid is e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:10:04.358 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-14T12:10:04.358 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.47', 'mon.b': '172.21.15.66', 'mon.c': '172.21.15.73'} 2024-05-14T12:10:04.358 INFO:tasks.cephadm:First mon is mon.a on smithi047 2024-05-14T12:10:04.359 INFO:tasks.cephadm:First mgr is x 2024-05-14T12:10:04.359 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-14T12:10:04.359 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-05-14T12:10:04.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname $(hostname -s) 2024-05-14T12:10:04.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2024-05-14T12:10:04.505 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-14T12:10:04.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:10:04.729 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79237/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3588-ge2b755a6', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3588.ge2b755a6'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-09 07:03:10.506903', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240509.053109-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79236/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3588-ge2b755a6', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3588.ge2b755a6'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-09 06:43:33.316648', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240509.053109-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-14T12:10:04.884 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20240509.053109-debug, sha1 e2b755a64f0d72176b57299d02e880cf0620d780 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:10:04.885 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm 2024-05-14T12:10:04.886 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:05.434 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 12:10 /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:05.435 DEBUG:teuthology.orchestra.run.smithi066:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:05.972 INFO:teuthology.orchestra.run.smithi066.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 12:10 /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:05.972 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:06.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 12:10 /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:06.415 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:06.479 DEBUG:teuthology.orchestra.run.smithi066:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:06.499 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T12:10:06.534 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 on all hosts... 2024-05-14T12:10:06.534 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T12:10:06.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T12:10:06.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T12:10:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T12:10:07.412 INFO:teuthology.orchestra.run.smithi066.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T12:10:07.719 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T12:10:51.284 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:10:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T12:10:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T12:10:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-05-14T12:10:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T12:10:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:10:51.285 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:10:57.009 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-14T12:10:57.010 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T12:10:57.010 INFO:teuthology.orchestra.run.smithi066.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T12:10:57.010 INFO:teuthology.orchestra.run.smithi066.stdout: "repo_digests": [ 2024-05-14T12:10:57.010 INFO:teuthology.orchestra.run.smithi066.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T12:10:57.010 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-05-14T12:10:57.010 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-14T12:11:06.346 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-14T12:11:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T12:11:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T12:11:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2024-05-14T12:11:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T12:11:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-05-14T12:11:06.346 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-14T12:11:06.371 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-05-14T12:11:06.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph 2024-05-14T12:11:06.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2024-05-14T12:11:06.534 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-05-14T12:11:06.627 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /etc/ceph 2024-05-14T12:11:06.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2024-05-14T12:11:06.681 INFO:tasks.cephadm:Writing seed config... 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-14T12:11:06.682 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-14T12:11:06.683 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-14T12:11:06.684 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-14T12:11:06.685 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-05-14T12:11:06.686 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:11:06.686 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-14T12:11:06.746 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e5959f02-11ea-11ef-bc98-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-14T12:11:06.746 DEBUG:teuthology.orchestra.run.smithi047:mon.a> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service 2024-05-14T12:11:06.792 DEBUG:teuthology.orchestra.run.smithi047:mgr.x> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.x.service 2024-05-14T12:11:06.838 INFO:tasks.cephadm:Bootstrapping... 2024-05-14T12:11:06.839 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 -v bootstrap --fsid e5959f02-11ea-11ef-bc98-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.47 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:11:07.113 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-05-14T12:11:07.113 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780', '-v', 'bootstrap', '--fsid', 'e5959f02-11ea-11ef-bc98-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.47', '--skip-admin-label'] 2024-05-14T12:11:07.114 INFO:teuthology.orchestra.run.smithi047.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-14T12:11:07.114 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying podman|docker is present... 2024-05-14T12:11:07.172 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.0.2 2024-05-14T12:11:07.173 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying lvm2 is present... 2024-05-14T12:11:07.173 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying time synchronization is in place... 2024-05-14T12:11:07.189 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-14T12:11:07.189 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-14T12:11:07.204 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-14T12:11:07.204 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-05-14T12:11:07.222 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-05-14T12:11:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-05-14T12:11:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-05-14T12:11:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:Repeating the final host check... 2024-05-14T12:11:07.298 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.0.2 2024-05-14T12:11:07.299 INFO:teuthology.orchestra.run.smithi047.stdout:podman (/bin/podman) version 5.0.2 is present 2024-05-14T12:11:07.299 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl is present 2024-05-14T12:11:07.299 INFO:teuthology.orchestra.run.smithi047.stdout:lvcreate is present 2024-05-14T12:11:07.316 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-14T12:11:07.316 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-14T12:11:07.338 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-14T12:11:07.338 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-05-14T12:11:07.364 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-05-14T12:11:07.387 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-05-14T12:11:07.387 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-05-14T12:11:07.387 INFO:teuthology.orchestra.run.smithi047.stdout:Host looks OK 2024-05-14T12:11:07.387 INFO:teuthology.orchestra.run.smithi047.stdout:Cluster fsid: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:07.388 INFO:teuthology.orchestra.run.smithi047.stdout:Acquiring lock 140389949128656 on /run/cephadm/e5959f02-11ea-11ef-bc98-c7b262605968.lock 2024-05-14T12:11:07.389 INFO:teuthology.orchestra.run.smithi047.stdout:Lock 140389949128656 acquired on /run/cephadm/e5959f02-11ea-11ef-bc98-c7b262605968.lock 2024-05-14T12:11:07.390 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 3300 ... 2024-05-14T12:11:07.391 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 6789 ... 2024-05-14T12:11:07.392 INFO:teuthology.orchestra.run.smithi047.stdout:Base mon IP(s) is [172.21.15.47:3300, 172.21.15.47:6789], mon addrv is [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-05-14T12:11:07.407 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.47 metric 100 2024-05-14T12:11:07.407 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.47 metric 100 2024-05-14T12:11:07.420 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-14T12:11:07.421 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-14T12:11:07.421 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-14T12:11:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-14T12:11:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-14T12:11:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-14T12:11:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-14T12:11:07.434 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-05-14T12:11:07.434 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-14T12:11:07.436 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-05-14T12:11:07.437 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-05-14T12:11:07.437 INFO:teuthology.orchestra.run.smithi047.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-14T12:11:07.440 INFO:teuthology.orchestra.run.smithi047.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-14T12:11:07.443 INFO:teuthology.orchestra.run.smithi047.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T12:11:08.066 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 2024-05-14T12:11:08.066 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T12:11:08.066 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Getting image source signatures 2024-05-14T12:11:08.066 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:d2511a189d36a438cd7259d98515a840197dc63bdcef8f78efcfd8f43785c919 2024-05-14T12:11:08.066 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-14T12:11:08.067 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying config sha256:bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 2024-05-14T12:11:08.067 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-14T12:11:12.845 INFO:teuthology.orchestra.run.smithi047.stdout:ceph: stdout ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T12:11:12.846 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph version: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T12:11:12.846 INFO:teuthology.orchestra.run.smithi047.stdout:Extracting ceph user uid/gid from container image... 2024-05-14T12:11:20.210 INFO:teuthology.orchestra.run.smithi047.stdout:stat: stdout 167 167 2024-05-14T12:11:20.210 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial keys... 2024-05-14T12:11:21.398 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQDoVENmjwkyLxAA1qXHowndCir7NSk/1EWp8g== 2024-05-14T12:11:22.548 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQDpVENm/bJZOBAAJI+olNisjk3RR1IhdYcRUQ== 2024-05-14T12:11:23.761 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQDrVENmExlnCBAALT8HMax8C7SUchbRmKpilA== 2024-05-14T12:11:23.764 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial monmap... 2024-05-14T12:11:24.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-14T12:11:24.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-14T12:11:24.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:24.898 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-14T12:11:24.898 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool for a [v2:172.21.15.47:3300,v1:172.21.15.47:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-14T12:11:24.898 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-05-14T12:11:24.899 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: set fsid to e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:24.899 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-14T12:11:24.899 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:11:24.899 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mon... 2024-05-14T12:11:26.087 INFO:teuthology.orchestra.run.smithi047.stdout:create mon.a on 2024-05-14T12:11:26.443 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-14T12:11:26.688 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e5959f02-11ea-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-e5959f02-11ea-11ef-bc98-c7b262605968.target. 2024-05-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e5959f02-11ea-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-e5959f02-11ea-11ef-bc98-c7b262605968.target. 2024-05-14T12:11:27.353 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a 2024-05-14T12:11:27.353 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service: Unit ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service not loaded. 2024-05-14T12:11:27.658 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e5959f02-11ea-11ef-bc98-c7b262605968.target.wants/ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service → /etc/systemd/system/ceph-e5959f02-11ea-11ef-bc98-c7b262605968@.service. 2024-05-14T12:11:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:28 smithi047 podman[30869]: 2024-05-14 12:11:28.085741113 +0000 UTC m=+0.143105682 container create 8ca2b9884077dcb8f458b7d4a5a310124476c73bbab4071ec7c5e2d6c4d20bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-14T12:11:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:28 smithi047 podman[30869]: 2024-05-14 12:11:28.339252736 +0000 UTC m=+0.396617339 container init 8ca2b9884077dcb8f458b7d4a5a310124476c73bbab4071ec7c5e2d6c4d20bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-05-14T12:11:28.514 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T12:11:28.514 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-05-14T12:11:28.530 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T12:11:28.530 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-05-14T12:11:28.530 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-05-14T12:11:28.530 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-05-14T12:11:28.531 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon to start... 2024-05-14T12:11:28.531 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon... 2024-05-14T12:11:28.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:28 smithi047 podman[30869]: 2024-05-14 12:11:28.35195729 +0000 UTC m=+0.409321861 container start 8ca2b9884077dcb8f458b7d4a5a310124476c73bbab4071ec7c5e2d6c4d20bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:11:28.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:28 smithi047 bash[30869]: 8ca2b9884077dcb8f458b7d4a5a310124476c73bbab4071ec7c5e2d6c4d20bbe 2024-05-14T12:11:28.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:28 smithi047 systemd[1]: Started Ceph mon.a for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:11:28.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:28 smithi047 ceph-mon[30888]: mkfs e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:28.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:28 smithi047 ceph-mon[30888]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: monmap epoch 1 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: last_changed 2024-05-14T12:11:24.350717+0000 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: min_mon_release 19 (squid) 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: election_strategy: 1 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: fsmap 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: osdmap e1: 0 total, 0 up, 0 in 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: mgrmap e1: no daemons active 2024-05-14T12:11:29.775 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:29 smithi047 ceph-mon[30888]: from='client.? 172.21.15.47:0/4190725224' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-14T12:11:30.058 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout cluster: 2024-05-14T12:11:30.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout id: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:30.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-14T12:11:30.059 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:30.060 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout services: 2024-05-14T12:11:30.060 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.819691s) 2024-05-14T12:11:30.061 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-14T12:11:30.061 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-14T12:11:30.061 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:30.061 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout data: 2024-05-14T12:11:30.062 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-14T12:11:30.062 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-14T12:11:30.062 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-14T12:11:30.062 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pgs: 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.230+0000 7f041be00700 1 Processor -- start 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.230+0000 7f041be00700 1 -- start start 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.231+0000 7f041be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c110630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.231+0000 7f041be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f041c110c20 con 0x7f041c110220 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.232+0000 7f041aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.232+0000 7f041aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c110630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54512/0 (socket says 172.21.15.47:54512) 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.232+0000 7f041aa00700 1 -- 172.21.15.47:0/2846682883 learned_addr learned my addr 172.21.15.47:0/2846682883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.232+0000 7f041aa00700 1 -- 172.21.15.47:0/2846682883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c111300 con 0x7f041c110220 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.233+0000 7f041aa00700 1 --2- 172.21.15.47:0/2846682883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c110630 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f040c0098a0 tx=0x7f040c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edfa2d3dcf8f532 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.233+0000 7f041a000700 1 -- 172.21.15.47:0/2846682883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c004160 con 0x7f041c110220 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.233+0000 7f041a000700 1 -- 172.21.15.47:0/2846682883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c004300 con 0x7f041c110220 2024-05-14T12:11:30.064 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.233+0000 7f041a000700 1 -- 172.21.15.47:0/2846682883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0036a0 con 0x7f041c110220 2024-05-14T12:11:30.065 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.234+0000 7f041be00700 1 -- 172.21.15.47:0/2846682883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 msgr2=0x7f041c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:30.065 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.234+0000 7f041be00700 1 --2- 172.21.15.47:0/2846682883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c110630 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f040c0098a0 tx=0x7f040c009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:30.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.234+0000 7f041be00700 1 -- 172.21.15.47:0/2846682883 shutdown_connections 2024-05-14T12:11:30.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.234+0000 7f041be00700 1 --2- 172.21.15.47:0/2846682883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c110630 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:30.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.234+0000 7f041be00700 1 -- 172.21.15.47:0/2846682883 >> 172.21.15.47:0/2846682883 conn(0x7f041c07f400 msgr2=0x7f041c081820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:30.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.235+0000 7f041be00700 1 -- 172.21.15.47:0/2846682883 shutdown_connections 2024-05-14T12:11:30.068 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.235+0000 7f041be00700 1 -- 172.21.15.47:0/2846682883 wait complete. 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.236+0000 7f041be00700 1 Processor -- start 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.236+0000 7f041be00700 1 -- start start 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.237+0000 7f041be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c1a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.237+0000 7f041be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f041c111830 con 0x7f041c110220 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.237+0000 7f041aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c1a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.237+0000 7f041aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c1a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54526/0 (socket says 172.21.15.47:54526) 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.237+0000 7f041aa00700 1 -- 172.21.15.47:0/4190725224 learned_addr learned my addr 172.21.15.47:0/4190725224 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.237+0000 7f041aa00700 1 -- 172.21.15.47:0/4190725224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c1a41e0 con 0x7f041c110220 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.238+0000 7f041aa00700 1 --2- 172.21.15.47:0/4190725224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c1a3ca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c00 tx=0x7f040c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.238+0000 7f0413e00700 1 -- 172.21.15.47:0/4190725224 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c003db0 con 0x7f041c110220 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.238+0000 7f0413e00700 1 -- 172.21.15.47:0/4190725224 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c011630 con 0x7f041c110220 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.238+0000 7f0413e00700 1 -- 172.21.15.47:0/4190725224 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c011950 con 0x7f041c110220 2024-05-14T12:11:30.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.238+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c1a4470 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.238+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c1a7080 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.239+0000 7f0413e00700 1 -- 172.21.15.47:0/4190725224 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f040c011af0 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.239+0000 7f0413e00700 1 -- 172.21.15.47:0/4190725224 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f040c01c450 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.240+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c064e20 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.243+0000 7f0413e00700 1 -- 172.21.15.47:0/4190725224 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f040c032020 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.324+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f041c02e8f0 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.325+0000 7f0413e00700 1 -- 172.21.15.47:0/4190725224 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f040c004260 con 0x7f041c110220 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.326+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 msgr2=0x7f041c1a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.326+0000 7f041be00700 1 --2- 172.21.15.47:0/4190725224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c1a3ca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c00 tx=0x7f040c004750 comp rx=0 tx=0).stop 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.326+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 shutdown_connections 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.326+0000 7f041be00700 1 --2- 172.21.15.47:0/4190725224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f041c110220 0x7f041c1a3ca0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.326+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 >> 172.21.15.47:0/4190725224 conn(0x7f041c07f400 msgr2=0x7f041c19a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.326+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 shutdown_connections 2024-05-14T12:11:30.070 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:29.327+0000 7f041be00700 1 -- 172.21.15.47:0/4190725224 wait complete. 2024-05-14T12:11:30.071 INFO:teuthology.orchestra.run.smithi047.stdout:mon is available 2024-05-14T12:11:30.071 INFO:teuthology.orchestra.run.smithi047.stdout:Assimilating anything we can from ceph.conf... 2024-05-14T12:11:30.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:30 smithi047 ceph-mon[30888]: from='client.? 172.21.15.47:0/3421830463' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-14T12:11:30.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:30 smithi047 ceph-mon[30888]: from='client.? 172.21.15.47:0/3421830463' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:31.471 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-14T12:11:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-14T12:11:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-05-14T12:11:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-14T12:11:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-05-14T12:11:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-14T12:11:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-14T12:11:31.477 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-14T12:11:31.477 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-14T12:11:31.477 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-14T12:11:31.477 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.722+0000 7f7318400700 1 Processor -- start 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.722+0000 7f7318400700 1 -- start start 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.723+0000 7f7318400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731010c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.723+0000 7f7318400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f731010c930 con 0x7f731010bed0 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.723+0000 7f7315a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731010c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.724+0000 7f7315a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731010c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54540/0 (socket says 172.21.15.47:54540) 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.724+0000 7f7315a00700 1 -- 172.21.15.47:0/504289945 learned_addr learned my addr 172.21.15.47:0/504289945 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.724+0000 7f7315a00700 1 -- 172.21.15.47:0/504289945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731010d050 con 0x7f731010bed0 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.724+0000 7f7315a00700 1 --2- 172.21.15.47:0/504289945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731010c320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f73040098a0 tx=0x7f7304009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdd8659d1c9a8d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.724+0000 7f730fe00700 1 -- 172.21.15.47:0/504289945 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7304004160 con 0x7f731010bed0 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.725+0000 7f730fe00700 1 -- 172.21.15.47:0/504289945 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7304004300 con 0x7f731010bed0 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.725+0000 7f730fe00700 1 -- 172.21.15.47:0/504289945 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040036a0 con 0x7f731010bed0 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.725+0000 7f7318400700 1 -- 172.21.15.47:0/504289945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 msgr2=0x7f731010c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:31.478 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.725+0000 7f7318400700 1 --2- 172.21.15.47:0/504289945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731010c320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f73040098a0 tx=0x7f7304009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.725+0000 7f7318400700 1 -- 172.21.15.47:0/504289945 shutdown_connections 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.725+0000 7f7318400700 1 --2- 172.21.15.47:0/504289945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731010c320 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.725+0000 7f7318400700 1 -- 172.21.15.47:0/504289945 >> 172.21.15.47:0/504289945 conn(0x7f7310107840 msgr2=0x7f7310109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.726+0000 7f7318400700 1 -- 172.21.15.47:0/504289945 shutdown_connections 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.726+0000 7f7318400700 1 -- 172.21.15.47:0/504289945 wait complete. 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.727+0000 7f7318400700 1 Processor -- start 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.727+0000 7f7318400700 1 -- start start 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.727+0000 7f7318400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.727+0000 7f7318400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f731010d580 con 0x7f731010bed0 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.728+0000 7f7315a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.728+0000 7f7315a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731019fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54548/0 (socket says 172.21.15.47:54548) 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.728+0000 7f7315a00700 1 -- 172.21.15.47:0/3421830463 learned_addr learned my addr 172.21.15.47:0/3421830463 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:31.479 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.728+0000 7f7315a00700 1 -- 172.21.15.47:0/3421830463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731019ff80 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f7315a00700 1 --2- 172.21.15.47:0/3421830463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731019fa40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7304000c00 tx=0x7f7304004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7304003db0 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7304011630 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73101a0210 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7304011950 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73101a2e20 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f730401a460 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.729+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f730401b780 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.730+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7310064e20 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.734+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7304031020 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.811+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f731002ea30 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.816+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+517 (secure 0 0 0) 0x7f731002ea30 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.818+0000 7f730e000700 1 -- 172.21.15.47:0/3421830463 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f730401a890 con 0x7f731010bed0 2024-05-14T12:11:31.480 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.819+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 msgr2=0x7f731019fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:31.481 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.819+0000 7f7318400700 1 --2- 172.21.15.47:0/3421830463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731019fa40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7304000c00 tx=0x7f7304004750 comp rx=0 tx=0).stop 2024-05-14T12:11:31.481 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.820+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 shutdown_connections 2024-05-14T12:11:31.481 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.820+0000 7f7318400700 1 --2- 172.21.15.47:0/3421830463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f731010bed0 0x7f731019fa40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:31.481 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.820+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 >> 172.21.15.47:0/3421830463 conn(0x7f7310107840 msgr2=0x7f73101960a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:31.481 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.820+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 shutdown_connections 2024-05-14T12:11:31.481 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:30.820+0000 7f7318400700 1 -- 172.21.15.47:0/3421830463 wait complete. 2024-05-14T12:11:31.481 INFO:teuthology.orchestra.run.smithi047.stdout:Generating new minimal ceph.conf... 2024-05-14T12:11:32.600 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:32 smithi047 ceph-mon[30888]: from='client.? 172.21.15.47:0/864757331' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:11:32.853 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.189+0000 7f2d06e00700 1 Processor -- start 2024-05-14T12:11:32.853 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.189+0000 7f2d06e00700 1 -- start start 2024-05-14T12:11:32.853 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.190+0000 7f2d06e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0010a8c0 0x7f2d0010cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:32.853 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.190+0000 7f2d06e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0007cdc0 con 0x7f2d0010a8c0 2024-05-14T12:11:32.853 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.190+0000 7f2cffe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0010a8c0 0x7f2d0010cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:32.854 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.190+0000 7f2cffe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0010a8c0 0x7f2d0010cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54552/0 (socket says 172.21.15.47:54552) 2024-05-14T12:11:32.854 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.190+0000 7f2cffe00700 1 -- 172.21.15.47:0/1048149777 learned_addr learned my addr 172.21.15.47:0/1048149777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:32.854 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.191+0000 7f2cffe00700 1 -- 172.21.15.47:0/1048149777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0010d220 con 0x7f2d0010a8c0 2024-05-14T12:11:32.854 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.191+0000 7f2cffe00700 1 --2- 172.21.15.47:0/1048149777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0010a8c0 0x7f2d0010cce0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00098a0 tx=0x7f2cf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913a691fdeb023c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.191+0000 7f2cff400700 1 -- 172.21.15.47:0/1048149777 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf0004160 con 0x7f2d0010a8c0 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.191+0000 7f2cff400700 1 -- 172.21.15.47:0/1048149777 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2cf0004300 con 0x7f2d0010a8c0 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.191+0000 7f2cff400700 1 -- 172.21.15.47:0/1048149777 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf0011af0 con 0x7f2d0010a8c0 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.192+0000 7f2d06e00700 1 -- 172.21.15.47:0/1048149777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0010a8c0 msgr2=0x7f2d0010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.192+0000 7f2d06e00700 1 --2- 172.21.15.47:0/1048149777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0010a8c0 0x7f2d0010cce0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00098a0 tx=0x7f2cf0009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.193+0000 7f2d06e00700 1 -- 172.21.15.47:0/1048149777 shutdown_connections 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.193+0000 7f2d06e00700 1 --2- 172.21.15.47:0/1048149777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0010a8c0 0x7f2d0010cce0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.193+0000 7f2d06e00700 1 -- 172.21.15.47:0/1048149777 >> 172.21.15.47:0/1048149777 conn(0x7f2d00104440 msgr2=0x7f2d00106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.193+0000 7f2d06e00700 1 -- 172.21.15.47:0/1048149777 shutdown_connections 2024-05-14T12:11:32.858 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.193+0000 7f2d06e00700 1 -- 172.21.15.47:0/1048149777 wait complete. 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.194+0000 7f2d06e00700 1 Processor -- start 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.195+0000 7f2d06e00700 1 -- start start 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.195+0000 7f2d06e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0019e240 0x7f2d0019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.195+0000 7f2d06e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0010e120 con 0x7f2d0019e240 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.195+0000 7f2cffe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0019e240 0x7f2d0019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.195+0000 7f2cffe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0019e240 0x7f2d0019e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54564/0 (socket says 172.21.15.47:54564) 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.195+0000 7f2cffe00700 1 -- 172.21.15.47:0/864757331 learned_addr learned my addr 172.21.15.47:0/864757331 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.196+0000 7f2cffe00700 1 -- 172.21.15.47:0/864757331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0019ebf0 con 0x7f2d0019e240 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.196+0000 7f2cffe00700 1 --2- 172.21.15.47:0/864757331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0019e240 0x7f2d0019e670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0000c00 tx=0x7f2cf0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.196+0000 7f2cfd600700 1 -- 172.21.15.47:0/864757331 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf0011bb0 con 0x7f2d0019e240 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.197+0000 7f2cfd600700 1 -- 172.21.15.47:0/864757331 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2cf0003b30 con 0x7f2d0019e240 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.197+0000 7f2cfd600700 1 -- 172.21.15.47:0/864757331 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cf001ade0 con 0x7f2d0019e240 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.197+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0019ee80 con 0x7f2d0019e240 2024-05-14T12:11:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.197+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d001a19b0 con 0x7f2d0019e240 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.197+0000 7f2cfd600700 1 -- 172.21.15.47:0/864757331 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2cf002d7d0 con 0x7f2d0019e240 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.197+0000 7f2cfd600700 1 -- 172.21.15.47:0/864757331 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2cf0024430 con 0x7f2d0019e240 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.198+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d00064e20 con 0x7f2d0019e240 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.201+0000 7f2cfd600700 1 -- 172.21.15.47:0/864757331 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2cf0043ec0 con 0x7f2d0019e240 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.279+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f2d0002e5f0 con 0x7f2d0019e240 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.281+0000 7f2cfd600700 1 -- 172.21.15.47:0/864757331 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f2cf0032030 con 0x7f2d0019e240 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.282+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0019e240 msgr2=0x7f2d0019e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.282+0000 7f2d06e00700 1 --2- 172.21.15.47:0/864757331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0019e240 0x7f2d0019e670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0000c00 tx=0x7f2cf0004260 comp rx=0 tx=0).stop 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.282+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 shutdown_connections 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.282+0000 7f2d06e00700 1 --2- 172.21.15.47:0/864757331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d0019e240 0x7f2d0019e670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.282+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 >> 172.21.15.47:0/864757331 conn(0x7f2d00104440 msgr2=0x7f2d00105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.282+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 shutdown_connections 2024-05-14T12:11:32.860 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:32.282+0000 7f2d06e00700 1 -- 172.21.15.47:0/864757331 wait complete. 2024-05-14T12:11:32.861 INFO:teuthology.orchestra.run.smithi047.stdout:Restarting the monitor... 2024-05-14T12:11:33.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:32 smithi047 systemd[1]: Stopping Ceph mon.a for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:11:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:33 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a[30884]: 2024-05-14T12:11:33.307+0000 7f9178200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:11:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:33 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a[30884]: 2024-05-14T12:11:33.307+0000 7f9178200700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-14T12:11:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:33 smithi047 podman[31129]: 2024-05-14 12:11:33.484149003 +0000 UTC m=+0.307554157 container died 8ca2b9884077dcb8f458b7d4a5a310124476c73bbab4071ec7c5e2d6c4d20bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-14T12:11:34.017 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:33 smithi047 podman[31129]: 2024-05-14 12:11:33.858758364 +0000 UTC m=+0.682163537 container cleanup 8ca2b9884077dcb8f458b7d4a5a310124476c73bbab4071ec7c5e2d6c4d20bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-14T12:11:34.018 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:33 smithi047 bash[31129]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a 2024-05-14T12:11:34.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:34 smithi047 podman[31142]: 2024-05-14 12:11:34.017794734 +0000 UTC m=+0.510890085 container remove 8ca2b9884077dcb8f458b7d4a5a310124476c73bbab4071ec7c5e2d6c4d20bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-14T12:11:34.890 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:34 smithi047 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-14T12:11:34.890 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:34 smithi047 systemd[1]: Stopped Ceph mon.a for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:11:34.890 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:34 smithi047 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service: Consumed 2.035s CPU time. 2024-05-14T12:11:34.890 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:34 smithi047 systemd[1]: Starting Ceph mon.a for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:11:35.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:34 smithi047 podman[31235]: 2024-05-14 12:11:34.797516413 +0000 UTC m=+0.039860971 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:11:35.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:34 smithi047 podman[31235]: 2024-05-14 12:11:34.893422875 +0000 UTC m=+0.135767440 container create cfed7abc41f9c67624eec45431a5b15dbcc83bba5f31f470f53d981d81b30698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:11:35.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 podman[31235]: 2024-05-14 12:11:35.113362401 +0000 UTC m=+0.355706949 container init cfed7abc41f9c67624eec45431a5b15dbcc83bba5f31f470f53d981d81b30698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:11:35.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 podman[31235]: 2024-05-14 12:11:35.124747135 +0000 UTC m=+0.367091688 container start cfed7abc41f9c67624eec45431a5b15dbcc83bba5f31f470f53d981d81b30698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:11:35.208 INFO:teuthology.orchestra.run.smithi047.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-14T12:11:35.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 bash[31235]: cfed7abc41f9c67624eec45431a5b15dbcc83bba5f31f470f53d981d81b30698 2024-05-14T12:11:35.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 systemd[1]: Started Ceph mon.a for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:11:35.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: set uid:gid to 167:167 (ceph:ceph) 2024-05-14T12:11:35.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev), process ceph-mon, pid 2 2024-05-14T12:11:35.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: pidfile_write: ignore empty --pid-file 2024-05-14T12:11:35.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: load: jerasure load: lrc 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: RocksDB version: 7.9.2 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Git sha 0 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Compile date 2024-05-09 05:50:40 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: DB SUMMARY 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: DB Session ID: L2CMDQYZF1EQ5PA9C671 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: CURRENT file: CURRENT 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: IDENTITY file: IDENTITY 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105420 ; 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.error_if_exists: 0 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.create_if_missing: 0 2024-05-14T12:11:35.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.paranoid_checks: 1 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.env: 0x55ffb1b7c500 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.fs: PosixFileSystem 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.info_log: 0x55ffc15cc060 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_file_opening_threads: 16 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.statistics: (nil) 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.use_fsync: 0 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_log_file_size: 0 2024-05-14T12:11:35.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.keep_log_file_num: 1000 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.recycle_log_file_num: 0 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.allow_fallocate: 1 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.allow_mmap_reads: 0 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.allow_mmap_writes: 0 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.use_direct_reads: 0 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.create_missing_column_families: 0 2024-05-14T12:11:35.490 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.db_log_dir: 2024-05-14T12:11:35.491 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.wal_dir: 2024-05-14T12:11:35.491 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-14T12:11:35.491 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-14T12:11:35.491 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.advise_random_on_open: 1 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.db_write_buffer_size: 0 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.write_buffer_manager: 0x55ffc14968c0 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-14T12:11:35.492 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.rate_limiter: (nil) 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.wal_recovery_mode: 2 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.enable_thread_tracking: 0 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.enable_pipelined_write: 0 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.unordered_write: 0 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.row_cache: None 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.wal_filter: None 2024-05-14T12:11:35.493 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.allow_ingest_behind: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.two_write_queues: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.manual_wal_flush: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.wal_compression: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.atomic_flush: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.log_readahead_size: 0 2024-05-14T12:11:35.494 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.best_efforts_recovery: 0 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.allow_data_in_errors: 0 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.db_host_id: __hostname__ 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_background_jobs: 2 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_background_compactions: -1 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_subcompactions: 1 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-14T12:11:35.495 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_total_wal_size: 0 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_open_files: -1 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bytes_per_sync: 0 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_readahead_size: 0 2024-05-14T12:11:35.496 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_background_flushes: -1 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Compression algorithms supported: 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kZSTD supported: 0 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kXpressCompression supported: 0 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kLZ4HCCompression supported: 1 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kZlibCompression supported: 1 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kSnappyCompression supported: 1 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kLZ4Compression supported: 1 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: kBZip2Compression supported: 0 2024-05-14T12:11:35.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.merge_operator: 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_filter: None 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_filter_factory: None 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.sst_partitioner_factory: None 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-14T12:11:35.498 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ffc15cc220) 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_type: 0 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_index_type: 0 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_shortening: 1 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-14T12:11:35.500 INFO:journalctl@ceph.mon.a.smithi047.stdout: checksum: 4 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: no_block_cache: 0 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache: 0x55ffc14c91f0 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_options: 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: capacity : 536870912 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_shard_bits : 4 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: strict_capacity_limit : 0 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_compressed: (nil) 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: persistent_cache: (nil) 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size: 4096 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size_deviation: 10 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_restart_interval: 16 2024-05-14T12:11:35.501 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_block_restart_interval: 1 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: metadata_block_size: 4096 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: partition_filters: 0 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: use_delta_encoding: 1 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: filter_policy: bloomfilter 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: whole_key_filtering: 1 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: verify_compression: 0 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: format_version: 5 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_index_compression: 1 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_align: 0 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: max_auto_readahead_size: 262144 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: prepopulate_block_cache: 0 2024-05-14T12:11:35.502 INFO:journalctl@ceph.mon.a.smithi047.stdout: initial_auto_readahead_size: 8192 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.write_buffer_size: 33554432 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_write_buffer_number: 2 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression: NoCompression 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression: Disabled 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.prefix_extractor: nullptr 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.num_levels: 7 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-14T12:11:35.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.level: 32767 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.strategy: 0 2024-05-14T12:11:35.504 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.enabled: false 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.target_file_size_base: 67108864 2024-05-14T12:11:35.505 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-14T12:11:35.506 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.arena_block_size: 1048576 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.disable_auto_compactions: 0 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-14T12:11:35.507 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.inplace_update_support: 0 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.bloom_locality: 0 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.max_successive_merges: 0 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-14T12:11:35.508 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.paranoid_file_checks: 0 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.force_consistency_checks: 1 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.report_bg_io_stats: 0 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.ttl: 2592000 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.enable_blob_files: false 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.min_blob_size: 0 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.blob_file_size: 268435456 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-14T12:11:35.509 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.blob_file_starting_level: 0 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6112a21d-bd31-48a7-8591-da39ec86aacc 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715688695260095, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715688695263024, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100541, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98425, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14270, "raw_average_key_size": 49, "raw_value_size": 90665, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715688695, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6112a21d-bd31-48a7-8591-da39ec86aacc", "db_session_id": "L2CMDQYZF1EQ5PA9C671", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715688695263316, "job": 1, "event": "recovery_finished"} 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ffc14adc00 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: DB pointer 0x55ffc62a0000 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-14T12:11:35.510 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** DB Stats ** 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: L0 2/0 100.04 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 61.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-14T12:11:35.511 INFO:journalctl@ceph.mon.a.smithi047.stdout: Sum 2/0 100.04 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 61.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 61.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 61.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-14T12:11:35.512 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative compaction: 0.00 GB write, 10.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval compaction: 0.00 GB write, 10.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache BinnedLRUCache@0x55ffc14c91f0#2 capacity: 512.00 MB usage: 1.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.03 KB,0.000196695%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: starting mon.a rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???) e1 preinit fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???).mds e1 new map 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???).mds e1 print_map 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: e1 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T12:11:35.513 INFO:journalctl@ceph.mon.a.smithi047.stdout: legacy client fscid: -1 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout: No filesystems configured 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: monmap epoch 1 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: last_changed 2024-05-14T12:11:24.350717+0000 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: min_mon_release 19 (squid) 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: election_strategy: 1 2024-05-14T12:11:35.514 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:11:35.515 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: fsmap 2024-05-14T12:11:35.515 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: osdmap e1: 0 total, 0 up, 0 in 2024-05-14T12:11:35.515 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:35 smithi047 ceph-mon[31254]: mgrmap e1: no daemons active 2024-05-14T12:11:36.654 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.908+0000 7f9baea00700 1 Processor -- start 2024-05-14T12:11:36.654 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.909+0000 7f9baea00700 1 -- start start 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.909+0000 7f9baea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba807d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.909+0000 7f9baea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba807d760 con 0x7f9ba807ed50 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.910+0000 7f9bad600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba807d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.910+0000 7f9bad600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba807d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54572/0 (socket says 172.21.15.47:54572) 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.910+0000 7f9bad600700 1 -- 172.21.15.47:0/1567551656 learned_addr learned my addr 172.21.15.47:0/1567551656 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.911+0000 7f9bad600700 1 -- 172.21.15.47:0/1567551656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba807d8e0 con 0x7f9ba807ed50 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.912+0000 7f9bad600700 1 --2- 172.21.15.47:0/1567551656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba807d220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5941bbd870568d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:36.655 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.912+0000 7f9ba7e00700 1 -- 172.21.15.47:0/1567551656 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c004160 con 0x7f9ba807ed50 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.912+0000 7f9ba7e00700 1 -- 172.21.15.47:0/1567551656 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9b9c004300 con 0x7f9ba807ed50 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.912+0000 7f9ba7e00700 1 -- 172.21.15.47:0/1567551656 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c011af0 con 0x7f9ba807ed50 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.913+0000 7f9baea00700 1 -- 172.21.15.47:0/1567551656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 msgr2=0x7f9ba807d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.913+0000 7f9baea00700 1 --2- 172.21.15.47:0/1567551656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba807d220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.913+0000 7f9baea00700 1 -- 172.21.15.47:0/1567551656 shutdown_connections 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.913+0000 7f9baea00700 1 --2- 172.21.15.47:0/1567551656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba807d220 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.913+0000 7f9baea00700 1 -- 172.21.15.47:0/1567551656 >> 172.21.15.47:0/1567551656 conn(0x7f9ba81052a0 msgr2=0x7f9ba81076f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.914+0000 7f9baea00700 1 -- 172.21.15.47:0/1567551656 shutdown_connections 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.914+0000 7f9baea00700 1 -- 172.21.15.47:0/1567551656 wait complete. 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.915+0000 7f9baea00700 1 Processor -- start 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.915+0000 7f9baea00700 1 -- start start 2024-05-14T12:11:36.657 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.915+0000 7f9baea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba81a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:36.658 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.915+0000 7f9baea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8110160 con 0x7f9ba807ed50 2024-05-14T12:11:36.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.916+0000 7f9bad600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba81a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:36.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.916+0000 7f9bad600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba81a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54576/0 (socket says 172.21.15.47:54576) 2024-05-14T12:11:36.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.916+0000 7f9bad600700 1 -- 172.21.15.47:0/3388787711 learned_addr learned my addr 172.21.15.47:0/3388787711 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:36.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.916+0000 7f9bad600700 1 -- 172.21.15.47:0/3388787711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba81a0720 con 0x7f9ba807ed50 2024-05-14T12:11:36.659 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.917+0000 7f9bad600700 1 --2- 172.21.15.47:0/3388787711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba81a01e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009fb0 tx=0x7f9b9c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.917+0000 7f9ba6000700 1 -- 172.21.15.47:0/3388787711 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c011bc0 con 0x7f9ba807ed50 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.917+0000 7f9ba6000700 1 -- 172.21.15.47:0/3388787711 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9b9c024440 con 0x7f9ba807ed50 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.917+0000 7f9ba6000700 1 -- 172.21.15.47:0/3388787711 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c01a5c0 con 0x7f9ba807ed50 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.917+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba81a09b0 con 0x7f9ba807ed50 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.917+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba81a35c0 con 0x7f9ba807ed50 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.917+0000 7f9ba6000700 1 -- 172.21.15.47:0/3388787711 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9b9c01ac10 con 0x7f9ba807ed50 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.918+0000 7f9ba6000700 1 -- 172.21.15.47:0/3388787711 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9b9c019700 con 0x7f9ba807ed50 2024-05-14T12:11:36.660 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.918+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba8064e20 con 0x7f9ba807ed50 2024-05-14T12:11:36.661 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.922+0000 7f9ba6000700 1 -- 172.21.15.47:0/3388787711 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9b9c02dda0 con 0x7f9ba807ed50 2024-05-14T12:11:36.661 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:35.998+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f9ba81a38b0 con 0x7f9ba807ed50 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.002+0000 7f9ba6000700 1 -- 172.21.15.47:0/3388787711 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f9b9c0245f0 con 0x7f9ba807ed50 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.003+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 msgr2=0x7f9ba81a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.003+0000 7f9baea00700 1 --2- 172.21.15.47:0/3388787711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba81a01e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009fb0 tx=0x7f9b9c011890 comp rx=0 tx=0).stop 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.003+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 shutdown_connections 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.003+0000 7f9baea00700 1 --2- 172.21.15.47:0/3388787711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ba807ed50 0x7f9ba81a01e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.003+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 >> 172.21.15.47:0/3388787711 conn(0x7f9ba81052a0 msgr2=0x7f9ba8106cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.003+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 shutdown_connections 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:36.003+0000 7f9baea00700 1 -- 172.21.15.47:0/3388787711 wait complete. 2024-05-14T12:11:36.662 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-14T12:11:36.691 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:11:36.692 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mgr... 2024-05-14T12:11:36.693 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-14T12:11:36.695 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-14T12:11:37.144 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.x 2024-05-14T12:11:37.144 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.x.service: Unit ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.x.service not loaded. 2024-05-14T12:11:37.404 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e5959f02-11ea-11ef-bc98-c7b262605968.target.wants/ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-e5959f02-11ea-11ef-bc98-c7b262605968@.service. 2024-05-14T12:11:37.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:37 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3388787711' entity='client.admin' 2024-05-14T12:11:37.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:37 smithi047 systemd[1]: Starting Ceph mgr.x for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:11:38.139 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:37 smithi047 podman[31464]: 2024-05-14 12:11:37.828086621 +0000 UTC m=+0.117873687 container create d74a48a5c6e7448d1901da42bddebd8819413d29c6f302c312f6010a18998520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-14T12:11:38.139 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:37 smithi047 podman[31464]: 2024-05-14 12:11:37.750531832 +0000 UTC m=+0.040318870 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:11:38.139 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:38 smithi047 podman[31464]: 2024-05-14 12:11:38.048152272 +0000 UTC m=+0.337939322 container init d74a48a5c6e7448d1901da42bddebd8819413d29c6f302c312f6010a18998520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True) 2024-05-14T12:11:38.139 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:38 smithi047 podman[31464]: 2024-05-14 12:11:38.059510554 +0000 UTC m=+0.349297617 container start d74a48a5c6e7448d1901da42bddebd8819413d29c6f302c312f6010a18998520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-14T12:11:38.140 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:38 smithi047 bash[31464]: d74a48a5c6e7448d1901da42bddebd8819413d29c6f302c312f6010a18998520 2024-05-14T12:11:38.180 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T12:11:38.180 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-05-14T12:11:38.200 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T12:11:38.200 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-05-14T12:11:38.200 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-05-14T12:11:38.200 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-05-14T12:11:38.218 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T12:11:38.218 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-05-14T12:11:38.234 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T12:11:38.234 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-05-14T12:11:38.234 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-05-14T12:11:38.234 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-14T12:11:38.234 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr to start... 2024-05-14T12:11:38.234 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr... 2024-05-14T12:11:38.390 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:38 smithi047 systemd[1]: Started Ceph mgr.x for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:11:38.666 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:38 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:38.388+0000 7ffa204cc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T12:11:38.666 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:38 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:38.664+0000 7ffa204cc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:11:38.984 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:38 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:38.805+0000 7ffa204cc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T12:11:39.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:39 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1866766506' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T12:11:39.703 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:39 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:39.244+0000 7ffa204cc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T12:11:39.703 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:39 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:39.366+0000 7ffa204cc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T12:11:39.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T12:11:39.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T12:11:39.715 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T12:11:39.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T12:11:39.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T12:11:39.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T12:11:39.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T12:11:28.508084+0000", 2024-05-14T12:11:39.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.895+0000 7fd73e600700 1 Processor -- start 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.895+0000 7fd73e600700 1 -- start start 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.896+0000 7fd73e600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73810a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.896+0000 7fd73e600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd73810a880 con 0x7fd738109e80 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.896+0000 7fd737400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73810a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.896+0000 7fd737400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73810a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44134/0 (socket says 172.21.15.47:44134) 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.896+0000 7fd737400700 1 -- 172.21.15.47:0/553754320 learned_addr learned my addr 172.21.15.47:0/553754320 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.897+0000 7fd737400700 1 -- 172.21.15.47:0/553754320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73810afb0 con 0x7fd738109e80 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.897+0000 7fd737400700 1 --2- 172.21.15.47:0/553754320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73810a290 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd7280098a0 tx=0x7fd728009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cd08deaed06d84 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd736000700 1 -- 172.21.15.47:0/553754320 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728004160 con 0x7fd738109e80 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd736000700 1 -- 172.21.15.47:0/553754320 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd728004300 con 0x7fd738109e80 2024-05-14T12:11:39.725 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd736000700 1 -- 172.21.15.47:0/553754320 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728011af0 con 0x7fd738109e80 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd73e600700 1 -- 172.21.15.47:0/553754320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 msgr2=0x7fd73810a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd73e600700 1 --2- 172.21.15.47:0/553754320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73810a290 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd7280098a0 tx=0x7fd728009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd73e600700 1 -- 172.21.15.47:0/553754320 shutdown_connections 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd73e600700 1 --2- 172.21.15.47:0/553754320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73810a290 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.898+0000 7fd73e600700 1 -- 172.21.15.47:0/553754320 >> 172.21.15.47:0/553754320 conn(0x7fd7381054e0 msgr2=0x7fd738107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.899+0000 7fd73e600700 1 -- 172.21.15.47:0/553754320 shutdown_connections 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.899+0000 7fd73e600700 1 -- 172.21.15.47:0/553754320 wait complete. 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.900+0000 7fd73e600700 1 Processor -- start 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.900+0000 7fd73e600700 1 -- start start 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.900+0000 7fd73e600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73807ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.900+0000 7fd73e600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd73810e1e0 con 0x7fd738109e80 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.901+0000 7fd737400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73807ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.901+0000 7fd737400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73807ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44138/0 (socket says 172.21.15.47:44138) 2024-05-14T12:11:39.726 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.901+0000 7fd737400700 1 -- 172.21.15.47:0/1866766506 learned_addr learned my addr 172.21.15.47:0/1866766506 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.901+0000 7fd737400700 1 -- 172.21.15.47:0/1866766506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73807ef90 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.901+0000 7fd737400700 1 --2- 172.21.15.47:0/1866766506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73807ea50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7280090e0 tx=0x7fd728011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.902+0000 7fd72fe00700 1 -- 172.21.15.47:0/1866766506 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7280039e0 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.902+0000 7fd72fe00700 1 -- 172.21.15.47:0/1866766506 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd728003b80 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.902+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73807d1e0 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.902+0000 7fd72fe00700 1 -- 172.21.15.47:0/1866766506 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728024690 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.902+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73807d6c0 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.903+0000 7fd72fe00700 1 -- 172.21.15.47:0/1866766506 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd728022020 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.903+0000 7fd72fe00700 1 -- 172.21.15.47:0/1866766506 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd72802dbe0 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.903+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd738064e20 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.906+0000 7fd72fe00700 1 -- 172.21.15.47:0/1866766506 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd728043ec0 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.986+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd73807d940 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.987+0000 7fd72fe00700 1 -- 172.21.15.47:0/1866766506 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fd728032020 con 0x7fd738109e80 2024-05-14T12:11:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.989+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 msgr2=0x7fd73807ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:39.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.989+0000 7fd73e600700 1 --2- 172.21.15.47:0/1866766506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73807ea50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7280090e0 tx=0x7fd728011940 comp rx=0 tx=0).stop 2024-05-14T12:11:39.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.989+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 shutdown_connections 2024-05-14T12:11:39.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.989+0000 7fd73e600700 1 --2- 172.21.15.47:0/1866766506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd738109e80 0x7fd73807ea50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:39.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.989+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 >> 172.21.15.47:0/1866766506 conn(0x7fd7381054e0 msgr2=0x7fd738105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:39.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.991+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 shutdown_connections 2024-05-14T12:11:39.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:38.991+0000 7fd73e600700 1 -- 172.21.15.47:0/1866766506 wait complete. 2024-05-14T12:11:39.728 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (1/15)... 2024-05-14T12:11:41.480 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:41 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:41.017+0000 7ffa204cc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T12:11:41.481 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:41 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:41.257+0000 7ffa204cc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T12:11:41.481 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:41 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:41.479+0000 7ffa204cc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T12:11:42.126 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:41 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:41.877+0000 7ffa204cc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T12:11:42.126 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:42 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:42.010+0000 7ffa204cc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T12:11:42.448 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:42 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:42.276+0000 7ffa204cc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T12:11:42.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:42 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/157942560' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T12:11:42.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:42 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:42.549+0000 7ffa204cc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:11:43.159 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:43.159 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T12:11:43.160 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T12:11:43.161 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:43.162 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:43.163 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T12:11:28.508084+0000", 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.354+0000 7f5711600700 1 Processor -- start 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.355+0000 7f5711600700 1 -- start start 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.355+0000 7f5711600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c07d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.355+0000 7f5711600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f570c07d740 con 0x7f570c07ed30 2024-05-14T12:11:43.164 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.356+0000 7f570aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c07d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.356+0000 7f570aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c07d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44144/0 (socket says 172.21.15.47:44144) 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.356+0000 7f570aa00700 1 -- 172.21.15.47:0/475274354 learned_addr learned my addr 172.21.15.47:0/475274354 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.356+0000 7f570aa00700 1 -- 172.21.15.47:0/475274354 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c07d8c0 con 0x7f570c07ed30 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.357+0000 7f570aa00700 1 --2- 172.21.15.47:0/475274354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c07d200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0098a0 tx=0x7f56fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f069d83fa919a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.357+0000 7f5709600700 1 -- 172.21.15.47:0/475274354 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc004160 con 0x7f570c07ed30 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.357+0000 7f5709600700 1 -- 172.21.15.47:0/475274354 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f56fc004300 con 0x7f570c07ed30 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.357+0000 7f5709600700 1 -- 172.21.15.47:0/475274354 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc011af0 con 0x7f570c07ed30 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.358+0000 7f5711600700 1 -- 172.21.15.47:0/475274354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 msgr2=0x7f570c07d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.358+0000 7f5711600700 1 --2- 172.21.15.47:0/475274354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c07d200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0098a0 tx=0x7f56fc009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.358+0000 7f5711600700 1 -- 172.21.15.47:0/475274354 shutdown_connections 2024-05-14T12:11:43.165 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.358+0000 7f5711600700 1 --2- 172.21.15.47:0/475274354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c07d200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.358+0000 7f5711600700 1 -- 172.21.15.47:0/475274354 >> 172.21.15.47:0/475274354 conn(0x7f570c105470 msgr2=0x7f570c1078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.358+0000 7f5711600700 1 -- 172.21.15.47:0/475274354 shutdown_connections 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.358+0000 7f5711600700 1 -- 172.21.15.47:0/475274354 wait complete. 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.360+0000 7f5711600700 1 Processor -- start 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.360+0000 7f5711600700 1 -- start start 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.360+0000 7f5711600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.360+0000 7f5711600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f570c110330 con 0x7f570c07ed30 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.360+0000 7f570aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.360+0000 7f570aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c1a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44152/0 (socket says 172.21.15.47:44152) 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.361+0000 7f570aa00700 1 -- 172.21.15.47:0/157942560 learned_addr learned my addr 172.21.15.47:0/157942560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.361+0000 7f570aa00700 1 -- 172.21.15.47:0/157942560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c1a0910 con 0x7f570c07ed30 2024-05-14T12:11:43.166 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.361+0000 7f570aa00700 1 --2- 172.21.15.47:0/157942560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c1a03d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0117b0 tx=0x7f56fc011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.362+0000 7f5703400700 1 -- 172.21.15.47:0/157942560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc0039c0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.362+0000 7f5711600700 1 -- 172.21.15.47:0/157942560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c1a0ba0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.362+0000 7f5703400700 1 -- 172.21.15.47:0/157942560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f56fc003b60 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.362+0000 7f5703400700 1 -- 172.21.15.47:0/157942560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc0196a0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.362+0000 7f5711600700 1 -- 172.21.15.47:0/157942560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c1a37b0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.362+0000 7f5703400700 1 -- 172.21.15.47:0/157942560 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56fc019cf0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.362+0000 7f5703400700 1 -- 172.21.15.47:0/157942560 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f56fc0249e0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.363+0000 7f5700c00700 1 -- 172.21.15.47:0/157942560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e4005330 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.366+0000 7f5703400700 1 -- 172.21.15.47:0/157942560 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f56fc043ec0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.447+0000 7f5700c00700 1 -- 172.21.15.47:0/157942560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f56e40058f0 con 0x7f570c07ed30 2024-05-14T12:11:43.167 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.447+0000 7f5703400700 1 -- 172.21.15.47:0/157942560 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f56fc032020 con 0x7f570c07ed30 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.449+0000 7f5700c00700 1 -- 172.21.15.47:0/157942560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 msgr2=0x7f570c1a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.449+0000 7f5700c00700 1 --2- 172.21.15.47:0/157942560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c1a03d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0117b0 tx=0x7f56fc011b70 comp rx=0 tx=0).stop 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.449+0000 7f5700c00700 1 -- 172.21.15.47:0/157942560 shutdown_connections 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.449+0000 7f5700c00700 1 --2- 172.21.15.47:0/157942560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f570c07ed30 0x7f570c1a03d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.449+0000 7f5700c00700 1 -- 172.21.15.47:0/157942560 >> 172.21.15.47:0/157942560 conn(0x7f570c105470 msgr2=0x7f570c105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.450+0000 7f5700c00700 1 -- 172.21.15.47:0/157942560 shutdown_connections 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:42.450+0000 7f5700c00700 1 -- 172.21.15.47:0/157942560 wait complete. 2024-05-14T12:11:43.168 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (2/15)... 2024-05-14T12:11:43.705 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:43 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:43.404+0000 7ffa204cc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T12:11:43.984 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:43 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:43.703+0000 7ffa204cc200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T12:11:44.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:44 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:44.287+0000 7ffa204cc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T12:11:44.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:44 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:44.421+0000 7ffa204cc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T12:11:45.234 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:44 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:44.903+0000 7ffa204cc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T12:11:45.620 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:45 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:45.397+0000 7ffa204cc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T12:11:45.620 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:45 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:45.534+0000 7ffa204cc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T12:11:46.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:45 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2141869383' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T12:11:46.216 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:45 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:45.878+0000 7ffa204cc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T12:11:46.216 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:46 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:46.078+0000 7ffa204cc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T12:11:46.216 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:46 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:46.214+0000 7ffa204cc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T12:11:46.704 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:46.705 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:11:46.705 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:11:46.705 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T12:11:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T12:11:46.708 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T12:11:46.709 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T12:11:28.508084+0000", 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:11:46.710 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.848+0000 7fbff2c00700 1 Processor -- start 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.848+0000 7fbff2c00700 1 -- start start 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.849+0000 7fbff2c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec07d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.849+0000 7fbff2c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec07d740 con 0x7fbfec07ed30 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.849+0000 7fbfebe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec07d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.849+0000 7fbfebe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec07d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44158/0 (socket says 172.21.15.47:44158) 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.849+0000 7fbfebe00700 1 -- 172.21.15.47:0/72018751 learned_addr learned my addr 172.21.15.47:0/72018751 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.849+0000 7fbfebe00700 1 -- 172.21.15.47:0/72018751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec07d8c0 con 0x7fbfec07ed30 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.850+0000 7fbfebe00700 1 --2- 172.21.15.47:0/72018751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec07d200 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0098a0 tx=0x7fbfdc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e241590ad77cf7c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.850+0000 7fbfeaa00700 1 -- 172.21.15.47:0/72018751 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc004160 con 0x7fbfec07ed30 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.850+0000 7fbfeaa00700 1 -- 172.21.15.47:0/72018751 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbfdc004300 con 0x7fbfec07ed30 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.850+0000 7fbfeaa00700 1 -- 172.21.15.47:0/72018751 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc011af0 con 0x7fbfec07ed30 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.851+0000 7fbff2c00700 1 -- 172.21.15.47:0/72018751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 msgr2=0x7fbfec07d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.851+0000 7fbff2c00700 1 --2- 172.21.15.47:0/72018751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec07d200 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0098a0 tx=0x7fbfdc009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:46.711 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.851+0000 7fbff2c00700 1 -- 172.21.15.47:0/72018751 shutdown_connections 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.851+0000 7fbff2c00700 1 --2- 172.21.15.47:0/72018751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec07d200 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.851+0000 7fbff2c00700 1 -- 172.21.15.47:0/72018751 >> 172.21.15.47:0/72018751 conn(0x7fbfec105470 msgr2=0x7fbfec1078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.851+0000 7fbff2c00700 1 -- 172.21.15.47:0/72018751 shutdown_connections 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.851+0000 7fbff2c00700 1 -- 172.21.15.47:0/72018751 wait complete. 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.852+0000 7fbff2c00700 1 Processor -- start 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.853+0000 7fbff2c00700 1 -- start start 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.853+0000 7fbff2c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.853+0000 7fbff2c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec110330 con 0x7fbfec07ed30 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.853+0000 7fbfebe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.853+0000 7fbfebe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec1a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44166/0 (socket says 172.21.15.47:44166) 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.853+0000 7fbfebe00700 1 -- 172.21.15.47:0/2141869383 learned_addr learned my addr 172.21.15.47:0/2141869383 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.854+0000 7fbfebe00700 1 -- 172.21.15.47:0/2141869383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec1a0910 con 0x7fbfec07ed30 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.854+0000 7fbfebe00700 1 --2- 172.21.15.47:0/2141869383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec1a03d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0117b0 tx=0x7fbfdc011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:46.712 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.854+0000 7fbfe8c00700 1 -- 172.21.15.47:0/2141869383 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc0039c0 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.854+0000 7fbfe8c00700 1 -- 172.21.15.47:0/2141869383 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbfdc003b60 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.854+0000 7fbfe8c00700 1 -- 172.21.15.47:0/2141869383 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc0196a0 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.854+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec1a0ba0 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.855+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfec1a37b0 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.855+0000 7fbfe8c00700 1 -- 172.21.15.47:0/2141869383 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbfdc019cf0 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.855+0000 7fbfe8c00700 1 -- 172.21.15.47:0/2141869383 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbfdc024730 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.856+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfec064e20 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.858+0000 7fbfe8c00700 1 -- 172.21.15.47:0/2141869383 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbfdc0042a0 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.941+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbfec1a3980 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.942+0000 7fbfe8c00700 1 -- 172.21.15.47:0/2141869383 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7fbfdc01abb0 con 0x7fbfec07ed30 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.944+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 msgr2=0x7fbfec1a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.944+0000 7fbff2c00700 1 --2- 172.21.15.47:0/2141869383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec1a03d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0117b0 tx=0x7fbfdc011b70 comp rx=0 tx=0).stop 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.944+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 shutdown_connections 2024-05-14T12:11:46.713 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.944+0000 7fbff2c00700 1 --2- 172.21.15.47:0/2141869383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfec07ed30 0x7fbfec1a03d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:46.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.944+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 >> 172.21.15.47:0/2141869383 conn(0x7fbfec105470 msgr2=0x7fbfec105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:46.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.944+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 shutdown_connections 2024-05-14T12:11:46.714 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:45.944+0000 7fbff2c00700 1 -- 172.21.15.47:0/2141869383 wait complete. 2024-05-14T12:11:46.714 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (3/15)... 2024-05-14T12:11:46.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:46 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:46.630+0000 7ffa204cc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T12:11:46.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:46 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:46.761+0000 7ffa204cc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T12:11:47.863 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:47 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:47.563+0000 7ffa204cc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T12:11:48.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:47 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:47.862+0000 7ffa204cc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T12:11:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: Activating manager daemon x 2024-05-14T12:11:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: mgrmap e2: x(active, starting, since 0.0129221s) 2024-05-14T12:11:48.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T12:11:48.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T12:11:48.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T12:11:48.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:11:48.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T12:11:48.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: Manager daemon x is now available 2024-05-14T12:11:48.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:47 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T12:11:49.168 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:48 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' 2024-05-14T12:11:49.168 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:48 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T12:11:49.168 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:48 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' 2024-05-14T12:11:49.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:48 smithi047 ceph-mon[31254]: from='mgr.14100 172.21.15.47:0/2126520294' entity='mgr.x' 2024-05-14T12:11:49.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:48 smithi047 ceph-mon[31254]: mgrmap e3: x(active, since 1.02263s) 2024-05-14T12:11:50.099 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:49 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1811161914' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T12:11:50.393 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:50.393 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:11:50.393 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:11:50.393 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T12:11:50.393 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T12:11:50.395 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T12:11:50.395 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T12:11:50.397 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:50.397 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T12:11:50.397 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T12:11:50.397 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T12:11:50.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T12:11:50.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T12:11:50.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T12:11:50.403 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T12:11:50.404 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T12:11:50.405 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T12:11:28.508084+0000", 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.409+0000 7f8d71000700 1 Processor -- start 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.410+0000 7f8d71000700 1 -- start start 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.410+0000 7f8d71000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1107f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.410+0000 7f8d71000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c110de0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.411+0000 7f8d69e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.411+0000 7f8d69e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45000/0 (socket says 172.21.15.47:45000) 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.411+0000 7f8d69e00700 1 -- 172.21.15.47:0/4103219911 learned_addr learned my addr 172.21.15.47:0/4103219911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.411+0000 7f8d69e00700 1 -- 172.21.15.47:0/4103219911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c1114c0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.406 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.412+0000 7f8d69e00700 1 --2- 172.21.15.47:0/4103219911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1107f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0098a0 tx=0x7f8d5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d015507f0e5fb4e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.412+0000 7f8d69400700 1 -- 172.21.15.47:0/4103219911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d5c004160 con 0x7f8d6c1103e0 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.412+0000 7f8d69400700 1 -- 172.21.15.47:0/4103219911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8d5c004300 con 0x7f8d6c1103e0 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.412+0000 7f8d69400700 1 -- 172.21.15.47:0/4103219911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d5c011af0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.413+0000 7f8d71000700 1 -- 172.21.15.47:0/4103219911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 msgr2=0x7f8d6c1107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.413+0000 7f8d71000700 1 --2- 172.21.15.47:0/4103219911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1107f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0098a0 tx=0x7f8d5c009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.413+0000 7f8d71000700 1 -- 172.21.15.47:0/4103219911 shutdown_connections 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.413+0000 7f8d71000700 1 --2- 172.21.15.47:0/4103219911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1107f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.413+0000 7f8d71000700 1 -- 172.21.15.47:0/4103219911 >> 172.21.15.47:0/4103219911 conn(0x7f8d6c07f530 msgr2=0x7f8d6c081950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.413+0000 7f8d71000700 1 -- 172.21.15.47:0/4103219911 shutdown_connections 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.413+0000 7f8d71000700 1 -- 172.21.15.47:0/4103219911 wait complete. 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.414+0000 7f8d71000700 1 Processor -- start 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.415+0000 7f8d71000700 1 -- start start 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.415+0000 7f8d71000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.415+0000 7f8d71000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c114870 con 0x7f8d6c1103e0 2024-05-14T12:11:50.407 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.415+0000 7f8d69e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:50.408 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.415+0000 7f8d69e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1a4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45006/0 (socket says 172.21.15.47:45006) 2024-05-14T12:11:50.408 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.415+0000 7f8d69e00700 1 -- 172.21.15.47:0/1811161914 learned_addr learned my addr 172.21.15.47:0/1811161914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:50.408 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.416+0000 7f8d69e00700 1 -- 172.21.15.47:0/1811161914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c1a4d50 con 0x7f8d6c1103e0 2024-05-14T12:11:50.408 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.416+0000 7f8d69e00700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1a4810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0090e0 tx=0x7f8d5c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:50.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.416+0000 7f8d62a00700 1 -- 172.21.15.47:0/1811161914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d5c0039e0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.416+0000 7f8d62a00700 1 -- 172.21.15.47:0/1811161914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8d5c003b80 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.416+0000 7f8d62a00700 1 -- 172.21.15.47:0/1811161914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d5c024690 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.416+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c1a4fe0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.417+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1a7bf0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.418+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c064e20 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.418+0000 7f8d62a00700 1 -- 172.21.15.47:0/1811161914 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7f8d5c022020 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.418+0000 7f8d62a00700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f8d5003e300 0x7f8d50040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.418+0000 7f8d62a00700 1 -- 172.21.15.47:0/1811161914 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8d5c053140 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.419+0000 7f8d63e00700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f8d5003e300 0x7f8d50040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.420+0000 7f8d63e00700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f8d5003e300 0x7f8d50040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d54006fd0 tx=0x7f8d54006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.425+0000 7f8d62a00700 1 -- 172.21.15.47:0/1811161914 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8d5c0212c0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.758+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8d6c1a7ee0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.759+0000 7f8d62a00700 1 -- 172.21.15.47:0/1811161914 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f8d5c04d4f0 con 0x7f8d6c1103e0 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f8d5003e300 msgr2=0x7f8d50040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f8d5003e300 0x7f8d50040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d54006fd0 tx=0x7f8d54006e40 comp rx=0 tx=0).stop 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 msgr2=0x7f8d6c1a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1a4810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0090e0 tx=0x7f8d5c011940 comp rx=0 tx=0).stop 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 shutdown_connections 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f8d5003e300 0x7f8d50040810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 --2- 172.21.15.47:0/1811161914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d6c1103e0 0x7f8d6c1a4810 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.763+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 >> 172.21.15.47:0/1811161914 conn(0x7f8d6c07f530 msgr2=0x7f8d6c080ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.764+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 shutdown_connections 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:49.764+0000 7f8d71000700 1 -- 172.21.15.47:0/1811161914 wait complete. 2024-05-14T12:11:50.412 INFO:teuthology.orchestra.run.smithi047.stdout:mgr is available 2024-05-14T12:11:50.972 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:50 smithi047 ceph-mon[31254]: mgrmap e4: x(active, since 2s) 2024-05-14T12:11:52.069 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:51 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/442504579' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-14T12:11:52.077 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:52.078 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-05-14T12:11:52.078 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:11:52.078 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-14T12:11:52.078 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-05-14T12:11:52.079 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-05-14T12:11:52.081 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.124+0000 7fe4b5000700 1 Processor -- start 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.125+0000 7fe4b5000700 1 -- start start 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.125+0000 7fe4b5000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b0110630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.125+0000 7fe4b5000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0110c20 con 0x7fe4b0110220 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.126+0000 7fe4af400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b0110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.126+0000 7fe4af400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b0110630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45018/0 (socket says 172.21.15.47:45018) 2024-05-14T12:11:52.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.126+0000 7fe4af400700 1 -- 172.21.15.47:0/539223452 learned_addr learned my addr 172.21.15.47:0/539223452 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:52.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.126+0000 7fe4af400700 1 -- 172.21.15.47:0/539223452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b0111300 con 0x7fe4b0110220 2024-05-14T12:11:52.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.127+0000 7fe4af400700 1 --2- 172.21.15.47:0/539223452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b0110630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098a0 tx=0x7fe4a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4618acaae41813 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:52.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.127+0000 7fe4ae000700 1 -- 172.21.15.47:0/539223452 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0004160 con 0x7fe4b0110220 2024-05-14T12:11:52.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.127+0000 7fe4ae000700 1 -- 172.21.15.47:0/539223452 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe4a0004300 con 0x7fe4b0110220 2024-05-14T12:11:52.085 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.127+0000 7fe4ae000700 1 -- 172.21.15.47:0/539223452 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0011af0 con 0x7fe4b0110220 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.128+0000 7fe4b5000700 1 -- 172.21.15.47:0/539223452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 msgr2=0x7fe4b0110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.128+0000 7fe4b5000700 1 --2- 172.21.15.47:0/539223452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b0110630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098a0 tx=0x7fe4a0009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.128+0000 7fe4b5000700 1 -- 172.21.15.47:0/539223452 shutdown_connections 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.128+0000 7fe4b5000700 1 --2- 172.21.15.47:0/539223452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b0110630 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.128+0000 7fe4b5000700 1 -- 172.21.15.47:0/539223452 >> 172.21.15.47:0/539223452 conn(0x7fe4b007f400 msgr2=0x7fe4b0081820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.128+0000 7fe4b5000700 1 -- 172.21.15.47:0/539223452 shutdown_connections 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.128+0000 7fe4b5000700 1 -- 172.21.15.47:0/539223452 wait complete. 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.129+0000 7fe4b5000700 1 Processor -- start 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.129+0000 7fe4b5000700 1 -- start start 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.130+0000 7fe4b5000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b01a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.130+0000 7fe4b5000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b01146b0 con 0x7fe4b0110220 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.130+0000 7fe4af400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b01a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:52.086 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.130+0000 7fe4af400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b01a45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45022/0 (socket says 172.21.15.47:45022) 2024-05-14T12:11:52.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.130+0000 7fe4af400700 1 -- 172.21.15.47:0/442504579 learned_addr learned my addr 172.21.15.47:0/442504579 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:52.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.131+0000 7fe4af400700 1 -- 172.21.15.47:0/442504579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b01a4af0 con 0x7fe4b0110220 2024-05-14T12:11:52.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.131+0000 7fe4af400700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b01a45b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0011890 tx=0x7fe4a0011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:52.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.131+0000 7fe4a7e00700 1 -- 172.21.15.47:0/442504579 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00039e0 con 0x7fe4b0110220 2024-05-14T12:11:52.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.131+0000 7fe4a7e00700 1 -- 172.21.15.47:0/442504579 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe4a0003b80 con 0x7fe4b0110220 2024-05-14T12:11:52.087 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.131+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b01a4d80 con 0x7fe4b0110220 2024-05-14T12:11:52.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.131+0000 7fe4a7e00700 1 -- 172.21.15.47:0/442504579 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00246e0 con 0x7fe4b0110220 2024-05-14T12:11:52.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.132+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b01a7990 con 0x7fe4b0110220 2024-05-14T12:11:52.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.133+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b0064e20 con 0x7fe4b0110220 2024-05-14T12:11:52.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.133+0000 7fe4a7e00700 1 -- 172.21.15.47:0/442504579 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fe4a0022020 con 0x7fe4b0110220 2024-05-14T12:11:52.089 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.133+0000 7fe4a7e00700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fe49403e420 0x7fe494040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.133+0000 7fe4a7e00700 1 -- 172.21.15.47:0/442504579 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe4a0053410 con 0x7fe4b0110220 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.134+0000 7fe4aea00700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fe49403e420 0x7fe494040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.134+0000 7fe4aea00700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fe49403e420 0x7fe494040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe49c006fd0 tx=0x7fe49c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.139+0000 7fe4a7e00700 1 -- 172.21.15.47:0/442504579 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe4a00172b0 con 0x7fe4b0110220 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.372+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe4b01a9190 con 0x7fe4b0110220 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.374+0000 7fe4a7e00700 1 -- 172.21.15.47:0/442504579 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+461 (secure 0 0 0) 0x7fe4a0053170 con 0x7fe4b0110220 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fe49403e420 msgr2=0x7fe494040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fe49403e420 0x7fe494040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe49c006fd0 tx=0x7fe49c006e40 comp rx=0 tx=0).stop 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 msgr2=0x7fe4b01a45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b01a45b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0011890 tx=0x7fe4a0011970 comp rx=0 tx=0).stop 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 shutdown_connections 2024-05-14T12:11:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fe49403e420 0x7fe494040930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:52.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 --2- 172.21.15.47:0/442504579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4b0110220 0x7fe4b01a45b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:52.091 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.377+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 >> 172.21.15.47:0/442504579 conn(0x7fe4b007f400 msgr2=0x7fe4b0080ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:52.092 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.378+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 shutdown_connections 2024-05-14T12:11:52.093 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:51.378+0000 7fe4b5000700 1 -- 172.21.15.47:0/442504579 wait complete. 2024-05-14T12:11:52.093 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling cephadm module... 2024-05-14T12:11:53.305 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:53 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1497818600' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-14T12:11:53.732 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:53 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: ignoring --setuser ceph since I am not root 2024-05-14T12:11:53.732 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:53 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: ignoring --setgroup ceph since I am not root 2024-05-14T12:11:53.733 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:53 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:53.479+0000 7f23184c0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T12:11:53.733 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:53 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:53.731+0000 7f23184c0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:11:53.911 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.741+0000 7fc24e200700 1 Processor -- start 2024-05-14T12:11:53.911 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.741+0000 7fc24e200700 1 -- start start 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.742+0000 7fc24e200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc24807d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.742+0000 7fc24e200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc24807d760 con 0x7fc24807ed50 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.742+0000 7fc247400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc24807d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.742+0000 7fc247400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc24807d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45032/0 (socket says 172.21.15.47:45032) 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.742+0000 7fc247400700 1 -- 172.21.15.47:0/3374505703 learned_addr learned my addr 172.21.15.47:0/3374505703 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.743+0000 7fc247400700 1 -- 172.21.15.47:0/3374505703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24807d8e0 con 0x7fc24807ed50 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.743+0000 7fc247400700 1 --2- 172.21.15.47:0/3374505703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc24807d220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2380098a0 tx=0x7fc238009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afd2ae1da2068aa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.743+0000 7fc246000700 1 -- 172.21.15.47:0/3374505703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc238004160 con 0x7fc24807ed50 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.743+0000 7fc246000700 1 -- 172.21.15.47:0/3374505703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc238004300 con 0x7fc24807ed50 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.743+0000 7fc246000700 1 -- 172.21.15.47:0/3374505703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc238011af0 con 0x7fc24807ed50 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.744+0000 7fc24e200700 1 -- 172.21.15.47:0/3374505703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 msgr2=0x7fc24807d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.744+0000 7fc24e200700 1 --2- 172.21.15.47:0/3374505703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc24807d220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2380098a0 tx=0x7fc238009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.744+0000 7fc24e200700 1 -- 172.21.15.47:0/3374505703 shutdown_connections 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.744+0000 7fc24e200700 1 --2- 172.21.15.47:0/3374505703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc24807d220 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.744+0000 7fc24e200700 1 -- 172.21.15.47:0/3374505703 >> 172.21.15.47:0/3374505703 conn(0x7fc248105470 msgr2=0x7fc248107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.744+0000 7fc24e200700 1 -- 172.21.15.47:0/3374505703 shutdown_connections 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.744+0000 7fc24e200700 1 -- 172.21.15.47:0/3374505703 wait complete. 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.745+0000 7fc24e200700 1 Processor -- start 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.745+0000 7fc24e200700 1 -- start start 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.746+0000 7fc24e200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc2481a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.746+0000 7fc24e200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc248110390 con 0x7fc24807ed50 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.746+0000 7fc247400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc2481a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.746+0000 7fc247400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc2481a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45042/0 (socket says 172.21.15.47:45042) 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.746+0000 7fc247400700 1 -- 172.21.15.47:0/1497818600 learned_addr learned my addr 172.21.15.47:0/1497818600 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.747+0000 7fc247400700 1 -- 172.21.15.47:0/1497818600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2481a0900 con 0x7fc24807ed50 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.747+0000 7fc247400700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc2481a03c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2380117b0 tx=0x7fc238011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.747+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2380039c0 con 0x7fc24807ed50 2024-05-14T12:11:53.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.747+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc238003b60 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.747+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2481a0b90 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.747+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2380196a0 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.747+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2481a37a0 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.749+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc248064e20 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.749+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fc23801ab00 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.749+0000 7fc23fe00700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fc22c03e470 0x7fc22c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.750+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc238053bd0 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.750+0000 7fc246a00700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fc22c03e470 0x7fc22c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.751+0000 7fc246a00700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fc22c03e470 0x7fc22c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc230006fd0 tx=0x7fc230006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:52.755+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc2380535f0 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.045+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fc2481a3970 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.098+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fc238019c90 con 0x7fc24807ed50 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fc22c03e470 msgr2=0x7fc22c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:53.914 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fc22c03e470 0x7fc22c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc230006fd0 tx=0x7fc230006e40 comp rx=0 tx=0).stop 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 msgr2=0x7fc2481a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc2481a03c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2380117b0 tx=0x7fc238011b70 comp rx=0 tx=0).stop 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc23fe00700 1 -- 172.21.15.47:0/1497818600 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fc23800b3e0 con 0x7fc24807ed50 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 shutdown_connections 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7fc22c03e470 0x7fc22c040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 --2- 172.21.15.47:0/1497818600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc24807ed50 0x7fc2481a03c0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2380117b0 tx=0x7fc238011b70 comp rx=0 tx=0).stop 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.102+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 >> 172.21.15.47:0/1497818600 conn(0x7fc248105470 msgr2=0x7fc248105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.103+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 shutdown_connections 2024-05-14T12:11:53.915 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:53.103+0000 7fc24e200700 1 -- 172.21.15.47:0/1497818600 wait complete. 2024-05-14T12:11:53.984 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:53 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:53.868+0000 7f23184c0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T12:11:54.310 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:54 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1497818600' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-14T12:11:54.310 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:54 smithi047 ceph-mon[31254]: mgrmap e5: x(active, since 5s) 2024-05-14T12:11:54.311 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:54 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:54.291+0000 7f23184c0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T12:11:54.734 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:54 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:54.412+0000 7f23184c0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T12:11:55.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:11:55 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2627106261' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-14T12:11:55.594 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:11:55.594 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-14T12:11:55.594 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T12:11:55.594 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.540+0000 7ffbe3c00700 1 Processor -- start 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.540+0000 7ffbe3c00700 1 -- start start 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.541+0000 7ffbe3c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc07d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.541+0000 7ffbe3c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc07d760 con 0x7ffbdc07ed50 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.541+0000 7ffbe1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc07d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.542+0000 7ffbe1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc07d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45076/0 (socket says 172.21.15.47:45076) 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.542+0000 7ffbe1200700 1 -- 172.21.15.47:0/811998682 learned_addr learned my addr 172.21.15.47:0/811998682 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.542+0000 7ffbe1200700 1 -- 172.21.15.47:0/811998682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc07d8e0 con 0x7ffbdc07ed50 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.542+0000 7ffbe1200700 1 --2- 172.21.15.47:0/811998682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc07d220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40098a0 tx=0x7ffbc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bb207375b5625 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.543+0000 7ffbdbe00700 1 -- 172.21.15.47:0/811998682 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc4004160 con 0x7ffbdc07ed50 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.543+0000 7ffbdbe00700 1 -- 172.21.15.47:0/811998682 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ffbc4004300 con 0x7ffbdc07ed50 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.543+0000 7ffbdbe00700 1 -- 172.21.15.47:0/811998682 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc4011af0 con 0x7ffbdc07ed50 2024-05-14T12:11:55.595 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.543+0000 7ffbe3c00700 1 -- 172.21.15.47:0/811998682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 msgr2=0x7ffbdc07d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.543+0000 7ffbe3c00700 1 --2- 172.21.15.47:0/811998682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc07d220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40098a0 tx=0x7ffbc4009bb0 comp rx=0 tx=0).stop 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.543+0000 7ffbe3c00700 1 -- 172.21.15.47:0/811998682 shutdown_connections 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.543+0000 7ffbe3c00700 1 --2- 172.21.15.47:0/811998682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc07d220 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.544+0000 7ffbe3c00700 1 -- 172.21.15.47:0/811998682 >> 172.21.15.47:0/811998682 conn(0x7ffbdc105470 msgr2=0x7ffbdc1078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.544+0000 7ffbe3c00700 1 -- 172.21.15.47:0/811998682 shutdown_connections 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.544+0000 7ffbe3c00700 1 -- 172.21.15.47:0/811998682 wait complete. 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.545+0000 7ffbe3c00700 1 Processor -- start 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.545+0000 7ffbe3c00700 1 -- start start 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.546+0000 7ffbe3c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc1a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.546+0000 7ffbe3c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc110370 con 0x7ffbdc07ed50 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.546+0000 7ffbe1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc1a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.546+0000 7ffbe1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc1a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45092/0 (socket says 172.21.15.47:45092) 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.546+0000 7ffbe1200700 1 -- 172.21.15.47:0/2627106261 learned_addr learned my addr 172.21.15.47:0/2627106261 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.547+0000 7ffbe1200700 1 -- 172.21.15.47:0/2627106261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc1a08f0 con 0x7ffbdc07ed50 2024-05-14T12:11:55.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.547+0000 7ffbe1200700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc1a03b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40117b0 tx=0x7ffbc4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.547+0000 7ffbda000700 1 -- 172.21.15.47:0/2627106261 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc40039c0 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.547+0000 7ffbda000700 1 -- 172.21.15.47:0/2627106261 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ffbc4003b60 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.547+0000 7ffbda000700 1 -- 172.21.15.47:0/2627106261 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc40196a0 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.547+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc1a0b80 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.548+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc1a3790 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.549+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbdc064e20 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.549+0000 7ffbda000700 1 -- 172.21.15.47:0/2627106261 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7ffbc401ab00 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.549+0000 7ffbda000700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 0x7ffbbc0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.549+0000 7ffbda000700 1 -- 172.21.15.47:0/2627106261 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffbc4053aa0 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.549+0000 7ffbd3e00700 1 -- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 msgr2=0x7ffbbc0409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.550+0000 7ffbd3e00700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 0x7ffbbc0409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.555+0000 7ffbda000700 1 -- 172.21.15.47:0/2627106261 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffbc40534c0 con 0x7ffbdc07ed50 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.751+0000 7ffbd3e00700 1 -- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 msgr2=0x7ffbbc0409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:11:55.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.751+0000 7ffbd3e00700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 0x7ffbbc0409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.850+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ffbdc1a3e80 con 0x7ffbdc07ed50 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.851+0000 7ffbda000700 1 -- 172.21.15.47:0/2627106261 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7ffbc4019c90 con 0x7ffbdc07ed50 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.854+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 msgr2=0x7ffbbc0409d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.854+0000 7ffbe3c00700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 0x7ffbbc0409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.854+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 msgr2=0x7ffbdc1a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.854+0000 7ffbe3c00700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc1a03b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40117b0 tx=0x7ffbc4011b70 comp rx=0 tx=0).stop 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.854+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 shutdown_connections 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.855+0000 7ffbe3c00700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7ffbbc03e4c0 0x7ffbbc0409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.855+0000 7ffbe3c00700 1 --2- 172.21.15.47:0/2627106261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbdc07ed50 0x7ffbdc1a03b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.855+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 >> 172.21.15.47:0/2627106261 conn(0x7ffbdc105470 msgr2=0x7ffbdc105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.855+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 shutdown_connections 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:54.855+0000 7ffbe3c00700 1 -- 172.21.15.47:0/2627106261 wait complete. 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-05-14T12:11:55.598 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 5... 2024-05-14T12:11:56.149 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:56 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:56.035+0000 7f23184c0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T12:11:56.474 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:56 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:56.285+0000 7f23184c0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T12:11:56.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:56 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:56.507+0000 7f23184c0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T12:11:57.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:56 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:56.908+0000 7f23184c0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T12:11:57.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:57 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:57.037+0000 7f23184c0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T12:11:57.561 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:57 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:57.296+0000 7f23184c0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T12:11:57.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:57 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:57.560+0000 7f23184c0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:11:58.690 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:58 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:58.387+0000 7f23184c0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T12:11:58.690 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:58 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:58.690+0000 7f23184c0200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T12:11:59.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:59 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:59.272+0000 7f23184c0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T12:11:59.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:59 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:59.406+0000 7f23184c0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T12:12:00.234 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:11:59 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:11:59.886+0000 7f23184c0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T12:12:00.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:00 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:00.363+0000 7f23184c0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T12:12:00.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:00 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:00.495+0000 7f23184c0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T12:12:01.163 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:00 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:00.835+0000 7f23184c0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T12:12:01.163 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:01 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:01.027+0000 7f23184c0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T12:12:01.485 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:01 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:01.163+0000 7f23184c0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T12:12:01.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:01 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:01.574+0000 7f23184c0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T12:12:01.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:01 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:01.703+0000 7f23184c0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T12:12:02.734 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:02 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:02.501+0000 7f23184c0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T12:12:03.181 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:02 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:02.802+0000 7f23184c0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T12:12:03.181 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: Active manager daemon x restarted 2024-05-14T12:12:03.181 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: Activating manager daemon x 2024-05-14T12:12:03.181 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: osdmap e2: 0 total, 0 up, 0 in 2024-05-14T12:12:03.181 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: mgrmap e6: x(active, starting, since 0.0100619s) 2024-05-14T12:12:03.181 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:12:03.182 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T12:12:03.182 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T12:12:03.182 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T12:12:03.182 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T12:12:03.182 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:02 smithi047 ceph-mon[31254]: Manager daemon x is now available 2024-05-14T12:12:04.171 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: Found migration_current of "None". Setting to last migration. 2024-05-14T12:12:04.171 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:04.171 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:04.171 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:04.171 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:04.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T12:12:04.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T12:12:04.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:04.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:04.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:03 smithi047 ceph-mon[31254]: mgrmap e7: x(active, since 1.01976s) 2024-05-14T12:12:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:12:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-14T12:12:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-14T12:12:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.264+0000 7f7592600700 1 Processor -- start 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.264+0000 7f7592600700 1 -- start start 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.264+0000 7f7592600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c10a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.265+0000 7f7592600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f758c10a7f0 con 0x7f758c109df0 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.265+0000 7f758b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c10a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.265+0000 7f758b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c10a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45096/0 (socket says 172.21.15.47:45096) 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.265+0000 7f758b400700 1 -- 172.21.15.47:0/3967737334 learned_addr learned my addr 172.21.15.47:0/3967737334 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.265+0000 7f758b400700 1 -- 172.21.15.47:0/3967737334 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c10af20 con 0x7f758c109df0 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.266+0000 7f758b400700 1 --2- 172.21.15.47:0/3967737334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c10a200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f757c0098a0 tx=0x7f757c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3714e19a1b7bc050 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.266+0000 7f758a000700 1 -- 172.21.15.47:0/3967737334 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f757c004160 con 0x7f758c109df0 2024-05-14T12:12:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.266+0000 7f758a000700 1 -- 172.21.15.47:0/3967737334 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f757c004300 con 0x7f758c109df0 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.266+0000 7f758a000700 1 -- 172.21.15.47:0/3967737334 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f757c011af0 con 0x7f758c109df0 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.267+0000 7f7592600700 1 -- 172.21.15.47:0/3967737334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 msgr2=0x7f758c10a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.267+0000 7f7592600700 1 --2- 172.21.15.47:0/3967737334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c10a200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f757c0098a0 tx=0x7f757c009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.267+0000 7f7592600700 1 -- 172.21.15.47:0/3967737334 shutdown_connections 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.267+0000 7f7592600700 1 --2- 172.21.15.47:0/3967737334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c10a200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.267+0000 7f7592600700 1 -- 172.21.15.47:0/3967737334 >> 172.21.15.47:0/3967737334 conn(0x7f758c105470 msgr2=0x7f758c1078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.267+0000 7f7592600700 1 -- 172.21.15.47:0/3967737334 shutdown_connections 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.267+0000 7f7592600700 1 -- 172.21.15.47:0/3967737334 wait complete. 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.268+0000 7f7592600700 1 Processor -- start 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.269+0000 7f7592600700 1 -- start start 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.269+0000 7f7592600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.269+0000 7f7592600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f758c10e2d0 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.269+0000 7f758b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.269+0000 7f758b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c1a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45110/0 (socket says 172.21.15.47:45110) 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.269+0000 7f758b400700 1 -- 172.21.15.47:0/2953898548 learned_addr learned my addr 172.21.15.47:0/2953898548 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.270+0000 7f758b400700 1 -- 172.21.15.47:0/2953898548 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c1a0970 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.270+0000 7f758b400700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c1a0430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f757c0090e0 tx=0x7f757c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.270+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f757c0039e0 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.270+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f757c003b80 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.270+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758c1a0c00 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.270+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f757c024690 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.270+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758c1a3810 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.272+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f757c022020 con 0x7f758c109df0 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.273+0000 7f7583e00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.273+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 --> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7570041090 con 0x7f757003e470 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.273+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f757c053410 con 0x7f758c109df0 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.273+0000 7f758aa00700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 msgr2=0x7f7570040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.273+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.474+0000 7f758aa00700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 msgr2=0x7f7570040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.474+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.875+0000 7f758aa00700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 msgr2=0x7f7570040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:56.875+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:57.676+0000 7f758aa00700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 msgr2=0x7f7570040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:57.676+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:59.278+0000 7f758aa00700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 msgr2=0x7f7570040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:11:59.278+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-14T12:12:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:02.481+0000 7f758aa00700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 msgr2=0x7f7570040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3184141127 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:02.481+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:02.813+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f757c019ca0 con 0x7f758c109df0 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:02.813+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 msgr2=0x7f7570040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:02.813+0000 7f7583e00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.817+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f757c055470 con 0x7f758c109df0 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.818+0000 7f7583e00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f7570041db0 0x7f75700441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.818+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f757c006880 con 0x7f7570041db0 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.819+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f7570041db0 0x7f75700441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.821+0000 7f758aa00700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f7570041db0 0x7f75700441d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7578003a10 tx=0x7f7578009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.823+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f757c006880 con 0x7f7570041db0 2024-05-14T12:12:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.833+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f758c064e20 con 0x7f7570041db0 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.833+0000 7f7583e00700 1 -- 172.21.15.47:0/2953898548 <== mgr.14120 v2:172.21.15.47:6800/3791767528 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f758c064e20 con 0x7f7570041db0 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f7570041db0 msgr2=0x7f75700441d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f7570041db0 0x7f75700441d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7578003a10 tx=0x7f7578009290 comp rx=0 tx=0).stop 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 msgr2=0x7f758c1a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c1a0430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f757c0090e0 tx=0x7f757c011940 comp rx=0 tx=0).stop 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 shutdown_connections 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f7570041db0 0x7f75700441d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f758c109df0 0x7f758c1a0430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 --2- 172.21.15.47:0/2953898548 >> [v2:172.21.15.47:6800/3184141127,v1:172.21.15.47:6801/3184141127] conn(0x7f757003e470 0x7f7570040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 >> 172.21.15.47:0/2953898548 conn(0x7f758c105470 msgr2=0x7f758c07d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.834+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 shutdown_connections 2024-05-14T12:12:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:03.835+0000 7f7592600700 1 -- 172.21.15.47:0/2953898548 wait complete. 2024-05-14T12:12:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 5 is available 2024-05-14T12:12:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:Setting orchestrator backend to cephadm... 2024-05-14T12:12:05.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:04 smithi047 ceph-mon[31254]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-14T12:12:05.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:04 smithi047 ceph-mon[31254]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-14T12:12:05.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:04 smithi047 ceph-mon[31254]: [14/May/2024:12:12:04] ENGINE Bus STARTING 2024-05-14T12:12:05.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:04 smithi047 ceph-mon[31254]: [14/May/2024:12:12:04] ENGINE Serving on https://172.21.15.47:7150 2024-05-14T12:12:05.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:04 smithi047 ceph-mon[31254]: [14/May/2024:12:12:04] ENGINE Serving on http://172.21.15.47:8765 2024-05-14T12:12:05.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:04 smithi047 ceph-mon[31254]: [14/May/2024:12:12:04] ENGINE Bus STARTED 2024-05-14T12:12:05.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:04 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:05 smithi047 ceph-mon[31254]: mgrmap e8: x(active, since 2s) 2024-05-14T12:12:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:05 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:05 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:06.291 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.334+0000 7ff0abe00700 1 Processor -- start 2024-05-14T12:12:06.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.334+0000 7ff0abe00700 1 -- start start 2024-05-14T12:12:06.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.334+0000 7ff0abe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac110630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:06.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.334+0000 7ff0abe00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac110c20 con 0x7ff0ac110220 2024-05-14T12:12:06.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.335+0000 7ff0aaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:06.292 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.335+0000 7ff0aaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac110630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42790/0 (socket says 172.21.15.47:42790) 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.335+0000 7ff0aaa00700 1 -- 172.21.15.47:0/1222563995 learned_addr learned my addr 172.21.15.47:0/1222563995 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.336+0000 7ff0aaa00700 1 -- 172.21.15.47:0/1222563995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac111300 con 0x7ff0ac110220 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.336+0000 7ff0aaa00700 1 --2- 172.21.15.47:0/1222563995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac110630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0098a0 tx=0x7ff09c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3df9f5a0d5f164 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.336+0000 7ff0a9600700 1 -- 172.21.15.47:0/1222563995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff09c004160 con 0x7ff0ac110220 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.336+0000 7ff0a9600700 1 -- 172.21.15.47:0/1222563995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff09c004300 con 0x7ff0ac110220 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.336+0000 7ff0a9600700 1 -- 172.21.15.47:0/1222563995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff09c011af0 con 0x7ff0ac110220 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.337+0000 7ff0abe00700 1 -- 172.21.15.47:0/1222563995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 msgr2=0x7ff0ac110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.337+0000 7ff0abe00700 1 --2- 172.21.15.47:0/1222563995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac110630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0098a0 tx=0x7ff09c009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.337+0000 7ff0abe00700 1 -- 172.21.15.47:0/1222563995 shutdown_connections 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.337+0000 7ff0abe00700 1 --2- 172.21.15.47:0/1222563995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac110630 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.337+0000 7ff0abe00700 1 -- 172.21.15.47:0/1222563995 >> 172.21.15.47:0/1222563995 conn(0x7ff0ac07f400 msgr2=0x7ff0ac081820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.338+0000 7ff0abe00700 1 -- 172.21.15.47:0/1222563995 shutdown_connections 2024-05-14T12:12:06.294 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.338+0000 7ff0abe00700 1 -- 172.21.15.47:0/1222563995 wait complete. 2024-05-14T12:12:06.295 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.339+0000 7ff0abe00700 1 Processor -- start 2024-05-14T12:12:06.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.339+0000 7ff0abe00700 1 -- start start 2024-05-14T12:12:06.298 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.339+0000 7ff0abe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac1a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.339+0000 7ff0abe00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1146b0 con 0x7ff0ac110220 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.340+0000 7ff0aaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac1a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.340+0000 7ff0aaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac1a45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42796/0 (socket says 172.21.15.47:42796) 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.340+0000 7ff0aaa00700 1 -- 172.21.15.47:0/1792743731 learned_addr learned my addr 172.21.15.47:0/1792743731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.340+0000 7ff0aaa00700 1 -- 172.21.15.47:0/1792743731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac1a4af0 con 0x7ff0ac110220 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.340+0000 7ff0aaa00700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac1a45b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff09c011890 tx=0x7ff09c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.341+0000 7ff0a3400700 1 -- 172.21.15.47:0/1792743731 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff09c0039e0 con 0x7ff0ac110220 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.341+0000 7ff0a3400700 1 -- 172.21.15.47:0/1792743731 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff09c003b80 con 0x7ff0ac110220 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.341+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac1a4d80 con 0x7ff0ac110220 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.341+0000 7ff0a3400700 1 -- 172.21.15.47:0/1792743731 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff09c0246e0 con 0x7ff0ac110220 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.341+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac1a7990 con 0x7ff0ac110220 2024-05-14T12:12:06.299 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.342+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ac064e20 con 0x7ff0ac110220 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.342+0000 7ff0a3400700 1 -- 172.21.15.47:0/1792743731 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7ff09c022020 con 0x7ff0ac110220 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.343+0000 7ff0a3400700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7ff09003e4c0 0x7ff0900409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.343+0000 7ff0a3400700 1 -- 172.21.15.47:0/1792743731 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff09c053700 con 0x7ff0ac110220 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.343+0000 7ff0aa000700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7ff09003e4c0 0x7ff0900409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.344+0000 7ff0aa000700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7ff09003e4c0 0x7ff0900409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff098006fd0 tx=0x7ff098006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.352+0000 7ff0a3400700 1 -- 172.21.15.47:0/1792743731 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff09c019ca0 con 0x7ff0ac110220 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.605+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7ff0ac0813f0 con 0x7ff09003e4c0 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.619+0000 7ff0a3400700 1 -- 172.21.15.47:0/1792743731 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff0ac0813f0 con 0x7ff09003e4c0 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.622+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7ff09003e4c0 msgr2=0x7ff0900409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.622+0000 7ff0abe00700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7ff09003e4c0 0x7ff0900409d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff098006fd0 tx=0x7ff098006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.622+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 msgr2=0x7ff0ac1a45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.622+0000 7ff0abe00700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac1a45b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff09c011890 tx=0x7ff09c011970 comp rx=0 tx=0).stop 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.623+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 shutdown_connections 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.623+0000 7ff0abe00700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7ff09003e4c0 0x7ff0900409d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:06.300 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.623+0000 7ff0abe00700 1 --2- 172.21.15.47:0/1792743731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0ac110220 0x7ff0ac1a45b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:06.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.623+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 >> 172.21.15.47:0/1792743731 conn(0x7ff0ac07f400 msgr2=0x7ff0ac080ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:06.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.623+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 shutdown_connections 2024-05-14T12:12:06.301 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:05.623+0000 7ff0abe00700 1 -- 172.21.15.47:0/1792743731 wait complete. 2024-05-14T12:12:07.222 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:06 smithi047 ceph-mon[31254]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:07.947 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-14T12:12:07.948 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.967+0000 7fe6a8200700 1 Processor -- start 2024-05-14T12:12:07.948 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.967+0000 7fe6a8200700 1 -- start start 2024-05-14T12:12:07.948 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.967+0000 7fe6a8200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a010d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:07.948 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.967+0000 7fe6a8200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a010dde0 con 0x7fe6a010d400 2024-05-14T12:12:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.968+0000 7fe6a5800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a010d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.968+0000 7fe6a5800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a010d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42798/0 (socket says 172.21.15.47:42798) 2024-05-14T12:12:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.968+0000 7fe6a5800700 1 -- 172.21.15.47:0/750279214 learned_addr learned my addr 172.21.15.47:0/750279214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.968+0000 7fe6a5800700 1 -- 172.21.15.47:0/750279214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a010bd10 con 0x7fe6a010d400 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.969+0000 7fe6a5800700 1 --2- 172.21.15.47:0/750279214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a010d810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6940098a0 tx=0x7fe694009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a736697c2db7aa8d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.969+0000 7fe69fe00700 1 -- 172.21.15.47:0/750279214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe694004160 con 0x7fe6a010d400 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.969+0000 7fe69fe00700 1 -- 172.21.15.47:0/750279214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe694004300 con 0x7fe6a010d400 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.969+0000 7fe69fe00700 1 -- 172.21.15.47:0/750279214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe694011af0 con 0x7fe6a010d400 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.970+0000 7fe6a8200700 1 -- 172.21.15.47:0/750279214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 msgr2=0x7fe6a010d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.970+0000 7fe6a8200700 1 --2- 172.21.15.47:0/750279214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a010d810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6940098a0 tx=0x7fe694009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.970+0000 7fe6a8200700 1 -- 172.21.15.47:0/750279214 shutdown_connections 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.970+0000 7fe6a8200700 1 --2- 172.21.15.47:0/750279214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a010d810 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.970+0000 7fe6a8200700 1 -- 172.21.15.47:0/750279214 >> 172.21.15.47:0/750279214 conn(0x7fe6a0107840 msgr2=0x7fe6a0109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.970+0000 7fe6a8200700 1 -- 172.21.15.47:0/750279214 shutdown_connections 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.970+0000 7fe6a8200700 1 -- 172.21.15.47:0/750279214 wait complete. 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.971+0000 7fe6a8200700 1 Processor -- start 2024-05-14T12:12:07.954 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.972+0000 7fe6a8200700 1 -- start start 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.972+0000 7fe6a8200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a01a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.972+0000 7fe6a8200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0110490 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.972+0000 7fe6a5800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a01a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.972+0000 7fe6a5800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a01a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42802/0 (socket says 172.21.15.47:42802) 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.972+0000 7fe6a5800700 1 -- 172.21.15.47:0/3644439433 learned_addr learned my addr 172.21.15.47:0/3644439433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.973+0000 7fe6a5800700 1 -- 172.21.15.47:0/3644439433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a01a0820 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.973+0000 7fe6a5800700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a01a02e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6940090e0 tx=0x7fe694011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.973+0000 7fe69e000700 1 -- 172.21.15.47:0/3644439433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6940039e0 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.973+0000 7fe69e000700 1 -- 172.21.15.47:0/3644439433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe694003b80 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.973+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a01a0ab0 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.973+0000 7fe69e000700 1 -- 172.21.15.47:0/3644439433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6940246e0 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.973+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a01a36c0 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.975+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a0064e20 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.975+0000 7fe69e000700 1 -- 172.21.15.47:0/3644439433 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe694022020 con 0x7fe6a010d400 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.975+0000 7fe69e000700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fe68803e470 0x7fe688040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:07.955 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.975+0000 7fe69e000700 1 -- 172.21.15.47:0/3644439433 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe694053850 con 0x7fe6a010d400 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.976+0000 7fe6a4e00700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fe68803e470 0x7fe688040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.976+0000 7fe6a4e00700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fe68803e470 0x7fe688040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe68c006fd0 tx=0x7fe68c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:06.982+0000 7fe69e000700 1 -- 172.21.15.47:0/3644439433 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe69400b3e0 con 0x7fe6a010d400 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.222+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fe6a0109880 con 0x7fe68803e470 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.224+0000 7fe69e000700 1 -- 172.21.15.47:0/3644439433 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fe6a0109880 con 0x7fe68803e470 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.227+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fe68803e470 msgr2=0x7fe688040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.227+0000 7fe6a8200700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fe68803e470 0x7fe688040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe68c006fd0 tx=0x7fe68c006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.227+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 msgr2=0x7fe6a01a02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.227+0000 7fe6a8200700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a01a02e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6940090e0 tx=0x7fe694011940 comp rx=0 tx=0).stop 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.228+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 shutdown_connections 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.228+0000 7fe6a8200700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fe68803e470 0x7fe688040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.228+0000 7fe6a8200700 1 --2- 172.21.15.47:0/3644439433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d400 0x7fe6a01a02e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:07.956 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.228+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 >> 172.21.15.47:0/3644439433 conn(0x7fe6a0107840 msgr2=0x7fe6a0109110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:07.957 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.228+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 shutdown_connections 2024-05-14T12:12:07.957 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:07.228+0000 7fe6a8200700 1 -- 172.21.15.47:0/3644439433 wait complete. 2024-05-14T12:12:07.957 INFO:teuthology.orchestra.run.smithi047.stdout:Generating ssh key... 2024-05-14T12:12:08.224 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:07 smithi047 ceph-mon[31254]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:09.725 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:09 smithi047 ceph-mon[31254]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:09.725 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:09 smithi047 ceph-mon[31254]: Generating ssh key... 2024-05-14T12:12:09.726 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: Generating public/private rsa key pair. 2024-05-14T12:12:09.726 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: Your identification has been saved in /tmp/tmphmmk2y99/key. 2024-05-14T12:12:09.726 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: Your public key has been saved in /tmp/tmphmmk2y99/key.pub. 2024-05-14T12:12:09.726 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: The key fingerprint is: 2024-05-14T12:12:09.726 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: SHA256:jVcPdhj+YLiPcrchpRpK9kCSa1yOwuB26Q3GcX1Wz20 ceph-e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:12:09.726 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: The key's randomart image is: 2024-05-14T12:12:09.726 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: +---[RSA 3072]----+ 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: | . | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: | o o | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: | ..O . | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: | .. o.=o*. | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: |. .o.o.So+ .ooE | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: |.o..+B o. = . | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: | oo*= = o = + | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: |. +ooo + = o o | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: | . .. o . | 2024-05-14T12:12:09.727 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:09 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: +----[SHA256]-----+ 2024-05-14T12:12:10.050 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.603+0000 7fc6fd200700 1 Processor -- start 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.603+0000 7fc6fd200700 1 -- start start 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.603+0000 7fc6fd200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f8109ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.603+0000 7fc6fd200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f810a5e0 con 0x7fc6f8109be0 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.604+0000 7fc6f7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f8109ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.604+0000 7fc6f7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f8109ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38428/0 (socket says 172.21.15.47:38428) 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.604+0000 7fc6f7400700 1 -- 172.21.15.47:0/2296469071 learned_addr learned my addr 172.21.15.47:0/2296469071 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.604+0000 7fc6f7400700 1 -- 172.21.15.47:0/2296469071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f810ad10 con 0x7fc6f8109be0 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.605+0000 7fc6f7400700 1 --2- 172.21.15.47:0/2296469071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f8109ff0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009e80 tx=0x7fc6e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5092b92c5f63c81 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.605+0000 7fc6f6a00700 1 -- 172.21.15.47:0/2296469071 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e8017070 con 0x7fc6f8109be0 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.605+0000 7fc6f6a00700 1 -- 172.21.15.47:0/2296469071 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc6e800b8c0 con 0x7fc6f8109be0 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.605+0000 7fc6f6a00700 1 -- 172.21.15.47:0/2296469071 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e8004490 con 0x7fc6f8109be0 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.606+0000 7fc6fd200700 1 -- 172.21.15.47:0/2296469071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 msgr2=0x7fc6f8109ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.606+0000 7fc6fd200700 1 --2- 172.21.15.47:0/2296469071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f8109ff0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009e80 tx=0x7fc6e800b330 comp rx=0 tx=0).stop 2024-05-14T12:12:10.051 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.606+0000 7fc6fd200700 1 -- 172.21.15.47:0/2296469071 shutdown_connections 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.606+0000 7fc6fd200700 1 --2- 172.21.15.47:0/2296469071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f8109ff0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.606+0000 7fc6fd200700 1 -- 172.21.15.47:0/2296469071 >> 172.21.15.47:0/2296469071 conn(0x7fc6f81052e0 msgr2=0x7fc6f8107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.606+0000 7fc6fd200700 1 -- 172.21.15.47:0/2296469071 shutdown_connections 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.606+0000 7fc6fd200700 1 -- 172.21.15.47:0/2296469071 wait complete. 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.607+0000 7fc6fd200700 1 Processor -- start 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.607+0000 7fc6fd200700 1 -- start start 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.608+0000 7fc6fd200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f807ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.608+0000 7fc6fd200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f810e0c0 con 0x7fc6f8109be0 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.608+0000 7fc6f7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f807ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.608+0000 7fc6f7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f807ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38434/0 (socket says 172.21.15.47:38434) 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.608+0000 7fc6f7400700 1 -- 172.21.15.47:0/604435790 learned_addr learned my addr 172.21.15.47:0/604435790 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.609+0000 7fc6f7400700 1 -- 172.21.15.47:0/604435790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f807ef90 con 0x7fc6f8109be0 2024-05-14T12:12:10.052 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.609+0000 7fc6f7400700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f807ea50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009fd0 tx=0x7fc6e800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.609+0000 7fc6f4c00700 1 -- 172.21.15.47:0/604435790 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e8020020 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.609+0000 7fc6f4c00700 1 -- 172.21.15.47:0/604435790 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc6e8012430 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.609+0000 7fc6f4c00700 1 -- 172.21.15.47:0/604435790 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e8017040 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.609+0000 7fc6fd200700 1 -- 172.21.15.47:0/604435790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f807d1e0 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.609+0000 7fc6fd200700 1 -- 172.21.15.47:0/604435790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f807d720 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.611+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f8064e20 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.611+0000 7fc6f4c00700 1 -- 172.21.15.47:0/604435790 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fc6e8023020 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.612+0000 7fc6f4c00700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fc6dc03e4c0 0x7fc6dc0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.612+0000 7fc6f4c00700 1 -- 172.21.15.47:0/604435790 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc6e800f050 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.612+0000 7fc6eea00700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fc6dc03e4c0 0x7fc6dc0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.613+0000 7fc6eea00700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fc6dc03e4c0 0x7fc6dc0409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0006fd0 tx=0x7fc6e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.617+0000 7fc6f4c00700 1 -- 172.21.15.47:0/604435790 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc6e802a020 con 0x7fc6f8109be0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:08.860+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fc6f807d8f0 con 0x7fc6dc03e4c0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.403+0000 7fc6f4c00700 1 -- 172.21.15.47:0/604435790 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc6f807d8f0 con 0x7fc6dc03e4c0 2024-05-14T12:12:10.053 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fc6dc03e4c0 msgr2=0x7fc6dc0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fc6dc03e4c0 0x7fc6dc0409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0006fd0 tx=0x7fc6e0006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 msgr2=0x7fc6f807ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f807ea50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009fd0 tx=0x7fc6e800bd50 comp rx=0 tx=0).stop 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 shutdown_connections 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fc6dc03e4c0 0x7fc6dc0409d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 --2- 172.21.15.47:0/604435790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6f8109be0 0x7fc6f807ea50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.406+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 >> 172.21.15.47:0/604435790 conn(0x7fc6f81052e0 msgr2=0x7fc6f8106bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.407+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 shutdown_connections 2024-05-14T12:12:10.054 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:09.407+0000 7fc6ed600700 1 -- 172.21.15.47:0/604435790 wait complete. 2024-05-14T12:12:10.598 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:10 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:10.598 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:10 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:11.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:11 smithi047 ceph-mon[31254]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXMD/8Kkxg34MCMFfaYFcOfkCAvge8zuReCg/QwDyyIsjGjkEF0ois3/K5G2/CkHBsLd3mjZYbxG8elP0yPP8LMFZVB2b0PdmRxufWsG1M2loC6qnaRXDPLQL29ITuQCZgOJ1CMMuz2OMzv+Vl1cPULZDqotWMFCxQD3JvmywmSG/JwdPnMoqMC6O4+lT1kDjCif6luCdCSoGzb6yI0RNn/yk1+XypCxbjCcbC6o1KbcwkNgqqszcssjAeSNsIpZo2qL3BmhwPnPZj88T2YRz6YUh5ppVIqFoitwZ8BRbpvJ4UqaiydkSNbl8skhJnj8S4fZrKMDu/VEXRhZ8wrTJHRY6dS6ZRkCrBDrfgu61vpdBVq1bb6SiJuQcb3jn7UYyULgQmoxhjoJyR/M8lw8Fr1BMATb2U/ovtF9Efs8/NrUFDkTvUeRtp1k8CeLoGjDqnjllHSjzHFPjQjx65B3tft22lYAl04PTnvlQjk2ZxX1FxM+5LwqxxHC6Ziyr/Shc= ceph-e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.843+0000 7f25dfe00700 1 Processor -- start 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.843+0000 7f25dfe00700 1 -- start start 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.843+0000 7f25dfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e010eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.843+0000 7f25dfe00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25e010f050 con 0x7f25e007cc70 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.844+0000 7f25dea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e010eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.844+0000 7f25dea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e010eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38444/0 (socket says 172.21.15.47:38444) 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.844+0000 7f25dea00700 1 -- 172.21.15.47:0/3150683512 learned_addr learned my addr 172.21.15.47:0/3150683512 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.844+0000 7f25dea00700 1 -- 172.21.15.47:0/3150683512 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e010f1d0 con 0x7f25e007cc70 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.845+0000 7f25dea00700 1 --2- 172.21.15.47:0/3150683512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e010eb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098a0 tx=0x7f25d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f31d2ee035e52a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:11.728 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.845+0000 7f25dd600700 1 -- 172.21.15.47:0/3150683512 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0004160 con 0x7f25e007cc70 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.845+0000 7f25dd600700 1 -- 172.21.15.47:0/3150683512 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f25d0004300 con 0x7f25e007cc70 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.845+0000 7f25dd600700 1 -- 172.21.15.47:0/3150683512 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0011af0 con 0x7f25e007cc70 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.846+0000 7f25dfe00700 1 -- 172.21.15.47:0/3150683512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 msgr2=0x7f25e010eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.846+0000 7f25dfe00700 1 --2- 172.21.15.47:0/3150683512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e010eb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098a0 tx=0x7f25d0009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.846+0000 7f25dfe00700 1 -- 172.21.15.47:0/3150683512 shutdown_connections 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.846+0000 7f25dfe00700 1 --2- 172.21.15.47:0/3150683512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e010eb10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.846+0000 7f25dfe00700 1 -- 172.21.15.47:0/3150683512 >> 172.21.15.47:0/3150683512 conn(0x7f25e01041e0 msgr2=0x7f25e0106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.846+0000 7f25dfe00700 1 -- 172.21.15.47:0/3150683512 shutdown_connections 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.846+0000 7f25dfe00700 1 -- 172.21.15.47:0/3150683512 wait complete. 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.847+0000 7f25dfe00700 1 Processor -- start 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.847+0000 7f25dfe00700 1 -- start start 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.848+0000 7f25dfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e01a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.848+0000 7f25dfe00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01100e0 con 0x7f25e007cc70 2024-05-14T12:12:11.729 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.848+0000 7f25dea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e01a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.848+0000 7f25dea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e01a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38460/0 (socket says 172.21.15.47:38460) 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.848+0000 7f25dea00700 1 -- 172.21.15.47:0/1949228588 learned_addr learned my addr 172.21.15.47:0/1949228588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.849+0000 7f25dea00700 1 -- 172.21.15.47:0/1949228588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e01a0620 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.849+0000 7f25dea00700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e01a00e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25d0011ac0 tx=0x7f25d0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.849+0000 7f25d7400700 1 -- 172.21.15.47:0/1949228588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0003970 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.849+0000 7f25d7400700 1 -- 172.21.15.47:0/1949228588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f25d0003b10 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.849+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e01a08b0 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.849+0000 7f25d7400700 1 -- 172.21.15.47:0/1949228588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0024610 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.850+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a34c0 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.851+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0064e20 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.851+0000 7f25d7400700 1 -- 172.21.15.47:0/1949228588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f25d0024840 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.852+0000 7f25d7400700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f25c403e4c0 0x7f25c40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.852+0000 7f25d7400700 1 -- 172.21.15.47:0/1949228588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f25d0053aa0 con 0x7f25e007cc70 2024-05-14T12:12:11.730 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.852+0000 7f25de000700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f25c403e4c0 0x7f25c40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.853+0000 7f25de000700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f25c403e4c0 0x7f25c40409d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f25cc006fd0 tx=0x7f25cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:10.858+0000 7f25d7400700 1 -- 172.21.15.47:0/1949228588 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f25d00533f0 con 0x7f25e007cc70 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.096+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f25e0106240 con 0x7f25c403e4c0 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.098+0000 7f25d7400700 1 -- 172.21.15.47:0/1949228588 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f25e0106240 con 0x7f25c403e4c0 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f25c403e4c0 msgr2=0x7f25c40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f25c403e4c0 0x7f25c40409d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f25cc006fd0 tx=0x7f25cc006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 msgr2=0x7f25e01a00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e01a00e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25d0011ac0 tx=0x7f25d0011ba0 comp rx=0 tx=0).stop 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 shutdown_connections 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f25c403e4c0 0x7f25c40409d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 --2- 172.21.15.47:0/1949228588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e007cc70 0x7f25e01a00e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 >> 172.21.15.47:0/1949228588 conn(0x7f25e01041e0 msgr2=0x7f25e0105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 shutdown_connections 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:11.101+0000 7f25dfe00700 1 -- 172.21.15.47:0/1949228588 wait complete. 2024-05-14T12:12:11.731 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-14T12:12:11.732 INFO:teuthology.orchestra.run.smithi047.stdout:Adding key to root@localhost authorized_keys... 2024-05-14T12:12:11.732 INFO:teuthology.orchestra.run.smithi047.stdout:Adding host smithi047... 2024-05-14T12:12:13.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:13 smithi047 ceph-mon[31254]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:14.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:14 smithi047 ceph-mon[31254]: Deploying cephadm binary to smithi047 2024-05-14T12:12:19.902 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Added host 'smithi047' with addr '172.21.15.47' 2024-05-14T12:12:19.902 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.455+0000 7f5a69800700 1 Processor -- start 2024-05-14T12:12:19.902 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.455+0000 7f5a69800700 1 -- start start 2024-05-14T12:12:19.902 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.456+0000 7f5a69800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a6410c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:19.902 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.456+0000 7f5a69800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6410c9a0 con 0x7f5a6410bfa0 2024-05-14T12:12:19.902 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.457+0000 7f5a62a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a6410c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.457+0000 7f5a62a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a6410c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38476/0 (socket says 172.21.15.47:38476) 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.457+0000 7f5a62a00700 1 -- 172.21.15.47:0/2593396572 learned_addr learned my addr 172.21.15.47:0/2593396572 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.457+0000 7f5a62a00700 1 -- 172.21.15.47:0/2593396572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6410d0d0 con 0x7f5a6410bfa0 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.458+0000 7f5a62a00700 1 --2- 172.21.15.47:0/2593396572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a6410c3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5a540098a0 tx=0x7f5a54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d92798c8091130 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.458+0000 7f5a61600700 1 -- 172.21.15.47:0/2593396572 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a54004160 con 0x7f5a6410bfa0 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.458+0000 7f5a61600700 1 -- 172.21.15.47:0/2593396572 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5a54004300 con 0x7f5a6410bfa0 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.458+0000 7f5a61600700 1 -- 172.21.15.47:0/2593396572 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a54011af0 con 0x7f5a6410bfa0 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.459+0000 7f5a69800700 1 -- 172.21.15.47:0/2593396572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 msgr2=0x7f5a6410c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.459+0000 7f5a69800700 1 --2- 172.21.15.47:0/2593396572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a6410c3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5a540098a0 tx=0x7f5a54009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.459+0000 7f5a69800700 1 -- 172.21.15.47:0/2593396572 shutdown_connections 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.459+0000 7f5a69800700 1 --2- 172.21.15.47:0/2593396572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a6410c3b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:19.903 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.459+0000 7f5a69800700 1 -- 172.21.15.47:0/2593396572 >> 172.21.15.47:0/2593396572 conn(0x7f5a64107840 msgr2=0x7f5a64109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.459+0000 7f5a69800700 1 -- 172.21.15.47:0/2593396572 shutdown_connections 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.459+0000 7f5a69800700 1 -- 172.21.15.47:0/2593396572 wait complete. 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.460+0000 7f5a69800700 1 Processor -- start 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.461+0000 7f5a69800700 1 -- start start 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.461+0000 7f5a69800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a641a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.461+0000 7f5a69800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5a64110480 con 0x7f5a6410bfa0 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.461+0000 7f5a62a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a641a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.461+0000 7f5a62a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a641a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38478/0 (socket says 172.21.15.47:38478) 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.461+0000 7f5a62a00700 1 -- 172.21.15.47:0/2311374097 learned_addr learned my addr 172.21.15.47:0/2311374097 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.462+0000 7f5a62a00700 1 -- 172.21.15.47:0/2311374097 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a641a0900 con 0x7f5a6410bfa0 2024-05-14T12:12:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.462+0000 7f5a62a00700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a641a03c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5a540090e0 tx=0x7f5a54011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.462+0000 7f5a5b400700 1 -- 172.21.15.47:0/2311374097 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a540039e0 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.462+0000 7f5a5b400700 1 -- 172.21.15.47:0/2311374097 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5a54003b80 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.462+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a641a0b90 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.463+0000 7f5a5b400700 1 -- 172.21.15.47:0/2311374097 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a54024690 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.463+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a641a37a0 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.464+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a64064e20 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.464+0000 7f5a5b400700 1 -- 172.21.15.47:0/2311374097 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f5a54022020 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.464+0000 7f5a5b400700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f5a4803e4c0 0x7f5a480409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.465+0000 7f5a5b400700 1 -- 172.21.15.47:0/2311374097 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5a54053760 con 0x7f5a6410bfa0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.465+0000 7f5a62000700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f5a4803e4c0 0x7f5a480409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.466+0000 7f5a62000700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f5a4803e4c0 0x7f5a480409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5a50006fd0 tx=0x7f5a50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:19.905 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.470+0000 7f5a5b400700 1 -- 172.21.15.47:0/2311374097 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5a540212c0 con 0x7f5a6410bfa0 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:12.715+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}) -- 0x7f5a64109830 con 0x7f5a4803e4c0 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.235+0000 7f5a5b400700 1 -- 172.21.15.47:0/2311374097 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5a64109830 con 0x7f5a4803e4c0 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f5a4803e4c0 msgr2=0x7f5a480409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f5a4803e4c0 0x7f5a480409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5a50006fd0 tx=0x7f5a50006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 msgr2=0x7f5a641a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a641a03c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5a540090e0 tx=0x7f5a54011940 comp rx=0 tx=0).stop 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 shutdown_connections 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f5a4803e4c0 0x7f5a480409d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 --2- 172.21.15.47:0/2311374097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a6410bfa0 0x7f5a641a03c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.239+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 >> 172.21.15.47:0/2311374097 conn(0x7f5a64107840 msgr2=0x7f5a641090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:19.906 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.240+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 shutdown_connections 2024-05-14T12:12:19.907 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:19.240+0000 7f5a69800700 1 -- 172.21.15.47:0/2311374097 wait complete. 2024-05-14T12:12:19.907 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mon service... 2024-05-14T12:12:20.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:20 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:20.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:20 smithi047 ceph-mon[31254]: Added host smithi047 2024-05-14T12:12:20.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:20 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:21.540 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-14T12:12:21.540 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.585+0000 7f6b64c00700 1 Processor -- start 2024-05-14T12:12:21.540 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.585+0000 7f6b64c00700 1 -- start start 2024-05-14T12:12:21.540 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.585+0000 7f6b64c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601107c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:21.540 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.585+0000 7f6b64c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b60110db0 con 0x7f6b601103b0 2024-05-14T12:12:21.540 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.586+0000 7f6b5de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:21.540 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.586+0000 7f6b5de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601107c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33102/0 (socket says 172.21.15.47:33102) 2024-05-14T12:12:21.544 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.586+0000 7f6b5de00700 1 -- 172.21.15.47:0/3170508598 learned_addr learned my addr 172.21.15.47:0/3170508598 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:21.544 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.586+0000 7f6b5de00700 1 -- 172.21.15.47:0/3170508598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b601114e0 con 0x7f6b601103b0 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.587+0000 7f6b5de00700 1 --2- 172.21.15.47:0/3170508598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601107c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b500098a0 tx=0x7f6b50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a614944009d2520c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.587+0000 7f6b5ca00700 1 -- 172.21.15.47:0/3170508598 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50004160 con 0x7f6b601103b0 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.587+0000 7f6b5ca00700 1 -- 172.21.15.47:0/3170508598 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6b50004300 con 0x7f6b601103b0 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.587+0000 7f6b5ca00700 1 -- 172.21.15.47:0/3170508598 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50011af0 con 0x7f6b601103b0 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.588+0000 7f6b64c00700 1 -- 172.21.15.47:0/3170508598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 msgr2=0x7f6b601107c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.588+0000 7f6b64c00700 1 --2- 172.21.15.47:0/3170508598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601107c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b500098a0 tx=0x7f6b50009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.588+0000 7f6b64c00700 1 -- 172.21.15.47:0/3170508598 shutdown_connections 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.588+0000 7f6b64c00700 1 --2- 172.21.15.47:0/3170508598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601107c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.588+0000 7f6b64c00700 1 -- 172.21.15.47:0/3170508598 >> 172.21.15.47:0/3170508598 conn(0x7f6b6007f640 msgr2=0x7f6b60081a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.588+0000 7f6b64c00700 1 -- 172.21.15.47:0/3170508598 shutdown_connections 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.588+0000 7f6b64c00700 1 -- 172.21.15.47:0/3170508598 wait complete. 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.590+0000 7f6b64c00700 1 Processor -- start 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.590+0000 7f6b64c00700 1 -- start start 2024-05-14T12:12:21.545 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.590+0000 7f6b64c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.590+0000 7f6b64c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b60114890 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.590+0000 7f6b5de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.590+0000 7f6b5de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33116/0 (socket says 172.21.15.47:33116) 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.590+0000 7f6b5de00700 1 -- 172.21.15.47:0/3584301612 learned_addr learned my addr 172.21.15.47:0/3584301612 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.591+0000 7f6b5de00700 1 -- 172.21.15.47:0/3584301612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b601a4cd0 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.591+0000 7f6b5de00700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601a4790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b500090e0 tx=0x7f6b50011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.591+0000 7f6b56a00700 1 -- 172.21.15.47:0/3584301612 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b500039e0 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.592+0000 7f6b56a00700 1 -- 172.21.15.47:0/3584301612 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6b50003b80 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.592+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b601a4f60 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.592+0000 7f6b56a00700 1 -- 172.21.15.47:0/3584301612 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50024690 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.592+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b601a7b70 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.593+0000 7f6b56a00700 1 -- 172.21.15.47:0/3584301612 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f6b50022020 con 0x7f6b601103b0 2024-05-14T12:12:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.593+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b60064e20 con 0x7f6b601103b0 2024-05-14T12:12:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.594+0000 7f6b56a00700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f6b4403e520 0x7f6b44040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.594+0000 7f6b56a00700 1 -- 172.21.15.47:0/3584301612 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6b500537e0 con 0x7f6b601103b0 2024-05-14T12:12:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.594+0000 7f6b5d400700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f6b4403e520 0x7f6b44040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.595+0000 7f6b5d400700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f6b4403e520 0x7f6b44040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c006fd0 tx=0x7f6b4c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.600+0000 7f6b56a00700 1 -- 172.21.15.47:0/3584301612 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b500172b0 con 0x7f6b601103b0 2024-05-14T12:12:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.851+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6b600815f0 con 0x7f6b4403e520 2024-05-14T12:12:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.862+0000 7f6b56a00700 1 -- 172.21.15.47:0/3584301612 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6b600815f0 con 0x7f6b4403e520 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f6b4403e520 msgr2=0x7f6b44040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f6b4403e520 0x7f6b44040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c006fd0 tx=0x7f6b4c006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 msgr2=0x7f6b601a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601a4790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b500090e0 tx=0x7f6b50011940 comp rx=0 tx=0).stop 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 shutdown_connections 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f6b4403e520 0x7f6b44040a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 --2- 172.21.15.47:0/3584301612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b601103b0 0x7f6b601a4790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 >> 172.21.15.47:0/3584301612 conn(0x7f6b6007f640 msgr2=0x7f6b60080ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 shutdown_connections 2024-05-14T12:12:21.549 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:20.865+0000 7f6b64c00700 1 -- 172.21.15.47:0/3584301612 wait complete. 2024-05-14T12:12:21.550 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mgr service... 2024-05-14T12:12:22.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:21 smithi047 ceph-mon[31254]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:22.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:21 smithi047 ceph-mon[31254]: Saving service mon spec with placement count:5 2024-05-14T12:12:22.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:21 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.507+0000 7f1580000700 1 Processor -- start 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.508+0000 7f1580000700 1 -- start start 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.508+0000 7f1580000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157810cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.508+0000 7f1580000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f157807cdc0 con 0x7f157810a8c0 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.509+0000 7f157d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157810cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.509+0000 7f157d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157810cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33126/0 (socket says 172.21.15.47:33126) 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.509+0000 7f157d600700 1 -- 172.21.15.47:0/2065191763 learned_addr learned my addr 172.21.15.47:0/2065191763 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.509+0000 7f157d600700 1 -- 172.21.15.47:0/2065191763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157810d220 con 0x7f157810a8c0 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.510+0000 7f157d600700 1 --2- 172.21.15.47:0/2065191763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157810cce0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f156c0098a0 tx=0x7f156c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cf72242d62c1b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:23.741 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.510+0000 7f1577e00700 1 -- 172.21.15.47:0/2065191763 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f156c004160 con 0x7f157810a8c0 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.510+0000 7f1577e00700 1 -- 172.21.15.47:0/2065191763 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f156c004300 con 0x7f157810a8c0 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.510+0000 7f1577e00700 1 -- 172.21.15.47:0/2065191763 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f156c011af0 con 0x7f157810a8c0 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.511+0000 7f1580000700 1 -- 172.21.15.47:0/2065191763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 msgr2=0x7f157810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.511+0000 7f1580000700 1 --2- 172.21.15.47:0/2065191763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157810cce0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f156c0098a0 tx=0x7f156c009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.512+0000 7f1580000700 1 -- 172.21.15.47:0/2065191763 shutdown_connections 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.512+0000 7f1580000700 1 --2- 172.21.15.47:0/2065191763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157810cce0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.512+0000 7f1580000700 1 -- 172.21.15.47:0/2065191763 >> 172.21.15.47:0/2065191763 conn(0x7f1578104440 msgr2=0x7f1578106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.512+0000 7f1580000700 1 -- 172.21.15.47:0/2065191763 shutdown_connections 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.512+0000 7f1580000700 1 -- 172.21.15.47:0/2065191763 wait complete. 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.513+0000 7f1580000700 1 Processor -- start 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.513+0000 7f1580000700 1 -- start start 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.514+0000 7f1580000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:23.742 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.514+0000 7f1580000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f157810e120 con 0x7f157810a8c0 2024-05-14T12:12:23.745 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.514+0000 7f157d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:23.745 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.514+0000 7f157d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157819e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33136/0 (socket says 172.21.15.47:33136) 2024-05-14T12:12:23.745 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.514+0000 7f157d600700 1 -- 172.21.15.47:0/3372637348 learned_addr learned my addr 172.21.15.47:0/3372637348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.515+0000 7f157d600700 1 -- 172.21.15.47:0/3372637348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157819e700 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.515+0000 7f157d600700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157819e1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f156c0117b0 tx=0x7f156c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.515+0000 7f1576000700 1 -- 172.21.15.47:0/3372637348 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f156c0039c0 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.515+0000 7f1576000700 1 -- 172.21.15.47:0/3372637348 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f156c003b60 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.515+0000 7f1576000700 1 -- 172.21.15.47:0/3372637348 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f156c0196a0 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.515+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157819e990 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.516+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15781a15a0 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.517+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1578064e20 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.518+0000 7f1576000700 1 -- 172.21.15.47:0/3372637348 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f156c01ab00 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.518+0000 7f1576000700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f156003e470 0x7f1560040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.518+0000 7f1576000700 1 -- 172.21.15.47:0/3372637348 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f156c053b80 con 0x7f157810a8c0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.519+0000 7f157cc00700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f156003e470 0x7f1560040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:23.746 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.519+0000 7f157cc00700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f156003e470 0x7f1560040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1564006fd0 tx=0x7f1564006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.529+0000 7f1576000700 1 -- 172.21.15.47:0/3372637348 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f156c053510 con 0x7f157810a8c0 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.806+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1578106590 con 0x7f156003e470 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.815+0000 7f1576000700 1 -- 172.21.15.47:0/3372637348 <== mgr.14120 v2:172.21.15.47:6800/3791767528 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1578106590 con 0x7f156003e470 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f156003e470 msgr2=0x7f1560040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f156003e470 0x7f1560040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1564006fd0 tx=0x7f1564006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 msgr2=0x7f157819e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157819e1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f156c0117b0 tx=0x7f156c011b70 comp rx=0 tx=0).stop 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 shutdown_connections 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f156003e470 0x7f1560040980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 --2- 172.21.15.47:0/3372637348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f157810a8c0 0x7f157819e1c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 >> 172.21.15.47:0/3372637348 conn(0x7f1578104440 msgr2=0x7f1578105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 shutdown_connections 2024-05-14T12:12:23.747 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:22.818+0000 7f1580000700 1 -- 172.21.15.47:0/3372637348 wait complete. 2024-05-14T12:12:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:23 smithi047 ceph-mon[31254]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:23 smithi047 ceph-mon[31254]: Saving service mgr spec with placement count:2 2024-05-14T12:12:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:23 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:23 smithi047 ceph-mon[31254]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:12:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:23 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:25.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:24 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:25.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:24 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2716909767' entity='client.admin' 2024-05-14T12:12:25.323 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.410+0000 7f58cd800700 1 Processor -- start 2024-05-14T12:12:25.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.410+0000 7f58cd800700 1 -- start start 2024-05-14T12:12:25.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.411+0000 7f58cd800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c81090f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.411+0000 7f58cd800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58c81096e0 con 0x7f58c8108ce0 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.411+0000 7f58c6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c81090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.411+0000 7f58c6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c81090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33144/0 (socket says 172.21.15.47:33144) 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.411+0000 7f58c6a00700 1 -- 172.21.15.47:0/1047706290 learned_addr learned my addr 172.21.15.47:0/1047706290 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.412+0000 7f58c6a00700 1 -- 172.21.15.47:0/1047706290 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c8109e10 con 0x7f58c8108ce0 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.412+0000 7f58c6a00700 1 --2- 172.21.15.47:0/1047706290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c81090f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f58b80098a0 tx=0x7f58b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e040de1e0515c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.413+0000 7f58c6000700 1 -- 172.21.15.47:0/1047706290 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b8004160 con 0x7f58c8108ce0 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.413+0000 7f58c6000700 1 -- 172.21.15.47:0/1047706290 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b8004300 con 0x7f58c8108ce0 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.413+0000 7f58c6000700 1 -- 172.21.15.47:0/1047706290 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b8011a20 con 0x7f58c8108ce0 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.414+0000 7f58cd800700 1 -- 172.21.15.47:0/1047706290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 msgr2=0x7f58c81090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.414+0000 7f58cd800700 1 --2- 172.21.15.47:0/1047706290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c81090f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f58b80098a0 tx=0x7f58b8009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.414+0000 7f58cd800700 1 -- 172.21.15.47:0/1047706290 shutdown_connections 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.414+0000 7f58cd800700 1 --2- 172.21.15.47:0/1047706290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c81090f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:25.413 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.414+0000 7f58cd800700 1 -- 172.21.15.47:0/1047706290 >> 172.21.15.47:0/1047706290 conn(0x7f58c8104440 msgr2=0x7f58c8106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.414+0000 7f58cd800700 1 -- 172.21.15.47:0/1047706290 shutdown_connections 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.414+0000 7f58cd800700 1 -- 172.21.15.47:0/1047706290 wait complete. 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.415+0000 7f58cd800700 1 Processor -- start 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.415+0000 7f58cd800700 1 -- start start 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.415+0000 7f58cd800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.415+0000 7f58cd800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58c810d1c0 con 0x7f58c8108ce0 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.416+0000 7f58c6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.416+0000 7f58c6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c819e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33146/0 (socket says 172.21.15.47:33146) 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.416+0000 7f58c6a00700 1 -- 172.21.15.47:0/2716909767 learned_addr learned my addr 172.21.15.47:0/2716909767 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.416+0000 7f58c6a00700 1 -- 172.21.15.47:0/2716909767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c819e720 con 0x7f58c8108ce0 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.417+0000 7f58c6a00700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c819e1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009130 tx=0x7f58b8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.417+0000 7f58bf400700 1 -- 172.21.15.47:0/2716909767 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b8003aa0 con 0x7f58c8108ce0 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.417+0000 7f58bf400700 1 -- 172.21.15.47:0/2716909767 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b801a8e0 con 0x7f58c8108ce0 2024-05-14T12:12:25.414 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.417+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c819e9b0 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.417+0000 7f58bf400700 1 -- 172.21.15.47:0/2716909767 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58b80248f0 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.417+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c81a15c0 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.418+0000 7f58bf400700 1 -- 172.21.15.47:0/2716909767 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f58b8022020 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.419+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c8064e20 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.419+0000 7f58bf400700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f58ac03e4c0 0x7f58ac0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.419+0000 7f58bf400700 1 -- 172.21.15.47:0/2716909767 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f58b80538d0 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.419+0000 7f58bfe00700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f58ac03e4c0 0x7f58ac0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.420+0000 7f58bfe00700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f58ac03e4c0 0x7f58ac0409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58b0006fd0 tx=0x7f58b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.425+0000 7f58bf400700 1 -- 172.21.15.47:0/2716909767 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f58b8029df0 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.661+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f58c802e8c0 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.666+0000 7f58bf400700 1 -- 172.21.15.47:0/2716909767 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f58b8053220 con 0x7f58c8108ce0 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f58ac03e4c0 msgr2=0x7f58ac0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f58ac03e4c0 0x7f58ac0409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58b0006fd0 tx=0x7f58b0006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:25.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 msgr2=0x7f58c819e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c819e1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009130 tx=0x7f58b8011aa0 comp rx=0 tx=0).stop 2024-05-14T12:12:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 shutdown_connections 2024-05-14T12:12:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f58ac03e4c0 0x7f58ac0409d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 --2- 172.21.15.47:0/2716909767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58c8108ce0 0x7f58c819e1e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 >> 172.21.15.47:0/2716909767 conn(0x7f58c8104440 msgr2=0x7f58c8194790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 shutdown_connections 2024-05-14T12:12:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:24.669+0000 7f58cd800700 1 -- 172.21.15.47:0/2716909767 wait complete. 2024-05-14T12:12:26.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:25 smithi047 ceph-mon[31254]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:12:27.145 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.996+0000 7f4468e00700 1 Processor -- start 2024-05-14T12:12:27.145 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.996+0000 7f4468e00700 1 -- start start 2024-05-14T12:12:27.145 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.996+0000 7f4468e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641107f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:27.145 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.996+0000 7f4468e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4464110de0 con 0x7f44641103e0 2024-05-14T12:12:27.146 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.997+0000 7f4461e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:27.146 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.997+0000 7f4461e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33156/0 (socket says 172.21.15.47:33156) 2024-05-14T12:12:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.997+0000 7f4461e00700 1 -- 172.21.15.47:0/3260262836 learned_addr learned my addr 172.21.15.47:0/3260262836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.997+0000 7f4461e00700 1 -- 172.21.15.47:0/3260262836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44641114c0 con 0x7f44641103e0 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.998+0000 7f4461e00700 1 --2- 172.21.15.47:0/3260262836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641107f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44540098a0 tx=0x7f4454009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4af227c79745e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.998+0000 7f4460a00700 1 -- 172.21.15.47:0/3260262836 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4454004160 con 0x7f44641103e0 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.998+0000 7f4460a00700 1 -- 172.21.15.47:0/3260262836 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4454004300 con 0x7f44641103e0 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.998+0000 7f4460a00700 1 -- 172.21.15.47:0/3260262836 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4454011a20 con 0x7f44641103e0 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.999+0000 7f4468e00700 1 -- 172.21.15.47:0/3260262836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 msgr2=0x7f44641107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.999+0000 7f4468e00700 1 --2- 172.21.15.47:0/3260262836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641107f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44540098a0 tx=0x7f4454009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.999+0000 7f4468e00700 1 -- 172.21.15.47:0/3260262836 shutdown_connections 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.999+0000 7f4468e00700 1 --2- 172.21.15.47:0/3260262836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641107f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.999+0000 7f4468e00700 1 -- 172.21.15.47:0/3260262836 >> 172.21.15.47:0/3260262836 conn(0x7f446407f530 msgr2=0x7f4464081950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.999+0000 7f4468e00700 1 -- 172.21.15.47:0/3260262836 shutdown_connections 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:25.999+0000 7f4468e00700 1 -- 172.21.15.47:0/3260262836 wait complete. 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.000+0000 7f4468e00700 1 Processor -- start 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.000+0000 7f4468e00700 1 -- start start 2024-05-14T12:12:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.001+0000 7f4468e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.001+0000 7f4468e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4464114870 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.001+0000 7f4461e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.001+0000 7f4461e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641a47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33168/0 (socket says 172.21.15.47:33168) 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.001+0000 7f4461e00700 1 -- 172.21.15.47:0/172270182 learned_addr learned my addr 172.21.15.47:0/172270182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.001+0000 7f4461e00700 1 -- 172.21.15.47:0/172270182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44641a4cf0 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.002+0000 7f4461e00700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641a47b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4454011a20 tx=0x7f4454011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.002+0000 7f445aa00700 1 -- 172.21.15.47:0/172270182 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44540039c0 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.002+0000 7f445aa00700 1 -- 172.21.15.47:0/172270182 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4454003b60 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.002+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44641a4f80 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.002+0000 7f445aa00700 1 -- 172.21.15.47:0/172270182 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4454019700 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.002+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44641a7b90 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.003+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4464064e20 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.003+0000 7f445aa00700 1 -- 172.21.15.47:0/172270182 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f445401a430 con 0x7f44641103e0 2024-05-14T12:12:27.153 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.004+0000 7f445aa00700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f444803e470 0x7f4448040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.004+0000 7f445aa00700 1 -- 172.21.15.47:0/172270182 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f44540539a0 con 0x7f44641103e0 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.004+0000 7f4461400700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f444803e470 0x7f4448040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.005+0000 7f4461400700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f444803e470 0x7f4448040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f444c006fd0 tx=0x7f444c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.010+0000 7f445aa00700 1 -- 172.21.15.47:0/172270182 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4454029260 con 0x7f44641103e0 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.255+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f44641a7d60 con 0x7f44641103e0 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.261+0000 7f445aa00700 1 -- 172.21.15.47:0/172270182 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f4454053700 con 0x7f44641103e0 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.265+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f444803e470 msgr2=0x7f4448040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.265+0000 7f4468e00700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f444803e470 0x7f4448040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f444c006fd0 tx=0x7f444c006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.265+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 msgr2=0x7f44641a47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:27.154 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.265+0000 7f4468e00700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641a47b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4454011a20 tx=0x7f4454011b00 comp rx=0 tx=0).stop 2024-05-14T12:12:27.155 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.266+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 shutdown_connections 2024-05-14T12:12:27.155 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.266+0000 7f4468e00700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f444803e470 0x7f4448040980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:27.155 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.266+0000 7f4468e00700 1 --2- 172.21.15.47:0/172270182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641103e0 0x7f44641a47b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:27.155 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.266+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 >> 172.21.15.47:0/172270182 conn(0x7f446407f530 msgr2=0x7f4464080e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:27.155 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.266+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 shutdown_connections 2024-05-14T12:12:27.155 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:26.266+0000 7f4468e00700 1 -- 172.21.15.47:0/172270182 wait complete. 2024-05-14T12:12:27.155 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling the dashboard module... 2024-05-14T12:12:27.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:27 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/172270182' entity='client.admin' 2024-05-14T12:12:27.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:27 smithi047 ceph-mon[31254]: from='mgr.14120 172.21.15.47:0/931024371' entity='mgr.x' 2024-05-14T12:12:28.419 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:28 smithi047 ceph-mon[31254]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:12:28.419 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:28 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3904548320' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-14T12:12:28.705 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:28 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: ignoring --setuser ceph since I am not root 2024-05-14T12:12:28.705 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:28 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: ignoring --setgroup ceph since I am not root 2024-05-14T12:12:28.705 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:28 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:28.704+0000 7f86aaf4b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.842+0000 7f5332a00700 1 Processor -- start 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.842+0000 7f5332a00700 1 -- start start 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.842+0000 7f5332a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c07d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.842+0000 7f5332a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f532c07d7c0 con 0x7f532c07edb0 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.843+0000 7f532be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c07d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.843+0000 7f532be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c07d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33184/0 (socket says 172.21.15.47:33184) 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.843+0000 7f532be00700 1 -- 172.21.15.47:0/913656151 learned_addr learned my addr 172.21.15.47:0/913656151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.843+0000 7f532be00700 1 -- 172.21.15.47:0/913656151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c07d940 con 0x7f532c07edb0 2024-05-14T12:12:29.036 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.844+0000 7f532be00700 1 --2- 172.21.15.47:0/913656151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c07d280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f531c0098a0 tx=0x7f531c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b6836e58075591 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.844+0000 7f532aa00700 1 -- 172.21.15.47:0/913656151 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c004160 con 0x7f532c07edb0 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.844+0000 7f532aa00700 1 -- 172.21.15.47:0/913656151 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f531c004300 con 0x7f532c07edb0 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.844+0000 7f532aa00700 1 -- 172.21.15.47:0/913656151 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c011a20 con 0x7f532c07edb0 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.845+0000 7f5332a00700 1 -- 172.21.15.47:0/913656151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 msgr2=0x7f532c07d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.845+0000 7f5332a00700 1 --2- 172.21.15.47:0/913656151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c07d280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f531c0098a0 tx=0x7f531c009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.845+0000 7f5332a00700 1 -- 172.21.15.47:0/913656151 shutdown_connections 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.845+0000 7f5332a00700 1 --2- 172.21.15.47:0/913656151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c07d280 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.845+0000 7f5332a00700 1 -- 172.21.15.47:0/913656151 >> 172.21.15.47:0/913656151 conn(0x7f532c1054e0 msgr2=0x7f532c107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.846+0000 7f5332a00700 1 -- 172.21.15.47:0/913656151 shutdown_connections 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.846+0000 7f5332a00700 1 -- 172.21.15.47:0/913656151 wait complete. 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.847+0000 7f5332a00700 1 Processor -- start 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.847+0000 7f5332a00700 1 -- start start 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.847+0000 7f5332a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c1a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.847+0000 7f5332a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f532c10c030 con 0x7f532c07edb0 2024-05-14T12:12:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.848+0000 7f532be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c1a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.848+0000 7f532be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c1a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33192/0 (socket says 172.21.15.47:33192) 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.848+0000 7f532be00700 1 -- 172.21.15.47:0/3904548320 learned_addr learned my addr 172.21.15.47:0/3904548320 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.848+0000 7f532be00700 1 -- 172.21.15.47:0/3904548320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c1a4c60 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.848+0000 7f532be00700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c1a4720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f531c009520 tx=0x7f531c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.849+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c0039e0 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.849+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f531c01b8f0 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.849+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c0197d0 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.849+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c1a4ef0 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.849+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c1a7b00 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.850+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532c064e20 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.851+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f531c01b440 con 0x7f532c07edb0 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.851+0000 7f5328c00700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f531003e470 0x7f5310040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:29.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.851+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f531c053fd0 con 0x7f532c07edb0 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.851+0000 7f532b400700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f531003e470 0x7f5310040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.852+0000 7f532b400700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f531003e470 0x7f5310040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5318006fd0 tx=0x7f5318006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:27.857+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f531c01f030 con 0x7f532c07edb0 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.166+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f532c02e860 con 0x7f532c07edb0 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.263+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f531c00f2e0 con 0x7f532c07edb0 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.267+0000 7f5328c00700 1 -- 172.21.15.47:0/3904548320 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f531c018d00 con 0x7f532c07edb0 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.268+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f531003e470 msgr2=0x7f5310040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.268+0000 7f5332a00700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f531003e470 0x7f5310040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5318006fd0 tx=0x7f5318006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.268+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 msgr2=0x7f532c1a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.268+0000 7f5332a00700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c1a4720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f531c009520 tx=0x7f531c011aa0 comp rx=0 tx=0).stop 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.269+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 shutdown_connections 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.269+0000 7f5332a00700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f531003e470 0x7f5310040980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.269+0000 7f5332a00700 1 --2- 172.21.15.47:0/3904548320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f532c07edb0 0x7f532c1a4720 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:29.039 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.269+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 >> 172.21.15.47:0/3904548320 conn(0x7f532c1054e0 msgr2=0x7f532c19b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:29.040 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.269+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 shutdown_connections 2024-05-14T12:12:29.040 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:28.269+0000 7f5332a00700 1 -- 172.21.15.47:0/3904548320 wait complete. 2024-05-14T12:12:29.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:28 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:28.974+0000 7f86aaf4b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:12:29.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:29 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:29.113+0000 7f86aaf4b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T12:12:29.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:29 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3904548320' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-14T12:12:29.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:29 smithi047 ceph-mon[31254]: mgrmap e9: x(active, since 25s) 2024-05-14T12:12:29.934 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:29 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:29.535+0000 7f86aaf4b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T12:12:29.934 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:29 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:29.659+0000 7f86aaf4b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T12:12:30.665 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:30 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/198688434' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-14T12:12:30.674 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.719+0000 7fd0b3a00700 1 Processor -- start 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.719+0000 7fd0b3a00700 1 -- start start 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.720+0000 7fd0b3a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac10a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.720+0000 7fd0b3a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac10a7f0 con 0x7fd0ac109df0 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.720+0000 7fd0b1000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac10a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.721+0000 7fd0b1000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac10a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52056/0 (socket says 172.21.15.47:52056) 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.721+0000 7fd0b1000700 1 -- 172.21.15.47:0/3774749185 learned_addr learned my addr 172.21.15.47:0/3774749185 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.721+0000 7fd0b1000700 1 -- 172.21.15.47:0/3774749185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac10af20 con 0x7fd0ac109df0 2024-05-14T12:12:30.681 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.721+0000 7fd0b1000700 1 --2- 172.21.15.47:0/3774749185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac10a200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00098a0 tx=0x7fd0a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948dea418fe79f5b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.722+0000 7fd0ab400700 1 -- 172.21.15.47:0/3774749185 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a0004160 con 0x7fd0ac109df0 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.722+0000 7fd0ab400700 1 -- 172.21.15.47:0/3774749185 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0a0004300 con 0x7fd0ac109df0 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.722+0000 7fd0ab400700 1 -- 172.21.15.47:0/3774749185 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a0011a20 con 0x7fd0ac109df0 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.723+0000 7fd0b3a00700 1 -- 172.21.15.47:0/3774749185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 msgr2=0x7fd0ac10a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.723+0000 7fd0b3a00700 1 --2- 172.21.15.47:0/3774749185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac10a200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00098a0 tx=0x7fd0a0009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.723+0000 7fd0b3a00700 1 -- 172.21.15.47:0/3774749185 shutdown_connections 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.723+0000 7fd0b3a00700 1 --2- 172.21.15.47:0/3774749185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac10a200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.723+0000 7fd0b3a00700 1 -- 172.21.15.47:0/3774749185 >> 172.21.15.47:0/3774749185 conn(0x7fd0ac105470 msgr2=0x7fd0ac1078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.723+0000 7fd0b3a00700 1 -- 172.21.15.47:0/3774749185 shutdown_connections 2024-05-14T12:12:30.682 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.723+0000 7fd0b3a00700 1 -- 172.21.15.47:0/3774749185 wait complete. 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.724+0000 7fd0b3a00700 1 Processor -- start 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.724+0000 7fd0b3a00700 1 -- start start 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.725+0000 7fd0b3a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.725+0000 7fd0b3a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac10e2d0 con 0x7fd0ac109df0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.725+0000 7fd0b1000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.725+0000 7fd0b1000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac19e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52072/0 (socket says 172.21.15.47:52072) 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.725+0000 7fd0b1000700 1 -- 172.21.15.47:0/198688434 learned_addr learned my addr 172.21.15.47:0/198688434 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.725+0000 7fd0b1000700 1 -- 172.21.15.47:0/198688434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac19e710 con 0x7fd0ac109df0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.726+0000 7fd0b1000700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac19e1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0011a20 tx=0x7fd0a0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.726+0000 7fd0a9600700 1 -- 172.21.15.47:0/198688434 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a00039c0 con 0x7fd0ac109df0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.726+0000 7fd0a9600700 1 -- 172.21.15.47:0/198688434 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0a0003b60 con 0x7fd0ac109df0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.726+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ac19e9a0 con 0x7fd0ac109df0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.726+0000 7fd0a9600700 1 -- 172.21.15.47:0/198688434 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a0019700 con 0x7fd0ac109df0 2024-05-14T12:12:30.683 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.726+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ac1a15b0 con 0x7fd0ac109df0 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.727+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ac064e20 con 0x7fd0ac109df0 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.727+0000 7fd0a9600700 1 -- 172.21.15.47:0/198688434 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fd0a0019a00 con 0x7fd0ac109df0 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.728+0000 7fd0a9600700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 0x7fd094040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.728+0000 7fd0a9600700 1 -- 172.21.15.47:0/198688434 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd0a0053a40 con 0x7fd0ac109df0 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.728+0000 7fd0abe00700 1 -- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 msgr2=0x7fd094040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.728+0000 7fd0abe00700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 0x7fd094040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.734+0000 7fd0a9600700 1 -- 172.21.15.47:0/198688434 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd0a0020e20 con 0x7fd0ac109df0 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.929+0000 7fd0abe00700 1 -- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 msgr2=0x7fd094040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:29.929+0000 7fd0abe00700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 0x7fd094040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.028+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd0ac1a1780 con 0x7fd0ac109df0 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.029+0000 7fd0a9600700 1 -- 172.21.15.47:0/198688434 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fd0a000b3e0 con 0x7fd0ac109df0 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 msgr2=0x7fd094040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 0x7fd094040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:30.684 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 msgr2=0x7fd0ac19e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac19e1d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0011a20 tx=0x7fd0a0011b00 comp rx=0 tx=0).stop 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 shutdown_connections 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7fd09403e470 0x7fd094040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 --2- 172.21.15.47:0/198688434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ac109df0 0x7fd0ac19e1d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 >> 172.21.15.47:0/198688434 conn(0x7fd0ac105470 msgr2=0x7fd0ac105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 shutdown_connections 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:30.032+0000 7fd0b3a00700 1 -- 172.21.15.47:0/198688434 wait complete. 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-05-14T12:12:30.685 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 9... 2024-05-14T12:12:31.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:31 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:31.277+0000 7f86aaf4b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T12:12:31.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:31 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:31.519+0000 7f86aaf4b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T12:12:32.143 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:31 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:31.742+0000 7f86aaf4b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T12:12:32.485 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:32 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:32.142+0000 7f86aaf4b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T12:12:32.485 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:32 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:32.271+0000 7f86aaf4b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T12:12:32.798 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:32 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:32.530+0000 7f86aaf4b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T12:12:33.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:32 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:32.796+0000 7f86aaf4b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:12:33.930 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:33 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:33.622+0000 7f86aaf4b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T12:12:34.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:33 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:33.929+0000 7f86aaf4b200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T12:12:34.656 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:34 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:34.517+0000 7f86aaf4b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T12:12:34.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:34 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:34.654+0000 7f86aaf4b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T12:12:35.485 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:35 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:35.134+0000 7f86aaf4b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T12:12:35.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:35 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:35.611+0000 7f86aaf4b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T12:12:35.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:35 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:35.744+0000 7f86aaf4b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T12:12:36.415 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:36.087+0000 7f86aaf4b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T12:12:36.415 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:36.277+0000 7f86aaf4b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T12:12:36.415 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:36.414+0000 7f86aaf4b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T12:12:37.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:36.825+0000 7f86aaf4b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T12:12:37.235 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:36.960+0000 7f86aaf4b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T12:12:37.985 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:37 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:37.761+0000 7f86aaf4b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:12:38 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:12:38.069+0000 7f86aaf4b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: Active manager daemon x restarted 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: Activating manager daemon x 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: osdmap e3: 0 total, 0 up, 0 in 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: mgrmap e10: x(active, starting, since 0.0116253s) 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T12:12:38.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T12:12:38.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:38 smithi047 ceph-mon[31254]: Manager daemon x is now available 2024-05-14T12:12:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T12:12:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T12:12:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:39 smithi047 ceph-mon[31254]: mgrmap e11: x(active, since 1.01554s) 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.316+0000 7f1318000700 1 Processor -- start 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.316+0000 7f1318000700 1 -- start start 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.317+0000 7f1318000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101107c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:39.802 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.317+0000 7f1318000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1310110db0 con 0x7f13101103b0 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.317+0000 7f1315600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.317+0000 7f1315600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101107c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52076/0 (socket says 172.21.15.47:52076) 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.317+0000 7f1315600700 1 -- 172.21.15.47:0/160723594 learned_addr learned my addr 172.21.15.47:0/160723594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.318+0000 7f1315600700 1 -- 172.21.15.47:0/160723594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13101114e0 con 0x7f13101103b0 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.318+0000 7f1315600700 1 --2- 172.21.15.47:0/160723594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101107c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13040098a0 tx=0x7f1304009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124bcf0694da7fcc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.318+0000 7f130fe00700 1 -- 172.21.15.47:0/160723594 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1304004160 con 0x7f13101103b0 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.319+0000 7f130fe00700 1 -- 172.21.15.47:0/160723594 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1304004300 con 0x7f13101103b0 2024-05-14T12:12:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.319+0000 7f130fe00700 1 -- 172.21.15.47:0/160723594 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1304011a20 con 0x7f13101103b0 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.320+0000 7f1318000700 1 -- 172.21.15.47:0/160723594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 msgr2=0x7f13101107c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.320+0000 7f1318000700 1 --2- 172.21.15.47:0/160723594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101107c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13040098a0 tx=0x7f1304009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.320+0000 7f1318000700 1 -- 172.21.15.47:0/160723594 shutdown_connections 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.320+0000 7f1318000700 1 --2- 172.21.15.47:0/160723594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101107c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.320+0000 7f1318000700 1 -- 172.21.15.47:0/160723594 >> 172.21.15.47:0/160723594 conn(0x7f131007f640 msgr2=0x7f1310081a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.320+0000 7f1318000700 1 -- 172.21.15.47:0/160723594 shutdown_connections 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.320+0000 7f1318000700 1 -- 172.21.15.47:0/160723594 wait complete. 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.321+0000 7f1318000700 1 Processor -- start 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.321+0000 7f1318000700 1 -- start start 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.321+0000 7f1318000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.321+0000 7f1318000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1310114890 con 0x7f13101103b0 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.322+0000 7f1315600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.322+0000 7f1315600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52086/0 (socket says 172.21.15.47:52086) 2024-05-14T12:12:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.322+0000 7f1315600700 1 -- 172.21.15.47:0/3258813028 learned_addr learned my addr 172.21.15.47:0/3258813028 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.322+0000 7f1315600700 1 -- 172.21.15.47:0/3258813028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13101a4c90 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.322+0000 7f1315600700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101a4750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1304009130 tx=0x7f1304011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.323+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1304003aa0 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.323+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f130401a8e0 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.323+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13040248f0 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.323+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13101a4f20 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.323+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13101a7b30 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.324+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f1304022020 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.325+0000 7f130e000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.325+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 --> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f12f8041140 con 0x7f12f803e520 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.325+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1304053970 con 0x7f13101103b0 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.325+0000 7f1314c00700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 msgr2=0x7f12f8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.325+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T12:12:39.812 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.526+0000 7f1314c00700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 msgr2=0x7f12f8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.526+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.927+0000 7f1314c00700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 msgr2=0x7f12f8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:31.927+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:32.728+0000 7f1314c00700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 msgr2=0x7f12f8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:32.728+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:34.330+0000 7f1314c00700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 msgr2=0x7f12f8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:34.330+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:37.533+0000 7f1314c00700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 msgr2=0x7f12f8040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.47:6800/3791767528 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:37.533+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:38.081+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f1304018530 con 0x7f13101103b0 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:38.082+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 msgr2=0x7f12f8040a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:38.082+0000 7f130e000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:39.813 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.086+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f13040559a0 con 0x7f13101103b0 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.086+0000 7f130e000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1304053500 0x7f12f8044000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.086+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f12f8041140 con 0x7f1304053500 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.089+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1304053500 0x7f12f8044000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.093+0000 7f1314c00700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1304053500 0x7f12f8044000 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f12fc003a10 tx=0x7f12fc009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.096+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f12f8041140 con 0x7f1304053500 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.105+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1310064e20 con 0x7f1304053500 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f130e000700 1 -- 172.21.15.47:0/3258813028 <== mgr.14152 v2:172.21.15.47:6800/1176244093 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f1310064e20 con 0x7f1304053500 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1304053500 msgr2=0x7f12f8044000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1304053500 0x7f12f8044000 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f12fc003a10 tx=0x7f12fc009270 comp rx=0 tx=0).stop 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 msgr2=0x7f13101a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101a4750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1304009130 tx=0x7f1304011aa0 comp rx=0 tx=0).stop 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 shutdown_connections 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1304053500 0x7f12f8044000 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:39.814 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13101103b0 0x7f13101a4750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:39.815 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 --2- 172.21.15.47:0/3258813028 >> [v2:172.21.15.47:6800/3791767528,v1:172.21.15.47:6801/3791767528] conn(0x7f12f803e520 0x7f12f8040a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:39.815 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.106+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 >> 172.21.15.47:0/3258813028 conn(0x7f131007f640 msgr2=0x7f1310080ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:39.815 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.107+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 shutdown_connections 2024-05-14T12:12:39.815 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:39.107+0000 7f1318000700 1 -- 172.21.15.47:0/3258813028 wait complete. 2024-05-14T12:12:39.815 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 9 is available 2024-05-14T12:12:39.815 INFO:teuthology.orchestra.run.smithi047.stdout:Generating a dashboard self-signed certificate... 2024-05-14T12:12:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:40 smithi047 ceph-mon[31254]: [14/May/2024:12:12:39] ENGINE Bus STARTING 2024-05-14T12:12:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:40 smithi047 ceph-mon[31254]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-14T12:12:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:40 smithi047 ceph-mon[31254]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-14T12:12:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:40 smithi047 ceph-mon[31254]: [14/May/2024:12:12:39] ENGINE Serving on http://172.21.15.47:8765 2024-05-14T12:12:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:40 smithi047 ceph-mon[31254]: [14/May/2024:12:12:39] ENGINE Serving on https://172.21.15.47:7150 2024-05-14T12:12:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:40 smithi047 ceph-mon[31254]: [14/May/2024:12:12:39] ENGINE Bus STARTED 2024-05-14T12:12:41.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:41 smithi047 ceph-mon[31254]: mgrmap e12: x(active, since 2s) 2024-05-14T12:12:41.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:41 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:42 smithi047 ceph-mon[31254]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:42 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:42 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.896+0000 7f42bd800700 1 Processor -- start 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.896+0000 7f42bd800700 1 -- start start 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.896+0000 7f42bd800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b810c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.896+0000 7f42bd800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42b810cf20 con 0x7f42b807cc90 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.897+0000 7f42b6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b810c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.897+0000 7f42b6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b810c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50400/0 (socket says 172.21.15.47:50400) 2024-05-14T12:12:42.281 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.897+0000 7f42b6a00700 1 -- 172.21.15.47:0/1547658049 learned_addr learned my addr 172.21.15.47:0/1547658049 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:42.282 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.898+0000 7f42b6a00700 1 -- 172.21.15.47:0/1547658049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b810d0a0 con 0x7f42b807cc90 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.898+0000 7f42b6a00700 1 --2- 172.21.15.47:0/1547658049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b810c930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42a80098a0 tx=0x7f42a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7207cd5474555523 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.898+0000 7f42b5600700 1 -- 172.21.15.47:0/1547658049 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42a8004160 con 0x7f42b807cc90 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.898+0000 7f42b5600700 1 -- 172.21.15.47:0/1547658049 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a8004300 con 0x7f42b807cc90 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.898+0000 7f42b5600700 1 -- 172.21.15.47:0/1547658049 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42a8011a20 con 0x7f42b807cc90 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.899+0000 7f42bd800700 1 -- 172.21.15.47:0/1547658049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 msgr2=0x7f42b810c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.899+0000 7f42bd800700 1 --2- 172.21.15.47:0/1547658049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b810c930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42a80098a0 tx=0x7f42a8009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.899+0000 7f42bd800700 1 -- 172.21.15.47:0/1547658049 shutdown_connections 2024-05-14T12:12:42.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.900+0000 7f42bd800700 1 --2- 172.21.15.47:0/1547658049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b810c930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.900+0000 7f42bd800700 1 -- 172.21.15.47:0/1547658049 >> 172.21.15.47:0/1547658049 conn(0x7f42b8104440 msgr2=0x7f42b8106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.900+0000 7f42bd800700 1 -- 172.21.15.47:0/1547658049 shutdown_connections 2024-05-14T12:12:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.900+0000 7f42bd800700 1 -- 172.21.15.47:0/1547658049 wait complete. 2024-05-14T12:12:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.901+0000 7f42bd800700 1 Processor -- start 2024-05-14T12:12:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.901+0000 7f42bd800700 1 -- start start 2024-05-14T12:12:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.901+0000 7f42bd800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b819e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.901+0000 7f42bd800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42b810e160 con 0x7f42b807cc90 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.902+0000 7f42b6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b819e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.902+0000 7f42b6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b819e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50416/0 (socket says 172.21.15.47:50416) 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.902+0000 7f42b6a00700 1 -- 172.21.15.47:0/443086655 learned_addr learned my addr 172.21.15.47:0/443086655 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.902+0000 7f42b6a00700 1 -- 172.21.15.47:0/443086655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b819e6a0 con 0x7f42b807cc90 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.903+0000 7f42b6a00700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b819e160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009520 tx=0x7f42a8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.903+0000 7f42af400700 1 -- 172.21.15.47:0/443086655 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42a80039e0 con 0x7f42b807cc90 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.903+0000 7f42af400700 1 -- 172.21.15.47:0/443086655 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a801b8f0 con 0x7f42b807cc90 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.903+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b819e930 con 0x7f42b807cc90 2024-05-14T12:12:42.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.903+0000 7f42af400700 1 -- 172.21.15.47:0/443086655 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42a80197d0 con 0x7f42b807cc90 2024-05-14T12:12:42.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.903+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b81a1540 con 0x7f42b807cc90 2024-05-14T12:12:42.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.905+0000 7f42af400700 1 -- 172.21.15.47:0/443086655 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f42a8019a60 con 0x7f42b807cc90 2024-05-14T12:12:42.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.905+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b8064e20 con 0x7f42b807cc90 2024-05-14T12:12:42.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.905+0000 7f42af400700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f429c03e520 0x7f429c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:42.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.905+0000 7f42af400700 1 -- 172.21.15.47:0/443086655 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f42a8054080 con 0x7f42b807cc90 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.905+0000 7f42b6000700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f429c03e520 0x7f429c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.906+0000 7f42b6000700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f429c03e520 0x7f429c040a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006fd0 tx=0x7f42a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:40.911+0000 7f42af400700 1 -- 172.21.15.47:0/443086655 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f42a801f030 con 0x7f42b807cc90 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.158+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f42b81a17d0 con 0x7f429c03e520 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.600+0000 7f42af400700 1 -- 172.21.15.47:0/443086655 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f42b81a17d0 con 0x7f429c03e520 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f429c03e520 msgr2=0x7f429c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f429c03e520 0x7f429c040a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006fd0 tx=0x7f42a4006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 msgr2=0x7f42b819e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b819e160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009520 tx=0x7f42a8011aa0 comp rx=0 tx=0).stop 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 shutdown_connections 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f429c03e520 0x7f429c040a30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 --2- 172.21.15.47:0/443086655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42b807cc90 0x7f42b819e160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:42.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.603+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 >> 172.21.15.47:0/443086655 conn(0x7f42b8104440 msgr2=0x7f42b8105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:42.291 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.604+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 shutdown_connections 2024-05-14T12:12:42.291 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:41.604+0000 7f42bd800700 1 -- 172.21.15.47:0/443086655 wait complete. 2024-05-14T12:12:42.291 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial admin user... 2024-05-14T12:12:44.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:44.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:43 smithi047 ceph-mon[31254]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:44.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$K32P/TdHPj39sClIktrjYujGoaLsIKHgxVVkeRW.mP.Ckr04LbsF6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715688763, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.916+0000 7f39c0000700 1 Processor -- start 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.917+0000 7f39c0000700 1 -- start start 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.917+0000 7f39c0000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b810c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.917+0000 7f39c0000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39b810cf20 con 0x7f39b807cc70 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.917+0000 7f39bd600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b810c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.918+0000 7f39bd600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b810c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50432/0 (socket says 172.21.15.47:50432) 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.918+0000 7f39bd600700 1 -- 172.21.15.47:0/1614859323 learned_addr learned my addr 172.21.15.47:0/1614859323 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.918+0000 7f39bd600700 1 -- 172.21.15.47:0/1614859323 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b810d0a0 con 0x7f39b807cc70 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.918+0000 7f39bd600700 1 --2- 172.21.15.47:0/1614859323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b810c950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0098a0 tx=0x7f39ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fe4265bf79d036 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:44.171 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.919+0000 7f39b7e00700 1 -- 172.21.15.47:0/1614859323 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac004160 con 0x7f39b807cc70 2024-05-14T12:12:44.172 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.919+0000 7f39b7e00700 1 -- 172.21.15.47:0/1614859323 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39ac004300 con 0x7f39b807cc70 2024-05-14T12:12:44.172 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.919+0000 7f39b7e00700 1 -- 172.21.15.47:0/1614859323 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac011a20 con 0x7f39b807cc70 2024-05-14T12:12:44.172 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.920+0000 7f39c0000700 1 -- 172.21.15.47:0/1614859323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 msgr2=0x7f39b810c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:44.172 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.920+0000 7f39c0000700 1 --2- 172.21.15.47:0/1614859323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b810c950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0098a0 tx=0x7f39ac009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:44.172 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.920+0000 7f39c0000700 1 -- 172.21.15.47:0/1614859323 shutdown_connections 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.920+0000 7f39c0000700 1 --2- 172.21.15.47:0/1614859323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b810c950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.920+0000 7f39c0000700 1 -- 172.21.15.47:0/1614859323 >> 172.21.15.47:0/1614859323 conn(0x7f39b8104440 msgr2=0x7f39b8106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.920+0000 7f39c0000700 1 -- 172.21.15.47:0/1614859323 shutdown_connections 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.920+0000 7f39c0000700 1 -- 172.21.15.47:0/1614859323 wait complete. 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.921+0000 7f39c0000700 1 Processor -- start 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.921+0000 7f39c0000700 1 -- start start 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.922+0000 7f39c0000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b81a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.922+0000 7f39c0000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39b810e160 con 0x7f39b807cc70 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.922+0000 7f39bd600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b81a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.922+0000 7f39bd600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b81a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50438/0 (socket says 172.21.15.47:50438) 2024-05-14T12:12:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.922+0000 7f39bd600700 1 -- 172.21.15.47:0/2702525255 learned_addr learned my addr 172.21.15.47:0/2702525255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.922+0000 7f39bd600700 1 -- 172.21.15.47:0/2702525255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b81a08b0 con 0x7f39b807cc70 2024-05-14T12:12:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.923+0000 7f39bd600700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b81a0370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009520 tx=0x7f39ac011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.923+0000 7f39b6000700 1 -- 172.21.15.47:0/2702525255 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac003b70 con 0x7f39b807cc70 2024-05-14T12:12:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.923+0000 7f39b6000700 1 -- 172.21.15.47:0/2702525255 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39ac01b8f0 con 0x7f39b807cc70 2024-05-14T12:12:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.923+0000 7f39b6000700 1 -- 172.21.15.47:0/2702525255 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac019800 con 0x7f39b807cc70 2024-05-14T12:12:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.923+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b81a0b40 con 0x7f39b807cc70 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.923+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b81a3750 con 0x7f39b807cc70 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.925+0000 7f39b6000700 1 -- 172.21.15.47:0/2702525255 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f39ac019ab0 con 0x7f39b807cc70 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.925+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b8064e20 con 0x7f39b807cc70 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.925+0000 7f39b6000700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f39a003e4d0 0x7f39a00409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.925+0000 7f39b6000700 1 -- 172.21.15.47:0/2702525255 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f39ac054130 con 0x7f39b807cc70 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.926+0000 7f39bcc00700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f39a003e4d0 0x7f39a00409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.927+0000 7f39bcc00700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f39a003e4d0 0x7f39a00409e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39a4006fd0 tx=0x7f39a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:44.179 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:42.931+0000 7f39b6000700 1 -- 172.21.15.47:0/2702525255 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f39ac01f030 con 0x7f39b807cc70 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.220+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f39b81a3920 con 0x7f39a003e4d0 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.477+0000 7f39b6000700 1 -- 172.21.15.47:0/2702525255 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f39b81a3920 con 0x7f39a003e4d0 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f39a003e4d0 msgr2=0x7f39a00409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f39a003e4d0 0x7f39a00409e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39a4006fd0 tx=0x7f39a4006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 msgr2=0x7f39b81a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b81a0370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009520 tx=0x7f39ac011b10 comp rx=0 tx=0).stop 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 shutdown_connections 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f39a003e4d0 0x7f39a00409e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 --2- 172.21.15.47:0/2702525255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39b807cc70 0x7f39b81a0370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.480+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 >> 172.21.15.47:0/2702525255 conn(0x7f39b8104440 msgr2=0x7f39b8108830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.481+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 shutdown_connections 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:43.481+0000 7f39c0000700 1 -- 172.21.15.47:0/2702525255 wait complete. 2024-05-14T12:12:44.180 INFO:teuthology.orchestra.run.smithi047.stdout:Fetching dashboard port number... 2024-05-14T12:12:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:45 smithi047 ceph-mon[31254]: mgrmap e13: x(active, since 6s) 2024-05-14T12:12:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:45 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1097037912' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 8443 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.971+0000 7fa38f200700 1 Processor -- start 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.971+0000 7fa38f200700 1 -- start start 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.972+0000 7fa38f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa38810a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.972+0000 7fa38f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa38810a7d0 con 0x7fa388109dd0 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.972+0000 7fa387e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa38810a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.973+0000 7fa387e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa38810a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50440/0 (socket says 172.21.15.47:50440) 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.973+0000 7fa387e00700 1 -- 172.21.15.47:0/1569315250 learned_addr learned my addr 172.21.15.47:0/1569315250 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.973+0000 7fa387e00700 1 -- 172.21.15.47:0/1569315250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38810af00 con 0x7fa388109dd0 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.974+0000 7fa387e00700 1 --2- 172.21.15.47:0/1569315250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa38810a1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3780098a0 tx=0x7fa378009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b64312ad033649 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:46.285 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.974+0000 7fa386a00700 1 -- 172.21.15.47:0/1569315250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa378004160 con 0x7fa388109dd0 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.974+0000 7fa386a00700 1 -- 172.21.15.47:0/1569315250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa378004300 con 0x7fa388109dd0 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.974+0000 7fa386a00700 1 -- 172.21.15.47:0/1569315250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa378011a20 con 0x7fa388109dd0 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.975+0000 7fa38f200700 1 -- 172.21.15.47:0/1569315250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 msgr2=0x7fa38810a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.975+0000 7fa38f200700 1 --2- 172.21.15.47:0/1569315250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa38810a1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3780098a0 tx=0x7fa378009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.975+0000 7fa38f200700 1 -- 172.21.15.47:0/1569315250 shutdown_connections 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.975+0000 7fa38f200700 1 --2- 172.21.15.47:0/1569315250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa38810a1e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.975+0000 7fa38f200700 1 -- 172.21.15.47:0/1569315250 >> 172.21.15.47:0/1569315250 conn(0x7fa3881054b0 msgr2=0x7fa388107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.975+0000 7fa38f200700 1 -- 172.21.15.47:0/1569315250 shutdown_connections 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.975+0000 7fa38f200700 1 -- 172.21.15.47:0/1569315250 wait complete. 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.976+0000 7fa38f200700 1 Processor -- start 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.977+0000 7fa38f200700 1 -- start start 2024-05-14T12:12:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.977+0000 7fa38f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa3881a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.977+0000 7fa38f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa38810e2b0 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.977+0000 7fa387e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa3881a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.977+0000 7fa387e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa3881a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50444/0 (socket says 172.21.15.47:50444) 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.977+0000 7fa387e00700 1 -- 172.21.15.47:0/1097037912 learned_addr learned my addr 172.21.15.47:0/1097037912 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.978+0000 7fa387e00700 1 -- 172.21.15.47:0/1097037912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3881a08f0 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.978+0000 7fa387e00700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa3881a03b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa378009130 tx=0x7fa378011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.978+0000 7fa384c00700 1 -- 172.21.15.47:0/1097037912 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa378003aa0 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.978+0000 7fa384c00700 1 -- 172.21.15.47:0/1097037912 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa37801a8e0 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.979+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3881a0b80 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.979+0000 7fa384c00700 1 -- 172.21.15.47:0/1097037912 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3780248f0 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.979+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3881a3790 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.980+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa388064e20 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.980+0000 7fa384c00700 1 -- 172.21.15.47:0/1097037912 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa378022020 con 0x7fa388109dd0 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.981+0000 7fa384c00700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa36c03e560 0x7fa36c040a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:46.287 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.981+0000 7fa384c00700 1 -- 172.21.15.47:0/1097037912 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa378053b10 con 0x7fa388109dd0 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.981+0000 7fa387400700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa36c03e560 0x7fa36c040a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.982+0000 7fa387400700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa36c03e560 0x7fa36c040a70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa374006fd0 tx=0x7fa374006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:44.986+0000 7fa384c00700 1 -- 172.21.15.47:0/1097037912 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa37800f2e0 con 0x7fa388109dd0 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.228+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fa3881a3d90 con 0x7fa388109dd0 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.229+0000 7fa384c00700 1 -- 172.21.15.47:0/1097037912 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fa37801ad40 con 0x7fa388109dd0 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.232+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa36c03e560 msgr2=0x7fa36c040a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.232+0000 7fa38f200700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa36c03e560 0x7fa36c040a70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa374006fd0 tx=0x7fa374006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.232+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 msgr2=0x7fa3881a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.232+0000 7fa38f200700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa3881a03b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa378009130 tx=0x7fa378011aa0 comp rx=0 tx=0).stop 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.233+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 shutdown_connections 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.233+0000 7fa38f200700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa36c03e560 0x7fa36c040a70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:46.288 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.233+0000 7fa38f200700 1 --2- 172.21.15.47:0/1097037912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa388109dd0 0x7fa3881a03b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:46.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.233+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 >> 172.21.15.47:0/1097037912 conn(0x7fa3881054b0 msgr2=0x7fa388106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:46.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.233+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 shutdown_connections 2024-05-14T12:12:46.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:45.233+0000 7fa38f200700 1 -- 172.21.15.47:0/1097037912 wait complete. 2024-05-14T12:12:46.319 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T12:12:46.319 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-05-14T12:12:46.346 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T12:12:46.346 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-05-14T12:12:46.346 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-05-14T12:12:46.346 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-14T12:12:46.353 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph Dashboard is now available at: 2024-05-14T12:12:46.354 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:46.354 INFO:teuthology.orchestra.run.smithi047.stdout: URL: https://smithi047.front.sepia.ceph.com:8443/ 2024-05-14T12:12:46.354 INFO:teuthology.orchestra.run.smithi047.stdout: User: admin 2024-05-14T12:12:46.354 INFO:teuthology.orchestra.run.smithi047.stdout: Password: g255fdxcnw 2024-05-14T12:12:46.354 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:46.355 INFO:teuthology.orchestra.run.smithi047.stdout:Saving cluster configuration to /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config directory 2024-05-14T12:12:46.357 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling autotune for osd_memory_target 2024-05-14T12:12:47.936 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.072+0000 7f2278e00700 1 Processor -- start 2024-05-14T12:12:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.073+0000 7f2278e00700 1 -- start start 2024-05-14T12:12:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.073+0000 7f2278e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f227410a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.073+0000 7f2278e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f227410a7f0 con 0x7f2274109df0 2024-05-14T12:12:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.073+0000 7f2271e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f227410a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.074+0000 7f2271e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f227410a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50452/0 (socket says 172.21.15.47:50452) 2024-05-14T12:12:47.937 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.074+0000 7f2271e00700 1 -- 172.21.15.47:0/3668415901 learned_addr learned my addr 172.21.15.47:0/3668415901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:47.938 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.074+0000 7f2271e00700 1 -- 172.21.15.47:0/3668415901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227410af20 con 0x7f2274109df0 2024-05-14T12:12:47.938 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.074+0000 7f2271e00700 1 --2- 172.21.15.47:0/3668415901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f227410a200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22640098a0 tx=0x7f2264009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd613ec841403307 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:47.939 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.075+0000 7f2270a00700 1 -- 172.21.15.47:0/3668415901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2264004160 con 0x7f2274109df0 2024-05-14T12:12:47.939 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.075+0000 7f2270a00700 1 -- 172.21.15.47:0/3668415901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2264004300 con 0x7f2274109df0 2024-05-14T12:12:47.939 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.075+0000 7f2270a00700 1 -- 172.21.15.47:0/3668415901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2264011a20 con 0x7f2274109df0 2024-05-14T12:12:47.939 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.076+0000 7f2278e00700 1 -- 172.21.15.47:0/3668415901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 msgr2=0x7f227410a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:47.939 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.076+0000 7f2278e00700 1 --2- 172.21.15.47:0/3668415901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f227410a200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22640098a0 tx=0x7f2264009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:47.939 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.076+0000 7f2278e00700 1 -- 172.21.15.47:0/3668415901 shutdown_connections 2024-05-14T12:12:47.939 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.076+0000 7f2278e00700 1 --2- 172.21.15.47:0/3668415901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f227410a200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:47.940 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.076+0000 7f2278e00700 1 -- 172.21.15.47:0/3668415901 >> 172.21.15.47:0/3668415901 conn(0x7f2274105470 msgr2=0x7f22741078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:47.940 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.076+0000 7f2278e00700 1 -- 172.21.15.47:0/3668415901 shutdown_connections 2024-05-14T12:12:47.940 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.076+0000 7f2278e00700 1 -- 172.21.15.47:0/3668415901 wait complete. 2024-05-14T12:12:47.940 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.077+0000 7f2278e00700 1 Processor -- start 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.077+0000 7f2278e00700 1 -- start start 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.078+0000 7f2278e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f22741a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.078+0000 7f2278e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f227410e2d0 con 0x7f2274109df0 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.078+0000 7f2271e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f22741a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.078+0000 7f2271e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f22741a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50466/0 (socket says 172.21.15.47:50466) 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.078+0000 7f2271e00700 1 -- 172.21.15.47:0/1140852542 learned_addr learned my addr 172.21.15.47:0/1140852542 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.079+0000 7f2271e00700 1 -- 172.21.15.47:0/1140852542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22741a0900 con 0x7f2274109df0 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.079+0000 7f2271e00700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f22741a03c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2264011a20 tx=0x7f2264011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.079+0000 7f226aa00700 1 -- 172.21.15.47:0/1140852542 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22640039c0 con 0x7f2274109df0 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.079+0000 7f226aa00700 1 -- 172.21.15.47:0/1140852542 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2264003b60 con 0x7f2274109df0 2024-05-14T12:12:47.942 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.079+0000 7f226aa00700 1 -- 172.21.15.47:0/1140852542 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2264019700 con 0x7f2274109df0 2024-05-14T12:12:47.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.080+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22741a0b90 con 0x7f2274109df0 2024-05-14T12:12:47.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.080+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22741a37a0 con 0x7f2274109df0 2024-05-14T12:12:47.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.081+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2274064e20 con 0x7f2274109df0 2024-05-14T12:12:47.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.081+0000 7f226aa00700 1 -- 172.21.15.47:0/1140852542 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f226401ab00 con 0x7f2274109df0 2024-05-14T12:12:47.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.082+0000 7f226aa00700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f225803e570 0x7f2258040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.082+0000 7f226aa00700 1 -- 172.21.15.47:0/1140852542 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2264053f60 con 0x7f2274109df0 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.082+0000 7f2271400700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f225803e570 0x7f2258040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.083+0000 7f2271400700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f225803e570 0x7f2258040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2260006fd0 tx=0x7f2260006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.088+0000 7f226aa00700 1 -- 172.21.15.47:0/1140852542 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f226401a860 con 0x7f2274109df0 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.324+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f22741a3970 con 0x7f2274109df0 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.325+0000 7f226aa00700 1 -- 172.21.15.47:0/1140852542 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f2264018d40 con 0x7f2274109df0 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f225803e570 msgr2=0x7f2258040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f225803e570 0x7f2258040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2260006fd0 tx=0x7f2260006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 msgr2=0x7f22741a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f22741a03c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2264011a20 tx=0x7f2264011b00 comp rx=0 tx=0).stop 2024-05-14T12:12:47.945 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 shutdown_connections 2024-05-14T12:12:47.946 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f225803e570 0x7f2258040a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:47.946 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 --2- 172.21.15.47:0/1140852542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2274109df0 0x7f22741a03c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:47.946 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 >> 172.21.15.47:0/1140852542 conn(0x7f2274105470 msgr2=0x7f227407d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:47.946 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.328+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 shutdown_connections 2024-05-14T12:12:47.946 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:47.329+0000 7f2278e00700 1 -- 172.21.15.47:0/1140852542 wait complete. 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.631+0000 7f9c84400700 1 Processor -- start 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.631+0000 7f9c84400700 1 -- start start 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.632+0000 7f9c84400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c07d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.632+0000 7f9c84400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c07d760 con 0x7f9c7c07ed50 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.632+0000 7f9c81a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c07d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.633+0000 7f9c81a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c07d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33050/0 (socket says 172.21.15.47:33050) 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.633+0000 7f9c81a00700 1 -- 172.21.15.47:0/349898708 learned_addr learned my addr 172.21.15.47:0/349898708 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.633+0000 7f9c81a00700 1 -- 172.21.15.47:0/349898708 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7c07d8e0 con 0x7f9c7c07ed50 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.633+0000 7f9c81a00700 1 --2- 172.21.15.47:0/349898708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c07d220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c700098a0 tx=0x7f9c70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57af1ec2755dcc43 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.634+0000 7f9c7be00700 1 -- 172.21.15.47:0/349898708 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c70004160 con 0x7f9c7c07ed50 2024-05-14T12:12:49.717 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.634+0000 7f9c7be00700 1 -- 172.21.15.47:0/349898708 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c70004300 con 0x7f9c7c07ed50 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.634+0000 7f9c7be00700 1 -- 172.21.15.47:0/349898708 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c70011a20 con 0x7f9c7c07ed50 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.635+0000 7f9c84400700 1 -- 172.21.15.47:0/349898708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 msgr2=0x7f9c7c07d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.635+0000 7f9c84400700 1 --2- 172.21.15.47:0/349898708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c07d220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c700098a0 tx=0x7f9c70009bb0 comp rx=0 tx=0).stop 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.635+0000 7f9c84400700 1 -- 172.21.15.47:0/349898708 shutdown_connections 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.635+0000 7f9c84400700 1 --2- 172.21.15.47:0/349898708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c07d220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.635+0000 7f9c84400700 1 -- 172.21.15.47:0/349898708 >> 172.21.15.47:0/349898708 conn(0x7f9c7c105470 msgr2=0x7f9c7c1078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.635+0000 7f9c84400700 1 -- 172.21.15.47:0/349898708 shutdown_connections 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.635+0000 7f9c84400700 1 -- 172.21.15.47:0/349898708 wait complete. 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.636+0000 7f9c84400700 1 Processor -- start 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.636+0000 7f9c84400700 1 -- start start 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.637+0000 7f9c84400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.637+0000 7f9c84400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1103b0 con 0x7f9c7c07ed50 2024-05-14T12:12:49.718 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.637+0000 7f9c81a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.637+0000 7f9c81a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c1a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33058/0 (socket says 172.21.15.47:33058) 2024-05-14T12:12:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.637+0000 7f9c81a00700 1 -- 172.21.15.47:0/3666989175 learned_addr learned my addr 172.21.15.47:0/3666989175 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.637+0000 7f9c81a00700 1 -- 172.21.15.47:0/3666989175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7c1a0870 con 0x7f9c7c07ed50 2024-05-14T12:12:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.638+0000 7f9c81a00700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c1a0330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009520 tx=0x7f9c70011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.638+0000 7f9c7a000700 1 -- 172.21.15.47:0/3666989175 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c700039e0 con 0x7f9c7c07ed50 2024-05-14T12:12:49.722 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.638+0000 7f9c7a000700 1 -- 172.21.15.47:0/3666989175 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7001b8f0 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.638+0000 7f9c7a000700 1 -- 172.21.15.47:0/3666989175 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c700197d0 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.638+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7c1a0b00 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.638+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7c1a3710 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.640+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c7c064e20 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.640+0000 7f9c7a000700 1 -- 172.21.15.47:0/3666989175 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9c7001b440 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.640+0000 7f9c7a000700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9c6403e610 0x7f9c64040b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.640+0000 7f9c7a000700 1 -- 172.21.15.47:0/3666989175 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9c70054250 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.641+0000 7f9c81000700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9c6403e610 0x7f9c64040b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.641+0000 7f9c81000700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9c6403e610 0x7f9c64040b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006fd0 tx=0x7f9c68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:48.646+0000 7f9c7a000700 1 -- 172.21.15.47:0/3666989175 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9c7001f030 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.009+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f9c7c1a3a20 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.016+0000 7f9c7a000700 1 -- 172.21.15.47:0/3666989175 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f9c7000f2e0 con 0x7f9c7c07ed50 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9c6403e610 msgr2=0x7f9c64040b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:49.723 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9c6403e610 0x7f9c64040b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006fd0 tx=0x7f9c68006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 msgr2=0x7f9c7c1a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c1a0330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009520 tx=0x7f9c70011aa0 comp rx=0 tx=0).stop 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 shutdown_connections 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9c6403e610 0x7f9c64040b20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 --2- 172.21.15.47:0/3666989175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c7c07ed50 0x7f9c7c1a0330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.020+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 >> 172.21.15.47:0/3666989175 conn(0x7f9c7c105470 msgr2=0x7f9c7c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.021+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 shutdown_connections 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr 2024-05-14T12:12:49.021+0000 7f9c84400700 1 -- 172.21.15.47:0/3666989175 wait complete. 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.724 INFO:teuthology.orchestra.run.smithi047.stdout:Or, if you are only running a single cluster on this host: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: ceph telemetry on 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout:For more information see: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:12:49.725 INFO:teuthology.orchestra.run.smithi047.stdout:Bootstrap complete. 2024-05-14T12:12:49.830 INFO:tasks.cephadm:Fetching config... 2024-05-14T12:12:49.831 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:12:49.831 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-14T12:12:49.878 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-14T12:12:49.878 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:12:49.878 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-14T12:12:49.969 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-14T12:12:49.969 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:12:49.969 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-14T12:12:50.040 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-14T12:12:50.041 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:12:50.041 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-14T12:12:50.134 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-14T12:12:50.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXMD/8Kkxg34MCMFfaYFcOfkCAvge8zuReCg/QwDyyIsjGjkEF0ois3/K5G2/CkHBsLd3mjZYbxG8elP0yPP8LMFZVB2b0PdmRxufWsG1M2loC6qnaRXDPLQL29ITuQCZgOJ1CMMuz2OMzv+Vl1cPULZDqotWMFCxQD3JvmywmSG/JwdPnMoqMC6O4+lT1kDjCif6luCdCSoGzb6yI0RNn/yk1+XypCxbjCcbC6o1KbcwkNgqqszcssjAeSNsIpZo2qL3BmhwPnPZj88T2YRz6YUh5ppVIqFoitwZ8BRbpvJ4UqaiydkSNbl8skhJnj8S4fZrKMDu/VEXRhZ8wrTJHRY6dS6ZRkCrBDrfgu61vpdBVq1bb6SiJuQcb3jn7UYyULgQmoxhjoJyR/M8lw8Fr1BMATb2U/ovtF9Efs8/NrUFDkTvUeRtp1k8CeLoGjDqnjllHSjzHFPjQjx65B3tft22lYAl04PTnvlQjk2ZxX1FxM+5LwqxxHC6Ziyr/Shc= ceph-e5959f02-11ea-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T12:12:50.232 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXMD/8Kkxg34MCMFfaYFcOfkCAvge8zuReCg/QwDyyIsjGjkEF0ois3/K5G2/CkHBsLd3mjZYbxG8elP0yPP8LMFZVB2b0PdmRxufWsG1M2loC6qnaRXDPLQL29ITuQCZgOJ1CMMuz2OMzv+Vl1cPULZDqotWMFCxQD3JvmywmSG/JwdPnMoqMC6O4+lT1kDjCif6luCdCSoGzb6yI0RNn/yk1+XypCxbjCcbC6o1KbcwkNgqqszcssjAeSNsIpZo2qL3BmhwPnPZj88T2YRz6YUh5ppVIqFoitwZ8BRbpvJ4UqaiydkSNbl8skhJnj8S4fZrKMDu/VEXRhZ8wrTJHRY6dS6ZRkCrBDrfgu61vpdBVq1bb6SiJuQcb3jn7UYyULgQmoxhjoJyR/M8lw8Fr1BMATb2U/ovtF9Efs8/NrUFDkTvUeRtp1k8CeLoGjDqnjllHSjzHFPjQjx65B3tft22lYAl04PTnvlQjk2ZxX1FxM+5LwqxxHC6Ziyr/Shc= ceph-e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:12:50.257 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:50 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3666989175' entity='client.admin' 2024-05-14T12:12:50.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXMD/8Kkxg34MCMFfaYFcOfkCAvge8zuReCg/QwDyyIsjGjkEF0ois3/K5G2/CkHBsLd3mjZYbxG8elP0yPP8LMFZVB2b0PdmRxufWsG1M2loC6qnaRXDPLQL29ITuQCZgOJ1CMMuz2OMzv+Vl1cPULZDqotWMFCxQD3JvmywmSG/JwdPnMoqMC6O4+lT1kDjCif6luCdCSoGzb6yI0RNn/yk1+XypCxbjCcbC6o1KbcwkNgqqszcssjAeSNsIpZo2qL3BmhwPnPZj88T2YRz6YUh5ppVIqFoitwZ8BRbpvJ4UqaiydkSNbl8skhJnj8S4fZrKMDu/VEXRhZ8wrTJHRY6dS6ZRkCrBDrfgu61vpdBVq1bb6SiJuQcb3jn7UYyULgQmoxhjoJyR/M8lw8Fr1BMATb2U/ovtF9Efs8/NrUFDkTvUeRtp1k8CeLoGjDqnjllHSjzHFPjQjx65B3tft22lYAl04PTnvlQjk2ZxX1FxM+5LwqxxHC6Ziyr/Shc= ceph-e5959f02-11ea-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T12:12:50.313 INFO:teuthology.orchestra.run.smithi066.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXMD/8Kkxg34MCMFfaYFcOfkCAvge8zuReCg/QwDyyIsjGjkEF0ois3/K5G2/CkHBsLd3mjZYbxG8elP0yPP8LMFZVB2b0PdmRxufWsG1M2loC6qnaRXDPLQL29ITuQCZgOJ1CMMuz2OMzv+Vl1cPULZDqotWMFCxQD3JvmywmSG/JwdPnMoqMC6O4+lT1kDjCif6luCdCSoGzb6yI0RNn/yk1+XypCxbjCcbC6o1KbcwkNgqqszcssjAeSNsIpZo2qL3BmhwPnPZj88T2YRz6YUh5ppVIqFoitwZ8BRbpvJ4UqaiydkSNbl8skhJnj8S4fZrKMDu/VEXRhZ8wrTJHRY6dS6ZRkCrBDrfgu61vpdBVq1bb6SiJuQcb3jn7UYyULgQmoxhjoJyR/M8lw8Fr1BMATb2U/ovtF9Efs8/NrUFDkTvUeRtp1k8CeLoGjDqnjllHSjzHFPjQjx65B3tft22lYAl04PTnvlQjk2ZxX1FxM+5LwqxxHC6Ziyr/Shc= ceph-e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:12:50.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXMD/8Kkxg34MCMFfaYFcOfkCAvge8zuReCg/QwDyyIsjGjkEF0ois3/K5G2/CkHBsLd3mjZYbxG8elP0yPP8LMFZVB2b0PdmRxufWsG1M2loC6qnaRXDPLQL29ITuQCZgOJ1CMMuz2OMzv+Vl1cPULZDqotWMFCxQD3JvmywmSG/JwdPnMoqMC6O4+lT1kDjCif6luCdCSoGzb6yI0RNn/yk1+XypCxbjCcbC6o1KbcwkNgqqszcssjAeSNsIpZo2qL3BmhwPnPZj88T2YRz6YUh5ppVIqFoitwZ8BRbpvJ4UqaiydkSNbl8skhJnj8S4fZrKMDu/VEXRhZ8wrTJHRY6dS6ZRkCrBDrfgu61vpdBVq1bb6SiJuQcb3jn7UYyULgQmoxhjoJyR/M8lw8Fr1BMATb2U/ovtF9Efs8/NrUFDkTvUeRtp1k8CeLoGjDqnjllHSjzHFPjQjx65B3tft22lYAl04PTnvlQjk2ZxX1FxM+5LwqxxHC6Ziyr/Shc= ceph-e5959f02-11ea-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T12:12:50.364 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXMD/8Kkxg34MCMFfaYFcOfkCAvge8zuReCg/QwDyyIsjGjkEF0ois3/K5G2/CkHBsLd3mjZYbxG8elP0yPP8LMFZVB2b0PdmRxufWsG1M2loC6qnaRXDPLQL29ITuQCZgOJ1CMMuz2OMzv+Vl1cPULZDqotWMFCxQD3JvmywmSG/JwdPnMoqMC6O4+lT1kDjCif6luCdCSoGzb6yI0RNn/yk1+XypCxbjCcbC6o1KbcwkNgqqszcssjAeSNsIpZo2qL3BmhwPnPZj88T2YRz6YUh5ppVIqFoitwZ8BRbpvJ4UqaiydkSNbl8skhJnj8S4fZrKMDu/VEXRhZ8wrTJHRY6dS6ZRkCrBDrfgu61vpdBVq1bb6SiJuQcb3jn7UYyULgQmoxhjoJyR/M8lw8Fr1BMATb2U/ovtF9Efs8/NrUFDkTvUeRtp1k8CeLoGjDqnjllHSjzHFPjQjx65B3tft22lYAl04PTnvlQjk2ZxX1FxM+5LwqxxHC6Ziyr/Shc= ceph-e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:12:50.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-14T12:12:50.802 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:12:53.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.381+0000 7f1afe400700 1 -- 172.21.15.47:0/107808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 msgr2=0x7f1af810a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:53.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.381+0000 7f1afe400700 1 --2- 172.21.15.47:0/107808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af810a450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009910 tx=0x7f1aec009c20 comp rx=0 tx=0).stop 2024-05-14T12:12:53.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.382+0000 7f1afe400700 1 -- 172.21.15.47:0/107808 shutdown_connections 2024-05-14T12:12:53.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.382+0000 7f1afe400700 1 --2- 172.21.15.47:0/107808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af810a450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:53.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.382+0000 7f1afe400700 1 -- 172.21.15.47:0/107808 >> 172.21.15.47:0/107808 conn(0x7f1af80790f0 msgr2=0x7f1af807b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:53.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.382+0000 7f1afe400700 1 -- 172.21.15.47:0/107808 shutdown_connections 2024-05-14T12:12:53.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.382+0000 7f1afe400700 1 -- 172.21.15.47:0/107808 wait complete. 2024-05-14T12:12:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.383+0000 7f1afe400700 1 Processor -- start 2024-05-14T12:12:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.384+0000 7f1afe400700 1 -- start start 2024-05-14T12:12:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.384+0000 7f1afe400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.384+0000 7f1afe400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1af8110000 con 0x7f1af810a040 2024-05-14T12:12:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.384+0000 7f1afd000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.384+0000 7f1afd000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af819fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33068/0 (socket says 172.21.15.47:33068) 2024-05-14T12:12:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.384+0000 7f1afd000700 1 -- 172.21.15.47:0/1546404460 learned_addr learned my addr 172.21.15.47:0/1546404460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.385+0000 7f1afd000700 1 -- 172.21.15.47:0/1546404460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af81a00a0 con 0x7f1af810a040 2024-05-14T12:12:53.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.385+0000 7f1afd000700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af819fb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0057d0 tx=0x7f1aec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:53.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.385+0000 7f1af5600700 1 -- 172.21.15.47:0/1546404460 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec027070 con 0x7f1af810a040 2024-05-14T12:12:53.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.385+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af81a0330 con 0x7f1af810a040 2024-05-14T12:12:53.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.385+0000 7f1af5600700 1 -- 172.21.15.47:0/1546404460 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aec00be10 con 0x7f1af810a040 2024-05-14T12:12:53.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.385+0000 7f1af5600700 1 -- 172.21.15.47:0/1546404460 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec022dd0 con 0x7f1af810a040 2024-05-14T12:12:53.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.386+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af81a2f40 con 0x7f1af810a040 2024-05-14T12:12:53.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.387+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af8110780 con 0x7f1af810a040 2024-05-14T12:12:53.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.387+0000 7f1af5600700 1 -- 172.21.15.47:0/1546404460 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f1aec02a070 con 0x7f1af810a040 2024-05-14T12:12:53.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.387+0000 7f1af5600700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1ae003e4c0 0x7f1ae00409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:53.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.387+0000 7f1af5600700 1 -- 172.21.15.47:0/1546404460 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1aec01e030 con 0x7f1af810a040 2024-05-14T12:12:53.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.388+0000 7f1af7e00700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1ae003e4c0 0x7f1ae00409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:53.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.389+0000 7f1af7e00700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1ae003e4c0 0x7f1ae00409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4006fd0 tx=0x7f1ae4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:53.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.394+0000 7f1af5600700 1 -- 172.21.15.47:0/1546404460 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1aec013070 con 0x7f1af810a040 2024-05-14T12:12:53.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.617+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f1af802e700 con 0x7f1af810a040 2024-05-14T12:12:53.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.622+0000 7f1af5600700 1 -- 172.21.15.47:0/1546404460 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f1aec0292c0 con 0x7f1af810a040 2024-05-14T12:12:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1ae003e4c0 msgr2=0x7f1ae00409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1ae003e4c0 0x7f1ae00409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4006fd0 tx=0x7f1ae4006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 msgr2=0x7f1af819fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af819fb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0057d0 tx=0x7f1aec005800 comp rx=0 tx=0).stop 2024-05-14T12:12:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 shutdown_connections 2024-05-14T12:12:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1ae003e4c0 0x7f1ae00409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 --2- 172.21.15.47:0/1546404460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1af810a040 0x7f1af819fb60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.625+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 >> 172.21.15.47:0/1546404460 conn(0x7f1af80790f0 msgr2=0x7f1af8079df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.626+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 shutdown_connections 2024-05-14T12:12:53.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:53.626+0000 7f1afe400700 1 -- 172.21.15.47:0/1546404460 wait complete. 2024-05-14T12:12:53.983 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:53.983 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:53.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:12:53.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:53.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:53.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:53.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1546404460' entity='client.admin' 2024-05-14T12:12:53.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:53.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:54.312 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-14T12:12:54.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-14T12:12:54.751 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:12:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.841+0000 7f07e9200700 1 -- 172.21.15.47:0/855185554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 msgr2=0x7f07e41061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.841+0000 7f07e9200700 1 --2- 172.21.15.47:0/855185554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e41061f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009910 tx=0x7f07d4009c20 comp rx=0 tx=0).stop 2024-05-14T12:12:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.841+0000 7f07e9200700 1 -- 172.21.15.47:0/855185554 shutdown_connections 2024-05-14T12:12:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.841+0000 7f07e9200700 1 --2- 172.21.15.47:0/855185554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e41061f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.841+0000 7f07e9200700 1 -- 172.21.15.47:0/855185554 >> 172.21.15.47:0/855185554 conn(0x7f07e4101420 msgr2=0x7f07e41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.841+0000 7f07e9200700 1 -- 172.21.15.47:0/855185554 shutdown_connections 2024-05-14T12:12:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.841+0000 7f07e9200700 1 -- 172.21.15.47:0/855185554 wait complete. 2024-05-14T12:12:56.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.843+0000 7f07e9200700 1 Processor -- start 2024-05-14T12:12:56.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.843+0000 7f07e9200700 1 -- start start 2024-05-14T12:12:56.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.843+0000 7f07e9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:56.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.843+0000 7f07e9200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07e410bda0 con 0x7f07e4105de0 2024-05-14T12:12:56.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.843+0000 7f07e1e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:56.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.843+0000 7f07e1e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33090/0 (socket says 172.21.15.47:33090) 2024-05-14T12:12:56.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.843+0000 7f07e1e00700 1 -- 172.21.15.47:0/2758379024 learned_addr learned my addr 172.21.15.47:0/2758379024 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:12:56.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.844+0000 7f07e1e00700 1 -- 172.21.15.47:0/2758379024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e419be60 con 0x7f07e4105de0 2024-05-14T12:12:56.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.844+0000 7f07e1e00700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e419b920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07d4006010 tx=0x7f07d4004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:56.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.844+0000 7f07daa00700 1 -- 172.21.15.47:0/2758379024 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4026070 con 0x7f07e4105de0 2024-05-14T12:12:56.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.845+0000 7f07daa00700 1 -- 172.21.15.47:0/2758379024 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d400bc00 con 0x7f07e4105de0 2024-05-14T12:12:56.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.845+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e419c0f0 con 0x7f07e4105de0 2024-05-14T12:12:56.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.845+0000 7f07daa00700 1 -- 172.21.15.47:0/2758379024 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4003970 con 0x7f07e4105de0 2024-05-14T12:12:56.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.845+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e419ed00 con 0x7f07e4105de0 2024-05-14T12:12:56.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.846+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e410c520 con 0x7f07e4105de0 2024-05-14T12:12:56.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.846+0000 7f07daa00700 1 -- 172.21.15.47:0/2758379024 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f07d4029070 con 0x7f07e4105de0 2024-05-14T12:12:56.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.847+0000 7f07daa00700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07c803e510 0x7f07c8040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:12:56.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.847+0000 7f07daa00700 1 -- 172.21.15.47:0/2758379024 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f07d401e070 con 0x7f07e4105de0 2024-05-14T12:12:56.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.847+0000 7f07e1400700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07c803e510 0x7f07c8040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:12:56.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.848+0000 7f07e1400700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07c803e510 0x7f07c8040a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f07d0006fd0 tx=0x7f07d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:12:56.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:56.853+0000 7f07daa00700 1 -- 172.21.15.47:0/2758379024 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f07d4013070 con 0x7f07e4105de0 2024-05-14T12:12:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.093+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f07e402e700 con 0x7f07c803e510 2024-05-14T12:12:57.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.100+0000 7f07daa00700 1 -- 172.21.15.47:0/2758379024 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f07e402e700 con 0x7f07c803e510 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07c803e510 msgr2=0x7f07c8040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07c803e510 0x7f07c8040a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f07d0006fd0 tx=0x7f07d0006e40 comp rx=0 tx=0).stop 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 msgr2=0x7f07e419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e419b920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07d4006010 tx=0x7f07d4004fa0 comp rx=0 tx=0).stop 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 shutdown_connections 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07c803e510 0x7f07c8040a20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 --2- 172.21.15.47:0/2758379024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e4105de0 0x7f07e419b920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 >> 172.21.15.47:0/2758379024 conn(0x7f07e4101420 msgr2=0x7f07e41020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:12:57.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 shutdown_connections 2024-05-14T12:12:57.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:12:57.104+0000 7f07e9200700 1 -- 172.21.15.47:0/2758379024 wait complete. 2024-05-14T12:12:57.807 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi066 2024-05-14T12:12:57.807 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:12:57.807 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.conf 2024-05-14T12:12:57.827 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:12:57.827 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:12:57.885 INFO:tasks.cephadm:Adding host smithi066 to orchestrator... 2024-05-14T12:12:57.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch host add smithi066 2024-05-14T12:12:58.314 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:12:58.461 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:58 smithi047 ceph-mon[31254]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:12:58.462 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:12:58.462 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:12:58.462 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:12:58.462 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:12:58.462 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:58 smithi047 ceph-mon[31254]: Updating smithi047:/etc/ceph/ceph.conf 2024-05-14T12:12:59.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:59 smithi047 ceph-mon[31254]: Updating smithi047:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:12:59.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:59 smithi047 ceph-mon[31254]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:12:59.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:12:59 smithi047 ceph-mon[31254]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.335+0000 7f7167000700 1 -- 172.21.15.47:0/2938811497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 msgr2=0x7f716010a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.335+0000 7f7167000700 1 --2- 172.21.15.47:0/2938811497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716010a640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7154009910 tx=0x7f7154009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:00.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:00 smithi047 ceph-mon[31254]: Updating smithi047:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T12:13:00.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:00.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:00.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.336+0000 7f7167000700 1 -- 172.21.15.47:0/2938811497 shutdown_connections 2024-05-14T12:13:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.336+0000 7f7167000700 1 --2- 172.21.15.47:0/2938811497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716010a640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.336+0000 7f7167000700 1 -- 172.21.15.47:0/2938811497 >> 172.21.15.47:0/2938811497 conn(0x7f7160079730 msgr2=0x7f71601085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.336+0000 7f7167000700 1 -- 172.21.15.47:0/2938811497 shutdown_connections 2024-05-14T12:13:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.336+0000 7f7167000700 1 -- 172.21.15.47:0/2938811497 wait complete. 2024-05-14T12:13:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.338+0000 7f7167000700 1 Processor -- start 2024-05-14T12:13:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.338+0000 7f7167000700 1 -- start start 2024-05-14T12:13:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.339+0000 7f7167000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.339+0000 7f7167000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7160114520 con 0x7f716010a230 2024-05-14T12:13:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.339+0000 7f7165c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:00.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.339+0000 7f7165c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52300/0 (socket says 172.21.15.47:52300) 2024-05-14T12:13:00.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.339+0000 7f7165c00700 1 -- 172.21.15.47:0/83175563 learned_addr learned my addr 172.21.15.47:0/83175563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:13:00.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.339+0000 7f7165c00700 1 -- 172.21.15.47:0/83175563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71601a0300 con 0x7f716010a230 2024-05-14T12:13:00.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.340+0000 7f7165c00700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716019fdc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7154006010 tx=0x7f7154005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.340+0000 7f715e000700 1 -- 172.21.15.47:0/83175563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7154026070 con 0x7f716010a230 2024-05-14T12:13:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.340+0000 7f715e000700 1 -- 172.21.15.47:0/83175563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f715400bba0 con 0x7f716010a230 2024-05-14T12:13:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.340+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71601a05f0 con 0x7f716010a230 2024-05-14T12:13:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.340+0000 7f715e000700 1 -- 172.21.15.47:0/83175563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7154003910 con 0x7f716010a230 2024-05-14T12:13:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.340+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71601a45a0 con 0x7f716010a230 2024-05-14T12:13:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.342+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716010b6e0 con 0x7f716010a230 2024-05-14T12:13:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.342+0000 7f715e000700 1 -- 172.21.15.47:0/83175563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f7154029070 con 0x7f716010a230 2024-05-14T12:13:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.342+0000 7f715e000700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f714803e570 0x7f7148040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.343+0000 7f715e000700 1 -- 172.21.15.47:0/83175563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f715401e070 con 0x7f716010a230 2024-05-14T12:13:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.343+0000 7f7165200700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f714803e570 0x7f7148040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.344+0000 7f7165200700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f714803e570 0x7f7148040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f714c006fd0 tx=0x7f714c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:00.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.349+0000 7f715e000700 1 -- 172.21.15.47:0/83175563 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7154013070 con 0x7f716010a230 2024-05-14T12:13:00.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:00.589+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi066", "target": ["mon-mgr", ""]}) -- 0x7f71601a10d0 con 0x7f714803e570 2024-05-14T12:13:01.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:01 smithi047 ceph-mon[31254]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:02.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:02 smithi047 ceph-mon[31254]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:02.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:02 smithi047 ceph-mon[31254]: Deploying cephadm binary to smithi066 2024-05-14T12:13:03.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:03 smithi047 ceph-mon[31254]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:05.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:05 smithi047 ceph-mon[31254]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:05.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.570+0000 7f715e000700 1 -- 172.21.15.47:0/83175563 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f71601a10d0 con 0x7f714803e570 2024-05-14T12:13:05.572 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi066' with addr '172.21.15.66' 2024-05-14T12:13:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f714803e570 msgr2=0x7f7148040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f714803e570 0x7f7148040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f714c006fd0 tx=0x7f714c006e40 comp rx=0 tx=0).stop 2024-05-14T12:13:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 msgr2=0x7f716019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716019fdc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7154006010 tx=0x7f7154005780 comp rx=0 tx=0).stop 2024-05-14T12:13:05.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 shutdown_connections 2024-05-14T12:13:05.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f714803e570 0x7f7148040a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:05.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 --2- 172.21.15.47:0/83175563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f716010a230 0x7f716019fdc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:05.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.574+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 >> 172.21.15.47:0/83175563 conn(0x7f7160079730 msgr2=0x7f716010bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:05.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.575+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 shutdown_connections 2024-05-14T12:13:05.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:05.575+0000 7f7167000700 1 -- 172.21.15.47:0/83175563 wait complete. 2024-05-14T12:13:06.311 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-14T12:13:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:13:06.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:06 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:06.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:06 smithi047 ceph-mon[31254]: Added host smithi066 2024-05-14T12:13:06.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:06 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:06.918 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:06 smithi047 ceph-mon[31254]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:06.918 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:06 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:07.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:08.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.870+0000 7f8a79200700 1 -- 172.21.15.47:0/3122228716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 msgr2=0x7f8a74076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:08.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.870+0000 7f8a79200700 1 --2- 172.21.15.47:0/3122228716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a74076140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009910 tx=0x7f8a64009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:08.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.870+0000 7f8a79200700 1 -- 172.21.15.47:0/3122228716 shutdown_connections 2024-05-14T12:13:08.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.870+0000 7f8a79200700 1 --2- 172.21.15.47:0/3122228716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a74076140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:08.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.870+0000 7f8a79200700 1 -- 172.21.15.47:0/3122228716 >> 172.21.15.47:0/3122228716 conn(0x7f8a740ff490 msgr2=0x7f8a741018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:08.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.870+0000 7f8a79200700 1 -- 172.21.15.47:0/3122228716 shutdown_connections 2024-05-14T12:13:08.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.870+0000 7f8a79200700 1 -- 172.21.15.47:0/3122228716 wait complete. 2024-05-14T12:13:08.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.871+0000 7f8a79200700 1 Processor -- start 2024-05-14T12:13:08.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.871+0000 7f8a79200700 1 -- start start 2024-05-14T12:13:08.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.872+0000 7f8a79200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a741a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:08.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.872+0000 7f8a79200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74110130 con 0x7f8a74075d30 2024-05-14T12:13:08.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.872+0000 7f8a73400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a741a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:08.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.872+0000 7f8a73400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a741a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39248/0 (socket says 172.21.15.47:39248) 2024-05-14T12:13:08.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.872+0000 7f8a73400700 1 -- 172.21.15.47:0/1830732030 learned_addr learned my addr 172.21.15.47:0/1830732030 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:13:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.873+0000 7f8a73400700 1 -- 172.21.15.47:0/1830732030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a741a1b20 con 0x7f8a74075d30 2024-05-14T12:13:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.873+0000 7f8a73400700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a741a15e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a640056d0 tx=0x7f8a640057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.873+0000 7f8a70c00700 1 -- 172.21.15.47:0/1830732030 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a64026070 con 0x7f8a74075d30 2024-05-14T12:13:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.873+0000 7f8a70c00700 1 -- 172.21.15.47:0/1830732030 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a64004370 con 0x7f8a74075d30 2024-05-14T12:13:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.873+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a741a1db0 con 0x7f8a74075d30 2024-05-14T12:13:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.873+0000 7f8a70c00700 1 -- 172.21.15.47:0/1830732030 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a640039b0 con 0x7f8a74075d30 2024-05-14T12:13:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.874+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7419b870 con 0x7f8a74075d30 2024-05-14T12:13:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.875+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a740772a0 con 0x7f8a74075d30 2024-05-14T12:13:08.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.875+0000 7f8a70c00700 1 -- 172.21.15.47:0/1830732030 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8a64029070 con 0x7f8a74075d30 2024-05-14T12:13:08.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.876+0000 7f8a70c00700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8a5803e570 0x7f8a58040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:08.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.876+0000 7f8a70c00700 1 -- 172.21.15.47:0/1830732030 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8a6401e070 con 0x7f8a74075d30 2024-05-14T12:13:08.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.876+0000 7f8a6aa00700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8a5803e570 0x7f8a58040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:08.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.877+0000 7f8a6aa00700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8a5803e570 0x7f8a58040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006fd0 tx=0x7f8a5c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:08.882+0000 7f8a70c00700 1 -- 172.21.15.47:0/1830732030 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8a64013070 con 0x7f8a74075d30 2024-05-14T12:13:09.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.126+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a7419cd30 con 0x7f8a5803e570 2024-05-14T12:13:09.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.129+0000 7f8a70c00700 1 -- 172.21.15.47:0/1830732030 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f8a7419cd30 con 0x7f8a5803e570 2024-05-14T12:13:09.130 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:13:09.130 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}] 2024-05-14T12:13:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8a5803e570 msgr2=0x7f8a58040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8a5803e570 0x7f8a58040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006fd0 tx=0x7f8a5c006e40 comp rx=0 tx=0).stop 2024-05-14T12:13:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 msgr2=0x7f8a741a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a741a15e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a640056d0 tx=0x7f8a640057b0 comp rx=0 tx=0).stop 2024-05-14T12:13:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 shutdown_connections 2024-05-14T12:13:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8a5803e570 0x7f8a58040a80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 --2- 172.21.15.47:0/1830732030 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a74075d30 0x7f8a741a15e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.133+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 >> 172.21.15.47:0/1830732030 conn(0x7f8a740ff490 msgr2=0x7f8a7410c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.134+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 shutdown_connections 2024-05-14T12:13:09.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:09.134+0000 7f8a79200700 1 -- 172.21.15.47:0/1830732030 wait complete. 2024-05-14T12:13:09.460 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:09 smithi047 ceph-mon[31254]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:09.460 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:09 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:09.816 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi073 2024-05-14T12:13:09.816 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:13:09.816 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.conf 2024-05-14T12:13:09.835 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:13:09.835 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:09.893 INFO:tasks.cephadm:Adding host smithi073 to orchestrator... 2024-05-14T12:13:09.894 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch host add smithi073 2024-05-14T12:13:10.356 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:13:10.659 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:10 smithi047 ceph-mon[31254]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:13:11.501 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:11 smithi047 ceph-mon[31254]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.398+0000 7fb3f5000700 1 -- 172.21.15.47:0/2018296635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 msgr2=0x7fb3f0078100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.398+0000 7fb3f5000700 1 --2- 172.21.15.47:0/2018296635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f0078100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009910 tx=0x7fb3e0009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.398+0000 7fb3f5000700 1 -- 172.21.15.47:0/2018296635 shutdown_connections 2024-05-14T12:13:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.398+0000 7fb3f5000700 1 --2- 172.21.15.47:0/2018296635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f0078100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.398+0000 7fb3f5000700 1 -- 172.21.15.47:0/2018296635 >> 172.21.15.47:0/2018296635 conn(0x7fb3f0101850 msgr2=0x7fb3f0103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.398+0000 7fb3f5000700 1 -- 172.21.15.47:0/2018296635 shutdown_connections 2024-05-14T12:13:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.398+0000 7fb3f5000700 1 -- 172.21.15.47:0/2018296635 wait complete. 2024-05-14T12:13:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.400+0000 7fb3f5000700 1 Processor -- start 2024-05-14T12:13:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.400+0000 7fb3f5000700 1 -- start start 2024-05-14T12:13:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.400+0000 7fb3f5000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f019ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.400+0000 7fb3f5000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0114710 con 0x7fb3f0077cf0 2024-05-14T12:13:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.400+0000 7fb3ede00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f019ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.401+0000 7fb3ede00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f019ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39262/0 (socket says 172.21.15.47:39262) 2024-05-14T12:13:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.401+0000 7fb3ede00700 1 -- 172.21.15.47:0/3096011657 learned_addr learned my addr 172.21.15.47:0/3096011657 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:13:12.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.401+0000 7fb3ede00700 1 -- 172.21.15.47:0/3096011657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f01a04b0 con 0x7fb3f0077cf0 2024-05-14T12:13:12.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.401+0000 7fb3ede00700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f019ff70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0006010 tx=0x7fb3e0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.402+0000 7fb3e6a00700 1 -- 172.21.15.47:0/3096011657 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e0026070 con 0x7fb3f0077cf0 2024-05-14T12:13:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.402+0000 7fb3e6a00700 1 -- 172.21.15.47:0/3096011657 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e000bc00 con 0x7fb3f0077cf0 2024-05-14T12:13:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.402+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f01a0740 con 0x7fb3f0077cf0 2024-05-14T12:13:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.402+0000 7fb3e6a00700 1 -- 172.21.15.47:0/3096011657 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e0003910 con 0x7fb3f0077cf0 2024-05-14T12:13:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.402+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f01a0ba0 con 0x7fb3f0077cf0 2024-05-14T12:13:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.403+0000 7fb3e6a00700 1 -- 172.21.15.47:0/3096011657 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fb3e0029070 con 0x7fb3f0077cf0 2024-05-14T12:13:12.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.404+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f0079430 con 0x7fb3f0077cf0 2024-05-14T12:13:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.404+0000 7fb3e6a00700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb3d403e570 0x7fb3d4040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.404+0000 7fb3e6a00700 1 -- 172.21.15.47:0/3096011657 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb3e001e070 con 0x7fb3f0077cf0 2024-05-14T12:13:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.404+0000 7fb3ed400700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb3d403e570 0x7fb3d4040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.405+0000 7fb3ed400700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb3d403e570 0x7fb3d4040a80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc006fd0 tx=0x7fb3dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:12.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.411+0000 7fb3e6a00700 1 -- 172.21.15.47:0/3096011657 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb3e0013070 con 0x7fb3f0077cf0 2024-05-14T12:13:12.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:12.660+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}) -- 0x7fb3f01a12d0 con 0x7fb3d403e570 2024-05-14T12:13:12.661 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:12.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:12.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:12.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:12.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:13:12.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:12.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:12.662 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:12 smithi047 ceph-mon[31254]: Updating smithi066:/etc/ceph/ceph.conf 2024-05-14T12:13:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:13 smithi047 ceph-mon[31254]: Updating smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:13 smithi047 ceph-mon[31254]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:13 smithi047 ceph-mon[31254]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:13 smithi047 ceph-mon[31254]: Updating smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T12:13:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:13 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:13 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:13 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:14.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:14 smithi047 ceph-mon[31254]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:14.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:14 smithi047 ceph-mon[31254]: Deploying cephadm binary to smithi073 2024-05-14T12:13:15.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:15 smithi047 ceph-mon[31254]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:17.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.601+0000 7fb3e6a00700 1 -- 172.21.15.47:0/3096011657 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fb3f01a12d0 con 0x7fb3d403e570 2024-05-14T12:13:17.603 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi073' with addr '172.21.15.73' 2024-05-14T12:13:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb3d403e570 msgr2=0x7fb3d4040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb3d403e570 0x7fb3d4040a80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc006fd0 tx=0x7fb3dc006e40 comp rx=0 tx=0).stop 2024-05-14T12:13:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 msgr2=0x7fb3f019ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:17.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f019ff70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0006010 tx=0x7fb3e0005780 comp rx=0 tx=0).stop 2024-05-14T12:13:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 shutdown_connections 2024-05-14T12:13:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb3d403e570 0x7fb3d4040a80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 --2- 172.21.15.47:0/3096011657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3f0077cf0 0x7fb3f019ff70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.606+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 >> 172.21.15.47:0/3096011657 conn(0x7fb3f0101850 msgr2=0x7fb3f0102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.607+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 shutdown_connections 2024-05-14T12:13:17.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:17.607+0000 7fb3f5000700 1 -- 172.21.15.47:0/3096011657 wait complete. 2024-05-14T12:13:17.936 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:17 smithi047 ceph-mon[31254]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:18.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-14T12:13:18.784 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:13:18.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:18 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:18.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:18 smithi047 ceph-mon[31254]: Added host smithi073 2024-05-14T12:13:18.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:18 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:18.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:18 smithi047 ceph-mon[31254]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:18.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:18 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:19.913 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:20.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.821+0000 7f879dc00700 1 -- 172.21.15.47:0/1607225465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 msgr2=0x7f8798105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.821+0000 7f879dc00700 1 --2- 172.21.15.47:0/1607225465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f8798105100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8788009910 tx=0x7f8788009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.821+0000 7f879dc00700 1 -- 172.21.15.47:0/1607225465 shutdown_connections 2024-05-14T12:13:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.821+0000 7f879dc00700 1 --2- 172.21.15.47:0/1607225465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f8798105100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.821+0000 7f879dc00700 1 -- 172.21.15.47:0/1607225465 >> 172.21.15.47:0/1607225465 conn(0x7f87980785b0 msgr2=0x7f8798078a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.821+0000 7f879dc00700 1 -- 172.21.15.47:0/1607225465 shutdown_connections 2024-05-14T12:13:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.822+0000 7f879dc00700 1 -- 172.21.15.47:0/1607225465 wait complete. 2024-05-14T12:13:20.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.823+0000 7f879dc00700 1 Processor -- start 2024-05-14T12:13:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.823+0000 7f879dc00700 1 -- start start 2024-05-14T12:13:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.824+0000 7f879dc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f87981a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.824+0000 7f879dc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f879810e150 con 0x7f8798104cf0 2024-05-14T12:13:20.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.824+0000 7f8796a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f87981a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:20.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.824+0000 7f8796a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f87981a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42086/0 (socket says 172.21.15.47:42086) 2024-05-14T12:13:20.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.824+0000 7f8796a00700 1 -- 172.21.15.47:0/56048167 learned_addr learned my addr 172.21.15.47:0/56048167 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:13:20.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.824+0000 7f8796a00700 1 -- 172.21.15.47:0/56048167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87981a1cb0 con 0x7f8798104cf0 2024-05-14T12:13:20.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.825+0000 7f8796a00700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f87981a1770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8788006010 tx=0x7f8788005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:20.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.825+0000 7f878f400700 1 -- 172.21.15.47:0/56048167 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788026070 con 0x7f8798104cf0 2024-05-14T12:13:20.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.825+0000 7f878f400700 1 -- 172.21.15.47:0/56048167 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f878800bc00 con 0x7f8798104cf0 2024-05-14T12:13:20.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.825+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87981a1f40 con 0x7f8798104cf0 2024-05-14T12:13:20.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.825+0000 7f878f400700 1 -- 172.21.15.47:0/56048167 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788003910 con 0x7f8798104cf0 2024-05-14T12:13:20.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.825+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879819b990 con 0x7f8798104cf0 2024-05-14T12:13:20.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.827+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879806b670 con 0x7f8798104cf0 2024-05-14T12:13:20.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.827+0000 7f878f400700 1 -- 172.21.15.47:0/56048167 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8788029070 con 0x7f8798104cf0 2024-05-14T12:13:20.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.827+0000 7f878f400700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f877c03e570 0x7f877c040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:20.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.828+0000 7f878f400700 1 -- 172.21.15.47:0/56048167 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f878801e070 con 0x7f8798104cf0 2024-05-14T12:13:20.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.828+0000 7f8796000700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f877c03e570 0x7f877c040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:20.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.829+0000 7f8796000700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f877c03e570 0x7f877c040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8784006fd0 tx=0x7f8784006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:20.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:20.834+0000 7f878f400700 1 -- 172.21.15.47:0/56048167 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8788013070 con 0x7f8798104cf0 2024-05-14T12:13:21.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.077+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f879819cec0 con 0x7f877c03e570 2024-05-14T12:13:21.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.079+0000 7f878f400700 1 -- 172.21.15.47:0/56048167 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7f879819cec0 con 0x7f877c03e570 2024-05-14T12:13:21.080 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:13:21.080 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}, {"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}] 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f877c03e570 msgr2=0x7f877c040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f877c03e570 0x7f877c040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8784006fd0 tx=0x7f8784006e40 comp rx=0 tx=0).stop 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 msgr2=0x7f87981a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f87981a1770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8788006010 tx=0x7f8788005780 comp rx=0 tx=0).stop 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 shutdown_connections 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f877c03e570 0x7f877c040a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 --2- 172.21.15.47:0/56048167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8798104cf0 0x7f87981a1770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:21.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 >> 172.21.15.47:0/56048167 conn(0x7f87980785b0 msgr2=0x7f8798109f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:21.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 shutdown_connections 2024-05-14T12:13:21.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:21.082+0000 7f879dc00700 1 -- 172.21.15.47:0/56048167 wait complete. 2024-05-14T12:13:21.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:21 smithi047 ceph-mon[31254]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:21.439 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:21.826 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-14T12:13:21.827 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd crush tunables default 2024-05-14T12:13:22.248 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:13:22.564 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:22 smithi047 ceph-mon[31254]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:13:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:23 smithi047 ceph-mon[31254]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:24.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.403+0000 7fea9ee00700 1 -- 172.21.15.47:0/3688052446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 msgr2=0x7fea980760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.403+0000 7fea9ee00700 1 --2- 172.21.15.47:0/3688052446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea980760c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fea88009910 tx=0x7fea88009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.403+0000 7fea9ee00700 1 -- 172.21.15.47:0/3688052446 shutdown_connections 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.403+0000 7fea9ee00700 1 --2- 172.21.15.47:0/3688052446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea980760c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.403+0000 7fea9ee00700 1 -- 172.21.15.47:0/3688052446 >> 172.21.15.47:0/3688052446 conn(0x7fea980ff660 msgr2=0x7fea98101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.403+0000 7fea9ee00700 1 -- 172.21.15.47:0/3688052446 shutdown_connections 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.403+0000 7fea9ee00700 1 -- 172.21.15.47:0/3688052446 wait complete. 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.405+0000 7fea9ee00700 1 Processor -- start 2024-05-14T12:13:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.405+0000 7fea9ee00700 1 -- start start 2024-05-14T12:13:24.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.405+0000 7fea9ee00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea981a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:24.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.405+0000 7fea9ee00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea98110320 con 0x7fea98075cb0 2024-05-14T12:13:24.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.406+0000 7fea97e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea981a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:24.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.406+0000 7fea97e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea981a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42108/0 (socket says 172.21.15.47:42108) 2024-05-14T12:13:24.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.406+0000 7fea97e00700 1 -- 172.21.15.47:0/3002033006 learned_addr learned my addr 172.21.15.47:0/3002033006 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:13:24.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.406+0000 7fea97e00700 1 -- 172.21.15.47:0/3002033006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea981a1cb0 con 0x7fea98075cb0 2024-05-14T12:13:24.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.406+0000 7fea97e00700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea981a1770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea880056d0 tx=0x7fea880057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:24.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.407+0000 7fea94c00700 1 -- 172.21.15.47:0/3002033006 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88026070 con 0x7fea98075cb0 2024-05-14T12:13:24.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.407+0000 7fea94c00700 1 -- 172.21.15.47:0/3002033006 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea88004370 con 0x7fea98075cb0 2024-05-14T12:13:24.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.407+0000 7fea94c00700 1 -- 172.21.15.47:0/3002033006 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea880039b0 con 0x7fea98075cb0 2024-05-14T12:13:24.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.407+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea981a1f40 con 0x7fea98075cb0 2024-05-14T12:13:24.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.407+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9819b990 con 0x7fea98075cb0 2024-05-14T12:13:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.408+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea98077220 con 0x7fea98075cb0 2024-05-14T12:13:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.408+0000 7fea94c00700 1 -- 172.21.15.47:0/3002033006 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fea88029070 con 0x7fea98075cb0 2024-05-14T12:13:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.409+0000 7fea94c00700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea7c03e510 0x7fea7c040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.409+0000 7fea94c00700 1 -- 172.21.15.47:0/3002033006 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fea8801e070 con 0x7fea98075cb0 2024-05-14T12:13:24.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.409+0000 7fea97400700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea7c03e510 0x7fea7c040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:24.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.410+0000 7fea97400700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea7c03e510 0x7fea7c040a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fea84006fd0 tx=0x7fea84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:24.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.415+0000 7fea94c00700 1 -- 172.21.15.47:0/3002033006 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fea88013070 con 0x7fea98075cb0 2024-05-14T12:13:24.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:24.662+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fea98064e20 con 0x7fea98075cb0 2024-05-14T12:13:24.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:24.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:24.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:24.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:24.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:13:24.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:24.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:24.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:24 smithi047 ceph-mon[31254]: Updating smithi073:/etc/ceph/ceph.conf 2024-05-14T12:13:25.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.658+0000 7fea94c00700 1 -- 172.21.15.47:0/3002033006 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fea8800bcc0 con 0x7fea98075cb0 2024-05-14T12:13:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea7c03e510 msgr2=0x7fea7c040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea7c03e510 0x7fea7c040a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fea84006fd0 tx=0x7fea84006e40 comp rx=0 tx=0).stop 2024-05-14T12:13:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 msgr2=0x7fea981a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:25.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea981a1770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea880056d0 tx=0x7fea880057b0 comp rx=0 tx=0).stop 2024-05-14T12:13:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 shutdown_connections 2024-05-14T12:13:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea7c03e510 0x7fea7c040a20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 --2- 172.21.15.47:0/3002033006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea98075cb0 0x7fea981a1770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 >> 172.21.15.47:0/3002033006 conn(0x7fea980ff660 msgr2=0x7fea98107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 shutdown_connections 2024-05-14T12:13:25.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:25.663+0000 7fea9ee00700 1 -- 172.21.15.47:0/3002033006 wait complete. 2024-05-14T12:13:25.665 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: Updating smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: Updating smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:25 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3002033006' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T12:13:26.347 INFO:tasks.cephadm:Adding mon.a on smithi047 2024-05-14T12:13:26.347 INFO:tasks.cephadm:Adding mon.b on smithi066 2024-05-14T12:13:26.348 INFO:tasks.cephadm:Adding mon.c on smithi073 2024-05-14T12:13:26.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch apply mon '3;smithi047:172.21.15.47=a;smithi066:172.21.15.66=b;smithi073:172.21.15.73=c' 2024-05-14T12:13:26.582 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:26.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:26 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3002033006' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T12:13:26.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:26 smithi047 ceph-mon[31254]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:26.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:26 smithi047 ceph-mon[31254]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:28.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.073+0000 7f20c099f700 1 -- 172.21.15.73:0/2249378884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 msgr2=0x7f20bc108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:28.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.073+0000 7f20c099f700 1 --2- 172.21.15.73:0/2249378884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc108cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009910 tx=0x7f20ac009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:28.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.074+0000 7f20c099f700 1 -- 172.21.15.73:0/2249378884 shutdown_connections 2024-05-14T12:13:28.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.074+0000 7f20c099f700 1 --2- 172.21.15.73:0/2249378884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc108cc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:28.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.074+0000 7f20c099f700 1 -- 172.21.15.73:0/2249378884 >> 172.21.15.73:0/2249378884 conn(0x7f20bc0fe3e0 msgr2=0x7f20bc100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:28.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.074+0000 7f20c099f700 1 -- 172.21.15.73:0/2249378884 shutdown_connections 2024-05-14T12:13:28.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.074+0000 7f20c099f700 1 -- 172.21.15.73:0/2249378884 wait complete. 2024-05-14T12:13:28.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.074+0000 7f20c099f700 1 Processor -- start 2024-05-14T12:13:28.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.075+0000 7f20c099f700 1 -- start start 2024-05-14T12:13:28.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.075+0000 7f20c099f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:28.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.075+0000 7f20c099f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc10ce00 con 0x7f20bc1088b0 2024-05-14T12:13:28.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.075+0000 7f20bb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.075+0000 7f20bb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.73:48656/0 (socket says 172.21.15.73:48656) 2024-05-14T12:13:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.075+0000 7f20bb7fe700 1 -- 172.21.15.73:0/2349963478 learned_addr learned my addr 172.21.15.73:0/2349963478 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:13:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.076+0000 7f20bb7fe700 1 -- 172.21.15.73:0/2349963478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc06c7e0 con 0x7f20bc1088b0 2024-05-14T12:13:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.076+0000 7f20bb7fe700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc19a6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0056d0 tx=0x7f20ac0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.077+0000 7f20b8ff9700 1 -- 172.21.15.73:0/2349963478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac027070 con 0x7f20bc1088b0 2024-05-14T12:13:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.077+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20bc19ac50 con 0x7f20bc1088b0 2024-05-14T12:13:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.077+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20bc19b110 con 0x7f20bc1088b0 2024-05-14T12:13:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.077+0000 7f20b8ff9700 1 -- 172.21.15.73:0/2349963478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20ac0047d0 con 0x7f20bc1088b0 2024-05-14T12:13:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.077+0000 7f20b8ff9700 1 -- 172.21.15.73:0/2349963478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac031060 con 0x7f20bc1088b0 2024-05-14T12:13:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.078+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a8005330 con 0x7f20bc1088b0 2024-05-14T12:13:28.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.079+0000 7f20b8ff9700 1 -- 172.21.15.73:0/2349963478 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f20ac02a070 con 0x7f20bc1088b0 2024-05-14T12:13:28.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.079+0000 7f20b8ff9700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f20a403e510 0x7f20a4040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:28.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.079+0000 7f20b8ff9700 1 -- 172.21.15.73:0/2349963478 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f20ac01e030 con 0x7f20bc1088b0 2024-05-14T12:13:28.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.079+0000 7f20baffd700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f20a403e510 0x7f20a4040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:28.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.080+0000 7f20baffd700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f20a403e510 0x7f20a4040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20b0006fd0 tx=0x7f20b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:28.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.096+0000 7f20b8ff9700 1 -- 172.21.15.73:0/2349963478 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f20ac013070 con 0x7f20bc1088b0 2024-05-14T12:13:28.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.308+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi066:172.21.15.66=b;smithi073:172.21.15.73=c", "target": ["mon-mgr", ""]}) -- 0x7f20a8000c70 con 0x7f20a403e510 2024-05-14T12:13:28.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.324+0000 7f20b8ff9700 1 -- 172.21.15.73:0/2349963478 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f20a8000c70 con 0x7f20a403e510 2024-05-14T12:13:28.324 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mon update... 2024-05-14T12:13:28.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f20a403e510 msgr2=0x7f20a4040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:28.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f20a403e510 0x7f20a4040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20b0006fd0 tx=0x7f20b0006e40 comp rx=0 tx=0).stop 2024-05-14T12:13:28.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 msgr2=0x7f20bc19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:28.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc19a6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0056d0 tx=0x7f20ac0057b0 comp rx=0 tx=0).stop 2024-05-14T12:13:28.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 shutdown_connections 2024-05-14T12:13:28.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f20a403e510 0x7f20a4040a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:28.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 --2- 172.21.15.73:0/2349963478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc1088b0 0x7f20bc19a6b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:28.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 >> 172.21.15.73:0/2349963478 conn(0x7f20bc0fe3e0 msgr2=0x7f20bc0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:28.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 shutdown_connections 2024-05-14T12:13:28.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:28.326+0000 7f20c099f700 1 -- 172.21.15.73:0/2349963478 wait complete. 2024-05-14T12:13:28.884 DEBUG:teuthology.orchestra.run.smithi066:mon.b> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.b.service 2024-05-14T12:13:28.887 DEBUG:teuthology.orchestra.run.smithi073:mon.c> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.c.service 2024-05-14T12:13:28.889 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T12:13:28.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T12:13:29.620 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi066:172.21.15.66=b;smithi073:172.21.15.73=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi066:172.21.15.66=b;smithi073:172.21.15.73=c;count:3 2024-05-14T12:13:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:29.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:29.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:29.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:29.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:29.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:29.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:29.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:29 smithi047 ceph-mon[31254]: Deploying daemon mon.c on smithi073 2024-05-14T12:13:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:31 smithi047 ceph-mon[31254]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:32.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.674+0000 7f41b8a02700 1 -- 172.21.15.73:0/961451624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 msgr2=0x7f41b4108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:32.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.674+0000 7f41b8a02700 1 --2- 172.21.15.73:0/961451624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4108c90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41a400b0a0 tx=0x7f41a400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:13:32.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.674+0000 7f41b8a02700 1 -- 172.21.15.73:0/961451624 shutdown_connections 2024-05-14T12:13:32.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.674+0000 7f41b8a02700 1 --2- 172.21.15.73:0/961451624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4108c90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:32.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.674+0000 7f41b8a02700 1 -- 172.21.15.73:0/961451624 >> 172.21.15.73:0/961451624 conn(0x7f41b40fe390 msgr2=0x7f41b41007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:32.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.674+0000 7f41b8a02700 1 -- 172.21.15.73:0/961451624 shutdown_connections 2024-05-14T12:13:32.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.674+0000 7f41b8a02700 1 -- 172.21.15.73:0/961451624 wait complete. 2024-05-14T12:13:32.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.675+0000 7f41b8a02700 1 Processor -- start 2024-05-14T12:13:32.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.675+0000 7f41b8a02700 1 -- start start 2024-05-14T12:13:32.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.675+0000 7f41b8a02700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:32.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.675+0000 7f41b8a02700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41b410cdd0 con 0x7f41b4108880 2024-05-14T12:13:32.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.676+0000 7f41b2d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:32.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.676+0000 7f41b2d9d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.73:52580/0 (socket says 172.21.15.73:52580) 2024-05-14T12:13:32.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.676+0000 7f41b2d9d700 1 -- 172.21.15.73:0/2343240565 learned_addr learned my addr 172.21.15.73:0/2343240565 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:13:32.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.677+0000 7f41b2d9d700 1 -- 172.21.15.73:0/2343240565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b4198b50 con 0x7f41b4108880 2024-05-14T12:13:32.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.677+0000 7f41b2d9d700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4198610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41a400d010 tx=0x7f41a4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:32.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.677+0000 7f41abfff700 1 -- 172.21.15.73:0/2343240565 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a4021020 con 0x7f41b4108880 2024-05-14T12:13:32.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.677+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b4198de0 con 0x7f41b4108880 2024-05-14T12:13:32.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.677+0000 7f41abfff700 1 -- 172.21.15.73:0/2343240565 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41a4007a40 con 0x7f41b4108880 2024-05-14T12:13:32.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.677+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b419ce40 con 0x7f41b4108880 2024-05-14T12:13:32.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.677+0000 7f41abfff700 1 -- 172.21.15.73:0/2343240565 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a4017040 con 0x7f41b4108880 2024-05-14T12:13:32.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.678+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b4103f90 con 0x7f41b4108880 2024-05-14T12:13:32.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.679+0000 7f41abfff700 1 -- 172.21.15.73:0/2343240565 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f41a4024020 con 0x7f41b4108880 2024-05-14T12:13:32.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.679+0000 7f41abfff700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41a003e560 0x7f41a0040a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:32.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.679+0000 7f41abfff700 1 -- 172.21.15.73:0/2343240565 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f41a400f050 con 0x7f41b4108880 2024-05-14T12:13:32.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.680+0000 7f41b259c700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41a003e560 0x7f41a0040a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:32.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.681+0000 7f41b259c700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41a003e560 0x7f41a0040a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f419c006fd0 tx=0x7f419c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:32.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:32.697+0000 7f41abfff700 1 -- 172.21.15.73:0/2343240565 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f41a402b030 con 0x7f41b4108880 2024-05-14T12:13:33.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.004+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f41b4199970 con 0x7f41b4108880 2024-05-14T12:13:33.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.006+0000 7f41abfff700 1 -- 172.21.15.73:0/2343240565 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f41a40115f0 con 0x7f41b4108880 2024-05-14T12:13:33.006 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:13:33.006 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","modified":"2024-05-14T12:11:24.350717Z","created":"2024-05-14T12:11:24.350717Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41a003e560 msgr2=0x7f41a0040a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41a003e560 0x7f41a0040a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f419c006fd0 tx=0x7f419c006e40 comp rx=0 tx=0).stop 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 msgr2=0x7f41b4198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4198610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41a400d010 tx=0x7f41a4003ce0 comp rx=0 tx=0).stop 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 shutdown_connections 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41a003e560 0x7f41a0040a70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 --2- 172.21.15.73:0/2343240565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41b4108880 0x7f41b4198610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 >> 172.21.15.73:0/2343240565 conn(0x7f41b40fe390 msgr2=0x7f41b40ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 shutdown_connections 2024-05-14T12:13:33.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:33.008+0000 7f41b8a02700 1 -- 172.21.15.73:0/2343240565 wait complete. 2024-05-14T12:13:33.009 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-05-14T12:13:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:33 smithi047 ceph-mon[31254]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:33 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/2343240565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:34.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:34 smithi073 systemd[1]: Started Ceph mon.c for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:13:34.659 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T12:13:34.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T12:13:34.892 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:13:39.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.461+0000 7f757846f700 1 -- 172.21.15.73:0/2327413414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75580035c0 msgr2=0x7f7558005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:39.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.461+0000 7f757846f700 1 --2- 172.21.15.73:0/2327413414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75580035c0 0x7f7558005aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7570103b70 tx=0x7f7560009e80 comp rx=0 tx=0).stop 2024-05-14T12:13:39.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.462+0000 7f757846f700 1 -- 172.21.15.73:0/2327413414 shutdown_connections 2024-05-14T12:13:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.462+0000 7f757846f700 1 --2- 172.21.15.73:0/2327413414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75580035c0 0x7f7558005aa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.462+0000 7f757846f700 1 -- 172.21.15.73:0/2327413414 >> 172.21.15.73:0/2327413414 conn(0x7f75700ff7a0 msgr2=0x7f7570101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.462+0000 7f757846f700 1 -- 172.21.15.73:0/2327413414 shutdown_connections 2024-05-14T12:13:39.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.462+0000 7f757846f700 1 -- 172.21.15.73:0/2327413414 wait complete. 2024-05-14T12:13:39.463 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:13:39.463 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: mon.a calling monitor election 2024-05-14T12:13:39.463 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.463 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: mon.c calling monitor election 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: monmap epoch 2 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: last_changed 2024-05-14T12:13:34.073870+0000 2024-05-14T12:13:39.464 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: min_mon_release 19 (squid) 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: election_strategy: 1 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: fsmap 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: mgrmap e13: x(active, since 61s) 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: overall HEALTH_OK 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:39.465 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757846f700 1 Processor -- start 2024-05-14T12:13:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757846f700 1 -- start start 2024-05-14T12:13:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757846f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 0x7f75701a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:39.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757846f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75701a1de0 0x7f757019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757846f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f757010bbf0 con 0x7f75701a1de0 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757846f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f757010ba70 con 0x7f75580035c0 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757620b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 0x7f75701a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757620b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 0x7f75701a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35370/0 (socket says 172.21.15.73:35370) 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757620b700 1 -- 172.21.15.73:0/2218093611 learned_addr learned my addr 172.21.15.73:0/2218093611 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757620b700 1 -- 172.21.15.73:0/2218093611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 msgr2=0x7f75701a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757620b700 1 -- 172.21.15.73:0/2218093611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 msgr2=0x7f75701a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.463+0000 7f757620b700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 0x7f75701a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.464+0000 7f757620b700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 0x7f75701a18a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.464+0000 7f7575a0a700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75701a1de0 0x7f757019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.464+0000 7f7575a0a700 1 -- 172.21.15.73:0/2218093611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 msgr2=0x7f75701a18a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.464+0000 7f7575a0a700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 0x7f75701a18a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.464+0000 7f7575a0a700 1 -- 172.21.15.73:0/2218093611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75701a23d0 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.465+0000 7f7575a0a700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75701a1de0 0x7f757019bae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f756400b4d0 tx=0x7f756400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.465+0000 7f756f7fe700 1 -- 172.21.15.73:0/2218093611 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7564011630 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.465+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757019c080 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.465+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757019c610 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.465+0000 7f756f7fe700 1 -- 172.21.15.73:0/2218093611 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7564011c80 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.465+0000 7f756f7fe700 1 -- 172.21.15.73:0/2218093611 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f756401adc0 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.466+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7558002b30 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.467+0000 7f756f7fe700 1 -- 172.21.15.73:0/2218093611 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f7564018020 con 0x7f75701a1de0 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.467+0000 7f756f7fe700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f755c03e2d0 0x7f755c0407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:39.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.467+0000 7f756f7fe700 1 -- 172.21.15.73:0/2218093611 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7564052280 con 0x7f75701a1de0 2024-05-14T12:13:39.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.468+0000 7f757620b700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f755c03e2d0 0x7f755c0407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:39.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.469+0000 7f757620b700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f755c03e2d0 0x7f755c0407e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f756001c040 tx=0x7f75600091d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:39.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.483+0000 7f756f7fe700 1 -- 172.21.15.73:0/2218093611 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f756401f020 con 0x7f75701a1de0 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: mon.a calling monitor election 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: mon.c calling monitor election 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:39.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: monmap epoch 2 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: last_changed 2024-05-14T12:13:34.073870+0000 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: min_mon_release 19 (squid) 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: election_strategy: 1 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: fsmap 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: mgrmap e13: x(active, since 61s) 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: overall HEALTH_OK 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:39.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:39.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.768+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f75580030f0 con 0x7f75701a1de0 2024-05-14T12:13:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.769+0000 7f756f7fe700 1 -- 172.21.15.73:0/2218093611 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f756401a490 con 0x7f75701a1de0 2024-05-14T12:13:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:13:39.769 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","modified":"2024-05-14T12:13:34.073870Z","created":"2024-05-14T12:11:24.350717Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-14T12:13:39.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f755c03e2d0 msgr2=0x7f755c0407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:39.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f755c03e2d0 0x7f755c0407e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f756001c040 tx=0x7f75600091d0 comp rx=0 tx=0).stop 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75701a1de0 msgr2=0x7f757019bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75701a1de0 0x7f757019bae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f756400b4d0 tx=0x7f756400b890 comp rx=0 tx=0).stop 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 shutdown_connections 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f755c03e2d0 0x7f755c0407e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75580035c0 0x7f75701a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 --2- 172.21.15.73:0/2218093611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75701a1de0 0x7f757019bae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 >> 172.21.15.73:0/2218093611 conn(0x7f75700ff7a0 msgr2=0x7f7570076e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 shutdown_connections 2024-05-14T12:13:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:39.771+0000 7f757846f700 1 -- 172.21.15.73:0/2218093611 wait complete. 2024-05-14T12:13:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 2 2024-05-14T12:13:40.371 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:40.371 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:40.371 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:40.371 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:40 smithi073 ceph-mon[35809]: Deploying daemon mon.b on smithi066 2024-05-14T12:13:40.371 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:40 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/2218093611' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:40.371 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:40 smithi047 ceph-mon[31254]: Deploying daemon mon.b on smithi066 2024-05-14T12:13:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:40 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/2218093611' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:41.400 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T12:13:41.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T12:13:41.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:41 smithi047 ceph-mon[31254]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:41.485 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:13:41 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:13:41.075+0000 7f866fc00700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-14T12:13:41.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:41 smithi073 ceph-mon[35809]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:41.641 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:13:43.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.040+0000 7fe040eb2700 1 -- 172.21.15.73:0/256005188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c102dd0 msgr2=0x7fe03c1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:43.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.040+0000 7fe040eb2700 1 --2- 172.21.15.73:0/256005188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c102dd0 0x7fe03c1031e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009910 tx=0x7fe02c009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:43.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.040+0000 7fe040eb2700 1 -- 172.21.15.73:0/256005188 shutdown_connections 2024-05-14T12:13:43.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.040+0000 7fe040eb2700 1 --2- 172.21.15.73:0/256005188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c102dd0 0x7fe03c1031e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:43.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.040+0000 7fe040eb2700 1 -- 172.21.15.73:0/256005188 >> 172.21.15.73:0/256005188 conn(0x7fe03c0797e0 msgr2=0x7fe03c079c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:43.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.040+0000 7fe040eb2700 1 -- 172.21.15.73:0/256005188 shutdown_connections 2024-05-14T12:13:43.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.041+0000 7fe040eb2700 1 -- 172.21.15.73:0/256005188 wait complete. 2024-05-14T12:13:43.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.041+0000 7fe040eb2700 1 Processor -- start 2024-05-14T12:13:43.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe040eb2700 1 -- start start 2024-05-14T12:13:43.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe040eb2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 0x7fe03c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:43.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe040eb2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c198d80 0x7fe03c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:43.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe040eb2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c10d0c0 con 0x7fe03c198d80 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe040eb2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c10cf40 con 0x7fe03c102dd0 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe03a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 0x7fe03c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe03a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 0x7fe03c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51814/0 (socket says 172.21.15.73:51814) 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe03a59c700 1 -- 172.21.15.73:0/3879933301 learned_addr learned my addr 172.21.15.73:0/3879933301 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe03a59c700 1 -- 172.21.15.73:0/3879933301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 msgr2=0x7fe03c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe03a59c700 1 -- 172.21.15.73:0/3879933301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 msgr2=0x7fe03c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe03a59c700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 0x7fe03c198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe03a59c700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 0x7fe03c198840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.042+0000 7fe039d9b700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c198d80 0x7fe03c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.043+0000 7fe039d9b700 1 -- 172.21.15.73:0/3879933301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 msgr2=0x7fe03c198840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.043+0000 7fe039d9b700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 0x7fe03c198840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.043+0000 7fe039d9b700 1 -- 172.21.15.73:0/3879933301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c06ca40 con 0x7fe03c198d80 2024-05-14T12:13:43.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.043+0000 7fe039d9b700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c198d80 0x7fe03c199190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe03000b500 tx=0x7fe03000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:43.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.044+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe030011630 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.044+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe030011c80 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.044+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c1a5eb0 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.044+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe030010d10 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.044+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c1a6360 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.045+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c104280 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.046+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fe030018020 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.046+0000 7fe02b7fe700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe02403e2b0 0x7fe0240407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.046+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe030052260 con 0x7fe03c198d80 2024-05-14T12:13:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.046+0000 7fe03a59c700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe02403e2b0 0x7fe0240407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:43.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.047+0000 7fe03a59c700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe02403e2b0 0x7fe0240407c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe02c000c00 tx=0x7fe02c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:43.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.063+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe03001f070 con 0x7fe03c198d80 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Deploying cephadm binary to smithi066 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Added host smithi066 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.338 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.338 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.338 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:13:43.338 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.338 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.338 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.338 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.345+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030019990 con 0x7fe03c198d80 2024-05-14T12:13:43.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:43.356+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe03c1a65e0 con 0x7fe03c198d80 2024-05-14T12:13:43.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:43 smithi047 ceph-mon[31254]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:43 smithi073 ceph-mon[35809]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.645 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.646 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:13:43.646 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:43.646 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:43.646 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi066:/etc/ceph/ceph.conf 2024-05-14T12:13:43.646 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:43.646 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.647 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:43.647 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T12:13:43.647 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.647 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.647 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.647 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:43.648 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Deploying cephadm binary to smithi073 2024-05-14T12:13:43.648 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.648 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.648 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.648 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Added host smithi073 2024-05-14T12:13:43.648 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:43.649 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.649 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.649 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.649 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.649 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.649 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:13:43.650 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.650 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.650 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.650 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.650 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.651 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:13:43.651 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:43.651 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:43.651 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi073:/etc/ceph/ceph.conf 2024-05-14T12:13:43.651 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:43.651 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:43.651 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.652 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Updating smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T12:13:43.652 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.652 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.652 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.652 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3002033006' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T12:13:43.652 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3002033006' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi066:172.21.15.66=b;smithi073:172.21.15.73=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi066:172.21.15.66=b;smithi073:172.21.15.73=c;count:3 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:43.653 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:43.654 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.654 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:43.654 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:43.654 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Deploying daemon mon.c on smithi073 2024-05-14T12:13:43.654 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.654 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/2343240565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: mon.a calling monitor election 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: mon.c calling monitor election 2024-05-14T12:13:43.655 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: monmap epoch 2 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:43.656 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: last_changed 2024-05-14T12:13:34.073870+0000 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: min_mon_release 19 (squid) 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: election_strategy: 1 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: fsmap 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: mgrmap e13: x(active, since 61s) 2024-05-14T12:13:43.657 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: overall HEALTH_OK 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: Deploying daemon mon.b on smithi066 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/2218093611' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:43.658 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:43.659 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.659 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:43.659 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 ceph-mon[35981]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-14T12:13:43.659 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 bash[35962]: 334e228c20bc30802533889174aad9498a2f401c9caf544a2d5e3a34f8329f37 2024-05-14T12:13:43.659 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:43 smithi066 systemd[1]: Started Ceph mon.b for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:13:48.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.366+0000 7fe02b7fe700 1 -- 172.21.15.73:0/3879933301 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7fe03000fd60 con 0x7fe03c198d80 2024-05-14T12:13:48.366 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-05-14T12:13:48.367 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","modified":"2024-05-14T12:13:43.343132Z","created":"2024-05-14T12:11:24.350717Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-14T12:13:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.368+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe02403e2b0 msgr2=0x7fe0240407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe02403e2b0 0x7fe0240407c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe02c000c00 tx=0x7fe02c01a040 comp rx=0 tx=0).stop 2024-05-14T12:13:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c198d80 msgr2=0x7fe03c199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c198d80 0x7fe03c199190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe03000b500 tx=0x7fe03000b8c0 comp rx=0 tx=0).stop 2024-05-14T12:13:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 shutdown_connections 2024-05-14T12:13:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe02403e2b0 0x7fe0240407c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe03c102dd0 0x7fe03c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 --2- 172.21.15.73:0/3879933301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe03c198d80 0x7fe03c199190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 >> 172.21.15.73:0/3879933301 conn(0x7fe03c0797e0 msgr2=0x7fe03c1089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 shutdown_connections 2024-05-14T12:13:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:48.369+0000 7fe040eb2700 1 -- 172.21.15.73:0/3879933301 wait complete. 2024-05-14T12:13:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 3 2024-05-14T12:13:48.698 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: mon.c calling monitor election 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: mon.a calling monitor election 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/3879933301' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: monmap epoch 3 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: last_changed 2024-05-14T12:13:43.343132+0000 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: min_mon_release 19 (squid) 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: election_strategy: 1 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: fsmap 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: mgrmap e13: x(active, since 70s) 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: overall HEALTH_OK 2024-05-14T12:13:48.700 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:48.701 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: mon.c calling monitor election 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: mon.a calling monitor election 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/3879933301' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:48.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: monmap epoch 3 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: last_changed 2024-05-14T12:13:43.343132+0000 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: min_mon_release 19 (squid) 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: election_strategy: 1 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: fsmap 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: mgrmap e13: x(active, since 70s) 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: overall HEALTH_OK 2024-05-14T12:13:48.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:48.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:49.023 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-14T12:13:49.024 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph config generate-minimal-conf 2024-05-14T12:13:49.465 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:13:49.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:49 smithi047 ceph-mon[31254]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:49.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:49.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:49.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:49.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:49.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:49 smithi073 ceph-mon[35809]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:49.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:49.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:49.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:49.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: mon.c calling monitor election 2024-05-14T12:13:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:13:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: mon.a calling monitor election 2024-05-14T12:13:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/3879933301' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: monmap epoch 3 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: last_changed 2024-05-14T12:13:43.343132+0000 2024-05-14T12:13:50.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: min_mon_release 19 (squid) 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: election_strategy: 1 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: fsmap 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: mgrmap e13: x(active, since 70s) 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: overall HEALTH_OK 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:50.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:50.828 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:50.828 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: mon.b calling monitor election 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: Updating smithi047:/etc/ceph/ceph.conf 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: Updating smithi066:/etc/ceph/ceph.conf 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: Updating smithi073:/etc/ceph/ceph.conf 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: mon.b calling monitor election 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: mon.c calling monitor election 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: mon.a calling monitor election 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T12:13:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: monmap epoch 3 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: last_changed 2024-05-14T12:13:43.343132+0000 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: min_mon_release 19 (squid) 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: election_strategy: 1 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: fsmap 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: mgrmap e13: x(active, since 72s) 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: overall HEALTH_OK 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: Updating smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:51.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: Updating smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:51.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: mon.b calling monitor election 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: Updating smithi047:/etc/ceph/ceph.conf 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: Updating smithi066:/etc/ceph/ceph.conf 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: Updating smithi073:/etc/ceph/ceph.conf 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: mon.b calling monitor election 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: mon.c calling monitor election 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: mon.a calling monitor election 2024-05-14T12:13:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: monmap epoch 3 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: last_changed 2024-05-14T12:13:43.343132+0000 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: min_mon_release 19 (squid) 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: election_strategy: 1 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: fsmap 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: mgrmap e13: x(active, since 72s) 2024-05-14T12:13:51.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: overall HEALTH_OK 2024-05-14T12:13:51.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:51.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: Updating smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:51.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: Updating smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:51.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: mon.b calling monitor election 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: Updating smithi047:/etc/ceph/ceph.conf 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: Updating smithi066:/etc/ceph/ceph.conf 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: Updating smithi073:/etc/ceph/ceph.conf 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: mon.b calling monitor election 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: mon.c calling monitor election 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: mon.a calling monitor election 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: monmap epoch 3 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: last_changed 2024-05-14T12:13:43.343132+0000 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: created 2024-05-14T12:11:24.350717+0000 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: min_mon_release 19 (squid) 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: election_strategy: 1 2024-05-14T12:13:51.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: fsmap 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: mgrmap e13: x(active, since 72s) 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: overall HEALTH_OK 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: Updating smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: Updating smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:51.534 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:13:51 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:13:51.343+0000 7f866fc00700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-14T12:13:51.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.533+0000 7f330dc00700 1 -- 172.21.15.47:0/809477862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3308075cb0 msgr2=0x7f33080760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.533+0000 7f330dc00700 1 --2- 172.21.15.47:0/809477862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3308075cb0 0x7f33080760c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009910 tx=0x7f32f8009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.533+0000 7f330dc00700 1 -- 172.21.15.47:0/809477862 shutdown_connections 2024-05-14T12:13:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.534+0000 7f330dc00700 1 --2- 172.21.15.47:0/809477862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3308075cb0 0x7f33080760c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.534+0000 7f330dc00700 1 -- 172.21.15.47:0/809477862 >> 172.21.15.47:0/809477862 conn(0x7f33080ff6a0 msgr2=0x7f3308101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.534+0000 7f330dc00700 1 -- 172.21.15.47:0/809477862 shutdown_connections 2024-05-14T12:13:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.534+0000 7f330dc00700 1 -- 172.21.15.47:0/809477862 wait complete. 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.535+0000 7f330dc00700 1 Processor -- start 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.536+0000 7f330dc00700 1 -- start start 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.536+0000 7f330dc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3308075cb0 0x7f330810d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.536+0000 7f330dc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33081077e0 0x7f3308107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.536+0000 7f330dc00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3308108130 0x7f33081b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.536+0000 7f330dc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3308110340 con 0x7f33081077e0 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.536+0000 7f330dc00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f33081101c0 con 0x7f3308075cb0 2024-05-14T12:13:51.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.536+0000 7f330dc00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33081104c0 con 0x7f3308108130 2024-05-14T12:13:51.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3307400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3308108130 0x7f33081b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:51.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3307400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3308108130 0x7f33081b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51268/0 (socket says 172.21.15.47:51268) 2024-05-14T12:13:51.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3307400700 1 -- 172.21.15.47:0/1940009798 learned_addr learned my addr 172.21.15.47:0/1940009798 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:13:51.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3306000700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33081077e0 0x7f3308107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:51.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3306a00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3308075cb0 0x7f330810d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:51.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3306000700 1 -- 172.21.15.47:0/1940009798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3308108130 msgr2=0x7f33081b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:51.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3306000700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3308108130 0x7f33081b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3306000700 1 -- 172.21.15.47:0/1940009798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3308075cb0 msgr2=0x7f330810d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.537+0000 7f3306000700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3308075cb0 0x7f330810d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.538+0000 7f3306000700 1 -- 172.21.15.47:0/1940009798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33081b5560 con 0x7f33081077e0 2024-05-14T12:13:51.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.538+0000 7f3306a00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3308075cb0 0x7f330810d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.538+0000 7f3306000700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33081077e0 0x7f3308107bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32f400b580 tx=0x7f32f400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.538+0000 7f32ff400700 1 -- 172.21.15.47:0/1940009798 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4004230 con 0x7f33081077e0 2024-05-14T12:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.538+0000 7f32ff400700 1 -- 172.21.15.47:0/1940009798 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f40043d0 con 0x7f33081077e0 2024-05-14T12:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.538+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33081b5850 con 0x7f33081077e0 2024-05-14T12:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.538+0000 7f32ff400700 1 -- 172.21.15.47:0/1940009798 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4011a50 con 0x7f33081077e0 2024-05-14T12:13:51.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.539+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33081b5de0 con 0x7f33081077e0 2024-05-14T12:13:51.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.540+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3308077220 con 0x7f33081077e0 2024-05-14T12:13:51.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.540+0000 7f32ff400700 1 -- 172.21.15.47:0/1940009798 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f32f4011c30 con 0x7f33081077e0 2024-05-14T12:13:51.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.541+0000 7f32ff400700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f32ec03e9a0 0x7f32ec040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:51.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.541+0000 7f32ff400700 1 -- 172.21.15.47:0/1940009798 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f32f4052250 con 0x7f33081077e0 2024-05-14T12:13:51.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.541+0000 7f3306a00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f32ec03e9a0 0x7f32ec040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:51.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.542+0000 7f3306a00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f32ec03e9a0 0x7f32ec040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006010 tx=0x7f32f801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:51.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.547+0000 7f32ff400700 1 -- 172.21.15.47:0/1940009798 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f32f4020720 con 0x7f33081077e0 2024-05-14T12:13:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.797+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f33081b60a0 con 0x7f33081077e0 2024-05-14T12:13:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.798+0000 7f32ff400700 1 -- 172.21.15.47:0/1940009798 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f32f400de80 con 0x7f33081077e0 2024-05-14T12:13:51.798 INFO:teuthology.orchestra.run.smithi047.stdout:# minimal ceph.conf for e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:51.798 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-14T12:13:51.798 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:13:51.798 INFO:teuthology.orchestra.run.smithi047.stdout: mon_host = [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-05-14T12:13:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f32ec03e9a0 msgr2=0x7f32ec040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f32ec03e9a0 0x7f32ec040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006010 tx=0x7f32f801a040 comp rx=0 tx=0).stop 2024-05-14T12:13:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33081077e0 msgr2=0x7f3308107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33081077e0 0x7f3308107bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32f400b580 tx=0x7f32f400b890 comp rx=0 tx=0).stop 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 shutdown_connections 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f32ec03e9a0 0x7f32ec040eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3308108130 0x7f33081b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3308075cb0 0x7f330810d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 --2- 172.21.15.47:0/1940009798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33081077e0 0x7f3308107bf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.801+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 >> 172.21.15.47:0/1940009798 conn(0x7f33080ff6a0 msgr2=0x7f3308195e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.802+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 shutdown_connections 2024-05-14T12:13:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:13:51.802+0000 7f330dc00700 1 -- 172.21.15.47:0/1940009798 wait complete. 2024-05-14T12:13:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: Updating smithi047:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:52.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:52.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:52.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:52 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1940009798' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:52.651 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-14T12:13:52.652 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:13:52.652 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T12:13:52.692 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: Updating smithi047:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:52.692 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.692 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.692 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.692 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.692 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.692 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.693 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.693 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:52.693 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:52.693 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:52.693 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:52 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1940009798' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:52.724 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:13:52.724 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: Updating smithi047:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:52.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:52.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:52.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:52.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:52 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1940009798' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:52.838 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:13:52.838 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T12:13:52.870 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:13:52.871 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:52.938 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:13:52.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T12:13:52.965 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:13:52.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T12:13:53.029 INFO:tasks.cephadm:Adding mgr.x on smithi047 2024-05-14T12:13:53.029 INFO:tasks.cephadm:Adding mgr.y on smithi066 2024-05-14T12:13:53.029 INFO:tasks.cephadm:Adding mgr.z on smithi073 2024-05-14T12:13:53.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch apply mgr '3;smithi047=x;smithi066=y;smithi073=z' 2024-05-14T12:13:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:13:53.672 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:53 smithi073 ceph-mon[35809]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T12:13:53.672 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:53 smithi073 ceph-mon[35809]: Reconfiguring daemon mon.a on smithi047 2024-05-14T12:13:53.672 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:53 smithi073 ceph-mon[35809]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:53.672 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:53.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:53 smithi047 ceph-mon[31254]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T12:13:53.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:53 smithi047 ceph-mon[31254]: Reconfiguring daemon mon.a on smithi047 2024-05-14T12:13:53.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:53 smithi047 ceph-mon[31254]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:53.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:53 smithi066 ceph-mon[35981]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T12:13:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:53 smithi066 ceph-mon[35981]: Reconfiguring daemon mon.a on smithi047 2024-05-14T12:13:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:53 smithi066 ceph-mon[35981]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:54.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.834+0000 7fc5bca35700 1 -- 172.21.15.73:0/2132889356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 msgr2=0x7fc5b8104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:54.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.834+0000 7fc5bca35700 1 --2- 172.21.15.73:0/2132889356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 0x7fc5b8104120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009910 tx=0x7fc5ac009c20 comp rx=0 tx=0).stop 2024-05-14T12:13:54.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.834+0000 7fc5bca35700 1 -- 172.21.15.73:0/2132889356 shutdown_connections 2024-05-14T12:13:54.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.834+0000 7fc5bca35700 1 --2- 172.21.15.73:0/2132889356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 0x7fc5b8104120 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:54.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.834+0000 7fc5bca35700 1 -- 172.21.15.73:0/2132889356 >> 172.21.15.73:0/2132889356 conn(0x7fc5b80ff350 msgr2=0x7fc5b8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:54.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.834+0000 7fc5bca35700 1 -- 172.21.15.73:0/2132889356 shutdown_connections 2024-05-14T12:13:54.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.834+0000 7fc5bca35700 1 -- 172.21.15.73:0/2132889356 wait complete. 2024-05-14T12:13:54.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 Processor -- start 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 -- start start 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 0x7fc5b8199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5b8199ec0 0x7fc5b819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5b819f390 0x7fc5b81a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b8109cd0 con 0x7fc5b8103d10 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b8109b50 con 0x7fc5b8199ec0 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5bca35700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b8109e50 con 0x7fc5b819f390 2024-05-14T12:13:54.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5b6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5b819f390 0x7fc5b81a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:54.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5b5d9b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5b8199ec0 0x7fc5b819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:54.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5b5d9b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5b8199ec0 0x7fc5b819ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.73:43146/0 (socket says 172.21.15.73:43146) 2024-05-14T12:13:54.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5b6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5b819f390 0x7fc5b81a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53040/0 (socket says 172.21.15.73:53040) 2024-05-14T12:13:54.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.835+0000 7fc5b5d9b700 1 -- 172.21.15.73:0/3726052467 learned_addr learned my addr 172.21.15.73:0/3726052467 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:13:54.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b659c700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 0x7fc5b8199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:54.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b6d9d700 1 -- 172.21.15.73:0/3726052467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5b8199ec0 msgr2=0x7fc5b819ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:54.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b6d9d700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5b8199ec0 0x7fc5b819ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b6d9d700 1 -- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 msgr2=0x7fc5b8199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b6d9d700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 0x7fc5b8199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b6d9d700 1 -- 172.21.15.73:0/3726052467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b81a1d20 con 0x7fc5b819f390 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b5d9b700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5b8199ec0 0x7fc5b819ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5b6d9d700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5b819f390 0x7fc5b81a17b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000bd50 tx=0x7fc5b000bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5a77fe700 1 -- 172.21.15.73:0/3726052467 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0019070 con 0x7fc5b819f390 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5a77fe700 1 -- 172.21.15.73:0/3726052467 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b000cc90 con 0x7fc5b819f390 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b81a1fb0 con 0x7fc5b819f390 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5a77fe700 1 -- 172.21.15.73:0/3726052467 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0012620 con 0x7fc5b819f390 2024-05-14T12:13:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.836+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b81a24e0 con 0x7fc5b819f390 2024-05-14T12:13:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.837+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b8064e20 con 0x7fc5b819f390 2024-05-14T12:13:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.837+0000 7fc5a77fe700 1 -- 172.21.15.73:0/3726052467 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fc5b001c070 con 0x7fc5b819f390 2024-05-14T12:13:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.838+0000 7fc5a77fe700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc5a003e9a0 0x7fc5a0040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:13:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.838+0000 7fc5a77fe700 1 -- 172.21.15.73:0/3726052467 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc5b0051f60 con 0x7fc5b819f390 2024-05-14T12:13:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.838+0000 7fc5b659c700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc5a003e9a0 0x7fc5a0040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:13:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.839+0000 7fc5b659c700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc5a003e9a0 0x7fc5a0040eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac006010 tx=0x7fc5ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:13:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:54.843+0000 7fc5a77fe700 1 -- 172.21.15.73:0/3726052467 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc5b0022170 con 0x7fc5b819f390 2024-05-14T12:13:55.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.058+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi066=y;smithi073=z", "target": ["mon-mgr", ""]}) -- 0x7fc5b8101170 con 0x7fc5a003e9a0 2024-05-14T12:13:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.073+0000 7fc5a77fe700 1 -- 172.21.15.73:0/3726052467 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc5b8101170 con 0x7fc5a003e9a0 2024-05-14T12:13:55.073 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mgr update... 2024-05-14T12:13:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc5a003e9a0 msgr2=0x7fc5a0040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc5a003e9a0 0x7fc5a0040eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac006010 tx=0x7fc5ac01a040 comp rx=0 tx=0).stop 2024-05-14T12:13:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5b819f390 msgr2=0x7fc5b81a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5b819f390 0x7fc5b81a17b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000bd50 tx=0x7fc5b000bd80 comp rx=0 tx=0).stop 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 shutdown_connections 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc5a003e9a0 0x7fc5a0040eb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5b819f390 0x7fc5b81a17b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5b8103d10 0x7fc5b8199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 --2- 172.21.15.73:0/3726052467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5b8199ec0 0x7fc5b819ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 >> 172.21.15.73:0/3726052467 conn(0x7fc5b80ff350 msgr2=0x7fc5b8100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 shutdown_connections 2024-05-14T12:13:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:13:55.075+0000 7fc5bca35700 1 -- 172.21.15.73:0/3726052467 wait complete. 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: Reconfiguring mon.b (monmap changed)... 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: Reconfiguring daemon mon.b on smithi066 2024-05-14T12:13:55.473 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: Reconfiguring mon.b (monmap changed)... 2024-05-14T12:13:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:55.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:55.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:55.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:55.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: Reconfiguring daemon mon.b on smithi066 2024-05-14T12:13:55.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: Reconfiguring mon.b (monmap changed)... 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: Reconfiguring daemon mon.b on smithi066 2024-05-14T12:13:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:55.784 DEBUG:teuthology.orchestra.run.smithi066:mgr.y> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.y.service 2024-05-14T12:13:55.786 DEBUG:teuthology.orchestra.run.smithi073:mgr.z> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.z.service 2024-05-14T12:13:55.789 INFO:tasks.cephadm:Deploying OSDs... 2024-05-14T12:13:55.789 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:13:55.789 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T12:13:55.849 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T12:13:55.849 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-14 12:12:51.422303653 +0000 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-14 12:06:56.059034034 +0000 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-14 12:06:56.059034034 +0000 2024-05-14T12:13:55.904 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-14 12:06:56.059034034 +0000 2024-05-14T12:13:55.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T12:13:55.984 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-14T12:13:55.984 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-14T12:13:55.984 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00027746 s, 1.8 MB/s 2024-05-14T12:13:55.987 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T12:13:56.044 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-05-14T12:13:56.096 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-14 12:12:51.492302123 +0000 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-14 12:06:56.656021497 +0000 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-14 12:06:56.656021497 +0000 2024-05-14T12:13:56.097 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-14 12:06:56.656021497 +0000 2024-05-14T12:13:56.097 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T12:13:56.181 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-14T12:13:56.181 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-14T12:13:56.181 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000272247 s, 1.9 MB/s 2024-05-14T12:13:56.184 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T12:13:56.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:56 smithi047 ceph-mon[31254]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi066=y;smithi073=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:56 smithi047 ceph-mon[31254]: Saving service mgr spec with placement smithi047=x;smithi066=y;smithi073=z;count:3 2024-05-14T12:13:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:56.241 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-05-14T12:13:56.296 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T12:13:56.296 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:56.296 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-14T12:13:56.296 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:56.296 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:56.296 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-14 12:12:51.566300505 +0000 2024-05-14T12:13:56.296 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-14 12:06:57.226009527 +0000 2024-05-14T12:13:56.297 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-14 12:06:57.226009527 +0000 2024-05-14T12:13:56.297 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-14 12:06:57.226009527 +0000 2024-05-14T12:13:56.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T12:13:56.365 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:56 smithi073 ceph-mon[35809]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi066=y;smithi073=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:56.365 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:56 smithi073 ceph-mon[35809]: Saving service mgr spec with placement smithi047=x;smithi066=y;smithi073=z;count:3 2024-05-14T12:13:56.365 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:56.365 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:56.365 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:56.365 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:56.365 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:56.386 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-14T12:13:56.386 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-14T12:13:56.386 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000287836 s, 1.8 MB/s 2024-05-14T12:13:56.390 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T12:13:56.448 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-14 12:12:51.639298909 +0000 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-14 12:06:57.776997956 +0000 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-14 12:06:57.776997956 +0000 2024-05-14T12:13:56.502 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-14 12:06:57.776997956 +0000 2024-05-14T12:13:56.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T12:13:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:56 smithi066 ceph-mon[35981]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi066=y;smithi073=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:13:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:56 smithi066 ceph-mon[35981]: Saving service mgr spec with placement smithi047=x;smithi066=y;smithi073=z;count:3 2024-05-14T12:13:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T12:13:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T12:13:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:56.587 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-14T12:13:56.587 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-14T12:13:56.587 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000282361 s, 1.8 MB/s 2024-05-14T12:13:56.591 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T12:13:56.650 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-05-14T12:13:56.650 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T12:13:56.670 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T12:13:56.670 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-14 12:13:42.793136574 +0000 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-14 12:05:48.576373864 +0000 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-14 12:05:48.576373864 +0000 2024-05-14T12:13:56.729 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-14 12:05:48.576373864 +0000 2024-05-14T12:13:56.729 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T12:13:56.796 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-14T12:13:56.796 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-14T12:13:56.797 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.0002871 s, 1.8 MB/s 2024-05-14T12:13:56.798 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T12:13:56.857 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-14 12:13:42.793136574 +0000 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-14 12:05:48.935371038 +0000 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-14 12:05:48.935371038 +0000 2024-05-14T12:13:56.914 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-14 12:05:48.935371038 +0000 2024-05-14T12:13:56.915 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T12:13:56.979 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-14T12:13:56.979 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-14T12:13:56.979 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000205576 s, 2.5 MB/s 2024-05-14T12:13:56.980 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T12:13:57.037 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-05-14T12:13:57.093 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T12:13:57.093 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:57.094 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-14T12:13:57.094 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:57.094 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:57.094 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-14 12:13:42.794136566 +0000 2024-05-14T12:13:57.094 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-14 12:05:49.283368299 +0000 2024-05-14T12:13:57.094 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-14 12:05:49.283368299 +0000 2024-05-14T12:13:57.094 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-14 12:05:49.283368299 +0000 2024-05-14T12:13:57.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T12:13:57.158 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-14T12:13:57.158 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-14T12:13:57.158 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000231583 s, 2.2 MB/s 2024-05-14T12:13:57.159 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T12:13:57.216 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-05-14T12:13:57.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:57 smithi073 ceph-mon[35809]: Reconfiguring mon.c (monmap changed)... 2024-05-14T12:13:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:57 smithi073 ceph-mon[35809]: Reconfiguring daemon mon.c on smithi073 2024-05-14T12:13:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:57 smithi073 ceph-mon[35809]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-05-14 12:13:42.794136566 +0000 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-05-14 12:05:49.626365600 +0000 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-05-14 12:05:49.626365600 +0000 2024-05-14T12:13:57.272 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-05-14 12:05:49.626365600 +0000 2024-05-14T12:13:57.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T12:13:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-05-14T12:13:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-05-14T12:13:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000251978 s, 2.0 MB/s 2024-05-14T12:13:57.338 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T12:13:57.394 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-05-14T12:13:57.394 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T12:13:57.410 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T12:13:57.411 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-14 12:13:33.030641627 +0000 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-14 12:05:45.722266145 +0000 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-14 12:05:45.722266145 +0000 2024-05-14T12:13:57.465 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-05-14 12:05:45.722266145 +0000 2024-05-14T12:13:57.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T12:13:57.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:57 smithi047 ceph-mon[31254]: Reconfiguring mon.c (monmap changed)... 2024-05-14T12:13:57.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:57 smithi047 ceph-mon[31254]: Reconfiguring daemon mon.c on smithi073 2024-05-14T12:13:57.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:57 smithi047 ceph-mon[31254]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-14T12:13:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-14T12:13:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00019234 s, 2.7 MB/s 2024-05-14T12:13:57.531 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T12:13:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:57 smithi066 ceph-mon[35981]: Reconfiguring mon.c (monmap changed)... 2024-05-14T12:13:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:57 smithi066 ceph-mon[35981]: Reconfiguring daemon mon.c on smithi073 2024-05-14T12:13:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:57 smithi066 ceph-mon[35981]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:57.588 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-05-14T12:13:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T12:13:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:57.645 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-14T12:13:57.645 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:57.645 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:57.646 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-14 12:13:33.031641604 +0000 2024-05-14T12:13:57.646 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-14 12:05:46.081257547 +0000 2024-05-14T12:13:57.646 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-14 12:05:46.081257547 +0000 2024-05-14T12:13:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-05-14 12:05:46.081257547 +0000 2024-05-14T12:13:57.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T12:13:57.708 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-14T12:13:57.714 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-14T12:13:57.714 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00018402 s, 2.8 MB/s 2024-05-14T12:13:57.715 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T12:13:57.772 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-05-14T12:13:57.827 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T12:13:57.827 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:57.827 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-14T12:13:57.827 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:57.828 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:57.828 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-14 12:13:33.031641604 +0000 2024-05-14T12:13:57.828 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-14 12:05:46.422249381 +0000 2024-05-14T12:13:57.828 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-14 12:05:46.422249381 +0000 2024-05-14T12:13:57.828 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-05-14 12:05:46.422249381 +0000 2024-05-14T12:13:57.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T12:13:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-14T12:13:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-14T12:13:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00021929 s, 2.3 MB/s 2024-05-14T12:13:57.891 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T12:13:57.948 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-05-14T12:13:58.004 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T12:13:58.004 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T12:13:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-14T12:13:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:13:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T12:13:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-05-14 12:13:33.032641580 +0000 2024-05-14T12:13:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-05-14 12:05:46.763241215 +0000 2024-05-14T12:13:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-05-14 12:05:46.763241215 +0000 2024-05-14T12:13:58.005 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-05-14 12:05:46.763241215 +0000 2024-05-14T12:13:58.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T12:13:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-05-14T12:13:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-05-14T12:13:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000245955 s, 2.1 MB/s 2024-05-14T12:13:58.067 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T12:13:58.122 INFO:tasks.cephadm:Deploying osd.0 on smithi047 with /dev/vg_nvme/lv_4... 2024-05-14T12:13:58.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:58 smithi047 ceph-mon[31254]: Deploying daemon mgr.z on smithi073 2024-05-14T12:13:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:13:58.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T12:13:58.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:13:58.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:58.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:58 smithi073 ceph-mon[35809]: Deploying daemon mgr.z on smithi073 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:13:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:13:58.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:58 smithi066 ceph-mon[35981]: Deploying daemon mgr.z on smithi073 2024-05-14T12:13:58.585 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:13:59.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:13:59 smithi073 ceph-mon[35809]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:59.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:13:59 smithi047 ceph-mon[31254]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:59.736 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:13:59 smithi066 ceph-mon[35981]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:13:59.842 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:13:59 smithi073 podman[37634]: 2024-05-14 12:13:59.809657906 +0000 UTC m=+0.357371809 container start ebff4ec15e40806ac993dd41934f6aafd33f6e0aace70525c7678f3131e9e994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-14T12:13:59.843 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:13:59 smithi073 ceph-mgr[37654]: -- 172.21.15.73:0/3091698368 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c9676c5a0 con 0x555c9b4f6000 2024-05-14T12:14:00.157 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:13:59 smithi073 bash[37634]: ebff4ec15e40806ac993dd41934f6aafd33f6e0aace70525c7678f3131e9e994 2024-05-14T12:14:00.158 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:13:59 smithi073 systemd[1]: Started Ceph mgr.z for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:14:00.158 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:13:59 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:13:59.974+0000 7ff54116d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T12:14:00.158 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:00 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:00.157+0000 7ff54116d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:14:00.502 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:00 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:00.258+0000 7ff54116d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T12:14:00.970 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:00 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:00.562+0000 7ff54116d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T12:14:00.971 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:00 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:00.646+0000 7ff54116d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: Deploying daemon mgr.y on smithi066 2024-05-14T12:14:01.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:00 smithi047 ceph-mon[31254]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:01.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:14:01.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T12:14:01.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:14:01.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:01.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: Deploying daemon mgr.y on smithi066 2024-05-14T12:14:01.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:00 smithi073 ceph-mon[35809]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: Deploying daemon mgr.y on smithi066 2024-05-14T12:14:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:00 smithi066 ceph-mon[35981]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:01.330 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T12:14:01.331 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T12:14:01.331 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-05-14T12:14:01.331 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-05-14T12:14:01.331 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0383887 s, 273 MB/s 2024-05-14T12:14:01.331 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-05-14T12:14:02.050 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-05-14T12:14:02.157 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:01 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:01.820+0000 7ff54116d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T12:14:02.157 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:01 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:01.989+0000 7ff54116d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T12:14:02.157 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:02 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:02.156+0000 7ff54116d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T12:14:02.228 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 systemd[1]: Starting Ceph mgr.y for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:14:02.497 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 podman[37358]: 2024-05-14 12:14:02.131313879 +0000 UTC m=+0.017410831 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:14:02.498 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 podman[37358]: 2024-05-14 12:14:02.229250114 +0000 UTC m=+0.115347050 container create 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:14:02.498 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 podman[37358]: 2024-05-14 12:14:02.431646461 +0000 UTC m=+0.317743396 container init 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-14T12:14:02.498 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 podman[37358]: 2024-05-14 12:14:02.434436235 +0000 UTC m=+0.320533170 container start 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-14T12:14:02.498 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 ceph-mgr[37377]: -- 172.21.15.66:0/974256984 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635d2be25a0 con 0x5635d796c900 2024-05-14T12:14:02.498 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 bash[37358]: 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 2024-05-14T12:14:02.504 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:14:02.734 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:02 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:02.441+0000 7ff54116d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T12:14:02.734 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:02 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:02.533+0000 7ff54116d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T12:14:02.735 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:02 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:02.733+0000 7ff54116d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T12:14:02.810 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 systemd[1]: Started Ceph mgr.y for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:14:02.810 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:02.615+0000 7fbcdfb8d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T12:14:02.810 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:02.810+0000 7fbcdfb8d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:14:03.002 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:02 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:02.923+0000 7ff54116d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:14:03.075 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:02 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:02.918+0000 7fbcdfb8d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T12:14:03.423 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:03 smithi047 ceph-mon[31254]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:03.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:03.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:03 smithi073 ceph-mon[35809]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:03.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:03 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:03.253+0000 7fbcdfb8d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:03 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:03.344+0000 7fbcdfb8d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:03 smithi066 ceph-mon[35981]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:03.903 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:03 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:03.560+0000 7ff54116d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T12:14:03.903 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:03 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:03.786+0000 7ff54116d200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T12:14:04.265 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:04.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:04.502 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:04 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:04.227+0000 7ff54116d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T12:14:04.502 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:04 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:04.327+0000 7ff54116d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T12:14:04.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 -- 172.21.15.47:0/2537924607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0760f0 msgr2=0x7feb8c076580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:04.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 --2- 172.21.15.47:0/2537924607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0760f0 0x7feb8c076580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009990 tx=0x7feb7c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:14:04.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 -- 172.21.15.47:0/2537924607 shutdown_connections 2024-05-14T12:14:04.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 --2- 172.21.15.47:0/2537924607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb8c10c000 0x7feb8c10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:04.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 --2- 172.21.15.47:0/2537924607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb8c0776e0 0x7feb8c075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 --2- 172.21.15.47:0/2537924607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0760f0 0x7feb8c076580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 -- 172.21.15.47:0/2537924607 >> 172.21.15.47:0/2537924607 conn(0x7feb8c0ff7b0 msgr2=0x7feb8c101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:14:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 -- 172.21.15.47:0/2537924607 shutdown_connections 2024-05-14T12:14:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.522+0000 7feb93200700 1 -- 172.21.15.47:0/2537924607 wait complete. 2024-05-14T12:14:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.523+0000 7feb93200700 1 Processor -- start 2024-05-14T12:14:04.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.524+0000 7feb93200700 1 -- start start 2024-05-14T12:14:04.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.524+0000 7feb93200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb8c0760f0 0x7feb8c19c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.524+0000 7feb93200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0776e0 0x7feb8c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.524+0000 7feb93200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb8c10c000 0x7feb8c1a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.524+0000 7feb93200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c111df0 con 0x7feb8c0760f0 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.524+0000 7feb93200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c111c70 con 0x7feb8c10c000 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.524+0000 7feb93200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c111f70 con 0x7feb8c0776e0 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0776e0 0x7feb8c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0776e0 0x7feb8c19cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34432/0 (socket says 172.21.15.47:34432) 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 -- 172.21.15.47:0/2243816007 learned_addr learned my addr 172.21.15.47:0/2243816007 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb92800700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb8c10c000 0x7feb8c1a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:14:04.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91e00700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb8c0760f0 0x7feb8c19c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:14:04.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 -- 172.21.15.47:0/2243816007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb8c10c000 msgr2=0x7feb8c1a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:04.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb8c10c000 0x7feb8c1a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:04.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 -- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb8c0760f0 msgr2=0x7feb8c19c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:04.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb8c0760f0 0x7feb8c19c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:04.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 -- 172.21.15.47:0/2243816007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c1a44c0 con 0x7feb8c0776e0 2024-05-14T12:14:04.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91e00700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb8c0760f0 0x7feb8c19c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.525+0000 7feb91400700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0776e0 0x7feb8c19cea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00b760 tx=0x7feb7c004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.526+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00fb90 con 0x7feb8c0776e0 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.526+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7c00fd30 con 0x7feb8c0776e0 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.526+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0173f0 con 0x7feb8c0776e0 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.526+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1a4750 con 0x7feb8c0776e0 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.526+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c1a4ba0 con 0x7feb8c0776e0 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.527+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7feb7c028060 con 0x7feb8c0776e0 2024-05-14T12:14:04.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.527+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c0512c0 con 0x7feb8c0776e0 2024-05-14T12:14:04.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.528+0000 7feb86a00700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feb7403e750 0x7feb74040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:04.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.528+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feb7c054680 con 0x7feb8c0776e0 2024-05-14T12:14:04.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.528+0000 7feb91e00700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feb7403e750 0x7feb74040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:14:04.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.529+0000 7feb91e00700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feb7403e750 0x7feb74040c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0773e0 tx=0x7feb80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:14:04.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.534+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feb7c013070 con 0x7feb8c0776e0 2024-05-14T12:14:04.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:04.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:04.782+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7feb8c063c00 con 0x7feb7403e750 2024-05-14T12:14:05.002 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:04 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:04.695+0000 7ff54116d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T12:14:05.023 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:04 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:04.670+0000 7fbcdfb8d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T12:14:05.023 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:04 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:04.847+0000 7fbcdfb8d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T12:14:05.023 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:05 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:05.023+0000 7fbcdfb8d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T12:14:05.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:05.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:14:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.374 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:05 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:05.045+0000 7ff54116d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T12:14:05.374 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:05 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:05.136+0000 7ff54116d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T12:14:05.374 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:05.374 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.374 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:14:05.375 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:05.482 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T12:14:05.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T12:14:05.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:14:05.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:14:05.483 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:05.575 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:05 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:05.323+0000 7fbcdfb8d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T12:14:05.575 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:05 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:05.419+0000 7fbcdfb8d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T12:14:05.752 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:05 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:05.374+0000 7ff54116d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T12:14:05.752 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:05 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:05.503+0000 7ff54116d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T12:14:05.752 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:05 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:05.597+0000 7ff54116d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T12:14:06.075 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:05 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:05.629+0000 7fbcdfb8d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T12:14:06.075 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:05 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:05.827+0000 7fbcdfb8d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T12:14:06.252 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:05 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:05.917+0000 7ff54116d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T12:14:06.252 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:06 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:06.008+0000 7ff54116d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T12:14:06.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:06 smithi047 ceph-mon[31254]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T12:14:06.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:06 smithi047 ceph-mon[31254]: Reconfiguring daemon mgr.x on smithi047 2024-05-14T12:14:06.502 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:06 smithi047 ceph-mon[31254]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:14:06.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:06 smithi066 ceph-mon[35981]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T12:14:06.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:06 smithi066 ceph-mon[35981]: Reconfiguring daemon mgr.x on smithi047 2024-05-14T12:14:06.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:06 smithi066 ceph-mon[35981]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:14:06.575 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:06 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:06.461+0000 7fbcdfb8d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T12:14:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:06 smithi073 ceph-mon[35809]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T12:14:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:06 smithi073 ceph-mon[35809]: Reconfiguring daemon mgr.x on smithi047 2024-05-14T12:14:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:06 smithi073 ceph-mon[35809]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:14:07.002 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:06 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:06.604+0000 7ff54116d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T12:14:07.002 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:14:06 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z[37650]: 2024-05-14T12:14:06.818+0000 7ff54116d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T12:14:07.075 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:06 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:06.694+0000 7fbcdfb8d200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T12:14:07.546 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: Standby manager daemon z started 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T12:14:07.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:07 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:07 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:07.136+0000 7fbcdfb8d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:07 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:07.236+0000 7fbcdfb8d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T12:14:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: Standby manager daemon z started 2024-05-14T12:14:07.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T12:14:07.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T12:14:07.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:07 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T12:14:07.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:07.685+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7feb7c009d10 con 0x7feb8c0776e0 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T12:14:07.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: Standby manager daemon z started 2024-05-14T12:14:07.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T12:14:07.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T12:14:07.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:07 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.73:0/2514359468' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T12:14:07.993 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:07 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:07.620+0000 7fbcdfb8d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T12:14:07.993 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:07 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:07.993+0000 7fbcdfb8d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T12:14:08.325 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:08 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:08.089+0000 7fbcdfb8d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T12:14:08.689 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:08 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:08.345+0000 7fbcdfb8d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T12:14:08.689 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:08 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:08.485+0000 7fbcdfb8d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T12:14:08.689 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:08 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:08.584+0000 7fbcdfb8d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T12:14:08.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:08 smithi047 ceph-mon[31254]: mgrmap e14: x(active, since 89s), standbys: z 2024-05-14T12:14:08.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:08 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T12:14:08.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:08 smithi047 ceph-mon[31254]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:09.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:08 smithi073 ceph-mon[35809]: mgrmap e14: x(active, since 89s), standbys: z 2024-05-14T12:14:09.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:08 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T12:14:09.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:08 smithi073 ceph-mon[35809]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:09.028 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:08 smithi066 ceph-mon[35981]: mgrmap e14: x(active, since 89s), standbys: z 2024-05-14T12:14:09.028 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:08 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T12:14:09.028 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:08 smithi066 ceph-mon[35981]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:09.029 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:08 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:08.933+0000 7fbcdfb8d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T12:14:09.029 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:09 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:09.027+0000 7fbcdfb8d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T12:14:09.963 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:09 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:09.658+0000 7fbcdfb8d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T12:14:09.963 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:14:09 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y[37373]: 2024-05-14T12:14:09.886+0000 7fbcdfb8d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T12:14:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:09.960+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mon.1 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7feb7c02a450 con 0x7feb8c0776e0 2024-05-14T12:14:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:09 smithi047 ceph-mon[31254]: Standby manager daemon y started 2024-05-14T12:14:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:09 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T12:14:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:09 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T12:14:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:09 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T12:14:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:09 smithi047 ceph-mon[31254]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T12:14:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:09 smithi073 ceph-mon[35809]: Standby manager daemon y started 2024-05-14T12:14:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:09 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T12:14:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:09 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T12:14:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:09 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T12:14:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:09 smithi073 ceph-mon[35809]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T12:14:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:09 smithi066 ceph-mon[35981]: Standby manager daemon y started 2024-05-14T12:14:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:09 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T12:14:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:09 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T12:14:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:09 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T12:14:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:09 smithi066 ceph-mon[35981]: from='mgr.? 172.21.15.66:0/2210330550' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T12:14:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3545335746' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]: dispatch 2024-05-14T12:14:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-05-14T12:14:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]: dispatch 2024-05-14T12:14:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]': finished 2024-05-14T12:14:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T12:14:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T12:14:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:11.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:11.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:10 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/242196053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:14:11.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3545335746' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]: dispatch 2024-05-14T12:14:11.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-05-14T12:14:11.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]: dispatch 2024-05-14T12:14:11.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]': finished 2024-05-14T12:14:11.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T12:14:11.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T12:14:11.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:11.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:11.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:10 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/242196053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3545335746' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]: dispatch 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]: dispatch 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93dfcb55-8853-4f03-845b-ba543a595731"}]': finished 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:10 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/242196053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:14:13.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:13 smithi047 ceph-mon[31254]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:13.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:13 smithi073 ceph-mon[35809]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:13.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:13 smithi066 ceph-mon[35981]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:15.306 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:15 smithi047 ceph-mon[31254]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:15.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:15 smithi073 ceph-mon[35809]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:15.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:15 smithi066 ceph-mon[35981]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:17.295 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:17 smithi047 ceph-mon[31254]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:17.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:17 smithi073 ceph-mon[35809]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:17.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:17 smithi066 ceph-mon[35981]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:19.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:19 smithi047 ceph-mon[31254]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:19.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:19 smithi073 ceph-mon[35809]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:19.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:19 smithi066 ceph-mon[35981]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:20.463 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T12:14:20.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:20.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:20 smithi047 ceph-mon[31254]: Deploying daemon osd.0 on smithi047 2024-05-14T12:14:20.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T12:14:20.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:20.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:20 smithi073 ceph-mon[35809]: Deploying daemon osd.0 on smithi047 2024-05-14T12:14:20.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T12:14:20.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:20.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:20 smithi066 ceph-mon[35981]: Deploying daemon osd.0 on smithi047 2024-05-14T12:14:21.449 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:21 smithi047 ceph-mon[31254]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:21 smithi073 ceph-mon[35809]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:21.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:21 smithi066 ceph-mon[35981]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:23 smithi047 ceph-mon[31254]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:23.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:23 smithi073 ceph-mon[35809]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:23.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:23 smithi066 ceph-mon[35981]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:25.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:25 smithi047 ceph-mon[31254]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:25.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:25 smithi073 ceph-mon[35809]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:25.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:25 smithi066 ceph-mon[35981]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:27.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:27 smithi047 ceph-mon[31254]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:27.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:27 smithi073 ceph-mon[35809]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:27.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:27 smithi066 ceph-mon[35981]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:29 smithi047 ceph-mon[31254]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:29 smithi073 ceph-mon[35809]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:29 smithi066 ceph-mon[35981]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:31.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:31 smithi047 ceph-mon[31254]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:31.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:31 smithi073 ceph-mon[35809]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:31.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:31 smithi066 ceph-mon[35981]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: from='osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T12:14:32.859 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:32 smithi047 ceph-mon[31254]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T12:14:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: from='osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T12:14:33.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:32 smithi073 ceph-mon[35809]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: from='osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T12:14:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:32 smithi066 ceph-mon[35981]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T12:14:33.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.734+0000 7feb86a00700 1 -- 172.21.15.47:0/2243816007 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb8c063c00 con 0x7feb7403e750 2024-05-14T12:14:33.734 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 0 on host 'smithi047' 2024-05-14T12:14:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feb7403e750 msgr2=0x7feb74040c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feb7403e750 0x7feb74040c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0773e0 tx=0x7feb80009260 comp rx=0 tx=0).stop 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0776e0 msgr2=0x7feb8c19cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0776e0 0x7feb8c19cea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00b760 tx=0x7feb7c004790 comp rx=0 tx=0).stop 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 shutdown_connections 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feb7403e750 0x7feb74040c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb8c10c000 0x7feb8c1a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb8c0760f0 0x7feb8c19c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 --2- 172.21.15.47:0/2243816007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb8c0776e0 0x7feb8c19cea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 >> 172.21.15.47:0/2243816007 conn(0x7feb8c0ff7b0 msgr2=0x7feb8c107f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.738+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 shutdown_connections 2024-05-14T12:14:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:14:33.739+0000 7feb93200700 1 -- 172.21.15.47:0/2243816007 wait complete. 2024-05-14T12:14:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:33 smithi047 ceph-mon[31254]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T12:14:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:33 smithi047 ceph-mon[31254]: from='osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:14:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:33 smithi047 ceph-mon[31254]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T12:14:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:33 smithi047 ceph-mon[31254]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:14:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:33 smithi073 ceph-mon[35809]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T12:14:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:33 smithi073 ceph-mon[35809]: from='osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:14:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:33 smithi073 ceph-mon[35809]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T12:14:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:33 smithi073 ceph-mon[35809]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:14:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:33 smithi066 ceph-mon[35981]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T12:14:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:33 smithi066 ceph-mon[35981]: from='osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:14:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:33 smithi066 ceph-mon[35981]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T12:14:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:33 smithi066 ceph-mon[35981]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:14:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:34.431 DEBUG:teuthology.orchestra.run.smithi047:osd.0> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.0.service 2024-05-14T12:14:34.437 INFO:tasks.cephadm:Deploying osd.1 on smithi066 with /dev/vg_nvme/lv_4... 2024-05-14T12:14:34.437 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T12:14:34.689 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:14:34.985 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:34 smithi066 ceph-mon[35981]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:14:34.985 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:34 smithi066 ceph-mon[35981]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T12:14:34.985 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:34 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:34.985 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:34 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:34.985 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:34 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:34.985 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:34 smithi066 ceph-mon[35981]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:34.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:34 smithi047 ceph-mon[31254]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:14:34.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:34 smithi047 ceph-mon[31254]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T12:14:34.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:34 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:34.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:34 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:34.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:34 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:34.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:34 smithi047 ceph-mon[31254]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:35.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:34 smithi073 ceph-mon[35809]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:14:35.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:34 smithi073 ceph-mon[35809]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T12:14:35.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:34 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:35.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:34 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:35.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:34 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:35.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:34 smithi073 ceph-mon[35809]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T12:14:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:35 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:14:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:35 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:14:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:35 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:35 smithi047 ceph-mon[31254]: osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] boot 2024-05-14T12:14:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:35 smithi047 ceph-mon[31254]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T12:14:35.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:35 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:35.882 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:35 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:14:35.882 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:35 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:14:35.883 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:35 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:35.883 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:35 smithi066 ceph-mon[35981]: osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] boot 2024-05-14T12:14:35.883 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:35 smithi066 ceph-mon[35981]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T12:14:35.883 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:35 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:35 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:14:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:35 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:14:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:35 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:35 smithi073 ceph-mon[35809]: osd.0 [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] boot 2024-05-14T12:14:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:35 smithi073 ceph-mon[35809]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T12:14:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:35 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T12:14:36.442 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T12:14:36.443 INFO:teuthology.orchestra.run.smithi066.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T12:14:36.443 INFO:teuthology.orchestra.run.smithi066.stderr: stderr: 10+0 records in 2024-05-14T12:14:36.443 INFO:teuthology.orchestra.run.smithi066.stderr:10+0 records out 2024-05-14T12:14:36.443 INFO:teuthology.orchestra.run.smithi066.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111644 s, 939 MB/s 2024-05-14T12:14:36.443 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping successful for: 2024-05-14T12:14:37.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:36 smithi073 ceph-mon[35809]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T12:14:37.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:36 smithi073 ceph-mon[35809]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:37.010 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:36 smithi066 ceph-mon[35981]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T12:14:37.010 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:36 smithi066 ceph-mon[35981]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:37.038 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_4 2024-05-14T12:14:37.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:36 smithi047 ceph-mon[31254]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T12:14:37.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:36 smithi047 ceph-mon[31254]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:37.277 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 -- 172.21.15.66:0/2079309857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d810a100 msgr2=0x7f40d810c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 --2- 172.21.15.66:0/2079309857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d810a100 0x7f40d810c520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40d000b0a0 tx=0x7f40d000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 -- 172.21.15.66:0/2079309857 shutdown_connections 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 --2- 172.21.15.66:0/2079309857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d810a100 0x7f40d810c520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 --2- 172.21.15.66:0/2079309857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40d8104e40 0x7f40d8107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 --2- 172.21.15.66:0/2079309857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d81077a0 0x7f40d8109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 -- 172.21.15.66:0/2079309857 >> 172.21.15.66:0/2079309857 conn(0x7f40d80fe880 msgr2=0x7f40d8100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 -- 172.21.15.66:0/2079309857 shutdown_connections 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.735+0000 7f40dfae3700 1 -- 172.21.15.66:0/2079309857 wait complete. 2024-05-14T12:14:38.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 Processor -- start 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 -- start start 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8104e40 0x7f40d819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d81077a0 0x7f40d819d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40d810a100 0x7f40d81a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40d810fe10 con 0x7f40d810a100 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40d810fc90 con 0x7f40d8104e40 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dfae3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f40d810ff90 con 0x7f40d81077a0 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dd87f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8104e40 0x7f40d819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dd87f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8104e40 0x7f40d819cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43552/0 (socket says 172.21.15.66:43552) 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.736+0000 7f40dd87f700 1 -- 172.21.15.66:0/1853963349 learned_addr learned my addr 172.21.15.66:0/1853963349 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dd07e700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d81077a0 0x7f40d819d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:14:38.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dd87f700 1 -- 172.21.15.66:0/1853963349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d81077a0 msgr2=0x7f40d819d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dd87f700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d81077a0 0x7f40d819d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dd87f700 1 -- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40d810a100 msgr2=0x7f40d81a3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dd87f700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40d810a100 0x7f40d81a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dd87f700 1 -- 172.21.15.66:0/1853963349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d81a4660 con 0x7f40d8104e40 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dd87f700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8104e40 0x7f40d819cb00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40d400b500 tx=0x7f40d400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40ceffd700 1 -- 172.21.15.66:0/1853963349 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4015020 con 0x7f40d8104e40 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40ceffd700 1 -- 172.21.15.66:0/1853963349 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d4011ce0 con 0x7f40d8104e40 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d81a4950 con 0x7f40d8104e40 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40ceffd700 1 -- 172.21.15.66:0/1853963349 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4010d40 con 0x7f40d8104e40 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.737+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d81a4f10 con 0x7f40d8104e40 2024-05-14T12:14:38.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.738+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d80512c0 con 0x7f40d8104e40 2024-05-14T12:14:38.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.740+0000 7f40ceffd700 1 -- 172.21.15.66:0/1853963349 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f40d4018020 con 0x7f40d8104e40 2024-05-14T12:14:38.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.740+0000 7f40ceffd700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f40c40b27f0 0x7f40c40b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:14:38.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.740+0000 7f40ceffd700 1 -- 172.21.15.66:0/1853963349 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f40d40dfe70 con 0x7f40d8104e40 2024-05-14T12:14:38.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.741+0000 7f40dd07e700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f40c40b27f0 0x7f40c40b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:14:38.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.742+0000 7f40dd07e700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f40c40b27f0 0x7f40c40b4d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40c8005950 tx=0x7f40c800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:14:38.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.745+0000 7f40ceffd700 1 -- 172.21.15.66:0/1853963349 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f40d401f020 con 0x7f40d8104e40 2024-05-14T12:14:38.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:38.969+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f40d8063c00 con 0x7f40c40b27f0 2024-05-14T12:14:39.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:39 smithi066 ceph-mon[35981]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:39.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:14:39.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:14:39.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:39 smithi047 ceph-mon[31254]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:14:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:14:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:39.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:39 smithi073 ceph-mon[35809]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:39.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:14:39.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:14:39.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:40.484 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:14:40.484 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi047 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi047 to 17094M 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:14:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi047 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi047 to 17094M 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:40.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi047 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi047 to 17094M 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:41.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:41 smithi047 ceph-mon[31254]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:41.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:41 smithi073 ceph-mon[35809]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:41.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:41 smithi066 ceph-mon[35981]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:42.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:42 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/2973585936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]: dispatch 2024-05-14T12:14:42.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:42 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]: dispatch 2024-05-14T12:14:42.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:42 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]': finished 2024-05-14T12:14:42.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:42 smithi073 ceph-mon[35809]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T12:14:42.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:42 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:14:42.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:42 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/3535900912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:14:42.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:42 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/2973585936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]: dispatch 2024-05-14T12:14:42.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:42 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]: dispatch 2024-05-14T12:14:42.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:42 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]': finished 2024-05-14T12:14:42.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:42 smithi066 ceph-mon[35981]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T12:14:42.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:42 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:14:42.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:42 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/3535900912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:14:42.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:42 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/2973585936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]: dispatch 2024-05-14T12:14:42.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:42 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]: dispatch 2024-05-14T12:14:42.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:42 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5f87079-8c21-4289-bb99-2969ef95c1cb"}]': finished 2024-05-14T12:14:42.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:42 smithi047 ceph-mon[31254]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T12:14:42.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:42 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:14:42.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:42 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/3535900912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:14:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:43 smithi073 ceph-mon[35809]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:43 smithi066 ceph-mon[35981]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:43 smithi047 ceph-mon[31254]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:45 smithi073 ceph-mon[35809]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:45.774 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:45 smithi066 ceph-mon[35981]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:45.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:45 smithi047 ceph-mon[31254]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:47.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:47 smithi066 ceph-mon[35981]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:47.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:47 smithi047 ceph-mon[31254]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:48.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:47 smithi073 ceph-mon[35809]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:49.731 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:49 smithi066 ceph-mon[35981]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:49.731 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T12:14:49.731 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:49 smithi047 ceph-mon[31254]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T12:14:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:49 smithi073 ceph-mon[35809]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T12:14:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:50 smithi066 ceph-mon[35981]: Deploying daemon osd.1 on smithi066 2024-05-14T12:14:50.886 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:50 smithi047 ceph-mon[31254]: Deploying daemon osd.1 on smithi066 2024-05-14T12:14:51.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:50 smithi073 ceph-mon[35809]: Deploying daemon osd.1 on smithi066 2024-05-14T12:14:51.809 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:51 smithi066 ceph-mon[35981]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:51.903 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:51 smithi073 ceph-mon[35809]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:51.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:51 smithi047 ceph-mon[31254]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:53.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:53 smithi066 ceph-mon[35981]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:53.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:53 smithi047 ceph-mon[31254]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:54.023 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:53 smithi073 ceph-mon[35809]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:55 smithi066 ceph-mon[35981]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:55 smithi047 ceph-mon[31254]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:55 smithi073 ceph-mon[35809]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:57.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:57.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:57.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:56 smithi047 ceph-mon[31254]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:56 smithi073 ceph-mon[35809]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:14:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:14:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:56 smithi066 ceph-mon[35981]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.658+0000 7f40ceffd700 1 -- 172.21.15.66:0/1853963349 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f40d8063c00 con 0x7f40c40b27f0 2024-05-14T12:14:57.659 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 1 on host 'smithi066' 2024-05-14T12:14:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f40c40b27f0 msgr2=0x7f40c40b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f40c40b27f0 0x7f40c40b4d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40c8005950 tx=0x7f40c800a300 comp rx=0 tx=0).stop 2024-05-14T12:14:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8104e40 msgr2=0x7f40d819cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:14:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8104e40 0x7f40d819cb00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40d400b500 tx=0x7f40d400b810 comp rx=0 tx=0).stop 2024-05-14T12:14:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 shutdown_connections 2024-05-14T12:14:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f40c40b27f0 0x7f40c40b4d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:57.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40d810a100 0x7f40d81a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8104e40 0x7f40d819cb00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 --2- 172.21.15.66:0/1853963349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d81077a0 0x7f40d819d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:14:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 >> 172.21.15.66:0/1853963349 conn(0x7f40d80fe880 msgr2=0x7f40d8108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:14:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 shutdown_connections 2024-05-14T12:14:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:14:57.662+0000 7f40dfae3700 1 -- 172.21.15.66:0/1853963349 wait complete. 2024-05-14T12:14:57.954 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:57.954 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:57.954 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:58.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:14:58.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:58.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:14:58.254 DEBUG:teuthology.orchestra.run.smithi066:osd.1> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.1.service 2024-05-14T12:14:58.257 INFO:tasks.cephadm:Deploying osd.2 on smithi073 with /dev/vg_nvme/lv_4... 2024-05-14T12:14:58.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T12:14:58.499 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:14:59.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:58 smithi047 ceph-mon[31254]: from='osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T12:14:59.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:58 smithi047 ceph-mon[31254]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T12:14:59.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:58 smithi047 ceph-mon[31254]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:59.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:58 smithi073 ceph-mon[35809]: from='osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T12:14:59.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:58 smithi073 ceph-mon[35809]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T12:14:59.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:58 smithi073 ceph-mon[35809]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:14:59.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:58 smithi066 ceph-mon[35981]: from='osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T12:14:59.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:58 smithi066 ceph-mon[35981]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T12:14:59.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:58 smithi066 ceph-mon[35981]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:15:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:59 smithi073 ceph-mon[35809]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T12:15:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:59 smithi073 ceph-mon[35809]: from='osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:15:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:59 smithi073 ceph-mon[35809]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T12:15:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:14:59 smithi073 ceph-mon[35809]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:15:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:59 smithi047 ceph-mon[31254]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T12:15:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:59 smithi047 ceph-mon[31254]: from='osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:15:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:59 smithi047 ceph-mon[31254]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T12:15:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:14:59 smithi047 ceph-mon[31254]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:15:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:59 smithi066 ceph-mon[35981]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T12:15:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:59 smithi066 ceph-mon[35981]: from='osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:15:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:59 smithi066 ceph-mon[35981]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T12:15:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:14:59 smithi066 ceph-mon[35981]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:15:00.324 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:14:59 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1[40558]: 2024-05-14T12:14:59.888+0000 7f30858c9700 -1 osd.1 0 waiting for initial osdmap 2024-05-14T12:15:00.325 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:14:59 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1[40558]: 2024-05-14T12:14:59.892+0000 7f308167e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:15:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T12:15:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T12:15:00.371 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2024-05-14T12:15:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2024-05-14T12:15:00.371 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132995 s, 788 MB/s 2024-05-14T12:15:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2024-05-14T12:15:00.937 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:00 smithi073 ceph-mon[35809]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:15:00.937 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:00 smithi073 ceph-mon[35809]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T12:15:00.938 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:00.938 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:00.938 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:00 smithi073 ceph-mon[35809]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:15:00.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2024-05-14T12:15:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:15:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:00 smithi047 ceph-mon[31254]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:15:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:00 smithi047 ceph-mon[31254]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T12:15:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:00 smithi047 ceph-mon[31254]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:15:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:00 smithi066 ceph-mon[35981]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:15:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:00 smithi066 ceph-mon[35981]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T12:15:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:00 smithi066 ceph-mon[35981]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-14T12:15:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:15:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:15:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] boot 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi066 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi066 to 17088M 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:02.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] boot 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi066 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi066 to 17088M 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:02.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: osd.1 [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] boot 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi066 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:15:02.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi066 to 17088M 2024-05-14T12:15:02.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:02.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:02.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.788+0000 7f1a0f298700 1 -- 172.21.15.73:0/3170916143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08103230 msgr2=0x7f1a08103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.788+0000 7f1a0f298700 1 --2- 172.21.15.73:0/3170916143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08103230 0x7f1a08103640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009990 tx=0x7f1a04009ca0 comp rx=0 tx=0).stop 2024-05-14T12:15:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.788+0000 7f1a0f298700 1 -- 172.21.15.73:0/3170916143 shutdown_connections 2024-05-14T12:15:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.788+0000 7f1a0f298700 1 --2- 172.21.15.73:0/3170916143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a08104d00 0x7f1a0810b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.788+0000 7f1a0f298700 1 --2- 172.21.15.73:0/3170916143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08103230 0x7f1a08103640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:02.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.788+0000 7f1a0f298700 1 --2- 172.21.15.73:0/3170916143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a08104360 0x7f1a08104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.788+0000 7f1a0f298700 1 -- 172.21.15.73:0/3170916143 >> 172.21.15.73:0/3170916143 conn(0x7f1a080fe870 msgr2=0x7f1a08100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 -- 172.21.15.73:0/3170916143 shutdown_connections 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 -- 172.21.15.73:0/3170916143 wait complete. 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 Processor -- start 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 -- start start 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a08103230 0x7f1a081998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a08104360 0x7f1a08199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08104d00 0x7f1a081a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810ecf0 con 0x7f1a08104360 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810eb70 con 0x7f1a08103230 2024-05-14T12:15:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0f298700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810ee70 con 0x7f1a08104d00 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.789+0000 7f1a0d835700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08104d00 0x7f1a081a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08104d00 0x7f1a081a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43858/0 (socket says 172.21.15.73:43858) 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 -- 172.21.15.73:0/2901927127 learned_addr learned my addr 172.21.15.73:0/2901927127 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d034700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a08103230 0x7f1a081998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 -- 172.21.15.73:0/2901927127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a08103230 msgr2=0x7f1a081998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a08103230 0x7f1a081998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 -- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a08104360 msgr2=0x7f1a08199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a08104360 0x7f1a08199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 -- 172.21.15.73:0/2901927127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a081a1400 con 0x7f1a08104d00 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0d835700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08104d00 0x7f1a081a0d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007f10 tx=0x7f1a0000f5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f19fe7fc700 1 -- 172.21.15.73:0/2901927127 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00016030 con 0x7f1a08104d00 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f19fe7fc700 1 -- 172.21.15.73:0/2901927127 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a0000fde0 con 0x7f1a08104d00 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0806c0a0 con 0x7f1a08104d00 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f19fe7fc700 1 -- 172.21.15.73:0/2901927127 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00005020 con 0x7f1a08104d00 2024-05-14T12:15:02.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.790+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0806c660 con 0x7f1a08104d00 2024-05-14T12:15:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.791+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a080512c0 con 0x7f1a08104d00 2024-05-14T12:15:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.793+0000 7f19fe7fc700 1 -- 172.21.15.73:0/2901927127 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f1a00004cb0 con 0x7f1a08104d00 2024-05-14T12:15:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.794+0000 7f19fe7fc700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19f40b2870 0x7f19f40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.794+0000 7f19fe7fc700 1 -- 172.21.15.73:0/2901927127 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f1a000e2ff0 con 0x7f1a08104d00 2024-05-14T12:15:02.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.794+0000 7f1a0d034700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19f40b2870 0x7f19f40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:15:02.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.795+0000 7f1a0d034700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19f40b2870 0x7f19f40b4d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a040038a0 tx=0x7f1a0401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:15:02.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:02.798+0000 7f19fe7fc700 1 -- 172.21.15.73:0/2901927127 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a000ac540 con 0x7f1a08104d00 2024-05-14T12:15:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:03.012+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1a0806c8c0 con 0x7f19f40b2870 2024-05-14T12:15:03.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:03 smithi066 ceph-mon[35981]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T12:15:03.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:03 smithi066 ceph-mon[35981]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:03.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:03 smithi047 ceph-mon[31254]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T12:15:03.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:03 smithi047 ceph-mon[31254]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:03.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:03 smithi073 ceph-mon[35809]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T12:15:03.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:03 smithi073 ceph-mon[35809]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:04 smithi073 ceph-mon[35809]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:15:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:15:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:15:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:04 smithi066 ceph-mon[35981]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:15:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:15:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:15:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:04.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:04 smithi047 ceph-mon[31254]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:15:04.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:15:04.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:15:04.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:05.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:05 smithi047 ceph-mon[31254]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:05.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:05 smithi073 ceph-mon[35809]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:05.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:05 smithi066 ceph-mon[35981]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:06 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/3141950626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]: dispatch 2024-05-14T12:15:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:06 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]: dispatch 2024-05-14T12:15:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:06 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]': finished 2024-05-14T12:15:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:06 smithi066 ceph-mon[35981]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T12:15:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:06 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:06.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:06 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/3141950626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]: dispatch 2024-05-14T12:15:06.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:06 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]: dispatch 2024-05-14T12:15:06.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:06 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]': finished 2024-05-14T12:15:06.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:06 smithi047 ceph-mon[31254]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T12:15:06.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:06 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:06.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:06 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/3141950626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]: dispatch 2024-05-14T12:15:06.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:06 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]: dispatch 2024-05-14T12:15:06.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:06 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1131b486-8220-4f69-85d2-b249ded3392f"}]': finished 2024-05-14T12:15:06.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:06 smithi073 ceph-mon[35809]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T12:15:06.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:06 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:07.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:07 smithi066 ceph-mon[35981]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:07.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:07 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/155236626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:15:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:07 smithi047 ceph-mon[31254]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:07 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/155236626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:15:07.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:07 smithi073 ceph-mon[35809]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:07.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:07 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/155236626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:15:09.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:09 smithi047 ceph-mon[31254]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:09.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:09 smithi073 ceph-mon[35809]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:09 smithi066 ceph-mon[35981]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:11.398 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:11 smithi073 ceph-mon[35809]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:11.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:11 smithi047 ceph-mon[31254]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:11.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:11 smithi066 ceph-mon[35981]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:13.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:13 smithi047 ceph-mon[31254]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:13.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:13 smithi073 ceph-mon[35809]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:13.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:13 smithi066 ceph-mon[35981]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T12:15:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:14 smithi073 ceph-mon[35809]: Deploying daemon osd.2 on smithi073 2024-05-14T12:15:14.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T12:15:14.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:14.520 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:14 smithi047 ceph-mon[31254]: Deploying daemon osd.2 on smithi073 2024-05-14T12:15:14.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T12:15:14.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:14.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:14 smithi066 ceph-mon[35981]: Deploying daemon osd.2 on smithi073 2024-05-14T12:15:15.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:15 smithi047 ceph-mon[31254]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:15.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:15 smithi073 ceph-mon[35809]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:15.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:15 smithi066 ceph-mon[35981]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:17.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:17 smithi047 ceph-mon[31254]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:17.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:17 smithi073 ceph-mon[35809]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:17.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:17 smithi066 ceph-mon[35981]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:19.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:19 smithi047 ceph-mon[31254]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:19.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:19.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:19.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:19.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:19 smithi073 ceph-mon[35809]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:19.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:19.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:19.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:19.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:19 smithi066 ceph-mon[35981]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:19.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:19.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:19.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:21 smithi073 ceph-mon[35809]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:21.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:21 smithi047 ceph-mon[31254]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:21.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:21 smithi066 ceph-mon[35981]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:22.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.915+0000 7f19fe7fc700 1 -- 172.21.15.73:0/2901927127 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1a0806c8c0 con 0x7f19f40b2870 2024-05-14T12:15:22.915 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 2 on host 'smithi073' 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19f40b2870 msgr2=0x7f19f40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19f40b2870 0x7f19f40b4d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a040038a0 tx=0x7f1a0401a040 comp rx=0 tx=0).stop 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08104d00 msgr2=0x7f1a081a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08104d00 0x7f1a081a0d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007f10 tx=0x7f1a0000f5c0 comp rx=0 tx=0).stop 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 shutdown_connections 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19f40b2870 0x7f19f40b4d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a08104d00 0x7f1a081a0d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a08103230 0x7f1a081998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 --2- 172.21.15.73:0/2901927127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a08104360 0x7f1a08199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 >> 172.21.15.73:0/2901927127 conn(0x7f1a080fe870 msgr2=0x7f1a08107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:15:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 shutdown_connections 2024-05-14T12:15:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:15:22.918+0000 7f1a0f298700 1 -- 172.21.15.73:0/2901927127 wait complete. 2024-05-14T12:15:23.221 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T12:15:23.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T12:15:23.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:23.569 DEBUG:teuthology.orchestra.run.smithi073:osd.2> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.2.service 2024-05-14T12:15:23.571 INFO:tasks.cephadm:Deploying osd.3 on smithi047 with /dev/vg_nvme/lv_3... 2024-05-14T12:15:23.571 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T12:15:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:23 smithi047 ceph-mon[31254]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T12:15:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:23 smithi047 ceph-mon[31254]: from='osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:15:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:23 smithi047 ceph-mon[31254]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T12:15:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:23 smithi047 ceph-mon[31254]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:15:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:15:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:23 smithi073 ceph-mon[35809]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T12:15:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:23 smithi073 ceph-mon[35809]: from='osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:15:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:23 smithi073 ceph-mon[35809]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T12:15:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:23 smithi073 ceph-mon[35809]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:15:24.252 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:23 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2[40923]: 2024-05-14T12:15:23.943+0000 7fe6adf75700 -1 osd.2 0 waiting for initial osdmap 2024-05-14T12:15:24.253 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:23 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2[40923]: 2024-05-14T12:15:23.947+0000 7fe6a9d2a700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:15:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:23 smithi066 ceph-mon[35981]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T12:15:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:23 smithi066 ceph-mon[35981]: from='osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:15:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:23 smithi066 ceph-mon[35981]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T12:15:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:23 smithi066 ceph-mon[35981]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:15:25.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:24 smithi047 ceph-mon[31254]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:15:25.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:24 smithi047 ceph-mon[31254]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T12:15:25.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:25.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:25.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:24 smithi047 ceph-mon[31254]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:25.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:24 smithi073 ceph-mon[35809]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:15:25.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:24 smithi073 ceph-mon[35809]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T12:15:25.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:25.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:25.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:24 smithi073 ceph-mon[35809]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:24 smithi066 ceph-mon[35981]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:15:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:24 smithi066 ceph-mon[35981]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T12:15:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:24 smithi066 ceph-mon[35981]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-14T12:15:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:25 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:15:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:25 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:15:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:25 smithi073 ceph-mon[35809]: osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] boot 2024-05-14T12:15:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:25 smithi073 ceph-mon[35809]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T12:15:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:26.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:25 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:15:26.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:25 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:15:26.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:25 smithi047 ceph-mon[31254]: osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] boot 2024-05-14T12:15:26.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:25 smithi047 ceph-mon[31254]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T12:15:26.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:25 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:15:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:25 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:15:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:25 smithi066 ceph-mon[35981]: osd.2 [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] boot 2024-05-14T12:15:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:25 smithi066 ceph-mon[35981]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T12:15:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T12:15:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T12:15:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T12:15:27.117 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-05-14T12:15:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-05-14T12:15:27.117 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0478866 s, 219 MB/s 2024-05-14T12:15:27.117 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-05-14T12:15:27.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: pgmap v93: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi073 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi073 to 17088M 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:27.204 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: pgmap v93: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi073 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:15:27.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi073 to 17088M 2024-05-14T12:15:27.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:27.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:27.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: pgmap v93: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi073 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi073 to 17088M 2024-05-14T12:15:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:27.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:27.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:27.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-05-14T12:15:28.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T12:15:28.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:27 smithi047 ceph-mon[31254]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T12:15:28.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:15:28.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T12:15:28.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:27 smithi073 ceph-mon[35809]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T12:15:28.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:15:28.321 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:15:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T12:15:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:27 smithi066 ceph-mon[35981]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T12:15:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:15:28.325 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44234]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T12:15:28.325 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44234]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.325 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44234]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.325 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44234]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.325 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44237]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T12:15:28.326 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44237]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.326 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44237]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.326 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44237]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47883]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47883]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47883]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47883]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47886]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47886]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47886]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.356 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47886]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47929]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47929]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47929]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47929]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47944]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47944]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47944]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.670 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 sudo[47944]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44958]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44958]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44958]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44961]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44961]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44961]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44961]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44964]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44964]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44964]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44964]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44967]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44967]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44967]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 sudo[44967]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44240]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44240]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44240]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44240]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44243]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44243]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44243]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T12:15:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 sudo[44243]: pam_unix(sudo:session): session closed for user root 2024-05-14T12:15:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T12:15:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T12:15:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:28 smithi073 ceph-mon[35809]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.272 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:28 smithi047 ceph-mon[31254]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T12:15:29.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T12:15:29.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:29.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:29.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T12:15:29.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T12:15:29.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T12:15:29.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T12:15:29.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:28 smithi066 ceph-mon[35981]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T12:15:30.128 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:30 smithi047 ceph-mon[31254]: osdmap e22: 3 total, 3 up, 3 in 2024-05-14T12:15:30.128 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:30 smithi047 ceph-mon[31254]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-14T12:15:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:30 smithi066 ceph-mon[35981]: osdmap e22: 3 total, 3 up, 3 in 2024-05-14T12:15:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:30 smithi066 ceph-mon[35981]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-14T12:15:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 -- 172.21.15.47:0/1711330106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4540109e00 msgr2=0x7f454010c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 --2- 172.21.15.47:0/1711330106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4540109e00 0x7f454010c310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4538009990 tx=0x7f4538009ca0 comp rx=0 tx=0).stop 2024-05-14T12:15:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 -- 172.21.15.47:0/1711330106 shutdown_connections 2024-05-14T12:15:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 --2- 172.21.15.47:0/1711330106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4540109e00 0x7f454010c310 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 --2- 172.21.15.47:0/1711330106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f454006cd00 0x7f4540106cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 --2- 172.21.15.47:0/1711330106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4540107290 0x7f4540109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 -- 172.21.15.47:0/1711330106 >> 172.21.15.47:0/1711330106 conn(0x7f45400fe690 msgr2=0x7f4540100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:15:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 -- 172.21.15.47:0/1711330106 shutdown_connections 2024-05-14T12:15:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.380+0000 7f453f200700 1 -- 172.21.15.47:0/1711330106 wait complete. 2024-05-14T12:15:30.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.381+0000 7f453f200700 1 Processor -- start 2024-05-14T12:15:30.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453f200700 1 -- start start 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453f200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454006cd00 0x7f454019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4540107290 0x7f454019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453f200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4540109e00 0x7f45401a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f454010fbf0 con 0x7f4540107290 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453f200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f454010fa70 con 0x7f454006cd00 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453f200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f454010fd70 con 0x7f4540109e00 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453de00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454006cd00 0x7f454019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453de00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454006cd00 0x7f454019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:58000/0 (socket says 172.21.15.47:58000) 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f453de00700 1 -- 172.21.15.47:0/1797343127 learned_addr learned my addr 172.21.15.47:0/1797343127 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.382+0000 7f4535400700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4540107290 0x7f454019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453e800700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4540109e00 0x7f45401a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:15:30.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453de00700 1 -- 172.21.15.47:0/1797343127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4540109e00 msgr2=0x7f45401a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453de00700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4540109e00 0x7f45401a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453de00700 1 -- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4540107290 msgr2=0x7f454019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453de00700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4540107290 0x7f454019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453de00700 1 -- 172.21.15.47:0/1797343127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45401a2240 con 0x7f454006cd00 2024-05-14T12:15:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453e800700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4540109e00 0x7f45401a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:15:30.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f453de00700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454006cd00 0x7f454019a6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f453000ef10 tx=0x7f453000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:15:30.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.383+0000 7f4537400700 1 -- 172.21.15.47:0/1797343127 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453000ca70 con 0x7f454006cd00 2024-05-14T12:15:30.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.384+0000 7f4537400700 1 -- 172.21.15.47:0/1797343127 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4530019070 con 0x7f454006cd00 2024-05-14T12:15:30.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.384+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45401a24d0 con 0x7f454006cd00 2024-05-14T12:15:30.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.384+0000 7f4537400700 1 -- 172.21.15.47:0/1797343127 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530014480 con 0x7f454006cd00 2024-05-14T12:15:30.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.384+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45401a2a60 con 0x7f454006cd00 2024-05-14T12:15:30.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.385+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45400512c0 con 0x7f454006cd00 2024-05-14T12:15:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.387+0000 7f4537400700 1 -- 172.21.15.47:0/1797343127 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4530012050 con 0x7f454006cd00 2024-05-14T12:15:30.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.389+0000 7f4537400700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f45240b2900 0x7f45240b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:15:30.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.389+0000 7f4537400700 1 -- 172.21.15.47:0/1797343127 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3237+0+0 (secure 0 0 0) 0x7f45300e0ed0 con 0x7f454006cd00 2024-05-14T12:15:30.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.389+0000 7f4535400700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f45240b2900 0x7f45240b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:15:30.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.390+0000 7f4535400700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f45240b2900 0x7f45240b4e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f454019b790 tx=0x7f4528009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:15:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.394+0000 7f4537400700 1 -- 172.21.15.47:0/1797343127 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4530010040 con 0x7f454006cd00 2024-05-14T12:15:30.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:30 smithi073 ceph-mon[35809]: osdmap e22: 3 total, 3 up, 3 in 2024-05-14T12:15:30.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:30 smithi073 ceph-mon[35809]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-14T12:15:30.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:30.638+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4540063c00 con 0x7f45240b2900 2024-05-14T12:15:31.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:31 smithi066 ceph-mon[35981]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:31.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:31 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:15:31.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:31 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:15:31.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:31 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:31.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:31 smithi047 ceph-mon[31254]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:31.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:31 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:15:31.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:31 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:15:31.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:31 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:31.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:31 smithi073 ceph-mon[35809]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:31.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:31 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:15:31.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:31 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:15:31.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:31 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:32 smithi047 ceph-mon[31254]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:15:32.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:32 smithi073 ceph-mon[35809]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:15:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:32 smithi066 ceph-mon[35981]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:15:33.311 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:33 smithi047 ceph-mon[31254]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:33.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:33 smithi066 ceph-mon[35981]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:33.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:33 smithi073 ceph-mon[35809]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:35.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:35 smithi047 ceph-mon[31254]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:35.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:35 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1294984707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0cdbf6ec-880b-4a04-9411-baf21e5daf0b"}]: dispatch 2024-05-14T12:15:35.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:35 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1294984707' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cdbf6ec-880b-4a04-9411-baf21e5daf0b"}]': finished 2024-05-14T12:15:35.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:35 smithi047 ceph-mon[31254]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T12:15:35.441 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:35 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:15:35.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:35 smithi073 ceph-mon[35809]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:35.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:35 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1294984707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0cdbf6ec-880b-4a04-9411-baf21e5daf0b"}]: dispatch 2024-05-14T12:15:35.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:35 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1294984707' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cdbf6ec-880b-4a04-9411-baf21e5daf0b"}]': finished 2024-05-14T12:15:35.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:35 smithi073 ceph-mon[35809]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T12:15:35.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:35 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:15:35.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:35 smithi066 ceph-mon[35981]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:35.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:35 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1294984707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0cdbf6ec-880b-4a04-9411-baf21e5daf0b"}]: dispatch 2024-05-14T12:15:35.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:35 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1294984707' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cdbf6ec-880b-4a04-9411-baf21e5daf0b"}]': finished 2024-05-14T12:15:35.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:35 smithi066 ceph-mon[35981]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T12:15:35.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:35 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:15:36.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:36 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/573043362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:15:36.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:36 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/573043362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:15:36.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:36 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/573043362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:15:37.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:37 smithi047 ceph-mon[31254]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:37.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:37 smithi073 ceph-mon[35809]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:37.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:37 smithi066 ceph-mon[35981]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:39 smithi047 ceph-mon[31254]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:39.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:39 smithi073 ceph-mon[35809]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:39.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:39 smithi066 ceph-mon[35981]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:41.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:41 smithi047 ceph-mon[31254]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:41.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:41 smithi073 ceph-mon[35809]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:41.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:41 smithi066 ceph-mon[35981]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:43.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:43 smithi047 ceph-mon[31254]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:43.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:43 smithi073 ceph-mon[35809]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:43.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:43 smithi066 ceph-mon[35981]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:44.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T12:15:44.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T12:15:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T12:15:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:45 smithi047 ceph-mon[31254]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:45 smithi047 ceph-mon[31254]: Deploying daemon osd.3 on smithi047 2024-05-14T12:15:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:45 smithi073 ceph-mon[35809]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:45 smithi073 ceph-mon[35809]: Deploying daemon osd.3 on smithi047 2024-05-14T12:15:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:45 smithi066 ceph-mon[35981]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:45 smithi066 ceph-mon[35981]: Deploying daemon osd.3 on smithi047 2024-05-14T12:15:47.362 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:47 smithi047 ceph-mon[31254]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:47.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:47 smithi073 ceph-mon[35809]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:47.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:47 smithi066 ceph-mon[35981]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:49 smithi047 ceph-mon[31254]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:49 smithi073 ceph-mon[35809]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:49 smithi066 ceph-mon[35981]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:51.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:51 smithi073 ceph-mon[35809]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:51 smithi066 ceph-mon[35981]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:51.624 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:51 smithi047 ceph-mon[31254]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:53.368 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:53 smithi047 ceph-mon[31254]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:53.368 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:53.368 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:53.368 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:53 smithi073 ceph-mon[35809]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:53.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:53 smithi066 ceph-mon[35981]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:53.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:53.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:53.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:55.395 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:55 smithi047 ceph-mon[31254]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:55.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:55 smithi073 ceph-mon[35809]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:55 smithi066 ceph-mon[35981]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:57.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:57 smithi047 ceph-mon[31254]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:57.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:57.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:57 smithi066 ceph-mon[35981]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:57.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:57 smithi073 ceph-mon[35809]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:57.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:57.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:58.337 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 3 on host 'smithi047' 2024-05-14T12:15:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.336+0000 7f4537400700 1 -- 172.21.15.47:0/1797343127 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4540063c00 con 0x7f45240b2900 2024-05-14T12:15:58.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.340+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f45240b2900 msgr2=0x7f45240b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.340+0000 7f453f200700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f45240b2900 0x7f45240b4e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f454019b790 tx=0x7f4528009260 comp rx=0 tx=0).stop 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.340+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454006cd00 msgr2=0x7f454019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.340+0000 7f453f200700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454006cd00 0x7f454019a6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f453000ef10 tx=0x7f453000c3a0 comp rx=0 tx=0).stop 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 shutdown_connections 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f45240b2900 0x7f45240b4e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4540109e00 0x7f45401a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454006cd00 0x7f454019a6e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 --2- 172.21.15.47:0/1797343127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4540107290 0x7f454019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 >> 172.21.15.47:0/1797343127 conn(0x7f45400fe690 msgr2=0x7f4540105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 shutdown_connections 2024-05-14T12:15:58.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:15:58.341+0000 7f453f200700 1 -- 172.21.15.47:0/1797343127 wait complete. 2024-05-14T12:15:58.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:58 smithi047 ceph-mon[31254]: from='osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T12:15:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:58 smithi047 ceph-mon[31254]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T12:15:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:58.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:58 smithi066 ceph-mon[35981]: from='osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T12:15:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:58 smithi066 ceph-mon[35981]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T12:15:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:58 smithi073 ceph-mon[35809]: from='osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T12:15:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:58 smithi073 ceph-mon[35809]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T12:15:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:15:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:15:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:59.110 DEBUG:teuthology.orchestra.run.smithi047:osd.3> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.3.service 2024-05-14T12:15:59.115 INFO:tasks.cephadm:Deploying osd.4 on smithi066 with /dev/vg_nvme/lv_3... 2024-05-14T12:15:59.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: from='osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:59.312 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:15:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:59.370 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:15:59.476 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:59.476 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T12:15:59.476 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: from='osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:15:59.476 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T12:15:59.476 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:15:59.476 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:15:59.477 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:59.477 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:59.477 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:15:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:59.564 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:15:59 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3[50287]: 2024-05-14T12:15:59.310+0000 7f5361400700 -1 osd.3 0 waiting for initial osdmap 2024-05-14T12:15:59.565 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:15:59 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3[50287]: 2024-05-14T12:15:59.325+0000 7f535c200700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: from='osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:15:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:00.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:00 smithi047 ceph-mon[31254]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:16:00.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:00 smithi047 ceph-mon[31254]: osdmap e25: 4 total, 3 up, 4 in 2024-05-14T12:16:00.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:00.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:00.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:00 smithi066 ceph-mon[35981]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:16:00.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:00 smithi066 ceph-mon[35981]: osdmap e25: 4 total, 3 up, 4 in 2024-05-14T12:16:00.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:00.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:00 smithi073 ceph-mon[35809]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:16:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:00 smithi073 ceph-mon[35809]: osdmap e25: 4 total, 3 up, 4 in 2024-05-14T12:16:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:01.352 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T12:16:01.352 INFO:teuthology.orchestra.run.smithi066.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T12:16:01.352 INFO:teuthology.orchestra.run.smithi066.stderr: stderr: 10+0 records in 2024-05-14T12:16:01.352 INFO:teuthology.orchestra.run.smithi066.stderr:10+0 records out 2024-05-14T12:16:01.352 INFO:teuthology.orchestra.run.smithi066.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110489 s, 949 MB/s 2024-05-14T12:16:01.352 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping successful for: 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] boot 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:01 smithi047 ceph-mon[31254]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] boot 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:01 smithi066 ceph-mon[35981]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T12:16:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:16:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:16:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-05-14T12:16:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: osd.3 [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] boot 2024-05-14T12:16:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T12:16:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T12:16:01.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:01 smithi073 ceph-mon[35809]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T12:16:02.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_3 2024-05-14T12:16:02.307 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:16:02.650 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:02 smithi066 ceph-mon[35981]: osdmap e28: 4 total, 4 up, 4 in 2024-05-14T12:16:02.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:02 smithi047 ceph-mon[31254]: osdmap e28: 4 total, 4 up, 4 in 2024-05-14T12:16:02.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:02 smithi073 ceph-mon[35809]: osdmap e28: 4 total, 4 up, 4 in 2024-05-14T12:16:03.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:03 smithi047 ceph-mon[31254]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-05-14T12:16:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:03 smithi066 ceph-mon[35981]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-05-14T12:16:03.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:03 smithi073 ceph-mon[35809]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 150 KiB/s, 0 objects/s recovering 2024-05-14T12:16:03.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 -- 172.21.15.66:0/234297254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec1054a0 msgr2=0x7fe2ec1058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 --2- 172.21.15.66:0/234297254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec1054a0 0x7fe2ec1058b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009990 tx=0x7fe2e0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 -- 172.21.15.66:0/234297254 shutdown_connections 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 --2- 172.21.15.66:0/234297254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2ec105e40 0x7fe2ec10c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 --2- 172.21.15.66:0/234297254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2ec104370 0x7fe2ec104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 --2- 172.21.15.66:0/234297254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec1054a0 0x7fe2ec1058b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 -- 172.21.15.66:0/234297254 >> 172.21.15.66:0/234297254 conn(0x7fe2ec0ff9d0 msgr2=0x7fe2ec101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 -- 172.21.15.66:0/234297254 shutdown_connections 2024-05-14T12:16:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 -- 172.21.15.66:0/234297254 wait complete. 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 Processor -- start 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.918+0000 7fe2f2781700 1 -- start start 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f2781700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2ec104370 0x7fe2ec078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f2781700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2ec1054a0 0x7fe2ec076c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f2781700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec105e40 0x7fe2ec077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f2781700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec10fe60 con 0x7fe2ec104370 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f2781700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec10fce0 con 0x7fe2ec105e40 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f2781700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec10ffe0 con 0x7fe2ec1054a0 2024-05-14T12:16:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec105e40 0x7fe2ec077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec105e40 0x7fe2ec077160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45226/0 (socket says 172.21.15.66:45226) 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 -- 172.21.15.66:0/1115847604 learned_addr learned my addr 172.21.15.66:0/1115847604 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2eb7fe700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2ec1054a0 0x7fe2ec076c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 -- 172.21.15.66:0/1115847604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2ec1054a0 msgr2=0x7fe2ec076c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2ec1054a0 0x7fe2ec076c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 -- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2ec104370 msgr2=0x7fe2ec078570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2ec104370 0x7fe2ec078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.919+0000 7fe2f0d1e700 1 -- 172.21.15.66:0/1115847604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec0778c0 con 0x7fe2ec105e40 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.920+0000 7fe2f0d1e700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec105e40 0x7fe2ec077160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007ee0 tx=0x7fe2e400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.920+0000 7fe2e97fa700 1 -- 172.21.15.66:0/1115847604 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400dbd0 con 0x7fe2ec105e40 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.920+0000 7fe2e97fa700 1 -- 172.21.15.66:0/1115847604 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e400dd70 con 0x7fe2ec105e40 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.920+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ec1a4ab0 con 0x7fe2ec105e40 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.920+0000 7fe2e97fa700 1 -- 172.21.15.66:0/1115847604 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4005990 con 0x7fe2ec105e40 2024-05-14T12:16:03.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.920+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ec1a4fc0 con 0x7fe2ec105e40 2024-05-14T12:16:03.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.921+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ec0512c0 con 0x7fe2ec105e40 2024-05-14T12:16:03.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.922+0000 7fe2e97fa700 1 -- 172.21.15.66:0/1115847604 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe2e401a020 con 0x7fe2ec105e40 2024-05-14T12:16:03.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.923+0000 7fe2e97fa700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2d40b2880 0x7fe2d40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:03.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.923+0000 7fe2e97fa700 1 -- 172.21.15.66:0/1115847604 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7fe2e40e0ee0 con 0x7fe2ec105e40 2024-05-14T12:16:03.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.924+0000 7fe2ebfff700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2d40b2880 0x7fe2d40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:03.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.925+0000 7fe2ebfff700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2d40b2880 0x7fe2d40b4d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec1053a0 tx=0x7fe2dc006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:16:03.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:03.927+0000 7fe2e97fa700 1 -- 172.21.15.66:0/1115847604 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2e4010070 con 0x7fe2ec105e40 2024-05-14T12:16:04.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:04.153+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe2ec063c00 con 0x7fe2d40b2880 2024-05-14T12:16:04.903 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi047 2024-05-14T12:16:04.903 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.903 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.903 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:04.903 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi047 to 8547M 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:04.904 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi047 2024-05-14T12:16:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi047 to 8547M 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi047 2024-05-14T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi047 to 8547M 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:07 smithi047 ceph-mon[31254]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:16:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:07 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/1330188820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]: dispatch 2024-05-14T12:16:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:07 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]: dispatch 2024-05-14T12:16:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:07 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]': finished 2024-05-14T12:16:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:07 smithi047 ceph-mon[31254]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T12:16:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:07.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:07 smithi073 ceph-mon[35809]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:16:07.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:07 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/1330188820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]: dispatch 2024-05-14T12:16:07.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:07 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]: dispatch 2024-05-14T12:16:07.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:07 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]': finished 2024-05-14T12:16:07.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:07 smithi073 ceph-mon[35809]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T12:16:07.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:07 smithi066 ceph-mon[35981]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:16:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:07 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/1330188820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]: dispatch 2024-05-14T12:16:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:07 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]: dispatch 2024-05-14T12:16:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:07 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6a73cfc-0b02-4d92-b2c0-7d5289970c22"}]': finished 2024-05-14T12:16:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:07 smithi066 ceph-mon[35981]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T12:16:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:08.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:08 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/866475290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:16:08.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:08 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/866475290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:16:08.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:08 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/866475290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:16:09.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:09 smithi047 ceph-mon[31254]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-14T12:16:09.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:09 smithi073 ceph-mon[35809]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-14T12:16:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:09 smithi066 ceph-mon[35981]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-14T12:16:11.373 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:11 smithi066 ceph-mon[35981]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T12:16:11.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:11 smithi047 ceph-mon[31254]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T12:16:11.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:11 smithi073 ceph-mon[35809]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T12:16:13.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:13 smithi047 ceph-mon[31254]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:13.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:13 smithi073 ceph-mon[35809]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:13.536 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:13 smithi066 ceph-mon[35981]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:14.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T12:16:14.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:14.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T12:16:14.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:14.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T12:16:14.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:15 smithi066 ceph-mon[35981]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:15 smithi066 ceph-mon[35981]: Deploying daemon osd.4 on smithi066 2024-05-14T12:16:15.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:15 smithi073 ceph-mon[35809]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:15.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:15 smithi073 ceph-mon[35809]: Deploying daemon osd.4 on smithi066 2024-05-14T12:16:15.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:15 smithi047 ceph-mon[31254]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:15.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:15 smithi047 ceph-mon[31254]: Deploying daemon osd.4 on smithi066 2024-05-14T12:16:17.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:17 smithi066 ceph-mon[35981]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:17.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:17 smithi073 ceph-mon[35809]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:17 smithi047 ceph-mon[31254]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:19.449 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:19 smithi066 ceph-mon[35981]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:19.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:19 smithi073 ceph-mon[35809]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:19.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:19 smithi047 ceph-mon[31254]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:21 smithi066 ceph-mon[35981]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:21.887 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:21 smithi047 ceph-mon[31254]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:21 smithi073 ceph-mon[35809]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:23.142 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 4 on host 'smithi066' 2024-05-14T12:16:23.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.140+0000 7fe2e97fa700 1 -- 172.21.15.66:0/1115847604 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe2ec063c00 con 0x7fe2d40b2880 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2d40b2880 msgr2=0x7fe2d40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2d40b2880 0x7fe2d40b4d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec1053a0 tx=0x7fe2dc006d20 comp rx=0 tx=0).stop 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec105e40 msgr2=0x7fe2ec077160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec105e40 0x7fe2ec077160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4007ee0 tx=0x7fe2e400d3b0 comp rx=0 tx=0).stop 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 shutdown_connections 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2d40b2880 0x7fe2d40b4d90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2ec105e40 0x7fe2ec077160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2ec104370 0x7fe2ec078570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 --2- 172.21.15.66:0/1115847604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2ec1054a0 0x7fe2ec076c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 >> 172.21.15.66:0/1115847604 conn(0x7fe2ec0ff9d0 msgr2=0x7fe2ec1086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:16:23.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 shutdown_connections 2024-05-14T12:16:23.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:16:23.143+0000 7fe2f2781700 1 -- 172.21.15.66:0/1115847604 wait complete. 2024-05-14T12:16:23.428 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:23.428 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.428 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.428 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:23.428 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:23.428 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.429 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:23.429 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.429 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:23.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:23.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:23.719 DEBUG:teuthology.orchestra.run.smithi066:osd.4> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.4.service 2024-05-14T12:16:23.721 INFO:tasks.cephadm:Deploying osd.5 on smithi073 with /dev/vg_nvme/lv_3... 2024-05-14T12:16:23.721 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T12:16:23.954 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:16:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:24 smithi066 ceph-mon[35981]: from='osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T12:16:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:24 smithi066 ceph-mon[35981]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T12:16:24.335 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:24 smithi073 ceph-mon[35809]: from='osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T12:16:24.335 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:24 smithi073 ceph-mon[35809]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T12:16:24.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:24 smithi047 ceph-mon[31254]: from='osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T12:16:24.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:24 smithi047 ceph-mon[31254]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T12:16:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:25 smithi066 ceph-mon[35981]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:25 smithi066 ceph-mon[35981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T12:16:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:25 smithi066 ceph-mon[35981]: from='osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:16:25.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:25 smithi066 ceph-mon[35981]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T12:16:25.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:25.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:25 smithi066 ceph-mon[35981]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:16:25.425 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:25 smithi073 ceph-mon[35809]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:25.425 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:25 smithi073 ceph-mon[35809]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T12:16:25.425 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:25 smithi073 ceph-mon[35809]: from='osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:16:25.425 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:25 smithi073 ceph-mon[35809]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T12:16:25.425 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:25.425 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:25 smithi073 ceph-mon[35809]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:16:25.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:25 smithi047 ceph-mon[31254]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:25.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:25 smithi047 ceph-mon[31254]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T12:16:25.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:25 smithi047 ceph-mon[31254]: from='osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:16:25.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:25 smithi047 ceph-mon[31254]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T12:16:25.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:25.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:25 smithi047 ceph-mon[31254]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:16:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T12:16:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T12:16:25.989 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2024-05-14T12:16:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2024-05-14T12:16:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113872 s, 921 MB/s 2024-05-14T12:16:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2024-05-14T12:16:26.363 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:26 smithi073 ceph-mon[35809]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:16:26.363 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:26 smithi073 ceph-mon[35809]: osdmap e31: 5 total, 4 up, 5 in 2024-05-14T12:16:26.363 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:26.363 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:26.363 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:26 smithi073 ceph-mon[35809]: from='osd.4 ' entity='osd.4' 2024-05-14T12:16:26.397 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:26 smithi066 ceph-mon[35981]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:16:26.397 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:26 smithi066 ceph-mon[35981]: osdmap e31: 5 total, 4 up, 5 in 2024-05-14T12:16:26.397 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:26.397 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:26.397 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:26 smithi066 ceph-mon[35981]: from='osd.4 ' entity='osd.4' 2024-05-14T12:16:26.398 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:16:26 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4[47056]: 2024-05-14T12:16:26.187+0000 7fbfcf420700 -1 osd.4 0 waiting for initial osdmap 2024-05-14T12:16:26.398 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:16:26 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4[47056]: 2024-05-14T12:16:26.230+0000 7fbfc71cd700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:16:26.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2024-05-14T12:16:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:26 smithi047 ceph-mon[31254]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:16:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:26 smithi047 ceph-mon[31254]: osdmap e31: 5 total, 4 up, 5 in 2024-05-14T12:16:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:26.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:26 smithi047 ceph-mon[31254]: from='osd.4 ' entity='osd.4' 2024-05-14T12:16:26.885 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:16:27.324 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:16:27.324 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:16:27.324 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:27.324 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] boot 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T12:16:27.325 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:16:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:16:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] boot 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T12:16:27.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:16:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:16:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: osd.4 [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] boot 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T12:16:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 -- 172.21.15.73:0/191527742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c81049e0 msgr2=0x7ff1c810c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/191527742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c81049e0 0x7ff1c810c6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000b0a0 tx=0x7ff1c000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 -- 172.21.15.73:0/191527742 shutdown_connections 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/191527742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c81049e0 0x7ff1c810c6f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/191527742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c81059b0 0x7ff1c8105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/191527742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c8103f60 0x7ff1c8104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 -- 172.21.15.73:0/191527742 >> 172.21.15.73:0/191527742 conn(0x7ff1c80ff9d0 msgr2=0x7ff1c8101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 -- 172.21.15.73:0/191527742 shutdown_connections 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.445+0000 7ff1ce30d700 1 -- 172.21.15.73:0/191527742 wait complete. 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 Processor -- start 2024-05-14T12:16:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 -- start start 2024-05-14T12:16:28.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c8103f60 0x7ff1c819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:28.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c81049e0 0x7ff1c819b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:28.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c81059b0 0x7ff1c81a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:28.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c810ffe0 con 0x7ff1c81059b0 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c810fe60 con 0x7ff1c81049e0 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1ce30d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8110160 con 0x7ff1c8103f60 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1c7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c8103f60 0x7ff1c819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1c7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c8103f60 0x7ff1c819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44860/0 (socket says 172.21.15.73:44860) 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1c7fff700 1 -- 172.21.15.73:0/3060530531 learned_addr learned my addr 172.21.15.73:0/3060530531 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.446+0000 7ff1c77fe700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c81049e0 0x7ff1c819b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c7fff700 1 -- 172.21.15.73:0/3060530531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c81049e0 msgr2=0x7ff1c819b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c7fff700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c81049e0 0x7ff1c819b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c7fff700 1 -- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c81059b0 msgr2=0x7ff1c81a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c7fff700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c81059b0 0x7ff1c81a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c7fff700 1 -- 172.21.15.73:0/3060530531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c81a2660 con 0x7ff1c8103f60 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c7fff700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c8103f60 0x7ff1c819ab00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800b4d0 tx=0x7ff1b800b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:16:28.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c57fa700 1 -- 172.21.15.73:0/3060530531 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8015020 con 0x7ff1c8103f60 2024-05-14T12:16:28.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c81a2950 con 0x7ff1c8103f60 2024-05-14T12:16:28.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c57fa700 1 -- 172.21.15.73:0/3060530531 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b8011ce0 con 0x7ff1c8103f60 2024-05-14T12:16:28.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1c57fa700 1 -- 172.21.15.73:0/3060530531 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8010cf0 con 0x7ff1c8103f60 2024-05-14T12:16:28.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.447+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c81a2ec0 con 0x7ff1c8103f60 2024-05-14T12:16:28.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.448+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c80512c0 con 0x7ff1c8103f60 2024-05-14T12:16:28.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.449+0000 7ff1c57fa700 1 -- 172.21.15.73:0/3060530531 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff1b8018020 con 0x7ff1c8103f60 2024-05-14T12:16:28.451 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:28 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi066 2024-05-14T12:16:28.451 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:28 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi066 to 8544M 2024-05-14T12:16:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.450+0000 7ff1c57fa700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff1b00b2880 0x7ff1b00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.450+0000 7ff1c57fa700 1 -- 172.21.15.73:0/3060530531 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7ff1b80e0910 con 0x7ff1c8103f60 2024-05-14T12:16:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.451+0000 7ff1c77fe700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff1b00b2880 0x7ff1b00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:28.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.452+0000 7ff1c77fe700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff1b00b2880 0x7ff1b00b4d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1c819bbb0 tx=0x7ff1bc009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:16:28.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.456+0000 7ff1c57fa700 1 -- 172.21.15.73:0/3060530531 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff1b801f020 con 0x7ff1c8103f60 2024-05-14T12:16:28.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:28 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi066 2024-05-14T12:16:28.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:28 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi066 to 8544M 2024-05-14T12:16:28.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:28.665+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff1c8063c00 con 0x7ff1b00b2880 2024-05-14T12:16:28.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:28 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi066 2024-05-14T12:16:28.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:28 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi066 to 8544M 2024-05-14T12:16:29.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:29 smithi066 ceph-mon[35981]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:29.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:29 smithi066 ceph-mon[35981]: osdmap e33: 5 total, 5 up, 5 in 2024-05-14T12:16:29.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:29.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:29.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:29.584 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:29 smithi073 ceph-mon[35809]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:29.584 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:29 smithi073 ceph-mon[35809]: osdmap e33: 5 total, 5 up, 5 in 2024-05-14T12:16:29.584 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:29.584 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:29.584 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:29 smithi047 ceph-mon[31254]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:29 smithi047 ceph-mon[31254]: osdmap e33: 5 total, 5 up, 5 in 2024-05-14T12:16:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:30.430 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:30 smithi073 ceph-mon[35809]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:30.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:30 smithi066 ceph-mon[35981]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:30.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:30 smithi047 ceph-mon[31254]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:31.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:31 smithi066 ceph-mon[35981]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:31.679 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:31 smithi073 ceph-mon[35809]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:31 smithi047 ceph-mon[31254]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:32.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:32 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/679372242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]: dispatch 2024-05-14T12:16:32.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:32 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]: dispatch 2024-05-14T12:16:32.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:32 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]': finished 2024-05-14T12:16:32.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:32 smithi066 ceph-mon[35981]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T12:16:32.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:32.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:32 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/1427849847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:16:32.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:32 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/679372242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]: dispatch 2024-05-14T12:16:32.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:32 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]: dispatch 2024-05-14T12:16:32.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:32 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]': finished 2024-05-14T12:16:32.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:32 smithi047 ceph-mon[31254]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T12:16:32.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:32.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:32 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/1427849847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:16:32.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:32 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/679372242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]: dispatch 2024-05-14T12:16:32.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:32 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]: dispatch 2024-05-14T12:16:32.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:32 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73764d93-e78d-4398-a314-f5d3fafdbb3b"}]': finished 2024-05-14T12:16:32.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:32 smithi073 ceph-mon[35809]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T12:16:32.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:32.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:32 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/1427849847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:16:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:33 smithi047 ceph-mon[31254]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:33.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:33 smithi073 ceph-mon[35809]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:33.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:33 smithi066 ceph-mon[35981]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:35.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:35 smithi073 ceph-mon[35809]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:35.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:35 smithi047 ceph-mon[31254]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:35 smithi066 ceph-mon[35981]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:37.662 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:37 smithi073 ceph-mon[35809]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:37.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:37 smithi047 ceph-mon[31254]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:37.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:37 smithi066 ceph-mon[35981]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:39.696 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:39 smithi073 ceph-mon[35809]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:39.697 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T12:16:39.697 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:39.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:39 smithi047 ceph-mon[31254]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:39.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T12:16:39.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:39 smithi066 ceph-mon[35981]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T12:16:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:40.433 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:40 smithi073 ceph-mon[35809]: Deploying daemon osd.5 on smithi073 2024-05-14T12:16:40.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:40 smithi066 ceph-mon[35981]: Deploying daemon osd.5 on smithi073 2024-05-14T12:16:40.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:40 smithi047 ceph-mon[31254]: Deploying daemon osd.5 on smithi073 2024-05-14T12:16:41.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:41 smithi047 ceph-mon[31254]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:41.770 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:41 smithi073 ceph-mon[35809]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:41.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:41 smithi066 ceph-mon[35981]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:43.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:43 smithi073 ceph-mon[35809]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:43.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:43 smithi047 ceph-mon[31254]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:43 smithi066 ceph-mon[35981]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:45.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:45 smithi047 ceph-mon[31254]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:45.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:45.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:45.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:45 smithi073 ceph-mon[35809]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:45 smithi066 ceph-mon[35981]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:47 smithi073 ceph-mon[35809]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:47 smithi047 ceph-mon[31254]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:47 smithi066 ceph-mon[35981]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:47.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:48.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.305+0000 7ff1c57fa700 1 -- 172.21.15.73:0/3060530531 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff1c8063c00 con 0x7ff1b00b2880 2024-05-14T12:16:48.305 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 5 on host 'smithi073' 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.307+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff1b00b2880 msgr2=0x7ff1b00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.307+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff1b00b2880 0x7ff1b00b4d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1c819bbb0 tx=0x7ff1bc009190 comp rx=0 tx=0).stop 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.307+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c8103f60 msgr2=0x7ff1c819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.307+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c8103f60 0x7ff1c819ab00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800b4d0 tx=0x7ff1b800b7e0 comp rx=0 tx=0).stop 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 shutdown_connections 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff1b00b2880 0x7ff1b00b4d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c81059b0 0x7ff1c81a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c8103f60 0x7ff1c819ab00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 --2- 172.21.15.73:0/3060530531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c81049e0 0x7ff1c819b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 >> 172.21.15.73:0/3060530531 conn(0x7ff1c80ff9d0 msgr2=0x7ff1c81086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 shutdown_connections 2024-05-14T12:16:48.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:16:48.308+0000 7ff1ce30d700 1 -- 172.21.15.73:0/3060530531 wait complete. 2024-05-14T12:16:48.932 DEBUG:teuthology.orchestra.run.smithi073:osd.5> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.5.service 2024-05-14T12:16:48.934 INFO:tasks.cephadm:Deploying osd.6 on smithi047 with /dev/vg_nvme/lv_2... 2024-05-14T12:16:48.934 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T12:16:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:16:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:49 smithi047 ceph-mon[31254]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:49 smithi047 ceph-mon[31254]: from='osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T12:16:49.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:49 smithi047 ceph-mon[31254]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T12:16:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:49 smithi073 ceph-mon[35809]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:49 smithi073 ceph-mon[35809]: from='osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T12:16:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:49 smithi073 ceph-mon[35809]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T12:16:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:49 smithi066 ceph-mon[35981]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:16:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:49 smithi066 ceph-mon[35981]: from='osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T12:16:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:49 smithi066 ceph-mon[35981]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T12:16:50.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:50 smithi066 ceph-mon[35981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T12:16:50.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:50 smithi066 ceph-mon[35981]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T12:16:50.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:50.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:50 smithi066 ceph-mon[35981]: from='osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:16:50.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:50 smithi066 ceph-mon[35981]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:16:50.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:50 smithi047 ceph-mon[31254]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T12:16:50.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:50 smithi047 ceph-mon[31254]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T12:16:50.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:50.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:50 smithi047 ceph-mon[31254]: from='osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:16:50.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:50 smithi047 ceph-mon[31254]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:16:50.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:50 smithi073 ceph-mon[35809]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T12:16:50.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:50 smithi073 ceph-mon[35809]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T12:16:50.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:50.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:50 smithi073 ceph-mon[35809]: from='osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:16:50.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:50 smithi073 ceph-mon[35809]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: osdmap e37: 6 total, 5 up, 6 in 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.412 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:51 smithi047 ceph-mon[31254]: from='osd.5 ' entity='osd.5' 2024-05-14T12:16:51.478 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:51.478 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:16:51.478 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T12:16:51.479 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.479 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.479 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: osdmap e37: 6 total, 5 up, 6 in 2024-05-14T12:16:51.479 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.479 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:51 smithi073 ceph-mon[35809]: from='osd.5 ' entity='osd.5' 2024-05-14T12:16:51.479 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:16:51 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5[47840]: 2024-05-14T12:16:51.227+0000 7f922b62b700 -1 osd.5 0 waiting for initial osdmap 2024-05-14T12:16:51.479 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:16:51 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5[47840]: 2024-05-14T12:16:51.371+0000 7f92233d8700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:16:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:16:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T12:16:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: osdmap e37: 6 total, 5 up, 6 in 2024-05-14T12:16:51.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:51.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:51 smithi066 ceph-mon[35981]: from='osd.5 ' entity='osd.5' 2024-05-14T12:16:52.321 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T12:16:52.321 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T12:16:52.322 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-05-14T12:16:52.322 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-05-14T12:16:52.322 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0358814 s, 292 MB/s 2024-05-14T12:16:52.322 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-05-14T12:16:52.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:16:52.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:16:52.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:52.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] boot 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:52.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] boot 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:52.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:52.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: osd.5 [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] boot 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:52.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:16:52.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:52.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:52.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:16:52.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:16:53.142 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-05-14T12:16:53.584 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:16:53.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:53 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi073 2024-05-14T12:16:53.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:53 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi073 to 8544M 2024-05-14T12:16:53.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:53 smithi047 ceph-mon[31254]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:53.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:53 smithi047 ceph-mon[31254]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T12:16:53.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:53 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi073 2024-05-14T12:16:53.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:53 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi073 to 8544M 2024-05-14T12:16:53.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:53 smithi073 ceph-mon[35809]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:53.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:53 smithi073 ceph-mon[35809]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T12:16:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:53 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi073 2024-05-14T12:16:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:53 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi073 to 8544M 2024-05-14T12:16:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:53 smithi066 ceph-mon[35981]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-14T12:16:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:53 smithi066 ceph-mon[35981]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T12:16:54.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:54 smithi047 ceph-mon[31254]: osdmap e40: 6 total, 6 up, 6 in 2024-05-14T12:16:54.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:54 smithi073 ceph-mon[35809]: osdmap e40: 6 total, 6 up, 6 in 2024-05-14T12:16:54.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:54 smithi066 ceph-mon[35981]: osdmap e40: 6 total, 6 up, 6 in 2024-05-14T12:16:55.532 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:55 smithi047 ceph-mon[31254]: pgmap v158: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:16:55.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:55 smithi073 ceph-mon[35809]: pgmap v158: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 -- 172.21.15.47:0/572430985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 msgr2=0x7f4f7410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 --2- 172.21.15.47:0/572430985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 0x7f4f7410c580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00b0a0 tx=0x7f4f6c00b3b0 comp rx=0 tx=0).stop 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 -- 172.21.15.47:0/572430985 shutdown_connections 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 --2- 172.21.15.47:0/572430985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 0x7f4f7410c580 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 --2- 172.21.15.47:0/572430985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f741026d0 0x7f4f74102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 --2- 172.21.15.47:0/572430985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f74107800 0x7f4f74109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 -- 172.21.15.47:0/572430985 >> 172.21.15.47:0/572430985 conn(0x7f4f740fe010 msgr2=0x7f4f741004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 -- 172.21.15.47:0/572430985 shutdown_connections 2024-05-14T12:16:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.786+0000 7f4f7a200700 1 -- 172.21.15.47:0/572430985 wait complete. 2024-05-14T12:16:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 Processor -- start 2024-05-14T12:16:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 -- start start 2024-05-14T12:16:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f741026d0 0x7f4f74104fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f74107800 0x7f4f74103670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 0x7f4f74103bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7410fd90 con 0x7f4f7410a160 2024-05-14T12:16:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7410fc10 con 0x7f4f741026d0 2024-05-14T12:16:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.788+0000 7f4f7a200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7410ff10 con 0x7f4f74107800 2024-05-14T12:16:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f741026d0 0x7f4f74104fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f741026d0 0x7f4f74104fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33840/0 (socket says 172.21.15.47:33840) 2024-05-14T12:16:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f6be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f74107800 0x7f4f74103670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 -- 172.21.15.47:0/1206032825 learned_addr learned my addr 172.21.15.47:0/1206032825 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:16:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 0x7f4f74103bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 -- 172.21.15.47:0/1206032825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f74107800 msgr2=0x7f4f74103670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f74107800 0x7f4f74103670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 -- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 msgr2=0x7f4f74103bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:16:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 0x7f4f74103bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:16:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 -- 172.21.15.47:0/1206032825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f74104310 con 0x7f4f741026d0 2024-05-14T12:16:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73e00700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 0x7f4f74103bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:16:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.789+0000 7f4f73400700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f741026d0 0x7f4f74104fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400ea10 tx=0x7f4f6400ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:16:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.790+0000 7f4f70c00700 1 -- 172.21.15.47:0/1206032825 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6400cbd0 con 0x7f4f741026d0 2024-05-14T12:16:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.790+0000 7f4f70c00700 1 -- 172.21.15.47:0/1206032825 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f6400cd70 con 0x7f4f741026d0 2024-05-14T12:16:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.790+0000 7f4f70c00700 1 -- 172.21.15.47:0/1206032825 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64018680 con 0x7f4f741026d0 2024-05-14T12:16:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.790+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f741a4910 con 0x7f4f741026d0 2024-05-14T12:16:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.790+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f741a4da0 con 0x7f4f741026d0 2024-05-14T12:16:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.791+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7402e5f0 con 0x7f4f741026d0 2024-05-14T12:16:55.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.794+0000 7f4f70c00700 1 -- 172.21.15.47:0/1206032825 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4f6401f020 con 0x7f4f741026d0 2024-05-14T12:16:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.796+0000 7f4f70c00700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f580b2900 0x7f4f580b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:16:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.796+0000 7f4f70c00700 1 -- 172.21.15.47:0/1206032825 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4533+0+0 (secure 0 0 0) 0x7f4f640e1280 con 0x7f4f741026d0 2024-05-14T12:16:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.796+0000 7f4f6be00700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f580b2900 0x7f4f580b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:16:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.797+0000 7f4f6be00700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f580b2900 0x7f4f580b4e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4f74104970 tx=0x7f4f5c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:16:55.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:55.801+0000 7f4f70c00700 1 -- 172.21.15.47:0/1206032825 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4f640a9dc0 con 0x7f4f741026d0 2024-05-14T12:16:55.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:55 smithi066 ceph-mon[35981]: pgmap v158: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:16:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:16:56.047+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4f74063c00 con 0x7f4f580b2900 2024-05-14T12:16:56.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:56.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:56.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:56.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:56.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:56.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:56.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:16:56.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:16:56.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:16:57.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:57 smithi047 ceph-mon[31254]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:57.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:57 smithi047 ceph-mon[31254]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:16:57.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:57 smithi073 ceph-mon[35809]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:57.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:57 smithi073 ceph-mon[35809]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:16:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:57 smithi066 ceph-mon[35981]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:16:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:57 smithi066 ceph-mon[35981]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:16:59.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:16:59 smithi047 ceph-mon[31254]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T12:16:59.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:16:59 smithi073 ceph-mon[35809]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T12:16:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:16:59 smithi066 ceph-mon[35981]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T12:17:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:00 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2746961065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589bf07a-e38e-486f-b8b7-4beeb4f937dd"}]: dispatch 2024-05-14T12:17:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:00 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2746961065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589bf07a-e38e-486f-b8b7-4beeb4f937dd"}]': finished 2024-05-14T12:17:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:00 smithi047 ceph-mon[31254]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T12:17:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:00 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2746961065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589bf07a-e38e-486f-b8b7-4beeb4f937dd"}]: dispatch 2024-05-14T12:17:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:00 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2746961065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589bf07a-e38e-486f-b8b7-4beeb4f937dd"}]': finished 2024-05-14T12:17:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:00 smithi073 ceph-mon[35809]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T12:17:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:00.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:00 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2746961065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589bf07a-e38e-486f-b8b7-4beeb4f937dd"}]: dispatch 2024-05-14T12:17:00.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:00 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2746961065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589bf07a-e38e-486f-b8b7-4beeb4f937dd"}]': finished 2024-05-14T12:17:00.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:00 smithi066 ceph-mon[35981]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T12:17:00.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:01.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:01 smithi047 ceph-mon[31254]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:17:01.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:01 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1423962340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:01 smithi073 ceph-mon[35809]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:17:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:01 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1423962340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:01 smithi066 ceph-mon[35981]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:17:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:01 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1423962340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:03.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:03 smithi047 ceph-mon[31254]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T12:17:03.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:03 smithi073 ceph-mon[35809]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T12:17:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:03 smithi066 ceph-mon[35981]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-14T12:17:05.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:05 smithi047 ceph-mon[31254]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:17:05.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:05 smithi073 ceph-mon[35809]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:17:05.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:05 smithi066 ceph-mon[35981]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:17:07.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:07 smithi047 ceph-mon[31254]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:17:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:07 smithi073 ceph-mon[35809]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:17:07.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:07 smithi066 ceph-mon[35981]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:17:09.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:09 smithi047 ceph-mon[31254]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:09 smithi073 ceph-mon[35809]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:09.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:09 smithi066 ceph-mon[35981]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:10.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:10 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T12:17:10.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:10 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:10 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T12:17:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:10 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:10.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:10 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T12:17:10.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:10 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:11 smithi047 ceph-mon[31254]: Deploying daemon osd.6 on smithi047 2024-05-14T12:17:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:11 smithi047 ceph-mon[31254]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:11.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:11 smithi073 ceph-mon[35809]: Deploying daemon osd.6 on smithi047 2024-05-14T12:17:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:11 smithi073 ceph-mon[35809]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:11 smithi066 ceph-mon[35981]: Deploying daemon osd.6 on smithi047 2024-05-14T12:17:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:11 smithi066 ceph-mon[35981]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:13.651 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:13 smithi047 ceph-mon[31254]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:13.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:13 smithi073 ceph-mon[35809]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:13.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:13 smithi066 ceph-mon[35981]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:15.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:15 smithi047 ceph-mon[31254]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:15.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:15 smithi073 ceph-mon[35809]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:15 smithi066 ceph-mon[35981]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:17 smithi073 ceph-mon[35809]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:17 smithi066 ceph-mon[35981]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:17.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:17 smithi047 ceph-mon[31254]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:19 smithi073 ceph-mon[35809]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:19 smithi066 ceph-mon[35981]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:19.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:19 smithi047 ceph-mon[31254]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:21.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:21 smithi047 ceph-mon[31254]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:21 smithi066 ceph-mon[35981]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:21.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:21 smithi073 ceph-mon[35809]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:23 smithi047 ceph-mon[31254]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:23.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:23.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:23 smithi066 ceph-mon[35981]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:23.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:23.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:23 smithi073 ceph-mon[35809]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.296 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 6 on host 'smithi047' 2024-05-14T12:17:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.295+0000 7f4f70c00700 1 -- 172.21.15.47:0/1206032825 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4f74063c00 con 0x7f4f580b2900 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.298+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f580b2900 msgr2=0x7f4f580b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.298+0000 7f4f7a200700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f580b2900 0x7f4f580b4e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4f74104970 tx=0x7f4f5c0073d0 comp rx=0 tx=0).stop 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.298+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f741026d0 msgr2=0x7f4f74104fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.298+0000 7f4f7a200700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f741026d0 0x7f4f74104fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400ea10 tx=0x7f4f6400ed20 comp rx=0 tx=0).stop 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 shutdown_connections 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f580b2900 0x7f4f580b4e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7410a160 0x7f4f74103bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f741026d0 0x7f4f74104fc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 --2- 172.21.15.47:0/1206032825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f74107800 0x7f4f74103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 >> 172.21.15.47:0/1206032825 conn(0x7f4f740fe010 msgr2=0x7f4f74108640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:17:24.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 shutdown_connections 2024-05-14T12:17:24.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:17:24.299+0000 7f4f7a200700 1 -- 172.21.15.47:0/1206032825 wait complete. 2024-05-14T12:17:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:24 smithi066 ceph-mon[35981]: from='osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T12:17:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:24 smithi066 ceph-mon[35981]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T12:17:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:24 smithi047 ceph-mon[31254]: from='osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T12:17:24.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:24 smithi047 ceph-mon[31254]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T12:17:24.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:24.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:24.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:24.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:25.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:24 smithi073 ceph-mon[35809]: from='osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T12:17:25.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:24 smithi073 ceph-mon[35809]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T12:17:25.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:25.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:25.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:25.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:25.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:25.140 DEBUG:teuthology.orchestra.run.smithi047:osd.6> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.6.service 2024-05-14T12:17:25.146 INFO:tasks.cephadm:Deploying osd.7 on smithi066 with /dev/vg_nvme/lv_2... 2024-05-14T12:17:25.146 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T12:17:25.400 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:17:25.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:25 smithi047 ceph-mon[31254]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:25.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:25 smithi047 ceph-mon[31254]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T12:17:25.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:25 smithi047 ceph-mon[31254]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T12:17:25.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:25 smithi047 ceph-mon[31254]: from='osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:17:25.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:25.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:25 smithi047 ceph-mon[31254]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:17:25.741 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:25.823 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:25 smithi066 ceph-mon[35981]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:25.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:25 smithi066 ceph-mon[35981]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T12:17:25.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:25 smithi066 ceph-mon[35981]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T12:17:25.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:25 smithi066 ceph-mon[35981]: from='osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:17:25.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:25.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:25 smithi066 ceph-mon[35981]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:17:25.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:25 smithi073 ceph-mon[35809]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:25 smithi073 ceph-mon[35809]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T12:17:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:25 smithi073 ceph-mon[35809]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T12:17:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:25 smithi073 ceph-mon[35809]: from='osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:17:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:25 smithi073 ceph-mon[35809]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:17:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:26.813 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:26 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:17:26.813 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:26 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:17:26.813 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:26 smithi066 ceph-mon[35981]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:17:26.813 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:26 smithi066 ceph-mon[35981]: osdmap e43: 7 total, 6 up, 7 in 2024-05-14T12:17:26.813 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:26.813 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:26.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:26 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:17:26.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:26 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:17:26.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:26 smithi047 ceph-mon[31254]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:17:26.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:26 smithi047 ceph-mon[31254]: osdmap e43: 7 total, 6 up, 7 in 2024-05-14T12:17:26.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:26.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:26.986 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:17:26 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6[56765]: 2024-05-14T12:17:26.551+0000 7f787f800700 -1 osd.6 0 waiting for initial osdmap 2024-05-14T12:17:26.986 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:17:26 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6[56765]: 2024-05-14T12:17:26.609+0000 7f7874c00700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:17:27.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:26 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:17:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:26 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:17:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:26 smithi073 ceph-mon[35809]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:17:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:26 smithi073 ceph-mon[35809]: osdmap e43: 7 total, 6 up, 7 in 2024-05-14T12:17:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T12:17:27.286 INFO:teuthology.orchestra.run.smithi066.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T12:17:27.286 INFO:teuthology.orchestra.run.smithi066.stderr: stderr: 10+0 records in 2024-05-14T12:17:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:10+0 records out 2024-05-14T12:17:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114169 s, 918 MB/s 2024-05-14T12:17:27.287 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping successful for: 2024-05-14T12:17:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:27 smithi047 ceph-mon[31254]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:27 smithi047 ceph-mon[31254]: from='osd.6 ' entity='osd.6' 2024-05-14T12:17:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:27 smithi066 ceph-mon[35981]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:27 smithi066 ceph-mon[35981]: from='osd.6 ' entity='osd.6' 2024-05-14T12:17:27.907 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_2 2024-05-14T12:17:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:27 smithi073 ceph-mon[35809]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:27 smithi073 ceph-mon[35809]: from='osd.6 ' entity='osd.6' 2024-05-14T12:17:28.155 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:17:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:28 smithi066 ceph-mon[35981]: osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] boot 2024-05-14T12:17:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:28 smithi066 ceph-mon[35981]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T12:17:28.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:28.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:28.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:28 smithi047 ceph-mon[31254]: osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] boot 2024-05-14T12:17:28.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:28 smithi047 ceph-mon[31254]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T12:17:28.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:29.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:29.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:28 smithi073 ceph-mon[35809]: osd.6 [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] boot 2024-05-14T12:17:29.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:28 smithi073 ceph-mon[35809]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T12:17:29.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T12:17:29.643 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:29 smithi066 ceph-mon[35981]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:29.643 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:29 smithi066 ceph-mon[35981]: osdmap e45: 7 total, 7 up, 7 in 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 -- 172.21.15.66:0/938091912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103ee0 msgr2=0x7f84101042f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 --2- 172.21.15.66:0/938091912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103ee0 0x7f84101042f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f840800b0a0 tx=0x7f840800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 -- 172.21.15.66:0/938091912 shutdown_connections 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 --2- 172.21.15.66:0/938091912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103ee0 0x7f84101042f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 --2- 172.21.15.66:0/938091912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410102c40 0x7f8410103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 --2- 172.21.15.66:0/938091912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8410103590 0x7f84101039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 -- 172.21.15.66:0/938091912 >> 172.21.15.66:0/938091912 conn(0x7f84100fe890 msgr2=0x7f8410100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:17:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 -- 172.21.15.66:0/938091912 shutdown_connections 2024-05-14T12:17:29.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.764+0000 7f841522f700 1 -- 172.21.15.66:0/938091912 wait complete. 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 Processor -- start 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 -- start start 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8410102c40 0x7f841019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103590 0x7f841019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410103ee0 0x7f84101a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8410112030 con 0x7f8410103ee0 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8410111eb0 con 0x7f8410103590 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.765+0000 7f841522f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f84101121b0 con 0x7f8410102c40 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103590 0x7f841019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103590 0x7f841019d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37526/0 (socket says 172.21.15.66:37526) 2024-05-14T12:17:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 -- 172.21.15.66:0/866361896 learned_addr learned my addr 172.21.15.66:0/866361896 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840ed9d700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8410102c40 0x7f841019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840f59e700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410103ee0 0x7f84101a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 -- 172.21.15.66:0/866361896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8410102c40 msgr2=0x7f841019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8410102c40 0x7f841019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 -- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410103ee0 msgr2=0x7f84101a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410103ee0 0x7f84101a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 -- 172.21.15.66:0/866361896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84101a4640 con 0x7f8410103590 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f840e59c700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103590 0x7f841019d020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f840000d980 tx=0x7f840000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f83f7fff700 1 -- 172.21.15.66:0/866361896 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400016070 con 0x7f8410103590 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f83f7fff700 1 -- 172.21.15.66:0/866361896 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8400004830 con 0x7f8410103590 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84101a4930 con 0x7f8410103590 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f83f7fff700 1 -- 172.21.15.66:0/866361896 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84000054c0 con 0x7f8410103590 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.766+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84101a4e70 con 0x7f8410103590 2024-05-14T12:17:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.767+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84100512c0 con 0x7f8410103590 2024-05-14T12:17:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.769+0000 7f83f7fff700 1 -- 172.21.15.66:0/866361896 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8400004220 con 0x7f8410103590 2024-05-14T12:17:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.769+0000 7f83f7fff700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83f80b2880 0x7f83f80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.770+0000 7f83f7fff700 1 -- 172.21.15.66:0/866361896 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4965+0+0 (secure 0 0 0) 0x7f84000e18c0 con 0x7f8410103590 2024-05-14T12:17:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.770+0000 7f840ed9d700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83f80b2880 0x7f83f80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:17:29.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.771+0000 7f840ed9d700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83f80b2880 0x7f83f80b4d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8410076410 tx=0x7f8404009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:17:29.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.773+0000 7f83f7fff700 1 -- 172.21.15.66:0/866361896 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f840001f020 con 0x7f8410103590 2024-05-14T12:17:29.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:29 smithi047 ceph-mon[31254]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:29.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:29 smithi047 ceph-mon[31254]: osdmap e45: 7 total, 7 up, 7 in 2024-05-14T12:17:29.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:29.999+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8410063c00 con 0x7f83f80b2880 2024-05-14T12:17:30.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:29 smithi073 ceph-mon[35809]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-14T12:17:30.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:29 smithi073 ceph-mon[35809]: osdmap e45: 7 total, 7 up, 7 in 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:30.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:30.855 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:30.855 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:30.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:17:30.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:30.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:31.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:31.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:31.945 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:31 smithi066 ceph-mon[35981]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:17:31.945 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:31 smithi066 ceph-mon[35981]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:31.945 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:31 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi047 2024-05-14T12:17:31.945 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:31 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi047 to 5698M 2024-05-14T12:17:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:31 smithi047 ceph-mon[31254]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:17:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:31 smithi047 ceph-mon[31254]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:31 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi047 2024-05-14T12:17:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:31 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi047 to 5698M 2024-05-14T12:17:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:31 smithi073 ceph-mon[35809]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:17:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:31 smithi073 ceph-mon[35809]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:31 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi047 2024-05-14T12:17:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:31 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi047 to 5698M 2024-05-14T12:17:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:33 smithi047 ceph-mon[31254]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:33 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/2713614985' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]: dispatch 2024-05-14T12:17:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:33 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]: dispatch 2024-05-14T12:17:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:33 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]': finished 2024-05-14T12:17:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:33 smithi047 ceph-mon[31254]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T12:17:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:33.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:33 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/1996713690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:33 smithi073 ceph-mon[35809]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:33 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/2713614985' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]: dispatch 2024-05-14T12:17:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:33 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]: dispatch 2024-05-14T12:17:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:33 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]': finished 2024-05-14T12:17:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:33 smithi073 ceph-mon[35809]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T12:17:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:33 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/1996713690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:33 smithi066 ceph-mon[35981]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:33 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/2713614985' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]: dispatch 2024-05-14T12:17:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:33 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]: dispatch 2024-05-14T12:17:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:33 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41"}]': finished 2024-05-14T12:17:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:33 smithi066 ceph-mon[35981]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T12:17:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:33 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/1996713690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:35 smithi047 ceph-mon[31254]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:36.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:35 smithi073 ceph-mon[35809]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:35 smithi066 ceph-mon[35981]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:37.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:37 smithi047 ceph-mon[31254]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:38.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:37 smithi073 ceph-mon[35809]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:38.062 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:37 smithi066 ceph-mon[35981]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:39 smithi047 ceph-mon[31254]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:40.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:39 smithi073 ceph-mon[35809]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:39 smithi066 ceph-mon[35981]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:40.929 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:40 smithi066 ceph-mon[35981]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:40.929 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T12:17:40.929 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:40.929 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:40 smithi066 ceph-mon[35981]: Deploying daemon osd.7 on smithi066 2024-05-14T12:17:40.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:40 smithi047 ceph-mon[31254]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:40.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T12:17:40.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:40.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:40 smithi047 ceph-mon[31254]: Deploying daemon osd.7 on smithi066 2024-05-14T12:17:41.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:40 smithi073 ceph-mon[35809]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:41.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T12:17:41.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:41.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:40 smithi073 ceph-mon[35809]: Deploying daemon osd.7 on smithi066 2024-05-14T12:17:43.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:43 smithi047 ceph-mon[31254]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:43.491 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:43 smithi066 ceph-mon[35981]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:43.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:43 smithi073 ceph-mon[35809]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:45.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:45 smithi066 ceph-mon[35981]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:45 smithi047 ceph-mon[31254]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:45 smithi073 ceph-mon[35809]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:46 smithi073 ceph-mon[35809]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:47.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:47.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:47.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:47.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:46 smithi066 ceph-mon[35981]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:47.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:47.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:47.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:47.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:46 smithi047 ceph-mon[31254]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:49.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:49 smithi066 ceph-mon[35981]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:49.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:49.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:49.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:49 smithi047 ceph-mon[31254]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:49.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:49 smithi073 ceph-mon[35809]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:49.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:49.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:49.692 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 7 on host 'smithi066' 2024-05-14T12:17:49.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.692+0000 7f83f7fff700 1 -- 172.21.15.66:0/866361896 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8410063c00 con 0x7f83f80b2880 2024-05-14T12:17:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83f80b2880 msgr2=0x7f83f80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83f80b2880 0x7f83f80b4d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8410076410 tx=0x7f8404009190 comp rx=0 tx=0).stop 2024-05-14T12:17:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103590 msgr2=0x7f841019d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103590 0x7f841019d020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f840000d980 tx=0x7f840000dc90 comp rx=0 tx=0).stop 2024-05-14T12:17:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 shutdown_connections 2024-05-14T12:17:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83f80b2880 0x7f83f80b4d90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410103ee0 0x7f84101a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:49.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8410102c40 0x7f841019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:49.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 --2- 172.21.15.66:0/866361896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8410103590 0x7f841019d020 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:49.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 >> 172.21.15.66:0/866361896 conn(0x7f84100fe890 msgr2=0x7f841010b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:17:49.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 shutdown_connections 2024-05-14T12:17:49.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:17:49.695+0000 7f841522f700 1 -- 172.21.15.66:0/866361896 wait complete. 2024-05-14T12:17:50.266 DEBUG:teuthology.orchestra.run.smithi066:osd.7> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.7.service 2024-05-14T12:17:50.269 INFO:tasks.cephadm:Deploying osd.8 on smithi073 with /dev/vg_nvme/lv_2... 2024-05-14T12:17:50.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T12:17:50.514 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:17:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:50 smithi066 ceph-mon[35981]: from='osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T12:17:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:50 smithi066 ceph-mon[35981]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T12:17:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:50 smithi066 ceph-mon[35981]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:50.952 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:50.952 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:50.952 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:50.953 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:50 smithi073 ceph-mon[35809]: from='osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T12:17:50.953 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:50 smithi073 ceph-mon[35809]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T12:17:50.953 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:50 smithi073 ceph-mon[35809]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:50.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:50.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:50.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:17:50.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:50 smithi047 ceph-mon[31254]: from='osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T12:17:50.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:50 smithi047 ceph-mon[31254]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T12:17:50.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:50 smithi047 ceph-mon[31254]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:51 smithi066 ceph-mon[35981]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T12:17:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:51 smithi066 ceph-mon[35981]: from='osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:17:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:51 smithi066 ceph-mon[35981]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T12:17:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:51 smithi066 ceph-mon[35981]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:17:51.892 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:51 smithi073 ceph-mon[35809]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T12:17:51.892 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:51 smithi073 ceph-mon[35809]: from='osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:17:51.892 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:51 smithi073 ceph-mon[35809]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T12:17:51.893 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:51.893 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:51 smithi073 ceph-mon[35809]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:17:51.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:51 smithi047 ceph-mon[31254]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T12:17:51.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:51 smithi047 ceph-mon[31254]: from='osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:17:51.920 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:51 smithi047 ceph-mon[31254]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T12:17:51.920 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:51.920 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:51 smithi047 ceph-mon[31254]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:17:52.421 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T12:17:52.422 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T12:17:52.422 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2024-05-14T12:17:52.422 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2024-05-14T12:17:52.422 INFO:teuthology.orchestra.run.smithi073.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127738 s, 821 MB/s 2024-05-14T12:17:52.422 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2024-05-14T12:17:52.727 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:52 smithi066 ceph-mon[35981]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:17:52.728 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:52 smithi066 ceph-mon[35981]: osdmap e48: 8 total, 7 up, 8 in 2024-05-14T12:17:52.728 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:52.728 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:52.728 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:52 smithi066 ceph-mon[35981]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:52.728 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:52 smithi066 ceph-mon[35981]: from='osd.7 ' entity='osd.7' 2024-05-14T12:17:52.728 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:17:52 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7[53880]: 2024-05-14T12:17:52.615+0000 7fdc5e2ee700 -1 osd.7 0 waiting for initial osdmap 2024-05-14T12:17:52.729 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:17:52 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7[53880]: 2024-05-14T12:17:52.654+0000 7fdc5609b700 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:17:52.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:52 smithi047 ceph-mon[31254]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:17:52.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:52 smithi047 ceph-mon[31254]: osdmap e48: 8 total, 7 up, 8 in 2024-05-14T12:17:52.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:52.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:52.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:52 smithi047 ceph-mon[31254]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:52.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:52 smithi047 ceph-mon[31254]: from='osd.7 ' entity='osd.7' 2024-05-14T12:17:53.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:52 smithi073 ceph-mon[35809]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:17:53.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:52 smithi073 ceph-mon[35809]: osdmap e48: 8 total, 7 up, 8 in 2024-05-14T12:17:53.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:53.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:53.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:52 smithi073 ceph-mon[35809]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:53.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:52 smithi073 ceph-mon[35809]: from='osd.7 ' entity='osd.7' 2024-05-14T12:17:53.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2024-05-14T12:17:53.329 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:17:53.709 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: osdmap e49: 8 total, 7 up, 8 in 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi066 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi066 to 5696M 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] boot 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T12:17:53.711 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: osdmap e49: 8 total, 7 up, 8 in 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi066 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi066 to 5696M 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] boot 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T12:17:53.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:17:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:17:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: osdmap e49: 8 total, 7 up, 8 in 2024-05-14T12:17:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi066 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi066 to 5696M 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: osd.7 [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] boot 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T12:17:54.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.819+0000 7fe9adf6c700 1 -- 172.21.15.73:0/2099493240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8104d00 msgr2=0x7fe9a810b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.819+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/2099493240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8104d00 0x7fe9a810b5b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000b0a0 tx=0x7fe9a000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.819+0000 7fe9adf6c700 1 -- 172.21.15.73:0/2099493240 shutdown_connections 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.819+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/2099493240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8104d00 0x7fe9a810b5b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.819+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/2099493240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a8103230 0x7fe9a8103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.819+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/2099493240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9a8104360 0x7fe9a8104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.820+0000 7fe9adf6c700 1 -- 172.21.15.73:0/2099493240 >> 172.21.15.73:0/2099493240 conn(0x7fe9a80fe890 msgr2=0x7fe9a8100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.820+0000 7fe9adf6c700 1 -- 172.21.15.73:0/2099493240 shutdown_connections 2024-05-14T12:17:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.820+0000 7fe9adf6c700 1 -- 172.21.15.73:0/2099493240 wait complete. 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.820+0000 7fe9adf6c700 1 Processor -- start 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.820+0000 7fe9adf6c700 1 -- start start 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8103230 0x7fe9a8076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9a8104360 0x7fe9a819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a8104d00 0x7fe9a81a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a810ed10 con 0x7fe9a8104360 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a810eb90 con 0x7fe9a8104d00 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a810ee90 con 0x7fe9a8103230 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8103230 0x7fe9a8076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8103230 0x7fe9a8076450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53832/0 (socket says 172.21.15.73:53832) 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 -- 172.21.15.73:0/1695821143 learned_addr learned my addr 172.21.15.73:0/1695821143 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 -- 172.21.15.73:0/1695821143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a8104d00 msgr2=0x7fe9a81a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a7fff700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a8104d00 0x7fe9a81a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a8104d00 0x7fe9a81a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 -- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9a8104360 msgr2=0x7fe9a819f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9a8104360 0x7fe9a819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 -- 172.21.15.73:0/1695821143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a81a2450 con 0x7fe9a8103230 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a77fe700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8103230 0x7fe9a8076450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c970 tx=0x7fe99800cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a4ff9700 1 -- 172.21.15.73:0/1695821143 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998004220 con 0x7fe9a8103230 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a81a2740 con 0x7fe9a8103230 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a4ff9700 1 -- 172.21.15.73:0/1695821143 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe998007db0 con 0x7fe9a8103230 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a81a2d50 con 0x7fe9a8103230 2024-05-14T12:17:54.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.821+0000 7fe9a4ff9700 1 -- 172.21.15.73:0/1695821143 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998003d00 con 0x7fe9a8103230 2024-05-14T12:17:54.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.822+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a80512c0 con 0x7fe9a8103230 2024-05-14T12:17:54.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.824+0000 7fe9a4ff9700 1 -- 172.21.15.73:0/1695821143 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe998007900 con 0x7fe9a8103230 2024-05-14T12:17:54.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.824+0000 7fe9a4ff9700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe9940b2880 0x7fe9940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:17:54.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.825+0000 7fe9a4ff9700 1 -- 172.21.15.73:0/1695821143 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5397+0+0 (secure 0 0 0) 0x7fe9980e1700 con 0x7fe9a8103230 2024-05-14T12:17:54.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.825+0000 7fe9a6ffd700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe9940b2880 0x7fe9940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:17:54.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.826+0000 7fe9a6ffd700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe9940b2880 0x7fe9940b4d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8075e00 tx=0x7fe990006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:17:54.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:54.828+0000 7fe9a4ff9700 1 -- 172.21.15.73:0/1695821143 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe998014030 con 0x7fe9a8103230 2024-05-14T12:17:54.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:54 smithi047 ceph-mon[31254]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:54.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:54 smithi047 ceph-mon[31254]: osdmap e51: 8 total, 8 up, 8 in 2024-05-14T12:17:55.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:54 smithi073 ceph-mon[35809]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:55.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:54 smithi073 ceph-mon[35809]: osdmap e51: 8 total, 8 up, 8 in 2024-05-14T12:17:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:17:55.044+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe9a8063c00 con 0x7fe9940b2880 2024-05-14T12:17:55.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:54 smithi066 ceph-mon[35981]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-14T12:17:55.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:54 smithi066 ceph-mon[35981]: osdmap e51: 8 total, 8 up, 8 in 2024-05-14T12:17:55.958 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:55 smithi073 ceph-mon[35809]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-14T12:17:55.958 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:55 smithi073 ceph-mon[35809]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:17:55.958 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:17:55.959 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:17:55.959 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:55.959 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:55 smithi073 ceph-mon[35809]: osdmap e52: 8 total, 8 up, 8 in 2024-05-14T12:17:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:55 smithi047 ceph-mon[31254]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-14T12:17:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:55 smithi047 ceph-mon[31254]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:17:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:17:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:17:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:55 smithi047 ceph-mon[31254]: osdmap e52: 8 total, 8 up, 8 in 2024-05-14T12:17:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:55 smithi066 ceph-mon[35981]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-14T12:17:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:55 smithi066 ceph-mon[35981]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:17:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:17:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:17:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:17:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:55 smithi066 ceph-mon[35981]: osdmap e52: 8 total, 8 up, 8 in 2024-05-14T12:17:56.964 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:56 smithi073 ceph-mon[35809]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:17:56.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:56 smithi047 ceph-mon[31254]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:17:57.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:56 smithi066 ceph-mon[35981]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:17:58.207 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:57 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/862674966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]: dispatch 2024-05-14T12:17:58.207 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:57 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]: dispatch 2024-05-14T12:17:58.207 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:57 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]': finished 2024-05-14T12:17:58.207 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:57 smithi073 ceph-mon[35809]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T12:17:58.207 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:17:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:57 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/862674966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]: dispatch 2024-05-14T12:17:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:57 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]: dispatch 2024-05-14T12:17:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:57 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]': finished 2024-05-14T12:17:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:57 smithi047 ceph-mon[31254]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T12:17:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:17:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:57 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/862674966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]: dispatch 2024-05-14T12:17:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:57 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]: dispatch 2024-05-14T12:17:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:57 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8df95850-ff70-4fb9-a2c4-bcd51a5e3762"}]': finished 2024-05-14T12:17:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:57 smithi066 ceph-mon[35981]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T12:17:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:17:59.226 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:58 smithi066 ceph-mon[35981]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:17:59.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:17:58 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/1785167158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:59.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:58 smithi047 ceph-mon[31254]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:17:59.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:17:58 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/1785167158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:17:59.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:58 smithi073 ceph-mon[35809]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:17:59.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:17:58 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/1785167158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:18:00.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:00 smithi066 ceph-mon[35981]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-14T12:18:00.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:00 smithi066 ceph-mon[35981]: Cluster is now healthy 2024-05-14T12:18:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:00 smithi047 ceph-mon[31254]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-14T12:18:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:00 smithi047 ceph-mon[31254]: Cluster is now healthy 2024-05-14T12:18:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:00 smithi073 ceph-mon[35809]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-14T12:18:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:00 smithi073 ceph-mon[35809]: Cluster is now healthy 2024-05-14T12:18:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:01 smithi066 ceph-mon[35981]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-14T12:18:01.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:01 smithi047 ceph-mon[31254]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-14T12:18:01.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:01 smithi073 ceph-mon[35809]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-14T12:18:03.356 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:03 smithi073 ceph-mon[35809]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 153 KiB/s, 0 objects/s recovering 2024-05-14T12:18:03.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:03 smithi066 ceph-mon[35981]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 153 KiB/s, 0 objects/s recovering 2024-05-14T12:18:03.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:03 smithi047 ceph-mon[31254]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 153 KiB/s, 0 objects/s recovering 2024-05-14T12:18:05.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:05 smithi073 ceph-mon[35809]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-14T12:18:05.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:05 smithi066 ceph-mon[35981]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-14T12:18:05.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:05 smithi047 ceph-mon[31254]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-05-14T12:18:06.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:06 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T12:18:06.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:06 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:06.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:06 smithi066 ceph-mon[35981]: Deploying daemon osd.8 on smithi073 2024-05-14T12:18:06.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:06 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T12:18:06.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:06 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:06.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:06 smithi047 ceph-mon[31254]: Deploying daemon osd.8 on smithi073 2024-05-14T12:18:06.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:06 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T12:18:06.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:06 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:06.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:06 smithi073 ceph-mon[35809]: Deploying daemon osd.8 on smithi073 2024-05-14T12:18:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:07 smithi066 ceph-mon[35981]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T12:18:07.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:07 smithi073 ceph-mon[35809]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T12:18:07.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:07 smithi047 ceph-mon[31254]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-14T12:18:09.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:09 smithi073 ceph-mon[35809]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-05-14T12:18:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:09 smithi066 ceph-mon[35981]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-05-14T12:18:09.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:09 smithi047 ceph-mon[31254]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-05-14T12:18:11.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:11 smithi066 ceph-mon[35981]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:18:11.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:11 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:11.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:11 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:11.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:11 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:11.698 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:11 smithi073 ceph-mon[35809]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:18:11.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:11 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:11.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:11 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:11.699 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:11 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:11 smithi047 ceph-mon[31254]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:18:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:11 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:11 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:11 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:13.591 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:13 smithi073 ceph-mon[35809]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:13.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:13 smithi047 ceph-mon[31254]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:13.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:13 smithi066 ceph-mon[35981]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:14.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.934+0000 7fe9a4ff9700 1 -- 172.21.15.73:0/1695821143 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe9a8063c00 con 0x7fe9940b2880 2024-05-14T12:18:14.935 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 8 on host 'smithi073' 2024-05-14T12:18:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe9940b2880 msgr2=0x7fe9940b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe9940b2880 0x7fe9940b4d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8075e00 tx=0x7fe990006d20 comp rx=0 tx=0).stop 2024-05-14T12:18:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8103230 msgr2=0x7fe9a8076450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8103230 0x7fe9a8076450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c970 tx=0x7fe99800cd30 comp rx=0 tx=0).stop 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 shutdown_connections 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe9940b2880 0x7fe9940b4d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a8104d00 0x7fe9a81a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a8103230 0x7fe9a8076450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 --2- 172.21.15.73:0/1695821143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9a8104360 0x7fe9a819f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 >> 172.21.15.73:0/1695821143 conn(0x7fe9a80fe890 msgr2=0x7fe9a8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 shutdown_connections 2024-05-14T12:18:14.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:18:14.938+0000 7fe9adf6c700 1 -- 172.21.15.73:0/1695821143 wait complete. 2024-05-14T12:18:15.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:15.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:15.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:14 smithi047 ceph-mon[31254]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:15.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:15.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:14 smithi073 ceph-mon[35809]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:15.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:14 smithi066 ceph-mon[35981]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.576 DEBUG:teuthology.orchestra.run.smithi073:osd.8> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.8.service 2024-05-14T12:18:15.578 INFO:tasks.cephadm:Deploying osd.9 on smithi047 with /dev/vg_nvme/lv_1... 2024-05-14T12:18:15.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T12:18:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:15 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:15 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:15 smithi047 ceph-mon[31254]: from='osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T12:18:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:15 smithi047 ceph-mon[31254]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T12:18:16.042 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:18:16.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:15 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:16.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:15 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:16.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:15 smithi073 ceph-mon[35809]: from='osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T12:18:16.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:15 smithi073 ceph-mon[35809]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T12:18:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:15 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:15 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:15 smithi066 ceph-mon[35981]: from='osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T12:18:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:15 smithi066 ceph-mon[35981]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T12:18:17.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:16 smithi047 ceph-mon[31254]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T12:18:17.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:16 smithi047 ceph-mon[31254]: from='osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:18:17.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:16 smithi047 ceph-mon[31254]: osdmap e54: 9 total, 8 up, 9 in 2024-05-14T12:18:17.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:16 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:17.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:16 smithi047 ceph-mon[31254]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:18:17.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:16 smithi047 ceph-mon[31254]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:17.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:16 smithi073 ceph-mon[35809]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T12:18:17.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:16 smithi073 ceph-mon[35809]: from='osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:18:17.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:16 smithi073 ceph-mon[35809]: osdmap e54: 9 total, 8 up, 9 in 2024-05-14T12:18:17.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:16 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:17.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:16 smithi073 ceph-mon[35809]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:18:17.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:16 smithi073 ceph-mon[35809]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:17.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:16 smithi066 ceph-mon[35981]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T12:18:17.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:16 smithi066 ceph-mon[35981]: from='osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:18:17.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:16 smithi066 ceph-mon[35981]: osdmap e54: 9 total, 8 up, 9 in 2024-05-14T12:18:17.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:16 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:17.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:16 smithi066 ceph-mon[35981]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:18:17.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:16 smithi066 ceph-mon[35981]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: osdmap e55: 9 total, 8 up, 9 in 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: from='osd.8 ' entity='osd.8' 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: osdmap e56: 9 total, 8 up, 9 in 2024-05-14T12:18:18.155 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:18.156 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:18:17 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8[54576]: 2024-05-14T12:18:17.895+0000 7f62112ff700 -1 osd.8 0 waiting for initial osdmap 2024-05-14T12:18:18.156 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:18:17 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8[54576]: 2024-05-14T12:18:17.989+0000 7f62090ac700 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:18:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:18:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:18:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:18:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: osdmap e55: 9 total, 8 up, 9 in 2024-05-14T12:18:18.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:18.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: from='osd.8 ' entity='osd.8' 2024-05-14T12:18:18.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: osdmap e56: 9 total, 8 up, 9 in 2024-05-14T12:18:18.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:18:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:18:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:18:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: osdmap e55: 9 total, 8 up, 9 in 2024-05-14T12:18:18.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:18.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: from='osd.8 ' entity='osd.8' 2024-05-14T12:18:18.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: osdmap e56: 9 total, 8 up, 9 in 2024-05-14T12:18:18.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T12:18:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T12:18:18.968 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-05-14T12:18:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-05-14T12:18:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0406507 s, 258 MB/s 2024-05-14T12:18:18.968 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-05-14T12:18:19.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:19.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi073 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi073 to 5696M 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] boot 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: osdmap e57: 9 total, 9 up, 9 in 2024-05-14T12:18:19.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:19.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi073 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi073 to 5696M 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:19.754 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:19.755 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.755 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] boot 2024-05-14T12:18:19.755 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: osdmap e57: 9 total, 9 up, 9 in 2024-05-14T12:18:19.755 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-14T12:18:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi073 2024-05-14T12:18:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi073 to 5696M 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: osd.8 [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] boot 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: osdmap e57: 9 total, 9 up, 9 in 2024-05-14T12:18:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T12:18:19.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_1 2024-05-14T12:18:20.293 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:18:21.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:20 smithi047 ceph-mon[31254]: osdmap e58: 9 total, 9 up, 9 in 2024-05-14T12:18:21.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:20 smithi047 ceph-mon[31254]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:20 smithi073 ceph-mon[35809]: osdmap e58: 9 total, 9 up, 9 in 2024-05-14T12:18:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:20 smithi073 ceph-mon[35809]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:21.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:20 smithi066 ceph-mon[35981]: osdmap e58: 9 total, 9 up, 9 in 2024-05-14T12:18:21.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:20 smithi066 ceph-mon[35981]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:22.073 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:21 smithi047 ceph-mon[31254]: osdmap e59: 9 total, 9 up, 9 in 2024-05-14T12:18:22.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:21 smithi073 ceph-mon[35809]: osdmap e59: 9 total, 9 up, 9 in 2024-05-14T12:18:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:21 smithi066 ceph-mon[35981]: osdmap e59: 9 total, 9 up, 9 in 2024-05-14T12:18:22.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 -- 172.21.15.47:0/4229207447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 msgr2=0x7f292c077690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 --2- 172.21.15.47:0/4229207447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c077690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f29180098f0 tx=0x7f2918009c00 comp rx=0 tx=0).stop 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 -- 172.21.15.47:0/4229207447 shutdown_connections 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 --2- 172.21.15.47:0/4229207447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f292c10c220 0x7f292c10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 --2- 172.21.15.47:0/4229207447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f292c0787f0 0x7f292c076cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 --2- 172.21.15.47:0/4229207447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c077690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 -- 172.21.15.47:0/4229207447 >> 172.21.15.47:0/4229207447 conn(0x7f292c0ff9d0 msgr2=0x7f292c101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 -- 172.21.15.47:0/4229207447 shutdown_connections 2024-05-14T12:18:22.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.610+0000 7f2933400700 1 -- 172.21.15.47:0/4229207447 wait complete. 2024-05-14T12:18:22.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.611+0000 7f2933400700 1 Processor -- start 2024-05-14T12:18:22.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.611+0000 7f2933400700 1 -- start start 2024-05-14T12:18:22.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2933400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:22.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2933400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f292c0787f0 0x7f292c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:22.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2933400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f292c10c220 0x7f292c1a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:22.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2933400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f292c111fd0 con 0x7f292c0787f0 2024-05-14T12:18:22.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2933400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f292c111e50 con 0x7f292c10c220 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2933400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f292c112150 con 0x7f292c077200 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2930a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2930a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56490/0 (socket says 172.21.15.47:56490) 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2930a00700 1 -- 172.21.15.47:0/1235289151 learned_addr learned my addr 172.21.15.47:0/1235289151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2923e00700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f292c0787f0 0x7f292c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.612+0000 7f2931400700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f292c10c220 0x7f292c1a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2930a00700 1 -- 172.21.15.47:0/1235289151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f292c10c220 msgr2=0x7f292c1a3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2930a00700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f292c10c220 0x7f292c1a3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2930a00700 1 -- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f292c0787f0 msgr2=0x7f292c19d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2930a00700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f292c0787f0 0x7f292c19d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2930a00700 1 -- 172.21.15.47:0/1235289151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c1a4670 con 0x7f292c077200 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2923e00700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f292c0787f0 0x7f292c19d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2930a00700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c19cb10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f291000e970 tx=0x7f291000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:18:22.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f292a000700 1 -- 172.21.15.47:0/1235289151 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291000cbd0 con 0x7f292c077200 2024-05-14T12:18:22.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f292a000700 1 -- 172.21.15.47:0/1235289151 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f291000cd70 con 0x7f292c077200 2024-05-14T12:18:22.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c1a4960 con 0x7f292c077200 2024-05-14T12:18:22.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f292a000700 1 -- 172.21.15.47:0/1235289151 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910010430 con 0x7f292c077200 2024-05-14T12:18:22.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.613+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1a4ef0 con 0x7f292c077200 2024-05-14T12:18:22.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.615+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c0512c0 con 0x7f292c077200 2024-05-14T12:18:22.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.617+0000 7f292a000700 1 -- 172.21.15.47:0/1235289151 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2910004d70 con 0x7f292c077200 2024-05-14T12:18:22.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.619+0000 7f292a000700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29080b2900 0x7f29080b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:22.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.619+0000 7f292a000700 1 -- 172.21.15.47:0/1235289151 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5829+0+0 (secure 0 0 0) 0x7f29100e1b30 con 0x7f292c077200 2024-05-14T12:18:22.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.619+0000 7f2923e00700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29080b2900 0x7f29080b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:18:22.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.620+0000 7f2923e00700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29080b2900 0x7f29080b4e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29180098c0 tx=0x7f2918019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:18:22.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.621+0000 7f292a000700 1 -- 172.21.15.47:0/1235289151 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f29100aa160 con 0x7f292c077200 2024-05-14T12:18:22.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:22.870+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f292c063c00 con 0x7f29080b2900 2024-05-14T12:18:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:22 smithi047 ceph-mon[31254]: pgmap v221: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:18:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:18:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:23.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:22 smithi073 ceph-mon[35809]: pgmap v221: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:23.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:18:23.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:18:23.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:22 smithi066 ceph-mon[35981]: pgmap v221: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:18:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:18:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:24.159 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:23 smithi047 ceph-mon[31254]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:18:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:23 smithi073 ceph-mon[35809]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:18:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:23 smithi066 ceph-mon[35981]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:18:25.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:24 smithi047 ceph-mon[31254]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:25.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:24 smithi073 ceph-mon[35809]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:25.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:24 smithi066 ceph-mon[35981]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:27.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:27 smithi073 ceph-mon[35809]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-14T12:18:27.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:27 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3790659557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be5d9c5f-765b-43b6-a77c-8976ed5a443e"}]: dispatch 2024-05-14T12:18:27.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:27 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3790659557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be5d9c5f-765b-43b6-a77c-8976ed5a443e"}]': finished 2024-05-14T12:18:27.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:27 smithi073 ceph-mon[35809]: osdmap e60: 10 total, 9 up, 10 in 2024-05-14T12:18:27.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:27 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:27 smithi066 ceph-mon[35981]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-14T12:18:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:27 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3790659557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be5d9c5f-765b-43b6-a77c-8976ed5a443e"}]: dispatch 2024-05-14T12:18:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:27 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3790659557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be5d9c5f-765b-43b6-a77c-8976ed5a443e"}]': finished 2024-05-14T12:18:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:27 smithi066 ceph-mon[35981]: osdmap e60: 10 total, 9 up, 10 in 2024-05-14T12:18:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:27 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:27 smithi047 ceph-mon[31254]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-14T12:18:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:27 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3790659557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be5d9c5f-765b-43b6-a77c-8976ed5a443e"}]: dispatch 2024-05-14T12:18:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:27 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3790659557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be5d9c5f-765b-43b6-a77c-8976ed5a443e"}]': finished 2024-05-14T12:18:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:27 smithi047 ceph-mon[31254]: osdmap e60: 10 total, 9 up, 10 in 2024-05-14T12:18:27.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:27 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:28.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:28 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1439483721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:18:28.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:28 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1439483721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:18:28.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:28 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1439483721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:18:29.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:29 smithi066 ceph-mon[35981]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:18:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:29 smithi047 ceph-mon[31254]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:18:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:29 smithi073 ceph-mon[35809]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:18:31.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:31 smithi066 ceph-mon[35981]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T12:18:31.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:31 smithi047 ceph-mon[31254]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T12:18:31.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:31 smithi073 ceph-mon[35809]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T12:18:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:33 smithi066 ceph-mon[35981]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:18:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:33 smithi047 ceph-mon[31254]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:18:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:33 smithi073 ceph-mon[35809]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:18:35.529 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:35 smithi047 ceph-mon[31254]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:18:35.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:35 smithi066 ceph-mon[35981]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:35 smithi073 ceph-mon[35809]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:18:37.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:37 smithi066 ceph-mon[35981]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:37.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T12:18:37.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:37.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:37 smithi047 ceph-mon[31254]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:37.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T12:18:37.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:37 smithi073 ceph-mon[35809]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T12:18:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:38.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:38 smithi066 ceph-mon[35981]: Deploying daemon osd.9 on smithi047 2024-05-14T12:18:38.726 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:38 smithi047 ceph-mon[31254]: Deploying daemon osd.9 on smithi047 2024-05-14T12:18:38.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:38 smithi073 ceph-mon[35809]: Deploying daemon osd.9 on smithi047 2024-05-14T12:18:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:39 smithi047 ceph-mon[31254]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:39.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:39 smithi066 ceph-mon[35981]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:39.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:39 smithi073 ceph-mon[35809]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:41.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:41 smithi066 ceph-mon[35981]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:41.718 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:41 smithi047 ceph-mon[31254]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:41.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:41 smithi073 ceph-mon[35809]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:43.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:43 smithi066 ceph-mon[35981]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:43.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:43 smithi047 ceph-mon[31254]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:43.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:43 smithi073 ceph-mon[35809]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:45 smithi066 ceph-mon[35981]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:45.720 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:45 smithi047 ceph-mon[31254]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:45 smithi073 ceph-mon[35809]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:47.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:47 smithi047 ceph-mon[31254]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:47.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:47.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:47.419 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:47 smithi073 ceph-mon[35809]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:47.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:47.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:47 smithi066 ceph-mon[35981]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:47.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:47.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:47.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:49 smithi047 ceph-mon[31254]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:49 smithi073 ceph-mon[35809]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:49 smithi066 ceph-mon[35981]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:51.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:51.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:51.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:50 smithi047 ceph-mon[31254]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:51.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:50 smithi047 ceph-mon[31254]: from='osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T12:18:51.173 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:50 smithi047 ceph-mon[31254]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T12:18:51.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:51.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:51.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:50 smithi073 ceph-mon[35809]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:51.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:50 smithi073 ceph-mon[35809]: from='osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T12:18:51.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:50 smithi073 ceph-mon[35809]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T12:18:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:50 smithi066 ceph-mon[35981]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:50 smithi066 ceph-mon[35981]: from='osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T12:18:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:50 smithi066 ceph-mon[35981]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T12:18:51.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.680+0000 7f292a000700 1 -- 172.21.15.47:0/1235289151 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f292c063c00 con 0x7f29080b2900 2024-05-14T12:18:51.682 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 9 on host 'smithi047' 2024-05-14T12:18:51.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29080b2900 msgr2=0x7f29080b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:51.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29080b2900 0x7f29080b4e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29180098c0 tx=0x7f2918019040 comp rx=0 tx=0).stop 2024-05-14T12:18:51.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 msgr2=0x7f292c19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:51.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c19cb10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f291000e970 tx=0x7f291000ed30 comp rx=0 tx=0).stop 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 shutdown_connections 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29080b2900 0x7f29080b4e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f292c10c220 0x7f292c1a3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f292c077200 0x7f292c19cb10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 --2- 172.21.15.47:0/1235289151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f292c0787f0 0x7f292c19d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.684+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 >> 172.21.15.47:0/1235289151 conn(0x7f292c0ff9d0 msgr2=0x7f292c1081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.685+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 shutdown_connections 2024-05-14T12:18:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:18:51.685+0000 7f2933400700 1 -- 172.21.15.47:0/1235289151 wait complete. 2024-05-14T12:18:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: osdmap e61: 10 total, 9 up, 10 in 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: osdmap e61: 10 total, 9 up, 10 in 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: osdmap e61: 10 total, 9 up, 10 in 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:52.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:18:52.503 DEBUG:teuthology.orchestra.run.smithi047:osd.9> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.9.service 2024-05-14T12:18:52.507 INFO:tasks.cephadm:Deploying osd.10 on smithi066 with /dev/vg_nvme/lv_1... 2024-05-14T12:18:52.507 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T12:18:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:18:53.033 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:52 smithi047 ceph-mon[31254]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:18:53.033 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:52 smithi047 ceph-mon[31254]: osdmap e62: 10 total, 9 up, 10 in 2024-05-14T12:18:53.033 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:53.033 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:53.033 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:52 smithi047 ceph-mon[31254]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:53.200 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:52 smithi066 ceph-mon[35981]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:18:53.200 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:52 smithi066 ceph-mon[35981]: osdmap e62: 10 total, 9 up, 10 in 2024-05-14T12:18:53.200 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:53.200 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:53.200 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:52 smithi066 ceph-mon[35981]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:53.255 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:52 smithi073 ceph-mon[35809]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-05-14T12:18:53.255 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:52 smithi073 ceph-mon[35809]: osdmap e62: 10 total, 9 up, 10 in 2024-05-14T12:18:53.255 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:53.255 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:53.255 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:52 smithi073 ceph-mon[35809]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-14T12:18:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:53 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:18:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:53 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:18:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:53 smithi066 ceph-mon[35981]: osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] boot 2024-05-14T12:18:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:53 smithi066 ceph-mon[35981]: osdmap e63: 10 total, 10 up, 10 in 2024-05-14T12:18:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:54.220 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:53 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:18:54.221 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:53 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:18:54.221 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:53 smithi047 ceph-mon[31254]: osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] boot 2024-05-14T12:18:54.221 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:53 smithi047 ceph-mon[31254]: osdmap e63: 10 total, 10 up, 10 in 2024-05-14T12:18:54.221 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:53 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:18:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:53 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:18:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:53 smithi073 ceph-mon[35809]: osd.9 [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] boot 2024-05-14T12:18:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:53 smithi073 ceph-mon[35809]: osdmap e63: 10 total, 10 up, 10 in 2024-05-14T12:18:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T12:18:54.689 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T12:18:54.689 INFO:teuthology.orchestra.run.smithi066.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T12:18:54.689 INFO:teuthology.orchestra.run.smithi066.stderr: stderr: 10+0 records in 2024-05-14T12:18:54.690 INFO:teuthology.orchestra.run.smithi066.stderr:10+0 records out 2024-05-14T12:18:54.690 INFO:teuthology.orchestra.run.smithi066.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112569 s, 931 MB/s 2024-05-14T12:18:54.690 INFO:teuthology.orchestra.run.smithi066.stderr:--> Zapping successful for: 2024-05-14T12:18:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:54 smithi047 ceph-mon[31254]: osdmap e64: 10 total, 10 up, 10 in 2024-05-14T12:18:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:54 smithi047 ceph-mon[31254]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:54 smithi073 ceph-mon[35809]: osdmap e64: 10 total, 10 up, 10 in 2024-05-14T12:18:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:54 smithi073 ceph-mon[35809]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:55.295 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:54 smithi066 ceph-mon[35981]: osdmap e64: 10 total, 10 up, 10 in 2024-05-14T12:18:55.295 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:54 smithi066 ceph-mon[35981]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:55.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_1 2024-05-14T12:18:55.576 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:18:57.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 -- 172.21.15.66:0/588041516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20104360 msgr2=0x7fce20104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:57.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 --2- 172.21.15.66:0/588041516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20104360 0x7fce20104770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce08009990 tx=0x7fce08009ca0 comp rx=0 tx=0).stop 2024-05-14T12:18:57.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 -- 172.21.15.66:0/588041516 shutdown_connections 2024-05-14T12:18:57.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 --2- 172.21.15.66:0/588041516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce20104d00 0x7fce2010b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:57.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 --2- 172.21.15.66:0/588041516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20103230 0x7fce20103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:57.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 --2- 172.21.15.66:0/588041516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20104360 0x7fce20104770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:57.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 -- 172.21.15.66:0/588041516 >> 172.21.15.66:0/588041516 conn(0x7fce200fe890 msgr2=0x7fce20100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:18:57.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 -- 172.21.15.66:0/588041516 shutdown_connections 2024-05-14T12:18:57.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.196+0000 7fce253d4700 1 -- 172.21.15.66:0/588041516 wait complete. 2024-05-14T12:18:57.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 Processor -- start 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 -- start start 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20103230 0x7fce2019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20104360 0x7fce2019af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce20104d00 0x7fce201a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fce2010fe60 con 0x7fce20104360 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fce2010fce0 con 0x7fce20103230 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce253d4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fce2010ffe0 con 0x7fce20104d00 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.197+0000 7fce1effd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20103230 0x7fce2019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20103230 0x7fce2019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59118/0 (socket says 172.21.15.66:59118) 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 -- 172.21.15.66:0/3398953968 learned_addr learned my addr 172.21.15.66:0/3398953968 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1f7fe700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce20104d00 0x7fce201a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 -- 172.21.15.66:0/3398953968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce20104d00 msgr2=0x7fce201a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce20104d00 0x7fce201a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:57.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 -- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20104360 msgr2=0x7fce2019af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20104360 0x7fce2019af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 -- 172.21.15.66:0/3398953968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201a2560 con 0x7fce20103230 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce1effd700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20103230 0x7fce2019aa00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce1800b990 tx=0x7fce1800bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce17fff700 1 -- 172.21.15.66:0/3398953968 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18019070 con 0x7fce20103230 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce17fff700 1 -- 172.21.15.66:0/3398953968 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce18014440 con 0x7fce20103230 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201a2850 con 0x7fce20103230 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce17fff700 1 -- 172.21.15.66:0/3398953968 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18012580 con 0x7fce20103230 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.198+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201a2de0 con 0x7fce20103230 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.199+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce200512c0 con 0x7fce20103230 2024-05-14T12:18:57.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.201+0000 7fce17fff700 1 -- 172.21.15.66:0/3398953968 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fce1801c070 con 0x7fce20103230 2024-05-14T12:18:57.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.202+0000 7fce17fff700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fce0c0b2900 0x7fce0c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:18:57.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.202+0000 7fce17fff700 1 -- 172.21.15.66:0/3398953968 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6261+0+0 (secure 0 0 0) 0x7fce180e11f0 con 0x7fce20103230 2024-05-14T12:18:57.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.202+0000 7fce1e7fc700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fce0c0b2900 0x7fce0c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:18:57.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.203+0000 7fce1e7fc700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fce0c0b2900 0x7fce0c0b4e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce08006010 tx=0x7fce08003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:18:57.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.206+0000 7fce17fff700 1 -- 172.21.15.66:0/3398953968 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fce180a9710 con 0x7fce20103230 2024-05-14T12:18:57.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:18:57.437+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fce20063c00 con 0x7fce0c0b2900 2024-05-14T12:18:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:57 smithi066 ceph-mon[35981]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:57.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:57 smithi047 ceph-mon[31254]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:57.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:57 smithi073 ceph-mon[35809]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:58.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi047 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi047 to 4273M 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:18:58.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:18:58.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi047 2024-05-14T12:18:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi047 to 4273M 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:18:58.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi047 2024-05-14T12:18:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi047 to 4273M 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:18:58.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:18:59.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:18:59 smithi047 ceph-mon[31254]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:18:59 smithi073 ceph-mon[35809]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:18:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:18:59 smithi066 ceph-mon[35981]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:00 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/3531893154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]: dispatch 2024-05-14T12:19:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:00 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]: dispatch 2024-05-14T12:19:00.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:00 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]': finished 2024-05-14T12:19:00.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:00 smithi047 ceph-mon[31254]: osdmap e65: 11 total, 10 up, 11 in 2024-05-14T12:19:00.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:00 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/3531893154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]: dispatch 2024-05-14T12:19:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:00 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]: dispatch 2024-05-14T12:19:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:00 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]': finished 2024-05-14T12:19:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:00 smithi073 ceph-mon[35809]: osdmap e65: 11 total, 10 up, 11 in 2024-05-14T12:19:00.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:00.768 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:00 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/3531893154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]: dispatch 2024-05-14T12:19:00.768 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:00 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]: dispatch 2024-05-14T12:19:00.768 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:00 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248e33b6-d8dd-49ac-9ec5-f9b0741b49b2"}]': finished 2024-05-14T12:19:00.769 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:00 smithi066 ceph-mon[35981]: osdmap e65: 11 total, 10 up, 11 in 2024-05-14T12:19:00.769 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:01.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:01 smithi047 ceph-mon[31254]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:01.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:01 smithi047 ceph-mon[31254]: from='client.? 172.21.15.66:0/1839184137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:01 smithi073 ceph-mon[35809]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:01 smithi073 ceph-mon[35809]: from='client.? 172.21.15.66:0/1839184137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:19:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:01 smithi066 ceph-mon[35981]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:01 smithi066 ceph-mon[35981]: from='client.? 172.21.15.66:0/1839184137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:19:03.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:03 smithi047 ceph-mon[31254]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:03.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:03 smithi073 ceph-mon[35809]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:03 smithi066 ceph-mon[35981]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:05.476 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:05 smithi066 ceph-mon[35981]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:05.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:05 smithi047 ceph-mon[31254]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:05.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:05 smithi073 ceph-mon[35809]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:07.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:07 smithi047 ceph-mon[31254]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:07 smithi073 ceph-mon[35809]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:07.816 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:07 smithi066 ceph-mon[35981]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:08.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:08 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T12:19:08.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:08 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:08.785 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:08 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T12:19:08.786 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:08 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:08.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:08 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T12:19:08.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:08 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:09 smithi066 ceph-mon[35981]: Deploying daemon osd.10 on smithi066 2024-05-14T12:19:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:09 smithi066 ceph-mon[35981]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:09 smithi073 ceph-mon[35809]: Deploying daemon osd.10 on smithi066 2024-05-14T12:19:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:09 smithi073 ceph-mon[35809]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:09.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:09 smithi047 ceph-mon[31254]: Deploying daemon osd.10 on smithi066 2024-05-14T12:19:09.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:09 smithi047 ceph-mon[31254]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:11.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:11 smithi066 ceph-mon[35981]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:11 smithi073 ceph-mon[35809]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:11.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:11 smithi047 ceph-mon[31254]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:13.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:13 smithi066 ceph-mon[35981]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:13 smithi047 ceph-mon[31254]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:14.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:13 smithi073 ceph-mon[35809]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:15 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:15 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:15 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:15.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:15 smithi066 ceph-mon[35981]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:15.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:15 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:15.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:15 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:15.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:15 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:15.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:15 smithi047 ceph-mon[31254]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:15.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:15 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:15.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:15 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:15.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:15 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:15.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:15 smithi073 ceph-mon[35809]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:17.475 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:17 smithi066 ceph-mon[35981]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:17.475 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.475 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.475 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:17.475 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:17.475 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:17 smithi047 ceph-mon[31254]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:17 smithi073 ceph-mon[35809]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:17.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.885+0000 7fce17fff700 1 -- 172.21.15.66:0/3398953968 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fce20063c00 con 0x7fce0c0b2900 2024-05-14T12:19:17.885 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 10 on host 'smithi066' 2024-05-14T12:19:17.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fce0c0b2900 msgr2=0x7fce0c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fce0c0b2900 0x7fce0c0b4e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce08006010 tx=0x7fce08003790 comp rx=0 tx=0).stop 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20103230 msgr2=0x7fce2019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20103230 0x7fce2019aa00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce1800b990 tx=0x7fce1800bd50 comp rx=0 tx=0).stop 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 shutdown_connections 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fce0c0b2900 0x7fce0c0b4e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce20104d00 0x7fce201a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce20103230 0x7fce2019aa00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 --2- 172.21.15.66:0/3398953968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20104360 0x7fce2019af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 >> 172.21.15.66:0/3398953968 conn(0x7fce200fe890 msgr2=0x7fce20107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 shutdown_connections 2024-05-14T12:19:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-05-14T12:19:17.887+0000 7fce253d4700 1 -- 172.21.15.66:0/3398953968 wait complete. 2024-05-14T12:19:18.472 DEBUG:teuthology.orchestra.run.smithi066:osd.10> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.10.service 2024-05-14T12:19:18.474 INFO:tasks.cephadm:Deploying osd.11 on smithi073 with /dev/vg_nvme/lv_1... 2024-05-14T12:19:18.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T12:19:18.718 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:19:19.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:18 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:19.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:18 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:19.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:18 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:19.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:18 smithi066 ceph-mon[35981]: from='osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T12:19:19.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:18 smithi066 ceph-mon[35981]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T12:19:19.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:18 smithi066 ceph-mon[35981]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:19.138 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:18 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:19.138 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:18 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:19.138 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:18 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:19.138 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:18 smithi073 ceph-mon[35809]: from='osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T12:19:19.138 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:18 smithi073 ceph-mon[35809]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T12:19:19.138 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:18 smithi073 ceph-mon[35809]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:19.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:18 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:19.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:18 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:19.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:18 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:19.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:18 smithi047 ceph-mon[31254]: from='osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T12:19:19.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:18 smithi047 ceph-mon[31254]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T12:19:19.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:18 smithi047 ceph-mon[31254]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:19.980 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:19 smithi066 ceph-mon[35981]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T12:19:19.980 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:19 smithi066 ceph-mon[35981]: from='osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:19:19.981 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:19 smithi066 ceph-mon[35981]: osdmap e66: 11 total, 10 up, 11 in 2024-05-14T12:19:19.981 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:19.981 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:19 smithi066 ceph-mon[35981]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:19:19.981 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:19:19 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:19:19.866+0000 7f4746173700 -1 osd.10 0 waiting for initial osdmap 2024-05-14T12:19:19.981 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:19:19 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:19:19.880+0000 7f4741f28700 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:19:20.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:19 smithi073 ceph-mon[35809]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T12:19:20.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:19 smithi073 ceph-mon[35809]: from='osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:19:20.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:19 smithi073 ceph-mon[35809]: osdmap e66: 11 total, 10 up, 11 in 2024-05-14T12:19:20.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:20.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:19 smithi073 ceph-mon[35809]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:19:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:19 smithi047 ceph-mon[31254]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T12:19:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:19 smithi047 ceph-mon[31254]: from='osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:19:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:19 smithi047 ceph-mon[31254]: osdmap e66: 11 total, 10 up, 11 in 2024-05-14T12:19:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:19 smithi047 ceph-mon[31254]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-05-14T12:19:20.677 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T12:19:20.677 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T12:19:20.677 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2024-05-14T12:19:20.677 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2024-05-14T12:19:20.677 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011418 s, 918 MB/s 2024-05-14T12:19:20.677 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2024-05-14T12:19:21.000 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:20 smithi066 ceph-mon[35981]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:19:21.000 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:20 smithi066 ceph-mon[35981]: osdmap e67: 11 total, 10 up, 11 in 2024-05-14T12:19:21.000 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:21.000 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:20 smithi066 ceph-mon[35981]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:21.000 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:20 smithi066 ceph-mon[35981]: osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] boot 2024-05-14T12:19:21.000 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:20 smithi066 ceph-mon[35981]: osdmap e68: 11 total, 11 up, 11 in 2024-05-14T12:19:21.000 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:21.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:20 smithi047 ceph-mon[31254]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:19:21.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:20 smithi047 ceph-mon[31254]: osdmap e67: 11 total, 10 up, 11 in 2024-05-14T12:19:21.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:21.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:20 smithi047 ceph-mon[31254]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:21.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:20 smithi047 ceph-mon[31254]: osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] boot 2024-05-14T12:19:21.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:20 smithi047 ceph-mon[31254]: osdmap e68: 11 total, 11 up, 11 in 2024-05-14T12:19:21.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:20 smithi073 ceph-mon[35809]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-05-14T12:19:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:20 smithi073 ceph-mon[35809]: osdmap e67: 11 total, 10 up, 11 in 2024-05-14T12:19:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:20 smithi073 ceph-mon[35809]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-14T12:19:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:20 smithi073 ceph-mon[35809]: osd.10 [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] boot 2024-05-14T12:19:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:20 smithi073 ceph-mon[35809]: osdmap e68: 11 total, 11 up, 11 in 2024-05-14T12:19:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T12:19:21.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_1 2024-05-14T12:19:21.577 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi066 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi066 to 4272M 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:22.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:22.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:21 smithi047 ceph-mon[31254]: osdmap e69: 11 total, 11 up, 11 in 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi066 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi066 to 4272M 2024-05-14T12:19:22.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:22.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:22.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:21 smithi073 ceph-mon[35809]: osdmap e69: 11 total, 11 up, 11 in 2024-05-14T12:19:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:19:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:19:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi066 2024-05-14T12:19:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi066 to 4272M 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:22.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:21 smithi066 ceph-mon[35981]: osdmap e69: 11 total, 11 up, 11 in 2024-05-14T12:19:23.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4058396782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104d20 msgr2=0x7fe23410b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:23.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4058396782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104d20 0x7fe23410b5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00b0a0 tx=0x7fe22c00b3b0 comp rx=0 tx=0).stop 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4058396782 shutdown_connections 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4058396782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104d20 0x7fe23410b5d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4058396782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe234103250 0x7fe234103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4058396782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe234104380 0x7fe234104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4058396782 >> 172.21.15.73:0/4058396782 conn(0x7fe2340fe890 msgr2=0x7fe234100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4058396782 shutdown_connections 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.305+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4058396782 wait complete. 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 Processor -- start 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 -- start start 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe234103250 0x7fe234076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104380 0x7fe23419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:23.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe234104d20 0x7fe2341a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe23410edb0 con 0x7fe234103250 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe23410ec30 con 0x7fe234104d20 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23c2b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe23410ef30 con 0x7fe234104380 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104380 0x7fe23419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104380 0x7fe23419f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41254/0 (socket says 172.21.15.73:41254) 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 -- 172.21.15.73:0/4227774415 learned_addr learned my addr 172.21.15.73:0/4227774415 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23a852700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe234104d20 0x7fe2341a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 -- 172.21.15.73:0/4227774415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe234104d20 msgr2=0x7fe2341a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe234104d20 0x7fe2341a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:23.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 -- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe234103250 msgr2=0x7fe234076450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe234103250 0x7fe234076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 -- 172.21.15.73:0/4227774415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2341a2530 con 0x7fe234104380 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe23a852700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe234104d20 0x7fe2341a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.306+0000 7fe239850700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104380 0x7fe23419f790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe22400b530 tx=0x7fe22400b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.307+0000 7fe22b7fe700 1 -- 172.21.15.73:0/4227774415 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224015020 con 0x7fe234104380 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.307+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2341a2820 con 0x7fe234104380 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.307+0000 7fe22b7fe700 1 -- 172.21.15.73:0/4227774415 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe224011ce0 con 0x7fe234104380 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.307+0000 7fe22b7fe700 1 -- 172.21.15.73:0/4227774415 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224010d20 con 0x7fe234104380 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.307+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2341a2e30 con 0x7fe234104380 2024-05-14T12:19:23.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.308+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2340512c0 con 0x7fe234104380 2024-05-14T12:19:23.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.309+0000 7fe22b7fe700 1 -- 172.21.15.73:0/4227774415 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe224018020 con 0x7fe234104380 2024-05-14T12:19:23.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.310+0000 7fe22b7fe700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2200b2880 0x7fe2200b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:23.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.310+0000 7fe22b7fe700 1 -- 172.21.15.73:0/4227774415 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6694+0+0 (secure 0 0 0) 0x7fe2240e1940 con 0x7fe234104380 2024-05-14T12:19:23.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.310+0000 7fe23a051700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2200b2880 0x7fe2200b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:23.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.311+0000 7fe23a051700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2200b2880 0x7fe2200b4d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe234104280 tx=0x7fe230006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:23.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.313+0000 7fe22b7fe700 1 -- 172.21.15.73:0/4227774415 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe22401f020 con 0x7fe234104380 2024-05-14T12:19:23.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:23.526+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe234063c00 con 0x7fe2200b2880 2024-05-14T12:19:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:23 smithi047 ceph-mon[31254]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:23 smithi047 ceph-mon[31254]: osdmap e70: 11 total, 11 up, 11 in 2024-05-14T12:19:23.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:23 smithi073 ceph-mon[35809]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:23.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:23 smithi073 ceph-mon[35809]: osdmap e70: 11 total, 11 up, 11 in 2024-05-14T12:19:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:23 smithi066 ceph-mon[35981]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:23 smithi066 ceph-mon[35981]: osdmap e70: 11 total, 11 up, 11 in 2024-05-14T12:19:24.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:24 smithi047 ceph-mon[31254]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:19:24.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:19:24.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:19:24.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:24 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:24.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:24 smithi073 ceph-mon[35809]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:19:24.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:19:24.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:19:24.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:24 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:24 smithi066 ceph-mon[35981]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:19:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T12:19:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T12:19:24.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:24 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:25.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:25 smithi047 ceph-mon[31254]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:25.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:25 smithi073 ceph-mon[35809]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:25.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:25 smithi066 ceph-mon[35981]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:26 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/3285990433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]: dispatch 2024-05-14T12:19:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:26 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]: dispatch 2024-05-14T12:19:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:26 smithi047 ceph-mon[31254]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]': finished 2024-05-14T12:19:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:26 smithi047 ceph-mon[31254]: osdmap e71: 12 total, 11 up, 12 in 2024-05-14T12:19:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:26.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:26 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/3285990433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]: dispatch 2024-05-14T12:19:26.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:26 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]: dispatch 2024-05-14T12:19:26.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:26 smithi073 ceph-mon[35809]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]': finished 2024-05-14T12:19:26.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:26 smithi073 ceph-mon[35809]: osdmap e71: 12 total, 11 up, 12 in 2024-05-14T12:19:26.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:26 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/3285990433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]: dispatch 2024-05-14T12:19:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:26 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]: dispatch 2024-05-14T12:19:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:26 smithi066 ceph-mon[35981]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f80cffd5-cb0c-46c4-9cc3-704730531566"}]': finished 2024-05-14T12:19:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:26 smithi066 ceph-mon[35981]: osdmap e71: 12 total, 11 up, 12 in 2024-05-14T12:19:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:27 smithi047 ceph-mon[31254]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:19:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:27 smithi047 ceph-mon[31254]: from='client.? 172.21.15.73:0/917120919' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:19:27.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:27 smithi073 ceph-mon[35809]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:19:27.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:27 smithi073 ceph-mon[35809]: from='client.? 172.21.15.73:0/917120919' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:19:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:27 smithi066 ceph-mon[35981]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T12:19:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:27 smithi066 ceph-mon[35981]: from='client.? 172.21.15.73:0/917120919' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T12:19:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:29 smithi047 ceph-mon[31254]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T12:19:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:29 smithi073 ceph-mon[35809]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T12:19:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:29 smithi066 ceph-mon[35981]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-14T12:19:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:31 smithi047 ceph-mon[31254]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:19:31.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:31 smithi073 ceph-mon[35809]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:19:31.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:31 smithi066 ceph-mon[35981]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T12:19:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:33 smithi047 ceph-mon[31254]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T12:19:33.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:33 smithi073 ceph-mon[35809]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T12:19:33.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:33 smithi066 ceph-mon[35981]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T12:19:34.705 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:34 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T12:19:34.706 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:34 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:34.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:34 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T12:19:34.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:34 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:34.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:34 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T12:19:34.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:34 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:35.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:35 smithi073 ceph-mon[35809]: Deploying daemon osd.11 on smithi073 2024-05-14T12:19:35.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:35 smithi073 ceph-mon[35809]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:19:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:35 smithi066 ceph-mon[35981]: Deploying daemon osd.11 on smithi073 2024-05-14T12:19:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:35 smithi066 ceph-mon[35981]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:19:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:35 smithi047 ceph-mon[31254]: Deploying daemon osd.11 on smithi073 2024-05-14T12:19:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:35 smithi047 ceph-mon[31254]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T12:19:37.708 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:37 smithi073 ceph-mon[35809]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:37.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:37 smithi066 ceph-mon[35981]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:37.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:37 smithi047 ceph-mon[31254]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:39 smithi066 ceph-mon[35981]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:39.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:39.838 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:39 smithi073 ceph-mon[35809]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:39.838 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:39.838 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:39.838 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:39 smithi047 ceph-mon[31254]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:41.678 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:41 smithi073 ceph-mon[35809]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:41.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:41 smithi066 ceph-mon[35981]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:41.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:41 smithi047 ceph-mon[31254]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:42.815 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 11 on host 'smithi073' 2024-05-14T12:19:42.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.814+0000 7fe22b7fe700 1 -- 172.21.15.73:0/4227774415 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe234063c00 con 0x7fe2200b2880 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.816+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2200b2880 msgr2=0x7fe2200b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.816+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2200b2880 0x7fe2200b4d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe234104280 tx=0x7fe230006d20 comp rx=0 tx=0).stop 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104380 msgr2=0x7fe23419f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104380 0x7fe23419f790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe22400b530 tx=0x7fe22400b8f0 comp rx=0 tx=0).stop 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 shutdown_connections 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2200b2880 0x7fe2200b4d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe234104d20 0x7fe2341a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe234103250 0x7fe234076450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 --2- 172.21.15.73:0/4227774415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe234104380 0x7fe23419f790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:42.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 >> 172.21.15.73:0/4227774415 conn(0x7fe2340fe890 msgr2=0x7fe2341075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:42.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 shutdown_connections 2024-05-14T12:19:42.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:42.817+0000 7fe23c2b5700 1 -- 172.21.15.73:0/4227774415 wait complete. 2024-05-14T12:19:43.442 DEBUG:teuthology.orchestra.run.smithi073:osd.11> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.11.service 2024-05-14T12:19:43.444 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-14T12:19:43.444 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-14T12:19:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:43 smithi073 ceph-mon[35809]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:43 smithi073 ceph-mon[35809]: from='osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T12:19:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:43 smithi073 ceph-mon[35809]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T12:19:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:43 smithi066 ceph-mon[35981]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:43 smithi066 ceph-mon[35981]: from='osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T12:19:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:43 smithi066 ceph-mon[35981]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T12:19:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:19:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:43 smithi047 ceph-mon[31254]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:43 smithi047 ceph-mon[31254]: from='osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T12:19:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:43 smithi047 ceph-mon[31254]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T12:19:44.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:44.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:44.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:44 smithi047 ceph-mon[31254]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T12:19:44.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:44 smithi047 ceph-mon[31254]: from='osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:19:44.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:44 smithi047 ceph-mon[31254]: osdmap e72: 12 total, 11 up, 12 in 2024-05-14T12:19:44.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:44.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:44 smithi047 ceph-mon[31254]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:19:44.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:44.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:44.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:44 smithi073 ceph-mon[35809]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T12:19:44.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:44 smithi073 ceph-mon[35809]: from='osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:19:44.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:44 smithi073 ceph-mon[35809]: osdmap e72: 12 total, 11 up, 12 in 2024-05-14T12:19:44.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:44.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:44 smithi073 ceph-mon[35809]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:19:44.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:44.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:44.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:44 smithi066 ceph-mon[35981]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T12:19:44.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:44 smithi066 ceph-mon[35981]: from='osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:19:44.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:44 smithi066 ceph-mon[35981]: osdmap e72: 12 total, 11 up, 12 in 2024-05-14T12:19:44.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:44.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:44 smithi066 ceph-mon[35981]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-05-14T12:19:45.139 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:19:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:19:44.786+0000 7f5628285700 -1 osd.11 0 waiting for initial osdmap 2024-05-14T12:19:45.139 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:19:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:19:44.800+0000 7f562403a700 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T12:19:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:45 smithi073 ceph-mon[35809]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:45 smithi073 ceph-mon[35809]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:19:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:45 smithi073 ceph-mon[35809]: osdmap e73: 12 total, 11 up, 12 in 2024-05-14T12:19:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:45.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:45 smithi066 ceph-mon[35981]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:45.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:45 smithi066 ceph-mon[35981]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:19:45.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:45 smithi066 ceph-mon[35981]: osdmap e73: 12 total, 11 up, 12 in 2024-05-14T12:19:45.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:45.827 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:45.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:45 smithi047 ceph-mon[31254]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:45.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:45 smithi047 ceph-mon[31254]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-05-14T12:19:45.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:45 smithi047 ceph-mon[31254]: osdmap e73: 12 total, 11 up, 12 in 2024-05-14T12:19:45.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:45.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 -- 172.21.15.47:0/347099919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc0760f0 msgr2=0x7f29bc076580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 --2- 172.21.15.47:0/347099919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc0760f0 0x7f29bc076580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009990 tx=0x7f29a4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 -- 172.21.15.47:0/347099919 shutdown_connections 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 --2- 172.21.15.47:0/347099919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc10c1f0 0x7f29bc10e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 --2- 172.21.15.47:0/347099919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0776e0 0x7f29bc075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 --2- 172.21.15.47:0/347099919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc0760f0 0x7f29bc076580 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 -- 172.21.15.47:0/347099919 >> 172.21.15.47:0/347099919 conn(0x7f29bc0ff9c0 msgr2=0x7f29bc101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 -- 172.21.15.47:0/347099919 shutdown_connections 2024-05-14T12:19:46.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.204+0000 7f29c1200700 1 -- 172.21.15.47:0/347099919 wait complete. 2024-05-14T12:19:46.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.205+0000 7f29c1200700 1 Processor -- start 2024-05-14T12:19:46.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29c1200700 1 -- start start 2024-05-14T12:19:46.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29c1200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0760f0 0x7f29bc19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29c1200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc0776e0 0x7f29bc19d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29c1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc10c1f0 0x7f29bc1a4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29c1200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc111ff0 con 0x7f29bc10c1f0 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29c1200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc111e70 con 0x7f29bc0776e0 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29c1200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc112170 con 0x7f29bc0760f0 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29b9e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0760f0 0x7f29bc19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29b9e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0760f0 0x7f29bc19cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:41644/0 (socket says 172.21.15.47:41644) 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29b9e00700 1 -- 172.21.15.47:0/55069268 learned_addr learned my addr 172.21.15.47:0/55069268 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.206+0000 7f29b1400700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc0776e0 0x7f29bc19d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:46.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.207+0000 7f29ba800700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc10c1f0 0x7f29bc1a4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.207+0000 7f29b9e00700 1 -- 172.21.15.47:0/55069268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc0776e0 msgr2=0x7f29bc19d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.207+0000 7f29b9e00700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc0776e0 0x7f29bc19d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.207+0000 7f29b9e00700 1 -- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc10c1f0 msgr2=0x7f29bc1a4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.207+0000 7f29b9e00700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc10c1f0 0x7f29bc1a4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.207+0000 7f29b9e00700 1 -- 172.21.15.47:0/55069268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29bc1a46c0 con 0x7f29bc0760f0 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.207+0000 7f29b9e00700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0760f0 0x7f29bc19cb60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e970 tx=0x7f29ac00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.208+0000 7f29b3400700 1 -- 172.21.15.47:0/55069268 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac004a30 con 0x7f29bc0760f0 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.208+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29bc1a49b0 con 0x7f29bc0760f0 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.208+0000 7f29b3400700 1 -- 172.21.15.47:0/55069268 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29ac00cc90 con 0x7f29bc0760f0 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.208+0000 7f29b3400700 1 -- 172.21.15.47:0/55069268 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac005610 con 0x7f29bc0760f0 2024-05-14T12:19:46.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.208+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29bc1a4ef0 con 0x7f29bc0760f0 2024-05-14T12:19:46.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.209+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29bc0512c0 con 0x7f29bc0760f0 2024-05-14T12:19:46.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.211+0000 7f29b3400700 1 -- 172.21.15.47:0/55069268 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f29ac00c7e0 con 0x7f29bc0760f0 2024-05-14T12:19:46.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.213+0000 7f29b3400700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29a00b2880 0x7f29a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:46.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.213+0000 7f29b3400700 1 -- 172.21.15.47:0/55069268 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f29ac0e1fe0 con 0x7f29bc0760f0 2024-05-14T12:19:46.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.213+0000 7f29b1400700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29a00b2880 0x7f29a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:46.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.214+0000 7f29b1400700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29a00b2880 0x7f29a00b4d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29bc19dc10 tx=0x7f29a400b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:46.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.215+0000 7f29b3400700 1 -- 172.21.15.47:0/55069268 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f29ac0aa100 con 0x7f29bc0760f0 2024-05-14T12:19:46.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.457+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f29bc02e5f0 con 0x7f29bc0760f0 2024-05-14T12:19:46.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.458+0000 7f29b3400700 1 -- 172.21.15.47:0/55069268 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f29ac0a9a00 con 0x7f29bc0760f0 2024-05-14T12:19:46.457 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29a00b2880 msgr2=0x7f29a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29a00b2880 0x7f29a00b4d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29bc19dc10 tx=0x7f29a400b2a0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0760f0 msgr2=0x7f29bc19cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0760f0 0x7f29bc19cb60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e970 tx=0x7f29ac00ec80 comp rx=0 tx=0).stop 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 shutdown_connections 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f29a00b2880 0x7f29a00b4d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29bc10c1f0 0x7f29bc1a4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29bc0760f0 0x7f29bc19cb60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 --2- 172.21.15.47:0/55069268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc0776e0 0x7f29bc19d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.461+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 >> 172.21.15.47:0/55069268 conn(0x7f29bc0ff9c0 msgr2=0x7f29bc108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.462+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 shutdown_connections 2024-05-14T12:19:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:46.462+0000 7f29c1200700 1 -- 172.21.15.47:0/55069268 wait complete. 2024-05-14T12:19:46.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:46 smithi047 ceph-mon[31254]: purged_snaps scrub starts 2024-05-14T12:19:46.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:46 smithi047 ceph-mon[31254]: purged_snaps scrub ok 2024-05-14T12:19:46.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:46.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:46 smithi047 ceph-mon[31254]: osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] boot 2024-05-14T12:19:46.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:46 smithi047 ceph-mon[31254]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T12:19:46.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:46.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:46 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/55069268' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T12:19:46.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:46 smithi073 ceph-mon[35809]: purged_snaps scrub starts 2024-05-14T12:19:46.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:46 smithi073 ceph-mon[35809]: purged_snaps scrub ok 2024-05-14T12:19:46.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:46.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:46 smithi073 ceph-mon[35809]: osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] boot 2024-05-14T12:19:46.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:46 smithi073 ceph-mon[35809]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T12:19:46.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:46.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:46 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/55069268' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T12:19:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:46 smithi066 ceph-mon[35981]: purged_snaps scrub starts 2024-05-14T12:19:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:46 smithi066 ceph-mon[35981]: purged_snaps scrub ok 2024-05-14T12:19:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:46 smithi066 ceph-mon[35981]: osd.11 [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] boot 2024-05-14T12:19:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:46 smithi066 ceph-mon[35981]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T12:19:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T12:19:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:46 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/55069268' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T12:19:47.255 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1715689185,"num_in_osds":12,"osd_in_since":1715689166,"num_remapped_pgs":0} 2024-05-14T12:19:47.255 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:19:47.702 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:47.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:47.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:47.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:47.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T12:19:47.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.856 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.856 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:47.856 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.856 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:47.856 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:47.856 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:47.856 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:19:48.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:48.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:48.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:48.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:48.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:48.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:48 smithi066 ceph-mon[35981]: Detected new or changed devices on smithi073 2024-05-14T12:19:48.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:48 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi073 to 4272M 2024-05-14T12:19:48.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:48 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:48.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:48 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:48.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:48 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:48.881 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:48 smithi047 ceph-mon[31254]: Detected new or changed devices on smithi073 2024-05-14T12:19:48.882 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:48 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi073 to 4272M 2024-05-14T12:19:48.882 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:48.882 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:48.882 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:49.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:48 smithi073 ceph-mon[35809]: Detected new or changed devices on smithi073 2024-05-14T12:19:49.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:48 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi073 to 4272M 2024-05-14T12:19:49.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:49.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:49.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:49.631 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:49 smithi047 ceph-mon[31254]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:49 smithi066 ceph-mon[35981]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 -- 172.21.15.47:0/283396650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48104400 msgr2=0x7f5a48104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/283396650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48104400 0x7f5a48104810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a380099c0 tx=0x7f5a38009cd0 comp rx=0 tx=0).stop 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 -- 172.21.15.47:0/283396650 shutdown_connections 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/283396650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a48109680 0x7f5a48110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/283396650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48104400 0x7f5a48104810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/283396650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48108d30 0x7f5a48109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 -- 172.21.15.47:0/283396650 >> 172.21.15.47:0/283396650 conn(0x7f5a48079d10 msgr2=0x7f5a4807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 -- 172.21.15.47:0/283396650 shutdown_connections 2024-05-14T12:19:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.952+0000 7f5a4dc00700 1 -- 172.21.15.47:0/283396650 wait complete. 2024-05-14T12:19:49.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.954+0000 7f5a4dc00700 1 Processor -- start 2024-05-14T12:19:49.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.954+0000 7f5a4dc00700 1 -- start start 2024-05-14T12:19:49.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a4dc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48104400 0x7f5a4819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:49.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a4dc00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48108d30 0x7f5a4819d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:49.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a4dc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a48109680 0x7f5a481a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:49.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a4dc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48114300 con 0x7f5a48104400 2024-05-14T12:19:49.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a4dc00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48114180 con 0x7f5a48109680 2024-05-14T12:19:49.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a4dc00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48114480 con 0x7f5a48108d30 2024-05-14T12:19:49.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a47e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48104400 0x7f5a4819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:49.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a47e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48104400 0x7f5a4819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34190/0 (socket says 172.21.15.47:34190) 2024-05-14T12:19:49.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a47e00700 1 -- 172.21.15.47:0/545925675 learned_addr learned my addr 172.21.15.47:0/545925675 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:19:49.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a4d200700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a48109680 0x7f5a481a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.955+0000 7f5a47400700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48108d30 0x7f5a4819d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a4d200700 1 -- 172.21.15.47:0/545925675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48108d30 msgr2=0x7f5a4819d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a4d200700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48108d30 0x7f5a4819d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a4d200700 1 -- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48104400 msgr2=0x7f5a4819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a4d200700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48104400 0x7f5a4819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a4d200700 1 -- 172.21.15.47:0/545925675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481a1de0 con 0x7f5a48109680 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a47e00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48104400 0x7f5a4819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a4d200700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a48109680 0x7f5a481a1740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000efc0 tx=0x7f5a4000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a44c00700 1 -- 172.21.15.47:0/545925675 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a400092e0 con 0x7f5a48109680 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a44c00700 1 -- 172.21.15.47:0/545925675 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a40004bb0 con 0x7f5a48109680 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481a2070 con 0x7f5a48109680 2024-05-14T12:19:49.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.956+0000 7f5a44c00700 1 -- 172.21.15.47:0/545925675 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40004020 con 0x7f5a48109680 2024-05-14T12:19:49.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.957+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a481a99f0 con 0x7f5a48109680 2024-05-14T12:19:49.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.958+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a480512c0 con 0x7f5a48109680 2024-05-14T12:19:49.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.960+0000 7f5a44c00700 1 -- 172.21.15.47:0/545925675 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5a4001b030 con 0x7f5a48109680 2024-05-14T12:19:49.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.962+0000 7f5a44c00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5a2c0b2900 0x7f5a2c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:49.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.962+0000 7f5a44c00700 1 -- 172.21.15.47:0/545925675 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5a400e1820 con 0x7f5a48109680 2024-05-14T12:19:49.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.962+0000 7f5a47e00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5a2c0b2900 0x7f5a2c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:49.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.963+0000 7f5a47e00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5a2c0b2900 0x7f5a2c0b4e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009990 tx=0x7f5a3801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:49.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:49.966+0000 7f5a44c00700 1 -- 172.21.15.47:0/545925675 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5a40022020 con 0x7f5a48109680 2024-05-14T12:19:50.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:49 smithi073 ceph-mon[35809]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:50.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.211+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a481a9bc0 con 0x7f5a48109680 2024-05-14T12:19:50.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.213+0000 7f5a44c00700 1 -- 172.21.15.47:0/545925675 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18385 (secure 0 0 0) 0x7f5a40010040 con 0x7f5a48109680 2024-05-14T12:19:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:19:50.214 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:19:46.791861+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:19:50.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5a2c0b2900 msgr2=0x7f5a2c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:50.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5a2c0b2900 0x7f5a2c0b4e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009990 tx=0x7f5a3801a040 comp rx=0 tx=0).stop 2024-05-14T12:19:50.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a48109680 msgr2=0x7f5a481a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a48109680 0x7f5a481a1740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000efc0 tx=0x7f5a4000c3a0 comp rx=0 tx=0).stop 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 shutdown_connections 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5a2c0b2900 0x7f5a2c0b4e10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a48109680 0x7f5a481a1740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a48104400 0x7f5a4819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 --2- 172.21.15.47:0/545925675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a48108d30 0x7f5a4819d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.217+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 >> 172.21.15.47:0/545925675 conn(0x7f5a48079d10 msgr2=0x7f5a48102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.218+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 shutdown_connections 2024-05-14T12:19:50.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:50.218+0000 7f5a4dc00700 1 -- 172.21.15.47:0/545925675 wait complete. 2024-05-14T12:19:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:50 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/545925675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:19:50.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:50 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/545925675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:19:50.998 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T12:15:26.253753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T12:19:50.999 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-14T12:19:51.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:50 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/545925675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:19:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:19:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:51 smithi066 ceph-mon[35981]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:51.903 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:51 smithi073 ceph-mon[35809]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:51.916 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:51 smithi047 ceph-mon[31254]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.558+0000 7fd278c00700 1 -- 172.21.15.47:0/3862400617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd274105e50 msgr2=0x7fd27410e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.558+0000 7fd278c00700 1 --2- 172.21.15.47:0/3862400617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd274105e50 0x7fd27410e3a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009990 tx=0x7fd25c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.558+0000 7fd278c00700 1 -- 172.21.15.47:0/3862400617 shutdown_connections 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.558+0000 7fd278c00700 1 --2- 172.21.15.47:0/3862400617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27410e8e0 0x7fd274110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.558+0000 7fd278c00700 1 --2- 172.21.15.47:0/3862400617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 0x7fd274105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.558+0000 7fd278c00700 1 --2- 172.21.15.47:0/3862400617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd274105e50 0x7fd27410e3a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.558+0000 7fd278c00700 1 -- 172.21.15.47:0/3862400617 >> 172.21.15.47:0/3862400617 conn(0x7fd2740fedc0 msgr2=0x7fd2741011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.559+0000 7fd278c00700 1 -- 172.21.15.47:0/3862400617 shutdown_connections 2024-05-14T12:19:53.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.559+0000 7fd278c00700 1 -- 172.21.15.47:0/3862400617 wait complete. 2024-05-14T12:19:53.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.560+0000 7fd278c00700 1 Processor -- start 2024-05-14T12:19:53.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.560+0000 7fd278c00700 1 -- start start 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd278c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 0x7fd2741031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd278c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd274105e50 0x7fd274103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd278c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd27410e8e0 0x7fd274103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd278c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd274114440 con 0x7fd27410e8e0 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd278c00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741142c0 con 0x7fd274105500 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd278c00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741145c0 con 0x7fd274105e50 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd271e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 0x7fd2741031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd271e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 0x7fd2741031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:44286/0 (socket says 172.21.15.47:44286) 2024-05-14T12:19:53.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd271e00700 1 -- 172.21.15.47:0/1650936516 learned_addr learned my addr 172.21.15.47:0/1650936516 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd272800700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd27410e8e0 0x7fd274103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.561+0000 7fd26be00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd274105e50 0x7fd274103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.562+0000 7fd271e00700 1 -- 172.21.15.47:0/1650936516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd274105e50 msgr2=0x7fd274103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.562+0000 7fd271e00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd274105e50 0x7fd274103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.562+0000 7fd271e00700 1 -- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd27410e8e0 msgr2=0x7fd274103c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.562+0000 7fd271e00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd27410e8e0 0x7fd274103c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.562+0000 7fd271e00700 1 -- 172.21.15.47:0/1650936516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2741a9150 con 0x7fd274105500 2024-05-14T12:19:53.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.562+0000 7fd26be00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd274105e50 0x7fd274103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:19:53.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.562+0000 7fd271e00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 0x7fd2741031f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd26400e9a0 tx=0x7fd26400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:53.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.566+0000 7fd26aa00700 1 -- 172.21.15.47:0/1650936516 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26400ca10 con 0x7fd274105500 2024-05-14T12:19:53.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.566+0000 7fd26aa00700 1 -- 172.21.15.47:0/1650936516 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26400cbb0 con 0x7fd274105500 2024-05-14T12:19:53.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.566+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2741a9440 con 0x7fd274105500 2024-05-14T12:19:53.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.566+0000 7fd26aa00700 1 -- 172.21.15.47:0/1650936516 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264018680 con 0x7fd274105500 2024-05-14T12:19:53.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.566+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2741a99a0 con 0x7fd274105500 2024-05-14T12:19:53.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.568+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2740512c0 con 0x7fd274105500 2024-05-14T12:19:53.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.570+0000 7fd26aa00700 1 -- 172.21.15.47:0/1650936516 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd26404aab0 con 0x7fd274105500 2024-05-14T12:19:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.572+0000 7fd26aa00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2580b2900 0x7fd2580b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.572+0000 7fd26aa00700 1 -- 172.21.15.47:0/1650936516 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd2640e1fe0 con 0x7fd274105500 2024-05-14T12:19:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.572+0000 7fd26be00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2580b2900 0x7fd2580b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.573+0000 7fd26be00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2580b2900 0x7fd2580b4e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00b2e0 tx=0x7fd25c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:53.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.574+0000 7fd26aa00700 1 -- 172.21.15.47:0/1650936516 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2640aa120 con 0x7fd274105500 2024-05-14T12:19:53.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.810+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd274104720 con 0x7fd274105500 2024-05-14T12:19:53.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:53 smithi047 ceph-mon[31254]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:53.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.811+0000 7fd26aa00700 1 -- 172.21.15.47:0/1650936516 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7fd2640a9a20 con 0x7fd274105500 2024-05-14T12:19:53.812 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2580b2900 msgr2=0x7fd2580b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2580b2900 0x7fd2580b4e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00b2e0 tx=0x7fd25c005960 comp rx=0 tx=0).stop 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 msgr2=0x7fd2741031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 0x7fd2741031f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd26400e9a0 tx=0x7fd26400ecb0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 shutdown_connections 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2580b2900 0x7fd2580b4e10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd27410e8e0 0x7fd274103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd274105500 0x7fd2741031f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 --2- 172.21.15.47:0/1650936516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd274105e50 0x7fd274103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:53.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 >> 172.21.15.47:0/1650936516 conn(0x7fd2740fedc0 msgr2=0x7fd2740ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:53.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 shutdown_connections 2024-05-14T12:19:53.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:19:53.815+0000 7fd278c00700 1 -- 172.21.15.47:0/1650936516 wait complete. 2024-05-14T12:19:53.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:53 smithi066 ceph-mon[35981]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:53 smithi073 ceph-mon[35809]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.a on smithi047 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.d on smithi047 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.g on smithi047 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.j on smithi047 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.b on smithi066 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.e on smithi066 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.h on smithi066 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.k on smithi066 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.c on smithi073 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.f on smithi073 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.i on smithi073 2024-05-14T12:19:54.593 INFO:tasks.cephadm:Adding mds.l on smithi073 2024-05-14T12:19:54.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph orch apply mds all '12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l' 2024-05-14T12:19:54.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:54 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1650936516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T12:19:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:19:54.959 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:54 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1650936516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T12:19:54.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:54 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1650936516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T12:19:55.891 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:55 smithi073 ceph-mon[35809]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:55 smithi047 ceph-mon[31254]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:55 smithi066 ceph-mon[35981]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:56.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 -- 172.21.15.73:0/4288624297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 msgr2=0x7f03dc103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:56.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 --2- 172.21.15.73:0/4288624297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc103650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009990 tx=0x7f03d0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 -- 172.21.15.73:0/4288624297 shutdown_connections 2024-05-14T12:19:56.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 --2- 172.21.15.73:0/4288624297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc104d10 0x7f03dc10b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 --2- 172.21.15.73:0/4288624297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc103650 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 --2- 172.21.15.73:0/4288624297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc104370 0x7f03dc104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 -- 172.21.15.73:0/4288624297 >> 172.21.15.73:0/4288624297 conn(0x7f03dc0fe880 msgr2=0x7f03dc100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 -- 172.21.15.73:0/4288624297 shutdown_connections 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 -- 172.21.15.73:0/4288624297 wait complete. 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.376+0000 7f03e1813700 1 Processor -- start 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e1813700 1 -- start start 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e1813700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e1813700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc104370 0x7f03dc19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e1813700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc104d10 0x7f03dc1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e1813700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc10ed80 con 0x7f03dc104d10 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e1813700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc10ec00 con 0x7f03dc104370 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e1813700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc10ef00 con 0x7f03dc103240 2024-05-14T12:19:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc06c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53618/0 (socket says 172.21.15.73:53618) 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 -- 172.21.15.73:0/1472554420 learned_addr learned my addr 172.21.15.73:0/1472554420 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 -- 172.21.15.73:0/1472554420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc104370 msgr2=0x7f03dc19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03da7fc700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc104370 0x7f03dc19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc104370 0x7f03dc19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 -- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc104d10 msgr2=0x7f03dc1a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc104d10 0x7f03dc1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 -- 172.21.15.73:0/1472554420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc1a25c0 con 0x7f03dc103240 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03da7fc700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc104370 0x7f03dc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03daffd700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc06c070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03d0000c00 tx=0x7f03d00047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.377+0000 7f03e0811700 1 -- 172.21.15.73:0/1472554420 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0027070 con 0x7f03dc103240 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.378+0000 7f03e0811700 1 -- 172.21.15.73:0/1472554420 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03d0022470 con 0x7f03dc103240 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.378+0000 7f03e0811700 1 -- 172.21.15.73:0/1472554420 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d000f6c0 con 0x7f03dc103240 2024-05-14T12:19:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.378+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03dc1a2850 con 0x7f03dc103240 2024-05-14T12:19:56.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.378+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03dc1a2cd0 con 0x7f03dc103240 2024-05-14T12:19:56.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.379+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03dc0512c0 con 0x7f03dc103240 2024-05-14T12:19:56.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.380+0000 7f03e0811700 1 -- 172.21.15.73:0/1472554420 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f03d002a070 con 0x7f03dc103240 2024-05-14T12:19:56.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.381+0000 7f03e0811700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f03c40b2880 0x7f03c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:19:56.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.381+0000 7f03e0811700 1 -- 172.21.15.73:0/1472554420 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f03d00e2ed0 con 0x7f03dc103240 2024-05-14T12:19:56.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.381+0000 7f03da7fc700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f03c40b2880 0x7f03c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:19:56.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.382+0000 7f03da7fc700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f03c40b2880 0x7f03c40b4d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f03dc06ba20 tx=0x7f03cc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:19:56.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.385+0000 7f03e0811700 1 -- 172.21.15.73:0/1472554420 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f03d0013070 con 0x7f03dc103240 2024-05-14T12:19:56.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.598+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}) -- 0x7f03dc063ec0 con 0x7f03c40b2880 2024-05-14T12:19:56.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.616+0000 7f03e0811700 1 -- 172.21.15.73:0/1472554420 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f03dc063ec0 con 0x7f03c40b2880 2024-05-14T12:19:56.616 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mds.all update... 2024-05-14T12:19:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f03c40b2880 msgr2=0x7f03c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f03c40b2880 0x7f03c40b4d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f03dc06ba20 tx=0x7f03cc008040 comp rx=0 tx=0).stop 2024-05-14T12:19:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 msgr2=0x7f03dc06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:19:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc06c070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03d0000c00 tx=0x7f03d00047b0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 shutdown_connections 2024-05-14T12:19:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f03c40b2880 0x7f03c40b4d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f03dc104d10 0x7f03dc1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03dc103240 0x7f03dc06c070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 --2- 172.21.15.73:0/1472554420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc104370 0x7f03dc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:19:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 >> 172.21.15.73:0/1472554420 conn(0x7f03dc0fe880 msgr2=0x7f03dc1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:19:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 shutdown_connections 2024-05-14T12:19:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-05-14T12:19:56.618+0000 7f03e1813700 1 -- 172.21.15.73:0/1472554420 wait complete. 2024-05-14T12:19:57.266 DEBUG:teuthology.orchestra.run.smithi047:mds.a> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.a.service 2024-05-14T12:19:57.273 DEBUG:teuthology.orchestra.run.smithi047:mds.d> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.d.service 2024-05-14T12:19:57.318 DEBUG:teuthology.orchestra.run.smithi047:mds.g> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.g.service 2024-05-14T12:19:57.364 DEBUG:teuthology.orchestra.run.smithi047:mds.j> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.j.service 2024-05-14T12:19:57.410 DEBUG:teuthology.orchestra.run.smithi066:mds.b> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.b.service 2024-05-14T12:19:57.413 DEBUG:teuthology.orchestra.run.smithi066:mds.e> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.e.service 2024-05-14T12:19:57.456 DEBUG:teuthology.orchestra.run.smithi066:mds.h> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.h.service 2024-05-14T12:19:57.499 DEBUG:teuthology.orchestra.run.smithi066:mds.k> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.k.service 2024-05-14T12:19:57.542 DEBUG:teuthology.orchestra.run.smithi073:mds.c> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.c.service 2024-05-14T12:19:57.545 DEBUG:teuthology.orchestra.run.smithi073:mds.f> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.f.service 2024-05-14T12:19:57.587 DEBUG:teuthology.orchestra.run.smithi073:mds.i> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.i.service 2024-05-14T12:19:57.630 DEBUG:teuthology.orchestra.run.smithi073:mds.l> sudo journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.l.service 2024-05-14T12:19:57.673 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-14T12:19:57.674 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:19:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:57 smithi066 ceph-mon[35981]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:57 smithi066 ceph-mon[35981]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:19:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:57 smithi066 ceph-mon[35981]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-05-14T12:19:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:57 smithi047 ceph-mon[31254]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:57 smithi047 ceph-mon[31254]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:19:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:57 smithi047 ceph-mon[31254]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-05-14T12:19:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:58.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:57 smithi073 ceph-mon[35809]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:57 smithi073 ceph-mon[35809]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:19:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:57 smithi073 ceph-mon[35809]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-05-14T12:19:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:19:58.141 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:19:58.844 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:58.844 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:58.844 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:58.844 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:19:58.844 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:19:58.844 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:58.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:58.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:58.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:58.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:19:58.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:19:58.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:19:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:19:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:19:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:19:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:19:59.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:59 smithi047 ceph-mon[31254]: Deploying daemon mds.l on smithi073 2024-05-14T12:19:59.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:19:59 smithi047 ceph-mon[31254]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:59.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:59 smithi073 ceph-mon[35809]: Deploying daemon mds.l on smithi073 2024-05-14T12:19:59.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:19:59 smithi073 ceph-mon[35809]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:19:59.976 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:59 smithi066 ceph-mon[35981]: Deploying daemon mds.l on smithi073 2024-05-14T12:19:59.976 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:19:59 smithi066 ceph-mon[35981]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:00.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 -- 172.21.15.47:0/2607626943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc110ba0 msgr2=0x7fddbc113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 --2- 172.21.15.47:0/2607626943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc110ba0 0x7fddbc113000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009990 tx=0x7fddb4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 -- 172.21.15.47:0/2607626943 shutdown_connections 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 --2- 172.21.15.47:0/2607626943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc110ba0 0x7fddbc113000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 --2- 172.21.15.47:0/2607626943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddbc075d30 0x7fddbc076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 --2- 172.21.15.47:0/2607626943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddbc076680 0x7fddbc110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 -- 172.21.15.47:0/2607626943 >> 172.21.15.47:0/2607626943 conn(0x7fddbc100040 msgr2=0x7fddbc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.287+0000 7fddc2600700 1 -- 172.21.15.47:0/2607626943 shutdown_connections 2024-05-14T12:20:00.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.288+0000 7fddc2600700 1 -- 172.21.15.47:0/2607626943 wait complete. 2024-05-14T12:20:00.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 Processor -- start 2024-05-14T12:20:00.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 -- start start 2024-05-14T12:20:00.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc075d30 0x7fddbc19cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddbc076680 0x7fddbc19d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddbc110ba0 0x7fddbc1a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc116680 con 0x7fddbc075d30 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc116500 con 0x7fddbc110ba0 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.289+0000 7fddc2600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc116800 con 0x7fddbc076680 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc075d30 0x7fddbc19cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbaa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddbc076680 0x7fddbc19d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbaa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddbc076680 0x7fddbc19d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:46564/0 (socket says 172.21.15.47:46564) 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc075d30 0x7fddbc19cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53908/0 (socket says 172.21.15.47:53908) 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbaa00700 1 -- 172.21.15.47:0/350358908 learned_addr learned my addr 172.21.15.47:0/350358908 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:00.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbbe00700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddbc110ba0 0x7fddbc1a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:00.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbbe00700 1 -- 172.21.15.47:0/350358908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddbc076680 msgr2=0x7fddbc19d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:00.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbbe00700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddbc076680 0x7fddbc19d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbbe00700 1 -- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc075d30 msgr2=0x7fddbc19cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbbe00700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc075d30 0x7fddbc19cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.290+0000 7fddbbe00700 1 -- 172.21.15.47:0/350358908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc1a1ea0 con 0x7fddbc110ba0 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.291+0000 7fddbbe00700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddbc110ba0 0x7fddbc1a1800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddb40059d0 tx=0x7fddb40057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.291+0000 7fddb3e00700 1 -- 172.21.15.47:0/350358908 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4026070 con 0x7fddbc110ba0 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.291+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc1a2130 con 0x7fddbc110ba0 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.291+0000 7fddb3e00700 1 -- 172.21.15.47:0/350358908 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddb4021410 con 0x7fddbc110ba0 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.291+0000 7fddb3e00700 1 -- 172.21.15.47:0/350358908 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4017650 con 0x7fddbc110ba0 2024-05-14T12:20:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.291+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc1a9ab0 con 0x7fddbc110ba0 2024-05-14T12:20:00.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.292+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc0772a0 con 0x7fddbc110ba0 2024-05-14T12:20:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.295+0000 7fddb3e00700 1 -- 172.21.15.47:0/350358908 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fddb4029070 con 0x7fddbc110ba0 2024-05-14T12:20:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.297+0000 7fddb3e00700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fdda00b2880 0x7fdda00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.297+0000 7fddb3e00700 1 -- 172.21.15.47:0/350358908 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fddb40e2d20 con 0x7fddbc110ba0 2024-05-14T12:20:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.297+0000 7fddbb400700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fdda00b2880 0x7fdda00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:00.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.298+0000 7fddbb400700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fdda00b2880 0x7fdda00b4d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fddac00f540 tx=0x7fddac00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:00.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.299+0000 7fddb3e00700 1 -- 172.21.15.47:0/350358908 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fddb405edf0 con 0x7fddbc110ba0 2024-05-14T12:20:00.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.591+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddbc19e330 con 0x7fddbc110ba0 2024-05-14T12:20:00.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.592+0000 7fddb3e00700 1 -- 172.21.15.47:0/350358908 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7fddb4013070 con 0x7fddbc110ba0 2024-05-14T12:20:00.593 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:00.593 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T12:20:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.596+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fdda00b2880 msgr2=0x7fdda00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.596+0000 7fddc2600700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fdda00b2880 0x7fdda00b4d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fddac00f540 tx=0x7fddac00b040 comp rx=0 tx=0).stop 2024-05-14T12:20:00.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.596+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddbc110ba0 msgr2=0x7fddbc1a1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.596+0000 7fddc2600700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddbc110ba0 0x7fddbc1a1800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddb40059d0 tx=0x7fddb40057c0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 shutdown_connections 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fdda00b2880 0x7fdda00b4d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddbc110ba0 0x7fddbc1a1800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc075d30 0x7fddbc19cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 --2- 172.21.15.47:0/350358908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddbc076680 0x7fddbc19d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 >> 172.21.15.47:0/350358908 conn(0x7fddbc100040 msgr2=0x7fddbc100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:00.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 shutdown_connections 2024-05-14T12:20:00.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:00.597+0000 7fddc2600700 1 -- 172.21.15.47:0/350358908 wait complete. 2024-05-14T12:20:00.598 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-05-14T12:20:00.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:00 smithi047 ceph-mon[31254]: overall HEALTH_OK 2024-05-14T12:20:00.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:00 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6832/1120434141,v1:172.21.15.73:6833/1120434141] up:boot 2024-05-14T12:20:00.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:00 smithi047 ceph-mon[31254]: fsmap 1 up:standby 2024-05-14T12:20:00.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T12:20:00.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:00 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/350358908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:01.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:00 smithi073 ceph-mon[35809]: overall HEALTH_OK 2024-05-14T12:20:01.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:00 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6832/1120434141,v1:172.21.15.73:6833/1120434141] up:boot 2024-05-14T12:20:01.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:00 smithi073 ceph-mon[35809]: fsmap 1 up:standby 2024-05-14T12:20:01.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T12:20:01.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:00 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/350358908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:01.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:00 smithi066 ceph-mon[35981]: overall HEALTH_OK 2024-05-14T12:20:01.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:00 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6832/1120434141,v1:172.21.15.73:6833/1120434141] up:boot 2024-05-14T12:20:01.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:00 smithi066 ceph-mon[35981]: fsmap 1 up:standby 2024-05-14T12:20:01.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T12:20:01.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:00 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/350358908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:01 smithi066 ceph-mon[35981]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:01.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:01 smithi047 ceph-mon[31254]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:01.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:01 smithi073 ceph-mon[35809]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:02.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:02 smithi066 ceph-mon[35981]: Deploying daemon mds.k on smithi066 2024-05-14T12:20:02.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:02 smithi047 ceph-mon[31254]: Deploying daemon mds.k on smithi066 2024-05-14T12:20:03.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:02 smithi073 ceph-mon[35809]: Deploying daemon mds.k on smithi066 2024-05-14T12:20:03.075 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:02 smithi066 systemd[1]: Starting Ceph mds.k for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:20:03.370 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:20:03.512 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 podman[65173]: 2024-05-14 12:20:03.119075935 +0000 UTC m=+0.018447478 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:20:03.512 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 podman[65173]: 2024-05-14 12:20:03.233283528 +0000 UTC m=+0.132655054 container create 4fcc12ac5f10b56114a2fb2ecc50846e15e8923479838c89c18beea1fa8c7c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:20:03.512 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 podman[65173]: 2024-05-14 12:20:03.512714257 +0000 UTC m=+0.412085784 container init 4fcc12ac5f10b56114a2fb2ecc50846e15e8923479838c89c18beea1fa8c7c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:20:03.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:03 smithi047 ceph-mon[31254]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:03 smithi066 ceph-mon[35981]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:03.825 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 podman[65173]: 2024-05-14 12:20:03.515414448 +0000 UTC m=+0.414785976 container start 4fcc12ac5f10b56114a2fb2ecc50846e15e8923479838c89c18beea1fa8c7c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-14T12:20:03.825 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 ceph-mds[65192]: -- 172.21.15.66:0/1038831197 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aec8dcba40 con 0x55aec8e13180 2024-05-14T12:20:03.826 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k[65188]: starting mds.k at 2024-05-14T12:20:03.826 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 bash[65173]: 4fcc12ac5f10b56114a2fb2ecc50846e15e8923479838c89c18beea1fa8c7c1d 2024-05-14T12:20:03.826 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:20:03 smithi066 systemd[1]: Started Ceph mds.k for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:03.836 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:03 smithi073 ceph-mon[35809]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:04.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6832/3730098623,v1:172.21.15.66:6833/3730098623] up:boot 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: fsmap 2 up:standby 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: Deploying daemon mds.j on smithi047 2024-05-14T12:20:04.942 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:04 smithi066 ceph-mon[35981]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6832/3730098623,v1:172.21.15.66:6833/3730098623] up:boot 2024-05-14T12:20:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: fsmap 2 up:standby 2024-05-14T12:20:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T12:20:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: Deploying daemon mds.j on smithi047 2024-05-14T12:20:04.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:04 smithi047 ceph-mon[31254]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6832/3730098623,v1:172.21.15.66:6833/3730098623] up:boot 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: fsmap 2 up:standby 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: Deploying daemon mds.j on smithi047 2024-05-14T12:20:05.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:04 smithi073 ceph-mon[35809]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:06.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 -- 172.21.15.47:0/698579875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 msgr2=0x7f5d74110fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:06.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 --2- 172.21.15.47:0/698579875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d74110fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009fc0 tx=0x7f5d6c00b330 comp rx=0 tx=0).stop 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 -- 172.21.15.47:0/698579875 shutdown_connections 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 --2- 172.21.15.47:0/698579875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d74110fe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 --2- 172.21.15.47:0/698579875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d74104400 0x7f5d74104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 --2- 172.21.15.47:0/698579875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d74108d30 0x7f5d74109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 -- 172.21.15.47:0/698579875 >> 172.21.15.47:0/698579875 conn(0x7f5d74079d10 msgr2=0x7f5d7407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 -- 172.21.15.47:0/698579875 shutdown_connections 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.712+0000 7f5d73e00700 1 -- 172.21.15.47:0/698579875 wait complete. 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.713+0000 7f5d73e00700 1 Processor -- start 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73e00700 1 -- start start 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d74104400 0x7f5d7419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d74108d30 0x7f5d7419d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d741a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741142b0 con 0x7f5d74109680 2024-05-14T12:20:06.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74114130 con 0x7f5d74108d30 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74114430 con 0x7f5d74104400 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d741a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d72a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d74104400 0x7f5d7419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d741a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53926/0 (socket says 172.21.15.47:53926) 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.714+0000 7f5d73400700 1 -- 172.21.15.47:0/2695196970 learned_addr learned my addr 172.21.15.47:0/2695196970 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d6a000700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d74108d30 0x7f5d7419d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d73400700 1 -- 172.21.15.47:0/2695196970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d74104400 msgr2=0x7f5d7419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d73400700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d74104400 0x7f5d7419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d73400700 1 -- 172.21.15.47:0/2695196970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d74108d30 msgr2=0x7f5d7419d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d73400700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d74108d30 0x7f5d7419d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d73400700 1 -- 172.21.15.47:0/2695196970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d741a1cd0 con 0x7f5d74109680 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d72a00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d74104400 0x7f5d7419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d73400700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d741a1630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006070 tx=0x7f5d6c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.715+0000 7f5d6be00700 1 -- 172.21.15.47:0/2695196970 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c021070 con 0x7f5d74109680 2024-05-14T12:20:06.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.716+0000 7f5d6be00700 1 -- 172.21.15.47:0/2695196970 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c007ac0 con 0x7f5d74109680 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.716+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d741a1f60 con 0x7f5d74109680 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.716+0000 7f5d6be00700 1 -- 172.21.15.47:0/2695196970 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c005040 con 0x7f5d74109680 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.716+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d741a98e0 con 0x7f5d74109680 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.717+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d741058b0 con 0x7f5d74109680 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.719+0000 7f5d6be00700 1 -- 172.21.15.47:0/2695196970 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5d6c024070 con 0x7f5d74109680 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.721+0000 7f5d6be00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5d580b2880 0x7f5d580b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.721+0000 7f5d6be00700 1 -- 172.21.15.47:0/2695196970 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5d6c00f020 con 0x7f5d74109680 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.721+0000 7f5d72a00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5d580b2880 0x7f5d580b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.722+0000 7f5d72a00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5d580b2880 0x7f5d580b4d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009750 tx=0x7f5d64009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:06.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:06.724+0000 7f5d6be00700 1 -- 172.21.15.47:0/2695196970 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5d6c02b020 con 0x7f5d74109680 2024-05-14T12:20:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.050+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d740512c0 con 0x7f5d74109680 2024-05-14T12:20:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.051+0000 7f5d6be00700 1 -- 172.21.15.47:0/2695196970 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f5d6c0ab850 con 0x7f5d74109680 2024-05-14T12:20:07.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:07.051 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T12:20:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5d580b2880 msgr2=0x7f5d580b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5d580b2880 0x7f5d580b4d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009750 tx=0x7f5d64009310 comp rx=0 tx=0).stop 2024-05-14T12:20:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 msgr2=0x7f5d741a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d741a1630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006070 tx=0x7f5d6c00ccb0 comp rx=0 tx=0).stop 2024-05-14T12:20:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 shutdown_connections 2024-05-14T12:20:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5d580b2880 0x7f5d580b4d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d74109680 0x7f5d741a1630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d74104400 0x7f5d7419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 --2- 172.21.15.47:0/2695196970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d74108d30 0x7f5d7419d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 >> 172.21.15.47:0/2695196970 conn(0x7f5d74079d10 msgr2=0x7f5d74101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 shutdown_connections 2024-05-14T12:20:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:07.054+0000 7f5d73e00700 1 -- 172.21.15.47:0/2695196970 wait complete. 2024-05-14T12:20:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-05-14T12:20:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:07 smithi047 ceph-mon[31254]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:07 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2695196970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:07 smithi066 ceph-mon[35981]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:07.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:07 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2695196970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:07 smithi073 ceph-mon[35809]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:07 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2695196970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:08.644 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:20:08 smithi047 podman[69343]: 2024-05-14 12:20:08.358429592 +0000 UTC m=+0.159153548 container create 71dacb13a5b04b7465d2ac6d79e3e329bc8d11fa9ce8abc28d69237a9ac52a37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-14T12:20:08.644 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:20:08 smithi047 podman[69343]: 2024-05-14 12:20:08.643346601 +0000 UTC m=+0.444070560 container init 71dacb13a5b04b7465d2ac6d79e3e329bc8d11fa9ce8abc28d69237a9ac52a37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-05-14T12:20:08.985 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:20:08 smithi047 podman[69343]: 2024-05-14 12:20:08.654538688 +0000 UTC m=+0.455262614 container start 71dacb13a5b04b7465d2ac6d79e3e329bc8d11fa9ce8abc28d69237a9ac52a37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-14T12:20:08.985 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:20:08 smithi047 bash[69343]: 71dacb13a5b04b7465d2ac6d79e3e329bc8d11fa9ce8abc28d69237a9ac52a37 2024-05-14T12:20:08.985 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:20:08 smithi047 systemd[1]: Started Ceph mds.j for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:08.985 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:20:08 smithi047 ceph-mds[69361]: -- 172.21.15.47:0/1208016884 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563bbdd4da40 con 0x563bbdd95600 2024-05-14T12:20:08.985 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:20:08 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j[69357]: starting mds.j at 2024-05-14T12:20:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:09 smithi066 ceph-mon[35981]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:09 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:09 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:09 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:09 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:09 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:09 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:09.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:09 smithi047 ceph-mon[31254]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:09.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:09 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:09 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:09 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:09 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:09.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:09 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:09.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:09 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:09 smithi073 ceph-mon[35809]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:09 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:09 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:09 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:09 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:09 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:09 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:10.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:20:10.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:10 smithi066 ceph-mon[35981]: Deploying daemon mds.d on smithi047 2024-05-14T12:20:10.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:10 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.47:6834/683389749,v1:172.21.15.47:6835/683389749] up:boot 2024-05-14T12:20:10.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:10 smithi066 ceph-mon[35981]: fsmap 3 up:standby 2024-05-14T12:20:10.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:10 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T12:20:10.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:10 smithi047 ceph-mon[31254]: Deploying daemon mds.d on smithi047 2024-05-14T12:20:10.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:10 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.47:6834/683389749,v1:172.21.15.47:6835/683389749] up:boot 2024-05-14T12:20:10.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:10 smithi047 ceph-mon[31254]: fsmap 3 up:standby 2024-05-14T12:20:10.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:10 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T12:20:10.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:10 smithi073 ceph-mon[35809]: Deploying daemon mds.d on smithi047 2024-05-14T12:20:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:10 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.47:6834/683389749,v1:172.21.15.47:6835/683389749] up:boot 2024-05-14T12:20:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:10 smithi073 ceph-mon[35809]: fsmap 3 up:standby 2024-05-14T12:20:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:10 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T12:20:11.276 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:11.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:11 smithi066 ceph-mon[35981]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:11 smithi047 ceph-mon[31254]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:11.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:11 smithi073 ceph-mon[35809]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:12.985 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:20:12 smithi047 podman[69732]: 2024-05-14 12:20:12.832368088 +0000 UTC m=+0.136059678 container create c41f7e11b3e65a013dffaca4d0ced90ca70e29dd4ffa16d2c1950542651ca4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:20:13.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:13 smithi066 ceph-mon[35981]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:13.648 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:13 smithi047 ceph-mon[31254]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:13.648 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:20:13 smithi047 podman[69732]: 2024-05-14 12:20:13.316514363 +0000 UTC m=+0.620206018 container init c41f7e11b3e65a013dffaca4d0ced90ca70e29dd4ffa16d2c1950542651ca4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:20:13.649 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:20:13 smithi047 podman[69732]: 2024-05-14 12:20:13.328776462 +0000 UTC m=+0.632468094 container start c41f7e11b3e65a013dffaca4d0ced90ca70e29dd4ffa16d2c1950542651ca4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True) 2024-05-14T12:20:13.649 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:20:13 smithi047 ceph-mds[69775]: -- 172.21.15.47:0/2271446550 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ed531fa40 con 0x555ed5367600 2024-05-14T12:20:13.649 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:20:13 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d[69767]: starting mds.d at 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.663+0000 7f8cfe400700 1 -- 172.21.15.47:0/3974009944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf8109870 msgr2=0x7f8cf81111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.663+0000 7f8cfe400700 1 --2- 172.21.15.47:0/3974009944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf8109870 0x7f8cf81111d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009f90 tx=0x7f8cf000b330 comp rx=0 tx=0).stop 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.664+0000 7f8cfe400700 1 -- 172.21.15.47:0/3974009944 shutdown_connections 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.664+0000 7f8cfe400700 1 --2- 172.21.15.47:0/3974009944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf8109870 0x7f8cf81111d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.664+0000 7f8cfe400700 1 --2- 172.21.15.47:0/3974009944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf81045f0 0x7f8cf8104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.664+0000 7f8cfe400700 1 --2- 172.21.15.47:0/3974009944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf8108f20 0x7f8cf8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.664+0000 7f8cfe400700 1 -- 172.21.15.47:0/3974009944 >> 172.21.15.47:0/3974009944 conn(0x7f8cf8100040 msgr2=0x7f8cf8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:13.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.664+0000 7f8cfe400700 1 -- 172.21.15.47:0/3974009944 shutdown_connections 2024-05-14T12:20:13.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.664+0000 7f8cfe400700 1 -- 172.21.15.47:0/3974009944 wait complete. 2024-05-14T12:20:13.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.665+0000 7f8cfe400700 1 Processor -- start 2024-05-14T12:20:13.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.665+0000 7f8cfe400700 1 -- start start 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.666+0000 7f8cfe400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf81045f0 0x7f8cf819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.666+0000 7f8cfe400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf8108f20 0x7f8cf819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.666+0000 7f8cfe400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf8109870 0x7f8cf819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.666+0000 7f8cfe400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81144f0 con 0x7f8cf8108f20 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.666+0000 7f8cfe400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8114370 con 0x7f8cf81045f0 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.666+0000 7f8cfe400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8114670 con 0x7f8cf8109870 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.666+0000 7f8cf6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf8108f20 0x7f8cf819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:13.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf81045f0 0x7f8cf819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf81045f0 0x7f8cf819ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51230/0 (socket says 172.21.15.47:51230) 2024-05-14T12:20:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 -- 172.21.15.47:0/1832122877 learned_addr learned my addr 172.21.15.47:0/1832122877 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7e00700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf8109870 0x7f8cf819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:13.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 -- 172.21.15.47:0/1832122877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf8109870 msgr2=0x7f8cf819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf8109870 0x7f8cf819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 -- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf8108f20 msgr2=0x7f8cf819b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf8108f20 0x7f8cf819b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 -- 172.21.15.47:0/1832122877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf819fcf0 con 0x7f8cf81045f0 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.667+0000 7f8cf7400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf81045f0 0x7f8cf819ae20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800eb30 tx=0x7f8ce800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.668+0000 7f8cefe00700 1 -- 172.21.15.47:0/1832122877 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800cbd0 con 0x7f8cf81045f0 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.668+0000 7f8cefe00700 1 -- 172.21.15.47:0/1832122877 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce80044d0 con 0x7f8cf81045f0 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.668+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf819ffe0 con 0x7f8cf81045f0 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.668+0000 7f8cefe00700 1 -- 172.21.15.47:0/1832122877 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8003e30 con 0x7f8cf81045f0 2024-05-14T12:20:13.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.668+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81a7900 con 0x7f8cf81045f0 2024-05-14T12:20:13.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.669+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf80512c0 con 0x7f8cf81045f0 2024-05-14T12:20:13.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.672+0000 7f8cefe00700 1 -- 172.21.15.47:0/1832122877 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8ce8004000 con 0x7f8cf81045f0 2024-05-14T12:20:13.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.673+0000 7f8cefe00700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8cdc0b2880 0x7f8cdc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:13.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.673+0000 7f8cefe00700 1 -- 172.21.15.47:0/1832122877 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f8ce80e21a0 con 0x7f8cf81045f0 2024-05-14T12:20:13.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.673+0000 7f8cf6a00700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8cdc0b2880 0x7f8cdc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:13.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.674+0000 7f8cf6a00700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8cdc0b2880 0x7f8cdc0b4d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009750 tx=0x7f8ce4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:13.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:13.678+0000 7f8cefe00700 1 -- 172.21.15.47:0/1832122877 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ce80042f0 con 0x7f8cf81045f0 2024-05-14T12:20:13.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:13 smithi073 ceph-mon[35809]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:13.985 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:20:13 smithi047 bash[69732]: c41f7e11b3e65a013dffaca4d0ced90ca70e29dd4ffa16d2c1950542651ca4c7 2024-05-14T12:20:13.985 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:20:13 smithi047 systemd[1]: Started Ceph mds.d for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:14.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.008+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cf819c180 con 0x7f8cf81045f0 2024-05-14T12:20:14.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.009+0000 7f8cefe00700 1 -- 172.21.15.47:0/1832122877 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3040 (secure 0 0 0) 0x7f8ce80aa2c0 con 0x7f8cf81045f0 2024-05-14T12:20:14.010 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:14.010 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T12:20:14.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8cdc0b2880 msgr2=0x7f8cdc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:14.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8cdc0b2880 0x7f8cdc0b4d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009750 tx=0x7f8ce4009310 comp rx=0 tx=0).stop 2024-05-14T12:20:14.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf81045f0 msgr2=0x7f8cf819ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:14.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf81045f0 0x7f8cf819ae20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800eb30 tx=0x7f8ce800ee40 comp rx=0 tx=0).stop 2024-05-14T12:20:14.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 shutdown_connections 2024-05-14T12:20:14.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8cdc0b2880 0x7f8cdc0b4d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:14.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf8109870 0x7f8cf819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:14.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cf81045f0 0x7f8cf819ae20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:14.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 --2- 172.21.15.47:0/1832122877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cf8108f20 0x7f8cf819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:14.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 >> 172.21.15.47:0/1832122877 conn(0x7f8cf8100040 msgr2=0x7f8cf8108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:14.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 shutdown_connections 2024-05-14T12:20:14.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:14.012+0000 7f8cfe400700 1 -- 172.21.15.47:0/1832122877 wait complete. 2024-05-14T12:20:14.015 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 4 2024-05-14T12:20:15.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: Deploying daemon mds.e on smithi066 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1832122877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.47:6836/1559121259,v1:172.21.15.47:6837/1559121259] up:boot 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: fsmap 4 up:standby 2024-05-14T12:20:15.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:14 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T12:20:15.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:15.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:15.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:15.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: Deploying daemon mds.e on smithi066 2024-05-14T12:20:15.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1832122877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:15.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:15.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.47:6836/1559121259,v1:172.21.15.47:6837/1559121259] up:boot 2024-05-14T12:20:15.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: fsmap 4 up:standby 2024-05-14T12:20:15.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:14 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T12:20:15.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: Deploying daemon mds.e on smithi066 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1832122877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.47:6836/1559121259,v1:172.21.15.47:6837/1559121259] up:boot 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: fsmap 4 up:standby 2024-05-14T12:20:15.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:14 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T12:20:16.075 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:20:16 smithi066 podman[65485]: 2024-05-14 12:20:16.065269258 +0000 UTC m=+0.137365990 container create a07a0bc8a3aa3bbdd22c1ff06d8682f68dfc4fb864028023e31f90973649f761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:20:16.575 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:20:16 smithi066 podman[65485]: 2024-05-14 12:20:16.309309787 +0000 UTC m=+0.381406521 container init a07a0bc8a3aa3bbdd22c1ff06d8682f68dfc4fb864028023e31f90973649f761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-14T12:20:16.576 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:20:16 smithi066 podman[65485]: 2024-05-14 12:20:16.312847322 +0000 UTC m=+0.384944056 container start a07a0bc8a3aa3bbdd22c1ff06d8682f68dfc4fb864028023e31f90973649f761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-14T12:20:16.576 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:20:16 smithi066 ceph-mds[65504]: -- 172.21.15.66:0/1571558905 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff75fcda40 con 0x55ff76015a80 2024-05-14T12:20:16.576 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:20:16 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e[65500]: starting mds.e at 2024-05-14T12:20:16.576 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:20:16 smithi066 bash[65485]: a07a0bc8a3aa3bbdd22c1ff06d8682f68dfc4fb864028023e31f90973649f761 2024-05-14T12:20:16.577 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:20:16 smithi066 systemd[1]: Started Ceph mds.e for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:16.796 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:20:17.264 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:17.726 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:17.726 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: Deploying daemon mds.f on smithi073 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6834/2635749889,v1:172.21.15.66:6835/2635749889] up:boot 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: fsmap 5 up:standby 2024-05-14T12:20:17.727 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:17 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: Deploying daemon mds.f on smithi073 2024-05-14T12:20:17.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6834/2635749889,v1:172.21.15.66:6835/2635749889] up:boot 2024-05-14T12:20:17.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: fsmap 5 up:standby 2024-05-14T12:20:17.753 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:17 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T12:20:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:17.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: Deploying daemon mds.f on smithi073 2024-05-14T12:20:17.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6834/2635749889,v1:172.21.15.66:6835/2635749889] up:boot 2024-05-14T12:20:17.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: fsmap 5 up:standby 2024-05-14T12:20:17.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:17 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T12:20:18.752 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:18 smithi073 systemd[1]: Starting Ceph mds.f for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:20:19.026 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:18 smithi073 podman[66699]: 2024-05-14 12:20:18.771072569 +0000 UTC m=+0.101403178 container create ded613d13e8d11c0ca724b6726d8a700f6df016a5c63f1b47899f073f778e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-14T12:20:19.027 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:18 smithi073 podman[66699]: 2024-05-14 12:20:18.686921222 +0000 UTC m=+0.017251852 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:20:19.027 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:18 smithi073 podman[66699]: 2024-05-14 12:20:18.990661639 +0000 UTC m=+0.320992256 container init ded613d13e8d11c0ca724b6726d8a700f6df016a5c63f1b47899f073f778e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS) 2024-05-14T12:20:19.027 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:18 smithi073 podman[66699]: 2024-05-14 12:20:18.993286482 +0000 UTC m=+0.323617107 container start ded613d13e8d11c0ca724b6726d8a700f6df016a5c63f1b47899f073f778e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507) 2024-05-14T12:20:19.464 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mds[66718]: -- 172.21.15.73:0/295052866 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e6b8425a40 con 0x55e6b846d180 2024-05-14T12:20:19.464 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:19 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f[66714]: starting mds.f at 2024-05-14T12:20:19.464 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:19 smithi073 bash[66699]: ded613d13e8d11c0ca724b6726d8a700f6df016a5c63f1b47899f073f778e69a 2024-05-14T12:20:19.464 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:20:19 smithi073 systemd[1]: Started Ceph mds.f for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:19.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.527+0000 7f0bef400700 1 -- 172.21.15.47:0/2583397236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8108f20 msgr2=0x7f0be8109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:19.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.527+0000 7f0bef400700 1 --2- 172.21.15.47:0/2583397236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8108f20 0x7f0be8109330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40099c0 tx=0x7f0bd4009cd0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.527+0000 7f0bef400700 1 -- 172.21.15.47:0/2583397236 shutdown_connections 2024-05-14T12:20:19.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.527+0000 7f0bef400700 1 --2- 172.21.15.47:0/2583397236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0be8109870 0x7f0be81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.527+0000 7f0bef400700 1 --2- 172.21.15.47:0/2583397236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be81045f0 0x7f0be8104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.527+0000 7f0bef400700 1 --2- 172.21.15.47:0/2583397236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8108f20 0x7f0be8109330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.528+0000 7f0bef400700 1 -- 172.21.15.47:0/2583397236 >> 172.21.15.47:0/2583397236 conn(0x7f0be8100040 msgr2=0x7f0be8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:19.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.528+0000 7f0bef400700 1 -- 172.21.15.47:0/2583397236 shutdown_connections 2024-05-14T12:20:19.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.528+0000 7f0bef400700 1 -- 172.21.15.47:0/2583397236 wait complete. 2024-05-14T12:20:19.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:19 smithi047 ceph-mon[31254]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:19.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:19.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:19.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:19.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.529+0000 7f0bef400700 1 Processor -- start 2024-05-14T12:20:19.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.529+0000 7f0bef400700 1 -- start start 2024-05-14T12:20:19.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bef400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be81045f0 0x7f0be819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:19.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bef400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0be8108f20 0x7f0be819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:19.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bef400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8109870 0x7f0be81a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bef400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0be81144d0 con 0x7f0be8108f20 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bef400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8114350 con 0x7f0be81045f0 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bef400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8114650 con 0x7f0be8109870 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bed400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8109870 0x7f0be81a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0be7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0be8108f20 0x7f0be819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bed400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8109870 0x7f0be81a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:54020/0 (socket says 172.21.15.47:54020) 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.530+0000 7f0bed400700 1 -- 172.21.15.47:0/616464791 learned_addr learned my addr 172.21.15.47:0/616464791 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0beca00700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be81045f0 0x7f0be819d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0bed400700 1 -- 172.21.15.47:0/616464791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be81045f0 msgr2=0x7f0be819d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0bed400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be81045f0 0x7f0be819d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0bed400700 1 -- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0be8108f20 msgr2=0x7f0be819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0bed400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0be8108f20 0x7f0be819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0bed400700 1 -- 172.21.15.47:0/616464791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be81a1f90 con 0x7f0be8109870 2024-05-14T12:20:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0beca00700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be81045f0 0x7f0be819d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:20:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0bed400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8109870 0x7f0be81a18f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0be000ef30 tx=0x7f0be000c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0be5600700 1 -- 172.21.15.47:0/616464791 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00092e0 con 0x7f0be8109870 2024-05-14T12:20:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.531+0000 7f0be5600700 1 -- 172.21.15.47:0/616464791 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0be0004bb0 con 0x7f0be8109870 2024-05-14T12:20:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.532+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be81a2220 con 0x7f0be8109870 2024-05-14T12:20:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.532+0000 7f0be5600700 1 -- 172.21.15.47:0/616464791 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0004280 con 0x7f0be8109870 2024-05-14T12:20:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.532+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81a26e0 con 0x7f0be8109870 2024-05-14T12:20:19.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.533+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be80512c0 con 0x7f0be8109870 2024-05-14T12:20:19.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.535+0000 7f0be5600700 1 -- 172.21.15.47:0/616464791 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0be001b030 con 0x7f0be8109870 2024-05-14T12:20:19.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.537+0000 7f0be5600700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0bd00b2880 0x7f0bd00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:19.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.537+0000 7f0be5600700 1 -- 172.21.15.47:0/616464791 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0be00e1a60 con 0x7f0be8109870 2024-05-14T12:20:19.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.537+0000 7f0beca00700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0bd00b2880 0x7f0bd00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:19.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.538+0000 7f0beca00700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0bd00b2880 0x7f0bd00b4d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009cb0 tx=0x7f0bdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:19.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.541+0000 7f0be5600700 1 -- 172.21.15.47:0/616464791 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0be0022020 con 0x7f0be8109870 2024-05-14T12:20:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mon[35809]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:19 smithi066 ceph-mon[35981]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:19.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.833+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0be81a9c30 con 0x7f0be8109870 2024-05-14T12:20:19.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.834+0000 7f0be5600700 1 -- 172.21.15.47:0/616464791 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5512 (secure 0 0 0) 0x7f0be0010040 con 0x7f0be8109870 2024-05-14T12:20:19.835 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:19.835 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24490,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-05-14T12:20:19.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.837+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0bd00b2880 msgr2=0x7f0bd00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.837+0000 7f0bef400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0bd00b2880 0x7f0bd00b4d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009cb0 tx=0x7f0bdc009260 comp rx=0 tx=0).stop 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.837+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8109870 msgr2=0x7f0be81a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.837+0000 7f0bef400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8109870 0x7f0be81a18f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0be000ef30 tx=0x7f0be000c450 comp rx=0 tx=0).stop 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 shutdown_connections 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0bd00b2880 0x7f0bd00b4d90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be8109870 0x7f0be81a18f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be81045f0 0x7f0be819d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 --2- 172.21.15.47:0/616464791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0be8108f20 0x7f0be819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 >> 172.21.15.47:0/616464791 conn(0x7f0be8100040 msgr2=0x7f0be8110ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 shutdown_connections 2024-05-14T12:20:19.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:19.838+0000 7f0bef400700 1 -- 172.21.15.47:0/616464791 wait complete. 2024-05-14T12:20:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 7 2024-05-14T12:20:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:20 smithi073 ceph-mon[35809]: Deploying daemon mds.c on smithi073 2024-05-14T12:20:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:20 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] up:boot 2024-05-14T12:20:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:20 smithi073 ceph-mon[35809]: fsmap 6 up:standby 2024-05-14T12:20:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T12:20:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:20 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/616464791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:20 smithi066 ceph-mon[35981]: Deploying daemon mds.c on smithi073 2024-05-14T12:20:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:20 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] up:boot 2024-05-14T12:20:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:20 smithi066 ceph-mon[35981]: fsmap 6 up:standby 2024-05-14T12:20:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T12:20:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:20 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/616464791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:20 smithi047 ceph-mon[31254]: Deploying daemon mds.c on smithi073 2024-05-14T12:20:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:20 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] up:boot 2024-05-14T12:20:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:20 smithi047 ceph-mon[31254]: fsmap 6 up:standby 2024-05-14T12:20:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T12:20:20.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:20 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/616464791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:21.684 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:21 smithi073 ceph-mon[35809]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:21 smithi066 ceph-mon[35981]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:21.889 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:21 smithi047 ceph-mon[31254]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:21.964 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:20:21 smithi073 podman[66999]: 2024-05-14 12:20:21.931333234 +0000 UTC m=+0.355221199 container start d3538bf0807a19354ed6a0e3943584e7ee13f606a1eb2323454a28a3699847b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-14T12:20:22.252 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:20:21 smithi073 ceph-mds[67019]: -- 172.21.15.73:0/4100773498 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5651c9e0da40 con 0x5651c9e55a80 2024-05-14T12:20:22.252 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:20:21 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: starting mds.c at 2024-05-14T12:20:22.252 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:20:22 smithi073 bash[66999]: d3538bf0807a19354ed6a0e3943584e7ee13f606a1eb2323454a28a3699847b7 2024-05-14T12:20:22.252 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:20:22 smithi073 systemd[1]: Started Ceph mds.c for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:22.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:20:23.107 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:23.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:23.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:23.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:23.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: Deploying daemon mds.h on smithi066 2024-05-14T12:20:23.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:23.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] up:boot 2024-05-14T12:20:23.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: fsmap 7 up:standby 2024-05-14T12:20:23.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: Deploying daemon mds.h on smithi066 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] up:boot 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: fsmap 7 up:standby 2024-05-14T12:20:23.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: Deploying daemon mds.h on smithi066 2024-05-14T12:20:23.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:23.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] up:boot 2024-05-14T12:20:23.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: fsmap 7 up:standby 2024-05-14T12:20:23.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T12:20:24.501 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 systemd[1]: Starting Ceph mds.h for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:20:24.811 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 podman[65789]: 2024-05-14 12:20:24.404476862 +0000 UTC m=+0.017484924 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:20:24.811 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 podman[65789]: 2024-05-14 12:20:24.5096796 +0000 UTC m=+0.122687650 container create 8fd6117631c40d0df86616ca80d21cbca37a26634b13bf0e46086672e2608b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-14T12:20:24.811 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 podman[65789]: 2024-05-14 12:20:24.811919209 +0000 UTC m=+0.424927255 container init 8fd6117631c40d0df86616ca80d21cbca37a26634b13bf0e46086672e2608b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-14T12:20:25.075 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 podman[65789]: 2024-05-14 12:20:24.814837223 +0000 UTC m=+0.427845286 container start 8fd6117631c40d0df86616ca80d21cbca37a26634b13bf0e46086672e2608b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-14T12:20:25.075 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 ceph-mds[65808]: -- 172.21.15.66:0/3890394300 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5562c3165a40 con 0x5562c31ada80 2024-05-14T12:20:25.075 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h[65804]: starting mds.h at 2024-05-14T12:20:25.075 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 bash[65789]: 8fd6117631c40d0df86616ca80d21cbca37a26634b13bf0e46086672e2608b9a 2024-05-14T12:20:25.075 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:20:24 smithi066 systemd[1]: Started Ceph mds.h for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:25.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:25 smithi047 ceph-mon[31254]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:25.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:25.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:25.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 -- 172.21.15.47:0/219705397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 msgr2=0x7fe744110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 --2- 172.21.15.47:0/219705397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 0x7fe744110d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe738009990 tx=0x7fe738009ca0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 -- 172.21.15.47:0/219705397 shutdown_connections 2024-05-14T12:20:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 --2- 172.21.15.47:0/219705397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410b2e0 0x7fe744117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 --2- 172.21.15.47:0/219705397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 0x7fe744110d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 --2- 172.21.15.47:0/219705397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe74410a990 0x7fe74410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 -- 172.21.15.47:0/219705397 >> 172.21.15.47:0/219705397 conn(0x7fe744077c80 msgr2=0x7fe7440780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 -- 172.21.15.47:0/219705397 shutdown_connections 2024-05-14T12:20:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.573+0000 7fe74b400700 1 -- 172.21.15.47:0/219705397 wait complete. 2024-05-14T12:20:25.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:25 smithi066 ceph-mon[35981]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:25.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:25.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:25.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.574+0000 7fe74b400700 1 Processor -- start 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.575+0000 7fe74b400700 1 -- start start 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.575+0000 7fe74b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410a990 0x7fe7441a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.575+0000 7fe74b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe74410b2e0 0x7fe7441a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.575+0000 7fe74b400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 0x7fe7441a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.575+0000 7fe74b400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe74411aac0 con 0x7fe74410b2e0 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.575+0000 7fe74b400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe74411a940 con 0x7fe744110970 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.575+0000 7fe74b400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe74411ac40 con 0x7fe74410a990 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410a990 0x7fe7441a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410a990 0x7fe7441a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:54026/0 (socket says 172.21.15.47:54026) 2024-05-14T12:20:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 -- 172.21.15.47:0/3243014018 learned_addr learned my addr 172.21.15.47:0/3243014018 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe743e00700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe74410b2e0 0x7fe7441a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe749400700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 0x7fe7441a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 -- 172.21.15.47:0/3243014018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 msgr2=0x7fe7441a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 0x7fe7441a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 -- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe74410b2e0 msgr2=0x7fe7441a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe74410b2e0 0x7fe7441a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 -- 172.21.15.47:0/3243014018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7441a6360 con 0x7fe74410a990 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.576+0000 7fe748a00700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410a990 0x7fe7441a1490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe738000c00 tx=0x7fe7380057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.577+0000 7fe741600700 1 -- 172.21.15.47:0/3243014018 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738027070 con 0x7fe74410a990 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.577+0000 7fe741600700 1 -- 172.21.15.47:0/3243014018 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe738022470 con 0x7fe74410a990 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.577+0000 7fe741600700 1 -- 172.21.15.47:0/3243014018 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738017650 con 0x7fe74410a990 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.577+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7441a65f0 con 0x7fe74410a990 2024-05-14T12:20:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.577+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7441adf70 con 0x7fe74410a990 2024-05-14T12:20:25.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.578+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74410c080 con 0x7fe74410a990 2024-05-14T12:20:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.580+0000 7fe741600700 1 -- 172.21.15.47:0/3243014018 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe73802a070 con 0x7fe74410a990 2024-05-14T12:20:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.582+0000 7fe741600700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe72c0b2900 0x7fe72c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.582+0000 7fe741600700 1 -- 172.21.15.47:0/3243014018 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe7380e2cb0 con 0x7fe74410a990 2024-05-14T12:20:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.582+0000 7fe743e00700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe72c0b2900 0x7fe72c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:25.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.583+0000 7fe743e00700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe72c0b2900 0x7fe72c0b4e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe74407b0d0 tx=0x7fe730009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:25.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.586+0000 7fe741600700 1 -- 172.21.15.47:0/3243014018 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe73805fdf0 con 0x7fe74410a990 2024-05-14T12:20:25.683 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:25 smithi073 ceph-mon[35809]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:25.683 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.683 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.683 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:25.683 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:25.683 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:25.683 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.876+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7441a27f0 con 0x7fe74410a990 2024-05-14T12:20:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.877+0000 7fe741600700 1 -- 172.21.15.47:0/3243014018 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7162 (secure 0 0 0) 0x7fe738013070 con 0x7fe74410a990 2024-05-14T12:20:25.878 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-14T12:20:25.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe72c0b2900 msgr2=0x7fe72c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:25.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe72c0b2900 0x7fe72c0b4e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe74407b0d0 tx=0x7fe730009260 comp rx=0 tx=0).stop 2024-05-14T12:20:25.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410a990 msgr2=0x7fe7441a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:25.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410a990 0x7fe7441a1490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe738000c00 tx=0x7fe7380057c0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 shutdown_connections 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe72c0b2900 0x7fe72c0b4e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe744110970 0x7fe7441a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe74410a990 0x7fe7441a1490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 --2- 172.21.15.47:0/3243014018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe74410b2e0 0x7fe7441a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.881+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 >> 172.21.15.47:0/3243014018 conn(0x7fe744077c80 msgr2=0x7fe74407bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.882+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 shutdown_connections 2024-05-14T12:20:25.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:25.882+0000 7fe74b400700 1 -- 172.21.15.47:0/3243014018 wait complete. 2024-05-14T12:20:25.884 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-14T12:20:26.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:26 smithi066 ceph-mon[35981]: Deploying daemon mds.i on smithi073 2024-05-14T12:20:26.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:26 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6836/2588925145,v1:172.21.15.66:6837/2588925145] up:boot 2024-05-14T12:20:26.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:26 smithi066 ceph-mon[35981]: fsmap 8 up:standby 2024-05-14T12:20:26.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T12:20:26.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:26 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3243014018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:26.652 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:26 smithi073 ceph-mon[35809]: Deploying daemon mds.i on smithi073 2024-05-14T12:20:26.652 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:26 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6836/2588925145,v1:172.21.15.66:6837/2588925145] up:boot 2024-05-14T12:20:26.652 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:26 smithi073 ceph-mon[35809]: fsmap 8 up:standby 2024-05-14T12:20:26.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T12:20:26.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:26 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3243014018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:26.667 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:26 smithi047 ceph-mon[31254]: Deploying daemon mds.i on smithi073 2024-05-14T12:20:26.667 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:26 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6836/2588925145,v1:172.21.15.66:6837/2588925145] up:boot 2024-05-14T12:20:26.667 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:26 smithi047 ceph-mon[31254]: fsmap 8 up:standby 2024-05-14T12:20:26.667 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T12:20:26.667 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:26 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3243014018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:27.252 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 systemd[1]: Starting Ceph mds.i for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:20:27.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:27 smithi066 ceph-mon[35981]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:27.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:27 smithi073 ceph-mon[35809]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:27.607 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 podman[67314]: 2024-05-14 12:20:27.245335467 +0000 UTC m=+0.017537042 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:20:27.608 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 podman[67314]: 2024-05-14 12:20:27.363468764 +0000 UTC m=+0.135670331 container create 4575e4da0fbf0733d766788098e1b1f7bd63e73156bc980fbf6671c42e7fb87d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-14T12:20:27.608 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 podman[67314]: 2024-05-14 12:20:27.608083279 +0000 UTC m=+0.380284845 container init 4575e4da0fbf0733d766788098e1b1f7bd63e73156bc980fbf6671c42e7fb87d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:20:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:27 smithi047 ceph-mon[31254]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:28.002 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 podman[67314]: 2024-05-14 12:20:27.611019237 +0000 UTC m=+0.383220808 container start 4575e4da0fbf0733d766788098e1b1f7bd63e73156bc980fbf6671c42e7fb87d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-14T12:20:28.002 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 ceph-mds[67334]: -- 172.21.15.73:0/2463055195 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5568254e9a40 con 0x556825531a80 2024-05-14T12:20:28.002 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i[67330]: starting mds.i at 2024-05-14T12:20:28.002 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 bash[67314]: 4575e4da0fbf0733d766788098e1b1f7bd63e73156bc980fbf6671c42e7fb87d 2024-05-14T12:20:28.002 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:20:27 smithi073 systemd[1]: Started Ceph mds.i for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:28.753 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:20:29.075 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.075 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.075 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: Deploying daemon mds.g on smithi047 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] up:boot 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: fsmap 9 up:standby 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:29.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:29.077 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: Deploying daemon mds.g on smithi047 2024-05-14T12:20:29.077 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:29.077 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] up:boot 2024-05-14T12:20:29.077 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: fsmap 9 up:standby 2024-05-14T12:20:29.077 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T12:20:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:29.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: Deploying daemon mds.g on smithi047 2024-05-14T12:20:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] up:boot 2024-05-14T12:20:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: fsmap 9 up:standby 2024-05-14T12:20:29.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T12:20:30.196 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:31.235 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:31 smithi047 systemd[1]: Starting Ceph mds.g for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:20:31.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:31 smithi066 ceph-mon[35981]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:31.641 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:31 smithi047 ceph-mon[31254]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:31.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:31 smithi073 ceph-mon[35809]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:31.894 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:31 smithi047 podman[70516]: 2024-05-14 12:20:31.777903063 +0000 UTC m=+0.040615636 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:20:31.894 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:31 smithi047 podman[70516]: 2024-05-14 12:20:31.89149385 +0000 UTC m=+0.154206456 container create 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0) 2024-05-14T12:20:32.764 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:32 smithi047 podman[70516]: 2024-05-14 12:20:32.509400307 +0000 UTC m=+0.772112978 container init 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True) 2024-05-14T12:20:32.765 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:32 smithi047 podman[70516]: 2024-05-14 12:20:32.521534917 +0000 UTC m=+0.784247497 container start 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-14T12:20:32.765 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:32 smithi047 bash[70516]: 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a 2024-05-14T12:20:32.765 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:32 smithi047 systemd[1]: Started Ceph mds.g for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:32.765 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:32 smithi047 ceph-mds[70556]: -- 172.21.15.47:0/967648354 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c672a65a40 con 0x55c672aad180 2024-05-14T12:20:32.765 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:20:32 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g[70545]: starting mds.g at 2024-05-14T12:20:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 -- 172.21.15.47:0/3348731833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc1054e0 msgr2=0x7f70bc1058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 --2- 172.21.15.47:0/3348731833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc1054e0 0x7f70bc1058f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009990 tx=0x7f70ac009ca0 comp rx=0 tx=0).stop 2024-05-14T12:20:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 -- 172.21.15.47:0/3348731833 shutdown_connections 2024-05-14T12:20:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 --2- 172.21.15.47:0/3348731833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70bc10e910 0x7f70bc110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 --2- 172.21.15.47:0/3348731833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc1054e0 0x7f70bc1058f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 --2- 172.21.15.47:0/3348731833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70bc105e30 0x7f70bc10e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 -- 172.21.15.47:0/3348731833 >> 172.21.15.47:0/3348731833 conn(0x7f70bc0fef30 msgr2=0x7f70bc101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 -- 172.21.15.47:0/3348731833 shutdown_connections 2024-05-14T12:20:32.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:32.998+0000 7f70c0a00700 1 -- 172.21.15.47:0/3348731833 wait complete. 2024-05-14T12:20:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.000+0000 7f70c0a00700 1 Processor -- start 2024-05-14T12:20:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.000+0000 7f70c0a00700 1 -- start start 2024-05-14T12:20:33.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70c0a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70bc1054e0 0x7f70bc19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70c0a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70bc105e30 0x7f70bc19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70c0a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc10e910 0x7f70bc19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70c0a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc114460 con 0x7f70bc105e30 2024-05-14T12:20:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70c0a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1142e0 con 0x7f70bc10e910 2024-05-14T12:20:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70c0a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1145e0 con 0x7f70bc1054e0 2024-05-14T12:20:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70b9400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70bc105e30 0x7f70bc19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:33.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70b9e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70bc1054e0 0x7f70bc19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70b9400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70bc105e30 0x7f70bc19b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33544/0 (socket says 172.21.15.47:33544) 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70b9400700 1 -- 172.21.15.47:0/2233929942 learned_addr learned my addr 172.21.15.47:0/2233929942 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.001+0000 7f70ba800700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc10e910 0x7f70bc19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.002+0000 7f70b9e00700 1 -- 172.21.15.47:0/2233929942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc10e910 msgr2=0x7f70bc19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.002+0000 7f70b9e00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc10e910 0x7f70bc19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.002+0000 7f70b9e00700 1 -- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70bc105e30 msgr2=0x7f70bc19b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.002+0000 7f70b9e00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70bc105e30 0x7f70bc19b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:33.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.002+0000 7f70b9e00700 1 -- 172.21.15.47:0/2233929942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc19fcc0 con 0x7f70bc1054e0 2024-05-14T12:20:33.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.002+0000 7f70b9e00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70bc1054e0 0x7f70bc19adf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70ac006010 tx=0x7f70ac0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:33.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.002+0000 7f70b2a00700 1 -- 172.21.15.47:0/2233929942 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac027070 con 0x7f70bc1054e0 2024-05-14T12:20:33.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.003+0000 7f70b2a00700 1 -- 172.21.15.47:0/2233929942 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70ac022470 con 0x7f70bc1054e0 2024-05-14T12:20:33.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.003+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc19ff50 con 0x7f70bc1054e0 2024-05-14T12:20:33.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.003+0000 7f70b2a00700 1 -- 172.21.15.47:0/2233929942 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac017650 con 0x7f70bc1054e0 2024-05-14T12:20:33.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.003+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc1a0430 con 0x7f70bc1054e0 2024-05-14T12:20:33.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.004+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc0512c0 con 0x7f70bc1054e0 2024-05-14T12:20:33.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.006+0000 7f70b2a00700 1 -- 172.21.15.47:0/2233929942 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f70ac02a070 con 0x7f70bc1054e0 2024-05-14T12:20:33.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.008+0000 7f70b2a00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70a00b2880 0x7f70a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:33.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.008+0000 7f70b2a00700 1 -- 172.21.15.47:0/2233929942 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f70ac0e2aa0 con 0x7f70bc1054e0 2024-05-14T12:20:33.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.008+0000 7f70b9400700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70a00b2880 0x7f70a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:33.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.009+0000 7f70b9400700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70a00b2880 0x7f70a00b4d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70bc1023c0 tx=0x7f70a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.013+0000 7f70b2a00700 1 -- 172.21.15.47:0/2233929942 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f70ac013070 con 0x7f70bc1054e0 2024-05-14T12:20:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.312+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70bc02e5f0 con 0x7f70bc1054e0 2024-05-14T12:20:33.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.314+0000 7f70b2a00700 1 -- 172.21.15.47:0/2233929942 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8815 (secure 0 0 0) 0x7f70ac0aabc0 con 0x7f70bc1054e0 2024-05-14T12:20:33.314 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:33.314 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.316+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70a00b2880 msgr2=0x7f70a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.316+0000 7f70c0a00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70a00b2880 0x7f70a00b4d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70bc1023c0 tx=0x7f70a8009260 comp rx=0 tx=0).stop 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.316+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70bc1054e0 msgr2=0x7f70bc19adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.316+0000 7f70c0a00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70bc1054e0 0x7f70bc19adf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70ac006010 tx=0x7f70ac0057c0 comp rx=0 tx=0).stop 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 shutdown_connections 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70a00b2880 0x7f70a00b4d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70bc10e910 0x7f70bc19f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70bc1054e0 0x7f70bc19adf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 --2- 172.21.15.47:0/2233929942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70bc105e30 0x7f70bc19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 >> 172.21.15.47:0/2233929942 conn(0x7f70bc0fef30 msgr2=0x7f70bc0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 shutdown_connections 2024-05-14T12:20:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:33.317+0000 7f70c0a00700 1 -- 172.21.15.47:0/2233929942 wait complete. 2024-05-14T12:20:33.318 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 11 2024-05-14T12:20:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:33 smithi066 ceph-mon[35981]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:33.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:33.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:33 smithi047 ceph-mon[31254]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:33.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:33.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:33.712 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:33 smithi073 ceph-mon[35809]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:34.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:34 smithi047 ceph-mon[31254]: Deploying daemon mds.a on smithi047 2024-05-14T12:20:34.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:34 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.47:6838/1063467558,v1:172.21.15.47:6839/1063467558] up:boot 2024-05-14T12:20:34.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:34 smithi047 ceph-mon[31254]: fsmap 10 up:standby 2024-05-14T12:20:34.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:34 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T12:20:34.328 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:34 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2233929942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:34.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:34 smithi066 ceph-mon[35981]: Deploying daemon mds.a on smithi047 2024-05-14T12:20:34.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:34 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.47:6838/1063467558,v1:172.21.15.47:6839/1063467558] up:boot 2024-05-14T12:20:34.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:34 smithi066 ceph-mon[35981]: fsmap 10 up:standby 2024-05-14T12:20:34.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:34 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T12:20:34.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:34 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2233929942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:34.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:34 smithi073 ceph-mon[35809]: Deploying daemon mds.a on smithi047 2024-05-14T12:20:34.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:34 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.47:6838/1063467558,v1:172.21.15.47:6839/1063467558] up:boot 2024-05-14T12:20:34.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:34 smithi073 ceph-mon[35809]: fsmap 10 up:standby 2024-05-14T12:20:34.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:34 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T12:20:34.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:34 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2233929942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:35 smithi047 ceph-mon[31254]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:35.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:35 smithi066 ceph-mon[35981]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:35.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:35 smithi073 ceph-mon[35809]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:36.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:20:36.866 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:20:36 smithi047 podman[70897]: 2024-05-14 12:20:36.484689978 +0000 UTC m=+0.035466036 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:20:36.866 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:20:36 smithi047 podman[70897]: 2024-05-14 12:20:36.865382219 +0000 UTC m=+0.416158321 container init ce3db125857dd0d62bc2300b20c6e1f2a3079e06938cf3c5d3daa16f19547e91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-14T12:20:37.057 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:37.207 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:20:36 smithi047 podman[70897]: 2024-05-14 12:20:36.876792623 +0000 UTC m=+0.427568692 container start ce3db125857dd0d62bc2300b20c6e1f2a3079e06938cf3c5d3daa16f19547e91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-14T12:20:37.208 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:20:36 smithi047 bash[70897]: ce3db125857dd0d62bc2300b20c6e1f2a3079e06938cf3c5d3daa16f19547e91 2024-05-14T12:20:37.208 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:20:36 smithi047 systemd[1]: Started Ceph mds.a for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:37.208 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:20:36 smithi047 ceph-mds[70932]: -- 172.21.15.47:0/265751879 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55abaf50da40 con 0x55abaf555600 2024-05-14T12:20:37.208 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: starting mds.a at 2024-05-14T12:20:37.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-mon[31254]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:37.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:37.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:37.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:37 smithi073 ceph-mon[35809]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:37.787 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:37 smithi066 ceph-mon[35981]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:37.787 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.787 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.787 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:37.787 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T12:20:37.787 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T12:20:37.787 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:38.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:38 smithi066 ceph-mon[35981]: Deploying daemon mds.b on smithi066 2024-05-14T12:20:38.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:38 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] up:boot 2024-05-14T12:20:38.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:38 smithi066 ceph-mon[35981]: fsmap 11 up:standby 2024-05-14T12:20:38.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T12:20:38.699 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:38 smithi047 ceph-mon[31254]: Deploying daemon mds.b on smithi066 2024-05-14T12:20:38.699 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:38 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] up:boot 2024-05-14T12:20:38.699 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:38 smithi047 ceph-mon[31254]: fsmap 11 up:standby 2024-05-14T12:20:38.699 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T12:20:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:38 smithi073 ceph-mon[35809]: Deploying daemon mds.b on smithi066 2024-05-14T12:20:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:38 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] up:boot 2024-05-14T12:20:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:38 smithi073 ceph-mon[35809]: fsmap 11 up:standby 2024-05-14T12:20:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.292+0000 7f835f200700 1 -- 172.21.15.47:0/4232415706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 msgr2=0x7f8358110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.292+0000 7f835f200700 1 --2- 172.21.15.47:0/4232415706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f8358110660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8344009990 tx=0x7f8344009ca0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.292+0000 7f835f200700 1 -- 172.21.15.47:0/4232415706 shutdown_connections 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.292+0000 7f835f200700 1 --2- 172.21.15.47:0/4232415706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358110ba0 0x7f8358113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.292+0000 7f835f200700 1 --2- 172.21.15.47:0/4232415706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8358075d30 0x7f8358076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.292+0000 7f835f200700 1 --2- 172.21.15.47:0/4232415706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f8358110660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.292+0000 7f835f200700 1 -- 172.21.15.47:0/4232415706 >> 172.21.15.47:0/4232415706 conn(0x7f83580fffe0 msgr2=0x7f8358102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:39.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.293+0000 7f835f200700 1 -- 172.21.15.47:0/4232415706 shutdown_connections 2024-05-14T12:20:39.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.293+0000 7f835f200700 1 -- 172.21.15.47:0/4232415706 wait complete. 2024-05-14T12:20:39.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.295+0000 7f835f200700 1 Processor -- start 2024-05-14T12:20:39.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.295+0000 7f835f200700 1 -- start start 2024-05-14T12:20:39.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f835f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8358075d30 0x7f835819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:39.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f835f200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f835819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f835f200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358110ba0 0x7f83581a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f835f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f83581166f0 con 0x7f8358075d30 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f835f200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8358116570 con 0x7f8358076680 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f835f200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8358116870 con 0x7f8358110ba0 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f835819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8358075d30 0x7f835819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f835819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:36438/0 (socket says 172.21.15.47:36438) 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 -- 172.21.15.47:0/371574249 learned_addr learned my addr 172.21.15.47:0/371574249 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f835d200700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358110ba0 0x7f83581a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 -- 172.21.15.47:0/371574249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358110ba0 msgr2=0x7f83581a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358110ba0 0x7f83581a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 -- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8358075d30 msgr2=0x7f835819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8358075d30 0x7f835819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.296+0000 7f8357400700 1 -- 172.21.15.47:0/371574249 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83581a1f50 con 0x7f8358076680 2024-05-14T12:20:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.297+0000 7f8357400700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f835819d620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8344005910 tx=0x7f834400b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:39.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.297+0000 7f8354c00700 1 -- 172.21.15.47:0/371574249 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344027070 con 0x7f8358076680 2024-05-14T12:20:39.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.297+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83581a21e0 con 0x7f8358076680 2024-05-14T12:20:39.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.297+0000 7f8354c00700 1 -- 172.21.15.47:0/371574249 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8344022470 con 0x7f8358076680 2024-05-14T12:20:39.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.297+0000 7f8354c00700 1 -- 172.21.15.47:0/371574249 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344017650 con 0x7f8358076680 2024-05-14T12:20:39.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.297+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83581a26c0 con 0x7f8358076680 2024-05-14T12:20:39.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.298+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83580512c0 con 0x7f8358076680 2024-05-14T12:20:39.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.301+0000 7f8354c00700 1 -- 172.21.15.47:0/371574249 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f834402a070 con 0x7f8358076680 2024-05-14T12:20:39.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.303+0000 7f8354c00700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f833c0b2880 0x7f833c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:39.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.303+0000 7f8354c00700 1 -- 172.21.15.47:0/371574249 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f83440e2db0 con 0x7f8358076680 2024-05-14T12:20:39.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.303+0000 7f8357e00700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f833c0b2880 0x7f833c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:39.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.304+0000 7f8357e00700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f833c0b2880 0x7f833c0b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8348009c60 tx=0x7f8348009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:39.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.305+0000 7f8354c00700 1 -- 172.21.15.47:0/371574249 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8344013070 con 0x7f8358076680 2024-05-14T12:20:39.325 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 systemd[1]: Starting Ceph mds.b for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:20:39.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.593+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f835802e5f0 con 0x7f8358076680 2024-05-14T12:20:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:39 smithi047 ceph-mon[31254]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:39.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.594+0000 7f8354c00700 1 -- 172.21.15.47:0/371574249 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9641 (secure 0 0 0) 0x7f83440aaf60 con 0x7f8358076680 2024-05-14T12:20:39.594 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:39.595 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-05-14T12:20:39.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.598+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f833c0b2880 msgr2=0x7f833c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.598+0000 7f835f200700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f833c0b2880 0x7f833c0b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8348009c60 tx=0x7f8348009260 comp rx=0 tx=0).stop 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.598+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 msgr2=0x7f835819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.598+0000 7f835f200700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f835819d620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8344005910 tx=0x7f834400b670 comp rx=0 tx=0).stop 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 shutdown_connections 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f833c0b2880 0x7f833c0b4d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358110ba0 0x7f83581a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8358075d30 0x7f835819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 --2- 172.21.15.47:0/371574249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8358076680 0x7f835819d620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 >> 172.21.15.47:0/371574249 conn(0x7f83580fffe0 msgr2=0x7f8358101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 shutdown_connections 2024-05-14T12:20:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:39.599+0000 7f835f200700 1 -- 172.21.15.47:0/371574249 wait complete. 2024-05-14T12:20:39.600 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 12 2024-05-14T12:20:39.668 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:39 smithi066 ceph-mon[35981]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:39.668 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 podman[66103]: 2024-05-14 12:20:39.323479752 +0000 UTC m=+0.017795752 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:20:39.668 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 podman[66103]: 2024-05-14 12:20:39.54756451 +0000 UTC m=+0.241880505 container create 35a40c749e6301556ae3f878ff3d48d0cf2af2d8ee34dc269233fb9a80d84c71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS) 2024-05-14T12:20:39.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:39 smithi073 ceph-mon[35809]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:40.075 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 podman[66103]: 2024-05-14 12:20:39.775296683 +0000 UTC m=+0.469612679 container init 35a40c749e6301556ae3f878ff3d48d0cf2af2d8ee34dc269233fb9a80d84c71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T12:20:40.075 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 podman[66103]: 2024-05-14 12:20:39.778639607 +0000 UTC m=+0.472955608 container start 35a40c749e6301556ae3f878ff3d48d0cf2af2d8ee34dc269233fb9a80d84c71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:20:40.075 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 ceph-mds[66121]: -- 172.21.15.66:0/2483937330 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc6dfbfa40 con 0x55fc6e007600 2024-05-14T12:20:40.075 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b[66117]: starting mds.b at 2024-05-14T12:20:40.075 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 bash[66103]: 35a40c749e6301556ae3f878ff3d48d0cf2af2d8ee34dc269233fb9a80d84c71 2024-05-14T12:20:40.076 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:20:39 smithi066 systemd[1]: Started Ceph mds.b for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:20:40.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:40 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/371574249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:40.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:40 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:20:40.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:40 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/371574249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:40.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:40 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:20:40.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:40 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/371574249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:40.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:40.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:40 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:20:41.418 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:41 smithi066 ceph-mon[35981]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:41.418 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:41 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] up:boot 2024-05-14T12:20:41.418 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:41 smithi066 ceph-mon[35981]: fsmap 12 up:standby 2024-05-14T12:20:41.418 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:41 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T12:20:41.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:41 smithi073 ceph-mon[35809]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:41.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:41 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] up:boot 2024-05-14T12:20:41.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:41 smithi073 ceph-mon[35809]: fsmap 12 up:standby 2024-05-14T12:20:41.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:41 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T12:20:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:41 smithi047 ceph-mon[31254]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:41 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] up:boot 2024-05-14T12:20:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:41 smithi047 ceph-mon[31254]: fsmap 12 up:standby 2024-05-14T12:20:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:41 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T12:20:42.648 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:20:43.114 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:43 smithi073 ceph-mon[35809]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:43.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:43 smithi047 ceph-mon[31254]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:43 smithi066 ceph-mon[35981]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:20:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:44 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:20:44.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:44 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:20:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:20:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:44.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:44 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:20:45.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 -- 172.21.15.47:0/2938222162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0110be0 msgr2=0x7ff8f0113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:45.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/2938222162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0110be0 0x7ff8f0113000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800b0a0 tx=0x7ff8e800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 -- 172.21.15.47:0/2938222162 shutdown_connections 2024-05-14T12:20:45.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/2938222162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0110be0 0x7ff8f0113000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/2938222162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8f0076c10 0x7ff8f0077020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/2938222162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0077560 0x7ff8f01106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 -- 172.21.15.47:0/2938222162 >> 172.21.15.47:0/2938222162 conn(0x7ff8f00ffea0 msgr2=0x7ff8f01022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:45.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 -- 172.21.15.47:0/2938222162 shutdown_connections 2024-05-14T12:20:45.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.408+0000 7ff8f4a00700 1 -- 172.21.15.47:0/2938222162 wait complete. 2024-05-14T12:20:45.409 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:45 smithi047 ceph-mon[31254]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.409+0000 7ff8f4a00700 1 Processor -- start 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.410+0000 7ff8f4a00700 1 -- start start 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.410+0000 7ff8f4a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0076c10 0x7ff8f019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.410+0000 7ff8f4a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0077560 0x7ff8f019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.410+0000 7ff8f4a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8f0110be0 0x7ff8f01a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.410+0000 7ff8f4a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0116710 con 0x7ff8f0076c10 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.410+0000 7ff8f4a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0116590 con 0x7ff8f0077560 2024-05-14T12:20:45.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.410+0000 7ff8f4a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0116890 con 0x7ff8f0110be0 2024-05-14T12:20:45.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ede00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0076c10 0x7ff8f019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ede00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0076c10 0x7ff8f019d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47150/0 (socket says 172.21.15.47:47150) 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ede00700 1 -- 172.21.15.47:0/234848511 learned_addr learned my addr 172.21.15.47:0/234848511 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ee800700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8f0110be0 0x7ff8f01a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ed400700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0077560 0x7ff8f019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ee800700 1 -- 172.21.15.47:0/234848511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0077560 msgr2=0x7ff8f019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ee800700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0077560 0x7ff8f019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ee800700 1 -- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0076c10 msgr2=0x7ff8f019d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ee800700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0076c10 0x7ff8f019d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ee800700 1 -- 172.21.15.47:0/234848511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f01a1f00 con 0x7ff8f0110be0 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.411+0000 7ff8ede00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0076c10 0x7ff8f019d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.412+0000 7ff8ee800700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8f0110be0 0x7ff8f01a1860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800b070 tx=0x7ff8e8004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.412+0000 7ff8e6a00700 1 -- 172.21.15.47:0/234848511 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8021070 con 0x7ff8f0110be0 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.412+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f01a2190 con 0x7ff8f0110be0 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.412+0000 7ff8e6a00700 1 -- 172.21.15.47:0/234848511 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8e8007e30 con 0x7ff8f0110be0 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.412+0000 7ff8e6a00700 1 -- 172.21.15.47:0/234848511 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e80046f0 con 0x7ff8f0110be0 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.412+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f01a9b10 con 0x7ff8f0110be0 2024-05-14T12:20:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.414+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f00512c0 con 0x7ff8f0110be0 2024-05-14T12:20:45.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.416+0000 7ff8e6a00700 1 -- 172.21.15.47:0/234848511 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff8e8007980 con 0x7ff8f0110be0 2024-05-14T12:20:45.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.418+0000 7ff8e6a00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8d40b2900 0x7ff8d40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:45.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.418+0000 7ff8e6a00700 1 -- 172.21.15.47:0/234848511 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ff8e800f020 con 0x7ff8f0110be0 2024-05-14T12:20:45.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.418+0000 7ff8ede00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8d40b2900 0x7ff8d40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:45.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.419+0000 7ff8ede00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8d40b2900 0x7ff8d40b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0011590 tx=0x7ff8e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:45.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.423+0000 7ff8e6a00700 1 -- 172.21.15.47:0/234848511 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff8e802a020 con 0x7ff8f0110be0 2024-05-14T12:20:45.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:45 smithi073 ceph-mon[35809]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:45 smithi066 ceph-mon[35981]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:45.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.765+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8f019e390 con 0x7ff8f0110be0 2024-05-14T12:20:45.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.766+0000 7ff8e6a00700 1 -- 172.21.15.47:0/234848511 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10467 (secure 0 0 0) 0x7ff8e80cbe20 con 0x7ff8f0110be0 2024-05-14T12:20:45.767 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:45.767 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8d40b2900 msgr2=0x7ff8d40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8d40b2900 0x7ff8d40b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0011590 tx=0x7ff8e0009260 comp rx=0 tx=0).stop 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8f0110be0 msgr2=0x7ff8f01a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8f0110be0 0x7ff8f01a1860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800b070 tx=0x7ff8e8004c80 comp rx=0 tx=0).stop 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 shutdown_connections 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8d40b2900 0x7ff8d40b4e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8f0110be0 0x7ff8f01a1860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8f0076c10 0x7ff8f019d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 --2- 172.21.15.47:0/234848511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f0077560 0x7ff8f019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:45.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 >> 172.21.15.47:0/234848511 conn(0x7ff8f00ffea0 msgr2=0x7ff8f01004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:45.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 shutdown_connections 2024-05-14T12:20:45.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:45.770+0000 7ff8f4a00700 1 -- 172.21.15.47:0/234848511 wait complete. 2024-05-14T12:20:45.771 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 13 2024-05-14T12:20:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:46 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:46 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/234848511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:46.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:46 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:46.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:46 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/234848511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:47.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:46 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:47.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:46 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/234848511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:20:47.020 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-14T12:20:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:47.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:47 smithi066 ceph-mon[35981]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:47.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:47 smithi047 ceph-mon[31254]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:47 smithi073 ceph-mon[35809]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.629+0000 7f6bb3a00700 1 -- 172.21.15.47:0/2820927715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac1054e0 msgr2=0x7f6bac1058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.629+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/2820927715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac1054e0 0x7f6bac1058f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009990 tx=0x7f6ba0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.629+0000 7f6bb3a00700 1 -- 172.21.15.47:0/2820927715 shutdown_connections 2024-05-14T12:20:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.629+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/2820927715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac10e910 0x7f6bac110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.629+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/2820927715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac1054e0 0x7f6bac1058f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.629+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/2820927715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac105e30 0x7f6bac10e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.629+0000 7f6bb3a00700 1 -- 172.21.15.47:0/2820927715 >> 172.21.15.47:0/2820927715 conn(0x7f6bac0fef30 msgr2=0x7f6bac101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.630+0000 7f6bb3a00700 1 -- 172.21.15.47:0/2820927715 shutdown_connections 2024-05-14T12:20:49.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.630+0000 7f6bb3a00700 1 -- 172.21.15.47:0/2820927715 wait complete. 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.631+0000 7f6bb3a00700 1 Processor -- start 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.631+0000 7f6bb3a00700 1 -- start start 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb3a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac1054e0 0x7f6bac19d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb3a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac105e30 0x7f6bac19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb3a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac10e910 0x7f6bac1a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb3a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac114460 con 0x7f6bac105e30 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb3a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac1142e0 con 0x7f6bac1054e0 2024-05-14T12:20:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb3a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac1145e0 con 0x7f6bac10e910 2024-05-14T12:20:49.632 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:49 smithi047 ceph-mon[31254]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:49.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:49.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:49.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:49.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:20:49.633 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb1000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac1054e0 0x7f6bac19d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6babe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac105e30 0x7f6bac19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb1a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac10e910 0x7f6bac1a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb1000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac1054e0 0x7f6bac19d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35642/0 (socket says 172.21.15.47:35642) 2024-05-14T12:20:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.632+0000 7f6bb1000700 1 -- 172.21.15.47:0/3157366232 learned_addr learned my addr 172.21.15.47:0/3157366232 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:49.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6bb1000700 1 -- 172.21.15.47:0/3157366232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac10e910 msgr2=0x7f6bac1a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6bb1000700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac10e910 0x7f6bac1a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6bb1000700 1 -- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac105e30 msgr2=0x7f6bac19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6bb1000700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac105e30 0x7f6bac19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6bb1000700 1 -- 172.21.15.47:0/3157366232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac1a1f60 con 0x7f6bac1054e0 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6bb1a00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac10e910 0x7f6bac1a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6babe00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac105e30 0x7f6bac19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.633+0000 7f6bb1000700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac1054e0 0x7f6bac19d090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0000c00 tx=0x7f6ba000bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.634+0000 7f6ba9600700 1 -- 172.21.15.47:0/3157366232 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0027070 con 0x7f6bac1054e0 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.634+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac1a21f0 con 0x7f6bac1054e0 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.634+0000 7f6ba9600700 1 -- 172.21.15.47:0/3157366232 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba0022470 con 0x7f6bac1054e0 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.634+0000 7f6ba9600700 1 -- 172.21.15.47:0/3157366232 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0017650 con 0x7f6bac1054e0 2024-05-14T12:20:49.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.634+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bac106320 con 0x7f6bac1054e0 2024-05-14T12:20:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.635+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8c005330 con 0x7f6bac1054e0 2024-05-14T12:20:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.637+0000 7f6ba9600700 1 -- 172.21.15.47:0/3157366232 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6ba002a070 con 0x7f6bac1054e0 2024-05-14T12:20:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.640+0000 7f6ba9600700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b940b2900 0x7f6b940b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.640+0000 7f6ba9600700 1 -- 172.21.15.47:0/3157366232 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6ba00e29a0 con 0x7f6bac1054e0 2024-05-14T12:20:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.640+0000 7f6babe00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b940b2900 0x7f6b940b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.641+0000 7f6babe00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b940b2900 0x7f6b940b4e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6bac102450 tx=0x7f6b98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:49.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.643+0000 7f6ba9600700 1 -- 172.21.15.47:0/3157366232 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ba0013070 con 0x7f6bac1054e0 2024-05-14T12:20:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:49 smithi066 ceph-mon[35981]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:20:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:49.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.893+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6b8c005620 con 0x7f6bac1054e0 2024-05-14T12:20:49.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.894+0000 7f6ba9600700 1 -- 172.21.15.47:0/3157366232 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f6ba00aaac0 con 0x7f6bac1054e0 2024-05-14T12:20:49.894 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:20:49.894 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-05-14T12:20:49.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:20:49.894 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-05-14T12:20:49.894 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-05-14T12:20:49.894 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:20:49.895 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-05-14T12:20:49.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b940b2900 msgr2=0x7f6b940b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:49.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b940b2900 0x7f6b940b4e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6bac102450 tx=0x7f6b98009260 comp rx=0 tx=0).stop 2024-05-14T12:20:49.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac1054e0 msgr2=0x7f6bac19d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:49.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac1054e0 0x7f6bac19d090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0000c00 tx=0x7f6ba000bfd0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 shutdown_connections 2024-05-14T12:20:49.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b940b2900 0x7f6b940b4e10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac10e910 0x7f6bac1a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bac1054e0 0x7f6bac19d090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 --2- 172.21.15.47:0/3157366232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bac105e30 0x7f6bac19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:49.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.897+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 >> 172.21.15.47:0/3157366232 conn(0x7f6bac0fef30 msgr2=0x7f6bac0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:49.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.898+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 shutdown_connections 2024-05-14T12:20:49.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:49.898+0000 7f6bb3a00700 1 -- 172.21.15.47:0/3157366232 wait complete. 2024-05-14T12:20:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:49 smithi073 ceph-mon[35809]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:20:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:20:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:20:50.607 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T12:20:50.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T12:20:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:50 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3157366232' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T12:20:50.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:50 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3157366232' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T12:20:51.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:50 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3157366232' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T12:20:51.058 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:51 smithi066 ceph-mon[35981]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:51.903 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:51 smithi073 ceph-mon[35809]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:51.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:51 smithi047 ceph-mon[31254]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:53.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 -- 172.21.15.47:0/1455317218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 msgr2=0x7fc0341111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 --2- 172.21.15.47:0/1455317218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 0x7fc0341111d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009fc0 tx=0x7fc02c00b330 comp rx=0 tx=0).stop 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 -- 172.21.15.47:0/1455317218 shutdown_connections 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 --2- 172.21.15.47:0/1455317218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 0x7fc0341111d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 --2- 172.21.15.47:0/1455317218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0341045f0 0x7fc034104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 --2- 172.21.15.47:0/1455317218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc034108f20 0x7fc034109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 -- 172.21.15.47:0/1455317218 >> 172.21.15.47:0/1455317218 conn(0x7fc034100040 msgr2=0x7fc034102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 -- 172.21.15.47:0/1455317218 shutdown_connections 2024-05-14T12:20:53.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.374+0000 7fc039400700 1 -- 172.21.15.47:0/1455317218 wait complete. 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 Processor -- start 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 -- start start 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0341045f0 0x7fc03419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc034108f20 0x7fc03419b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 0x7fc03419f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341144f0 con 0x7fc034109870 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc034114370 con 0x7fc0341045f0 2024-05-14T12:20:53.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.376+0000 7fc039400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc034114670 con 0x7fc034108f20 2024-05-14T12:20:53.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0341045f0 0x7fc03419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:53.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc033200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 0x7fc03419f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:53.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0341045f0 0x7fc03419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35660/0 (socket says 172.21.15.47:35660) 2024-05-14T12:20:53.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 -- 172.21.15.47:0/2343357492 learned_addr learned my addr 172.21.15.47:0/2343357492 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:53.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc031e00700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc034108f20 0x7fc03419b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:53.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 -- 172.21.15.47:0/2343357492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc034108f20 msgr2=0x7fc03419b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:53.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc034108f20 0x7fc03419b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:53.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 -- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 msgr2=0x7fc03419f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:53.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 0x7fc03419f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:53.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc032800700 1 -- 172.21.15.47:0/2343357492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03419fd30 con 0x7fc0341045f0 2024-05-14T12:20:53.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.377+0000 7fc033200700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 0x7fc03419f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:20:53.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.378+0000 7fc032800700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0341045f0 0x7fc03419ae60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc02400ec10 tx=0x7fc02400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:53.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.378+0000 7fc02b400700 1 -- 172.21.15.47:0/2343357492 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02400cc90 con 0x7fc0341045f0 2024-05-14T12:20:53.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.378+0000 7fc02b400700 1 -- 172.21.15.47:0/2343357492 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02400ce30 con 0x7fc0341045f0 2024-05-14T12:20:53.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.378+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0341a0020 con 0x7fc0341045f0 2024-05-14T12:20:53.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.378+0000 7fc02b400700 1 -- 172.21.15.47:0/2343357492 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024010430 con 0x7fc0341045f0 2024-05-14T12:20:53.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.378+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0341a7940 con 0x7fc0341045f0 2024-05-14T12:20:53.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.379+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0340512c0 con 0x7fc0341045f0 2024-05-14T12:20:53.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.382+0000 7fc02b400700 1 -- 172.21.15.47:0/2343357492 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc024004000 con 0x7fc0341045f0 2024-05-14T12:20:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.383+0000 7fc02b400700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc0180b2880 0x7fc0180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.384+0000 7fc02b400700 1 -- 172.21.15.47:0/2343357492 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc0240e2180 con 0x7fc0341045f0 2024-05-14T12:20:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.384+0000 7fc031e00700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc0180b2880 0x7fc0180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.385+0000 7fc031e00700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc0180b2880 0x7fc0180b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc034103a00 tx=0x7fc020009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:53.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.386+0000 7fc02b400700 1 -- 172.21.15.47:0/2343357492 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc0240aa2a0 con 0x7fc0341045f0 2024-05-14T12:20:53.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:53.626+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc03402e5f0 con 0x7fc0341045f0 2024-05-14T12:20:53.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:53 smithi047 ceph-mon[31254]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:53 smithi066 ceph-mon[35981]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:54.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:53 smithi073 ceph-mon[35809]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:54.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.590+0000 7fc02b400700 1 -- 172.21.15.47:0/2343357492 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7fc0240a9ba0 con 0x7fc0341045f0 2024-05-14T12:20:54.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.595+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc0180b2880 msgr2=0x7fc0180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:54.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.595+0000 7fc039400700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc0180b2880 0x7fc0180b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc034103a00 tx=0x7fc020009260 comp rx=0 tx=0).stop 2024-05-14T12:20:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.595+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0341045f0 msgr2=0x7fc03419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.595+0000 7fc039400700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0341045f0 0x7fc03419ae60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc02400ec10 tx=0x7fc02400ef20 comp rx=0 tx=0).stop 2024-05-14T12:20:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.596+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 shutdown_connections 2024-05-14T12:20:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.596+0000 7fc039400700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc0180b2880 0x7fc0180b4d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.596+0000 7fc039400700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc034109870 0x7fc03419f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.596+0000 7fc039400700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0341045f0 0x7fc03419ae60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.596+0000 7fc039400700 1 --2- 172.21.15.47:0/2343357492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc034108f20 0x7fc03419b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.596+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 >> 172.21.15.47:0/2343357492 conn(0x7fc034100040 msgr2=0x7fc034108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.599+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 shutdown_connections 2024-05-14T12:20:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:54.599+0000 7fc039400700 1 -- 172.21.15.47:0/2343357492 wait complete. 2024-05-14T12:20:54.603 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-05-14T12:20:54.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:54 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2343357492' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T12:20:54.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:54 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T12:20:55.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:54 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2343357492' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T12:20:55.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:54 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T12:20:55.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:54 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2343357492' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T12:20:55.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:54 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T12:20:55.507 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T12:20:55.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:55 smithi047 ceph-mon[31254]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:55.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:55 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T12:20:55.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:55 smithi047 ceph-mon[31254]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T12:20:55.990 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:20:56.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:55 smithi073 ceph-mon[35809]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:56.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:55 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T12:20:56.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:55 smithi073 ceph-mon[35809]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T12:20:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:55 smithi066 ceph-mon[35981]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:55 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T12:20:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:55 smithi066 ceph-mon[35981]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T12:20:56.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:56 smithi047 ceph-mon[31254]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T12:20:57.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:56 smithi073 ceph-mon[35809]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T12:20:57.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:56 smithi066 ceph-mon[35981]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T12:20:57.954 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:57 smithi047 ceph-mon[31254]: pgmap v316: 33 pgs: 12 creating+peering, 17 unknown, 4 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:57.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:57 smithi047 ceph-mon[31254]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T12:20:57.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:57 smithi047 ceph-mon[31254]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T12:20:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:57 smithi073 ceph-mon[35809]: pgmap v316: 33 pgs: 12 creating+peering, 17 unknown, 4 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:57 smithi073 ceph-mon[35809]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T12:20:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:57 smithi073 ceph-mon[35809]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T12:20:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:57 smithi066 ceph-mon[35981]: pgmap v316: 33 pgs: 12 creating+peering, 17 unknown, 4 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:57 smithi066 ceph-mon[35981]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T12:20:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:57 smithi066 ceph-mon[35981]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T12:20:58.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.212+0000 7fa97ec00700 1 -- 172.21.15.47:0/2846977245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa978106ef0 msgr2=0x7fa978113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:58.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.212+0000 7fa97ec00700 1 --2- 172.21.15.47:0/2846977245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa978106ef0 0x7fa978113380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa970009f90 tx=0x7fa97000b330 comp rx=0 tx=0).stop 2024-05-14T12:20:58.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.212+0000 7fa97ec00700 1 -- 172.21.15.47:0/2846977245 shutdown_connections 2024-05-14T12:20:58.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.212+0000 7fa97ec00700 1 --2- 172.21.15.47:0/2846977245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa978106ef0 0x7fa978113380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.212+0000 7fa97ec00700 1 --2- 172.21.15.47:0/2846977245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa97810c5e0 0x7fa97810c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.212+0000 7fa97ec00700 1 --2- 172.21.15.47:0/2846977245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9781065a0 0x7fa9781069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.212+0000 7fa97ec00700 1 -- 172.21.15.47:0/2846977245 >> 172.21.15.47:0/2846977245 conn(0x7fa9781020c0 msgr2=0x7fa978104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:58.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.213+0000 7fa97ec00700 1 -- 172.21.15.47:0/2846977245 shutdown_connections 2024-05-14T12:20:58.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.213+0000 7fa97ec00700 1 -- 172.21.15.47:0/2846977245 wait complete. 2024-05-14T12:20:58.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.214+0000 7fa97ec00700 1 Processor -- start 2024-05-14T12:20:58.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.214+0000 7fa97ec00700 1 -- start start 2024-05-14T12:20:58.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa97ec00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9781065a0 0x7fa97819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:58.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa97ec00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa978106ef0 0x7fa97819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa97ec00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97810c5e0 0x7fa9781a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa97ec00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa978116760 con 0x7fa978106ef0 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa97ec00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781165e0 con 0x7fa9781065a0 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa97ec00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781168e0 con 0x7fa97810c5e0 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa977400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa978106ef0 0x7fa97819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa977e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9781065a0 0x7fa97819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa977e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9781065a0 0x7fa97819cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:45904/0 (socket says 172.21.15.47:45904) 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa977e00700 1 -- 172.21.15.47:0/4152200113 learned_addr learned my addr 172.21.15.47:0/4152200113 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:20:58.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.215+0000 7fa97cc00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97810c5e0 0x7fa9781a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.216+0000 7fa977e00700 1 -- 172.21.15.47:0/4152200113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97810c5e0 msgr2=0x7fa9781a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.216+0000 7fa977e00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97810c5e0 0x7fa9781a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.216+0000 7fa977e00700 1 -- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa978106ef0 msgr2=0x7fa97819d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.216+0000 7fa977e00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa978106ef0 0x7fa97819d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.216+0000 7fa977e00700 1 -- 172.21.15.47:0/4152200113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9781a1ec0 con 0x7fa9781065a0 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.216+0000 7fa977e00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9781065a0 0x7fa97819cff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa96800e970 tx=0x7fa96800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.217+0000 7fa974c00700 1 -- 172.21.15.47:0/4152200113 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968004a30 con 0x7fa9781065a0 2024-05-14T12:20:58.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.217+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9781a21b0 con 0x7fa9781065a0 2024-05-14T12:20:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.217+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9781a9ad0 con 0x7fa9781065a0 2024-05-14T12:20:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.217+0000 7fa974c00700 1 -- 172.21.15.47:0/4152200113 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa96800cc70 con 0x7fa9781065a0 2024-05-14T12:20:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.217+0000 7fa974c00700 1 -- 172.21.15.47:0/4152200113 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968005490 con 0x7fa9781065a0 2024-05-14T12:20:58.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.218+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa958005330 con 0x7fa9781065a0 2024-05-14T12:20:58.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.221+0000 7fa974c00700 1 -- 172.21.15.47:0/4152200113 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa968004bd0 con 0x7fa9781065a0 2024-05-14T12:20:58.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.222+0000 7fa974c00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa95c0b2880 0x7fa95c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:20:58.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.222+0000 7fa974c00700 1 -- 172.21.15.47:0/4152200113 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7fa9680e2240 con 0x7fa9781065a0 2024-05-14T12:20:58.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.223+0000 7fa977400700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa95c0b2880 0x7fa95c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:20:58.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.223+0000 7fa977400700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa95c0b2880 0x7fa95c0b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa978103d10 tx=0x7fa964009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:20:58.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.224+0000 7fa974c00700 1 -- 172.21.15.47:0/4152200113 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa968054df0 con 0x7fa9781065a0 2024-05-14T12:20:58.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.463+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa958005620 con 0x7fa9781065a0 2024-05-14T12:20:58.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.646+0000 7fa974c00700 1 -- 172.21.15.47:0/4152200113 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fa9680aa1f0 con 0x7fa9781065a0 2024-05-14T12:20:58.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa95c0b2880 msgr2=0x7fa95c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:58.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa95c0b2880 0x7fa95c0b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa978103d10 tx=0x7fa964009310 comp rx=0 tx=0).stop 2024-05-14T12:20:58.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9781065a0 msgr2=0x7fa97819cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:20:58.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9781065a0 0x7fa97819cff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa96800e970 tx=0x7fa96800ec80 comp rx=0 tx=0).stop 2024-05-14T12:20:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 shutdown_connections 2024-05-14T12:20:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa95c0b2880 0x7fa95c0b4d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97810c5e0 0x7fa9781a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9781065a0 0x7fa97819cff0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa96800e970 tx=0x7fa96800ec80 comp rx=0 tx=0).stop 2024-05-14T12:20:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 --2- 172.21.15.47:0/4152200113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa978106ef0 0x7fa97819d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:20:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.655+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 >> 172.21.15.47:0/4152200113 conn(0x7fa9781020c0 msgr2=0x7fa978104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:20:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.658+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 shutdown_connections 2024-05-14T12:20:58.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:20:58.658+0000 7fa97ec00700 1 -- 172.21.15.47:0/4152200113 wait complete. 2024-05-14T12:20:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-05-14T12:20:58.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:58 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/4152200113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T12:20:58.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:58 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T12:20:59.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:58 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/4152200113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T12:20:59.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:58 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T12:20:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:58 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/4152200113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T12:20:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:58 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T12:20:59.606 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T12:20:59.977 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:59 smithi066 ceph-mon[35981]: pgmap v318: 33 pgs: 12 creating+peering, 6 unknown, 15 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:59.977 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:59 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T12:20:59.977 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:20:59 smithi066 ceph-mon[35981]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T12:20:59.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:59 smithi047 ceph-mon[31254]: pgmap v318: 33 pgs: 12 creating+peering, 6 unknown, 15 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:20:59.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:59 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T12:20:59.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:20:59 smithi047 ceph-mon[31254]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T12:21:00.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:59 smithi073 ceph-mon[35809]: pgmap v318: 33 pgs: 12 creating+peering, 6 unknown, 15 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:21:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:59 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T12:21:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:20:59 smithi073 ceph-mon[35809]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T12:21:00.087 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:00.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:00 smithi047 ceph-mon[31254]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T12:21:00.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:00 smithi066 ceph-mon[35981]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T12:21:01.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:00 smithi073 ceph-mon[35809]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T12:21:01.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:01 smithi047 ceph-mon[31254]: pgmap v321: 97 pgs: 2 creating+peering, 46 unknown, 49 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:21:01.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:01 smithi047 ceph-mon[31254]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T12:21:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:01 smithi073 ceph-mon[35809]: pgmap v321: 97 pgs: 2 creating+peering, 46 unknown, 49 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:21:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:01 smithi073 ceph-mon[35809]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T12:21:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:01 smithi066 ceph-mon[35981]: pgmap v321: 97 pgs: 2 creating+peering, 46 unknown, 49 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:21:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:01 smithi066 ceph-mon[35981]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T12:21:02.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.338+0000 7fa6e6200700 1 -- 172.21.15.47:0/2291246145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 msgr2=0x7fa6e0077000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.338+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2291246145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e0077000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009990 tx=0x7fa6d0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.338+0000 7fa6e6200700 1 -- 172.21.15.47:0/2291246145 shutdown_connections 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.338+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2291246145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6e0110c00 0x7fa6e0113020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.338+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2291246145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e0077000 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.338+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2291246145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6e0077540 0x7fa6e01106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.338+0000 7fa6e6200700 1 -- 172.21.15.47:0/2291246145 >> 172.21.15.47:0/2291246145 conn(0x7fa6e00ffea0 msgr2=0x7fa6e01022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.339+0000 7fa6e6200700 1 -- 172.21.15.47:0/2291246145 shutdown_connections 2024-05-14T12:21:02.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.339+0000 7fa6e6200700 1 -- 172.21.15.47:0/2291246145 wait complete. 2024-05-14T12:21:02.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.340+0000 7fa6e6200700 1 Processor -- start 2024-05-14T12:21:02.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.340+0000 7fa6e6200700 1 -- start start 2024-05-14T12:21:02.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6e6200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e019d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:02.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6e6200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6e0077540 0x7fa6e019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:02.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6e6200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6e0110c00 0x7fa6e01a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:02.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6e6200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01166d0 con 0x7fa6e0076bf0 2024-05-14T12:21:02.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6e6200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0116550 con 0x7fa6e0110c00 2024-05-14T12:21:02.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6e6200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0116850 con 0x7fa6e0077540 2024-05-14T12:21:02.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6df400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e019d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:02.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6df400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e019d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51468/0 (socket says 172.21.15.47:51468) 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6df400700 1 -- 172.21.15.47:0/2811473313 learned_addr learned my addr 172.21.15.47:0/2811473313 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6dea00700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6e0077540 0x7fa6e019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.341+0000 7fa6dfe00700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6e0110c00 0x7fa6e01a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6df400700 1 -- 172.21.15.47:0/2811473313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6e0077540 msgr2=0x7fa6e019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6df400700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6e0077540 0x7fa6e019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6df400700 1 -- 172.21.15.47:0/2811473313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6e0110c00 msgr2=0x7fa6e01a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6df400700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6e0110c00 0x7fa6e01a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6df400700 1 -- 172.21.15.47:0/2811473313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e01a1f70 con 0x7fa6e0076bf0 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6dfe00700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6e0110c00 0x7fa6e01a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6dea00700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6e0077540 0x7fa6e019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6df400700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e019d0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000c00 tx=0x7fa6d00057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6d7e00700 1 -- 172.21.15.47:0/2811473313 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0027070 con 0x7fa6e0076bf0 2024-05-14T12:21:02.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6d7e00700 1 -- 172.21.15.47:0/2811473313 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d0022470 con 0x7fa6e0076bf0 2024-05-14T12:21:02.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e01a2200 con 0x7fa6e0076bf0 2024-05-14T12:21:02.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.342+0000 7fa6d7e00700 1 -- 172.21.15.47:0/2811473313 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0017650 con 0x7fa6e0076bf0 2024-05-14T12:21:02.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.343+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e01a26e0 con 0x7fa6e0076bf0 2024-05-14T12:21:02.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.344+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e00512c0 con 0x7fa6e0076bf0 2024-05-14T12:21:02.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.346+0000 7fa6d7e00700 1 -- 172.21.15.47:0/2811473313 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa6d002a070 con 0x7fa6e0076bf0 2024-05-14T12:21:02.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.348+0000 7fa6d7e00700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa6c40b2880 0x7fa6c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.348+0000 7fa6d7e00700 1 -- 172.21.15.47:0/2811473313 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7fa6d00e3070 con 0x7fa6e0076bf0 2024-05-14T12:21:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.348+0000 7fa6dea00700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa6c40b2880 0x7fa6c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:02.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.349+0000 7fa6dea00700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa6c40b2880 0x7fa6c40b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6e01033e0 tx=0x7fa6cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:02.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.351+0000 7fa6d7e00700 1 -- 172.21.15.47:0/2811473313 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa6d0013070 con 0x7fa6e0076bf0 2024-05-14T12:21:02.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.640+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa6e002e5f0 con 0x7fa6e0076bf0 2024-05-14T12:21:02.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.672+0000 7fa6d7e00700 1 -- 172.21.15.47:0/2811473313 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa6d00aaf30 con 0x7fa6e0076bf0 2024-05-14T12:21:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa6c40b2880 msgr2=0x7fa6c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa6c40b2880 0x7fa6c40b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6e01033e0 tx=0x7fa6cc009260 comp rx=0 tx=0).stop 2024-05-14T12:21:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 msgr2=0x7fa6e019d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e019d0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000c00 tx=0x7fa6d00057c0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 shutdown_connections 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa6c40b2880 0x7fa6c40b4d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6e0110c00 0x7fa6e01a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e0076bf0 0x7fa6e019d0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 --2- 172.21.15.47:0/2811473313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6e0077540 0x7fa6e019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.676+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 >> 172.21.15.47:0/2811473313 conn(0x7fa6e00ffea0 msgr2=0x7fa6e0100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.677+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 shutdown_connections 2024-05-14T12:21:02.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:02.677+0000 7fa6e6200700 1 -- 172.21.15.47:0/2811473313 wait complete. 2024-05-14T12:21:02.680 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-05-14T12:21:02.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:02 smithi047 ceph-mon[31254]: pgmap v323: 97 pgs: 2 creating+peering, 13 unknown, 82 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:21:02.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:02 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2811473313' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T12:21:02.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:02 smithi047 ceph-mon[31254]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-05-14T12:21:03.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:02 smithi073 ceph-mon[35809]: pgmap v323: 97 pgs: 2 creating+peering, 13 unknown, 82 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:21:03.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:02 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2811473313' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T12:21:03.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:02 smithi073 ceph-mon[35809]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-05-14T12:21:03.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:02 smithi066 ceph-mon[35981]: pgmap v323: 97 pgs: 2 creating+peering, 13 unknown, 82 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:21:03.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:02 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2811473313' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T12:21:03.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:02 smithi066 ceph-mon[35981]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-05-14T12:21:03.599 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:21:03.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:03 smithi047 ceph-mon[31254]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T12:21:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:03 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2811473313' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T12:21:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:03 smithi047 ceph-mon[31254]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-05-14T12:21:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:03 smithi047 ceph-mon[31254]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-05-14T12:21:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:03 smithi073 ceph-mon[35809]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T12:21:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:03 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2811473313' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T12:21:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:03 smithi073 ceph-mon[35809]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-05-14T12:21:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:03 smithi073 ceph-mon[35809]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-05-14T12:21:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:03 smithi066 ceph-mon[35981]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T12:21:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:03 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2811473313' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T12:21:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:03 smithi066 ceph-mon[35981]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-05-14T12:21:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:03 smithi066 ceph-mon[35981]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-05-14T12:21:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:04 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] up:active 2024-05-14T12:21:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:04 smithi047 ceph-mon[31254]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:04 smithi047 ceph-mon[31254]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:04.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:04 smithi047 ceph-mon[31254]: pgmap v325: 97 pgs: 97 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s wr, 1 op/s 2024-05-14T12:21:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:04 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] up:active 2024-05-14T12:21:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:04 smithi073 ceph-mon[35809]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:04 smithi073 ceph-mon[35809]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:04 smithi073 ceph-mon[35809]: pgmap v325: 97 pgs: 97 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s wr, 1 op/s 2024-05-14T12:21:05.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:04 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] up:active 2024-05-14T12:21:05.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:04 smithi066 ceph-mon[35981]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:05.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:04 smithi066 ceph-mon[35981]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:05.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:04 smithi066 ceph-mon[35981]: pgmap v325: 97 pgs: 97 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 182 B/s wr, 1 op/s 2024-05-14T12:21:05.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:05 smithi047 ceph-mon[31254]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T12:21:05.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:05 smithi047 ceph-mon[31254]: Cluster is now healthy 2024-05-14T12:21:06.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:05 smithi073 ceph-mon[35809]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T12:21:06.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:05 smithi073 ceph-mon[35809]: Cluster is now healthy 2024-05-14T12:21:06.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:05 smithi066 ceph-mon[35981]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T12:21:06.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:05 smithi066 ceph-mon[35981]: Cluster is now healthy 2024-05-14T12:21:06.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.298+0000 7fa183200700 1 -- 172.21.15.47:0/2892009921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c10c5c0 msgr2=0x7fa17c10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.298+0000 7fa183200700 1 --2- 172.21.15.47:0/2892009921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c10c5c0 0x7fa17c10c9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009990 tx=0x7fa16c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.298+0000 7fa183200700 1 -- 172.21.15.47:0/2892009921 shutdown_connections 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.298+0000 7fa183200700 1 --2- 172.21.15.47:0/2892009921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa17c106ed0 0x7fa17c113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.298+0000 7fa183200700 1 --2- 172.21.15.47:0/2892009921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c10c5c0 0x7fa17c10c9d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.298+0000 7fa183200700 1 --2- 172.21.15.47:0/2892009921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17c106580 0x7fa17c106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.298+0000 7fa183200700 1 -- 172.21.15.47:0/2892009921 >> 172.21.15.47:0/2892009921 conn(0x7fa17c102080 msgr2=0x7fa17c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.299+0000 7fa183200700 1 -- 172.21.15.47:0/2892009921 shutdown_connections 2024-05-14T12:21:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.299+0000 7fa183200700 1 -- 172.21.15.47:0/2892009921 wait complete. 2024-05-14T12:21:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 Processor -- start 2024-05-14T12:21:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 -- start start 2024-05-14T12:21:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa17c106580 0x7fa17c19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c106ed0 0x7fa17c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17c10c5c0 0x7fa17c1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1166d0 con 0x7fa17c106ed0 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c116550 con 0x7fa17c106580 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.300+0000 7fa183200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c116850 con 0x7fa17c10c5c0 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c106ed0 0x7fa17c19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c106ed0 0x7fa17c19d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51486/0 (socket says 172.21.15.47:51486) 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 -- 172.21.15.47:0/3896303624 learned_addr learned my addr 172.21.15.47:0/3896303624 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa17be00700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa17c106580 0x7fa17c19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa181200700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17c10c5c0 0x7fa17c1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 -- 172.21.15.47:0/3896303624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17c10c5c0 msgr2=0x7fa17c1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17c10c5c0 0x7fa17c1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 -- 172.21.15.47:0/3896303624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa17c106580 msgr2=0x7fa17c19d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa17c106580 0x7fa17c19d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.301+0000 7fa173e00700 1 -- 172.21.15.47:0/3896303624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c1a1ef0 con 0x7fa17c106ed0 2024-05-14T12:21:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.302+0000 7fa173e00700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c106ed0 0x7fa17c19d5c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa16400e940 tx=0x7fa16400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:06.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.302+0000 7fa179600700 1 -- 172.21.15.47:0/3896303624 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16400c9c0 con 0x7fa17c106ed0 2024-05-14T12:21:06.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.302+0000 7fa179600700 1 -- 172.21.15.47:0/3896303624 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa16400cb60 con 0x7fa17c106ed0 2024-05-14T12:21:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.302+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c1a21e0 con 0x7fa17c106ed0 2024-05-14T12:21:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.302+0000 7fa179600700 1 -- 172.21.15.47:0/3896303624 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164018680 con 0x7fa17c106ed0 2024-05-14T12:21:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.302+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c1a9b00 con 0x7fa17c106ed0 2024-05-14T12:21:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.303+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17c10e980 con 0x7fa17c106ed0 2024-05-14T12:21:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.306+0000 7fa179600700 1 -- 172.21.15.47:0/3896303624 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa164010430 con 0x7fa17c106ed0 2024-05-14T12:21:06.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.308+0000 7fa179600700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa1600b2900 0x7fa1600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:06.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.308+0000 7fa179600700 1 -- 172.21.15.47:0/3896303624 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fa1640e2650 con 0x7fa17c106ed0 2024-05-14T12:21:06.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.308+0000 7fa17be00700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa1600b2900 0x7fa1600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:06.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.309+0000 7fa17be00700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa1600b2900 0x7fa1600b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00b2e0 tx=0x7fa16c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:06.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.311+0000 7fa179600700 1 -- 172.21.15.47:0/3896303624 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa1640aa420 con 0x7fa17c106ed0 2024-05-14T12:21:06.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.553+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa17c0512c0 con 0x7fa17c106ed0 2024-05-14T12:21:06.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.558+0000 7fa179600700 1 -- 172.21.15.47:0/3896303624 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22148 (secure 0 0 0) 0x7fa1640a9d20 con 0x7fa17c106ed0 2024-05-14T12:21:06.559 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:21:06.560 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":82,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:02.642759+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa1600b2900 msgr2=0x7fa1600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa1600b2900 0x7fa1600b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00b2e0 tx=0x7fa16c005960 comp rx=0 tx=0).stop 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c106ed0 msgr2=0x7fa17c19d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c106ed0 0x7fa17c19d5c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa16400e940 tx=0x7fa16400ec50 comp rx=0 tx=0).stop 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 shutdown_connections 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa1600b2900 0x7fa1600b4e10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17c10c5c0 0x7fa17c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa17c106580 0x7fa17c19d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 --2- 172.21.15.47:0/3896303624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa17c106ed0 0x7fa17c19d5c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 >> 172.21.15.47:0/3896303624 conn(0x7fa17c102080 msgr2=0x7fa17c104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 shutdown_connections 2024-05-14T12:21:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:06.562+0000 7fa183200700 1 -- 172.21.15.47:0/3896303624 wait complete. 2024-05-14T12:21:06.949 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:06 smithi047 ceph-mon[31254]: pgmap v326: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-14T12:21:06.949 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:06 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3896303624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:07.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:06 smithi073 ceph-mon[35809]: pgmap v326: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-14T12:21:07.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:06 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3896303624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:07.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:06 smithi066 ceph-mon[35981]: pgmap v326: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-14T12:21:07.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:06 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3896303624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:07.357 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:21:07.735 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:21:07 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: 2024-05-14T12:21:07.339+0000 7f3c07800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T12:21:07.826 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:09.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:09 smithi066 ceph-mon[35981]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T12:21:09.606 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:09 smithi047 ceph-mon[31254]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T12:21:09.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:09 smithi073 ceph-mon[35809]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T12:21:10.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 -- 172.21.15.47:0/1860545069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c075b60 msgr2=0x7fac0c075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:10.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 --2- 172.21.15.47:0/1860545069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c075b60 0x7fac0c075f70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fac0000b0a0 tx=0x7fac0000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 -- 172.21.15.47:0/1860545069 shutdown_connections 2024-05-14T12:21:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 --2- 172.21.15.47:0/1860545069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c115370 0x7fac0c117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 --2- 172.21.15.47:0/1860545069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c075b60 0x7fac0c075f70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 --2- 172.21.15.47:0/1860545069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac0c0764b0 0x7fac0c114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 -- 172.21.15.47:0/1860545069 >> 172.21.15.47:0/1860545069 conn(0x7fac0c100040 msgr2=0x7fac0c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 -- 172.21.15.47:0/1860545069 shutdown_connections 2024-05-14T12:21:10.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.026+0000 7fac13600700 1 -- 172.21.15.47:0/1860545069 wait complete. 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.027+0000 7fac13600700 1 Processor -- start 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.027+0000 7fac13600700 1 -- start start 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac13600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac0c075b60 0x7fac0c1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac13600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c0764b0 0x7fac0c1a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac13600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c115370 0x7fac0c1a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac13600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c11aad0 con 0x7fac0c115370 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac13600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c11a950 con 0x7fac0c075b60 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac13600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c11ac50 con 0x7fac0c0764b0 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac0be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c0764b0 0x7fac0c1a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac11600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c115370 0x7fac0c1a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac0be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c0764b0 0x7fac0c1a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43512/0 (socket says 172.21.15.47:43512) 2024-05-14T12:21:10.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac0be00700 1 -- 172.21.15.47:0/3788316002 learned_addr learned my addr 172.21.15.47:0/3788316002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.028+0000 7fac10c00700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac0c075b60 0x7fac0c1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac0be00700 1 -- 172.21.15.47:0/3788316002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac0c075b60 msgr2=0x7fac0c1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac0be00700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac0c075b60 0x7fac0c1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac0be00700 1 -- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c115370 msgr2=0x7fac0c1a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac0be00700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c115370 0x7fac0c1a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac0be00700 1 -- 172.21.15.47:0/3788316002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c1a6330 con 0x7fac0c0764b0 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac11600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c115370 0x7fac0c1a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac0be00700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c0764b0 0x7fac0c1a1a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabf800e9a0 tx=0x7fabf800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.029+0000 7fac09600700 1 -- 172.21.15.47:0/3788316002 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf800ca10 con 0x7fac0c0764b0 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.030+0000 7fac09600700 1 -- 172.21.15.47:0/3788316002 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabf800cbb0 con 0x7fac0c0764b0 2024-05-14T12:21:10.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.030+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c1a6620 con 0x7fac0c0764b0 2024-05-14T12:21:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.030+0000 7fac09600700 1 -- 172.21.15.47:0/3788316002 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8018680 con 0x7fac0c0764b0 2024-05-14T12:21:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.030+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c1adf40 con 0x7fac0c0764b0 2024-05-14T12:21:10.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.031+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c0512c0 con 0x7fac0c0764b0 2024-05-14T12:21:10.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.034+0000 7fac09600700 1 -- 172.21.15.47:0/3788316002 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fabf8010430 con 0x7fac0c0764b0 2024-05-14T12:21:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.035+0000 7fac09600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fabf40b2900 0x7fabf40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.035+0000 7fac09600700 1 -- 172.21.15.47:0/3788316002 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fabf80e2590 con 0x7fac0c0764b0 2024-05-14T12:21:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.035+0000 7fac10c00700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fabf40b2900 0x7fabf40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.036+0000 7fac10c00700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fabf40b2900 0x7fabf40b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac000062a0 tx=0x7fac00006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:10.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.037+0000 7fac09600700 1 -- 172.21.15.47:0/3788316002 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fabf80aa360 con 0x7fac0c0764b0 2024-05-14T12:21:10.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.278+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac0c02e5f0 con 0x7fac0c0764b0 2024-05-14T12:21:10.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.280+0000 7fac09600700 1 -- 172.21.15.47:0/3788316002 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22148 (secure 0 0 0) 0x7fabf80b23e0 con 0x7fac0c0764b0 2024-05-14T12:21:10.281 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:21:10.281 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":82,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:02.642759+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:21:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fabf40b2900 msgr2=0x7fabf40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fabf40b2900 0x7fabf40b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac000062a0 tx=0x7fac00006210 comp rx=0 tx=0).stop 2024-05-14T12:21:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c0764b0 msgr2=0x7fac0c1a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c0764b0 0x7fac0c1a1a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabf800e9a0 tx=0x7fabf800ecb0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 shutdown_connections 2024-05-14T12:21:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fabf40b2900 0x7fabf40b4e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c115370 0x7fac0c1a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac0c075b60 0x7fac0c1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 --2- 172.21.15.47:0/3788316002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac0c0764b0 0x7fac0c1a1a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 >> 172.21.15.47:0/3788316002 conn(0x7fac0c100040 msgr2=0x7fac0c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.283+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 shutdown_connections 2024-05-14T12:21:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:10.284+0000 7fac13600700 1 -- 172.21.15.47:0/3788316002 wait complete. 2024-05-14T12:21:10.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:10 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3788316002' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:10.655 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:10 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3788316002' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:10 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3788316002' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:11.183 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-14T12:21:11.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:11 smithi047 ceph-mon[31254]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-14T12:21:11.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:11 smithi066 ceph-mon[35981]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-14T12:21:11.656 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:11 smithi073 ceph-mon[35809]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-14T12:21:13.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:13 smithi047 ceph-mon[31254]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-14T12:21:13.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:13 smithi066 ceph-mon[35981]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-14T12:21:13.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:13 smithi073 ceph-mon[35809]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-14T12:21:13.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 -- 172.21.15.47:0/1032718077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc107df0 msgr2=0x7fe2bc108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:13.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1032718077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc107df0 0x7fe2bc108200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009920 tx=0x7fe2a8009c30 comp rx=0 tx=0).stop 2024-05-14T12:21:13.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 -- 172.21.15.47:0/1032718077 shutdown_connections 2024-05-14T12:21:13.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1032718077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2bc108740 0x7fe2bc1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1032718077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2bc1034c0 0x7fe2bc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1032718077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc107df0 0x7fe2bc108200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 -- 172.21.15.47:0/1032718077 >> 172.21.15.47:0/1032718077 conn(0x7fe2bc0fedc0 msgr2=0x7fe2bc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 -- 172.21.15.47:0/1032718077 shutdown_connections 2024-05-14T12:21:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.826+0000 7fe2c4400700 1 -- 172.21.15.47:0/1032718077 wait complete. 2024-05-14T12:21:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 Processor -- start 2024-05-14T12:21:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 -- start start 2024-05-14T12:21:13.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc1034c0 0x7fe2bc0ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2bc107df0 0x7fe2bc0ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2bc108740 0x7fe2bc0ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc113350 con 0x7fe2bc107df0 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1131d0 con 0x7fe2bc108740 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.828+0000 7fe2c4400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1134d0 con 0x7fe2bc1034c0 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc1034c0 0x7fe2bc0ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2bc107df0 0x7fe2bc0ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc1034c0 0x7fe2bc0ff2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43524/0 (socket says 172.21.15.47:43524) 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 -- 172.21.15.47:0/1567116802 learned_addr learned my addr 172.21.15.47:0/1567116802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c2400700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2bc108740 0x7fe2bc0ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 -- 172.21.15.47:0/1567116802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2bc108740 msgr2=0x7fe2bc0ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:13.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2bc108740 0x7fe2bc0ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:13.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 -- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2bc107df0 msgr2=0x7fe2bc0ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:13.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2bc107df0 0x7fe2bc0ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:13.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.829+0000 7fe2c1a00700 1 -- 172.21.15.47:0/1567116802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc1a9230 con 0x7fe2bc1034c0 2024-05-14T12:21:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.830+0000 7fe2c1a00700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc1034c0 0x7fe2bc0ff2a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000ec10 tx=0x7fe2b000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.830+0000 7fe2ba000700 1 -- 172.21.15.47:0/1567116802 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000cc90 con 0x7fe2bc1034c0 2024-05-14T12:21:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.830+0000 7fe2ba000700 1 -- 172.21.15.47:0/1567116802 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2b000ce30 con 0x7fe2bc1034c0 2024-05-14T12:21:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.830+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc1a9520 con 0x7fe2bc1034c0 2024-05-14T12:21:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.830+0000 7fe2ba000700 1 -- 172.21.15.47:0/1567116802 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0010430 con 0x7fe2bc1034c0 2024-05-14T12:21:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.830+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc1a9a30 con 0x7fe2bc1034c0 2024-05-14T12:21:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.831+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc0512c0 con 0x7fe2bc1034c0 2024-05-14T12:21:13.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.834+0000 7fe2ba000700 1 -- 172.21.15.47:0/1567116802 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe2b0004000 con 0x7fe2bc1034c0 2024-05-14T12:21:13.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.835+0000 7fe2ba000700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2a40b2880 0x7fe2a40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:13.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.836+0000 7fe2ba000700 1 -- 172.21.15.47:0/1567116802 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe2b00e24d0 con 0x7fe2bc1034c0 2024-05-14T12:21:13.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.836+0000 7fe2c1000700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2a40b2880 0x7fe2a40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:13.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.836+0000 7fe2c1000700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2a40b2880 0x7fe2a40b4d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80098f0 tx=0x7fe2a8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:13.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:13.837+0000 7fe2ba000700 1 -- 172.21.15.47:0/1567116802 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2b00aa2a0 con 0x7fe2bc1034c0 2024-05-14T12:21:14.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.129+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe2bc1a9cf0 con 0x7fe2bc1034c0 2024-05-14T12:21:14.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.337+0000 7fe2ba000700 1 -- 172.21.15.47:0/1567116802 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fe2b00a9ba0 con 0x7fe2bc1034c0 2024-05-14T12:21:14.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2a40b2880 msgr2=0x7fe2a40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2a40b2880 0x7fe2a40b4d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80098f0 tx=0x7fe2a8019040 comp rx=0 tx=0).stop 2024-05-14T12:21:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc1034c0 msgr2=0x7fe2bc0ff2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc1034c0 0x7fe2bc0ff2a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000ec10 tx=0x7fe2b000ef20 comp rx=0 tx=0).stop 2024-05-14T12:21:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 shutdown_connections 2024-05-14T12:21:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2a40b2880 0x7fe2a40b4d90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2bc108740 0x7fe2bc0ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc1034c0 0x7fe2bc0ff2a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 --2- 172.21.15.47:0/1567116802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2bc107df0 0x7fe2bc0ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 >> 172.21.15.47:0/1567116802 conn(0x7fe2bc0fedc0 msgr2=0x7fe2bc06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.341+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 shutdown_connections 2024-05-14T12:21:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:14.342+0000 7fe2c4400700 1 -- 172.21.15.47:0/1567116802 wait complete. 2024-05-14T12:21:14.434 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:14 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1567116802' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T12:21:14.435 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:14 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T12:21:14.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:14 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1567116802' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T12:21:14.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:14 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T12:21:14.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:14 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1567116802' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T12:21:14.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:14 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T12:21:15.119 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-14T12:21:15.119 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-14T12:21:15.596 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:15.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:15 smithi047 ceph-mon[31254]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-14T12:21:15.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:15 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T12:21:15.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:15 smithi047 ceph-mon[31254]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:15.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:15 smithi073 ceph-mon[35809]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-14T12:21:15.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:15 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T12:21:15.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:15 smithi073 ceph-mon[35809]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:15 smithi066 ceph-mon[35981]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-14T12:21:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:15 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T12:21:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:15 smithi066 ceph-mon[35981]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:17.644 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:17 smithi047 ceph-mon[31254]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-14T12:21:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:17 smithi073 ceph-mon[35809]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-14T12:21:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:17 smithi066 ceph-mon[35981]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-14T12:21:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 -- 172.21.15.47:0/3876814430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 msgr2=0x7f60c8113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 --2- 172.21.15.47:0/3876814430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 0x7f60c8113350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60c000b0a0 tx=0x7f60c000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:21:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 -- 172.21.15.47:0/3876814430 shutdown_connections 2024-05-14T12:21:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 --2- 172.21.15.47:0/3876814430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 0x7f60c8113350 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 --2- 172.21.15.47:0/3876814430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c810c5b0 0x7f60c810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 --2- 172.21.15.47:0/3876814430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c8106570 0x7f60c8106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:17.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 -- 172.21.15.47:0/3876814430 >> 172.21.15.47:0/3876814430 conn(0x7f60c8102050 msgr2=0x7f60c81044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.896+0000 7f60cf800700 1 -- 172.21.15.47:0/3876814430 shutdown_connections 2024-05-14T12:21:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.897+0000 7f60cf800700 1 -- 172.21.15.47:0/3876814430 wait complete. 2024-05-14T12:21:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 Processor -- start 2024-05-14T12:21:17.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 -- start start 2024-05-14T12:21:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c8106570 0x7f60c819d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 0x7f60c819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c810c5b0 0x7f60c81a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8116730 con 0x7f60c8106ec0 2024-05-14T12:21:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f60c81165b0 con 0x7f60c8106570 2024-05-14T12:21:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.898+0000 7f60cf800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f60c81168b0 con 0x7f60c810c5b0 2024-05-14T12:21:17.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60c7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 0x7f60c819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c8106570 0x7f60c819d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c8106570 0x7f60c819d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52178/0 (socket says 172.21.15.47:52178) 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 -- 172.21.15.47:0/2488601869 learned_addr learned my addr 172.21.15.47:0/2488601869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cd800700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c810c5b0 0x7f60c81a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 -- 172.21.15.47:0/2488601869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c810c5b0 msgr2=0x7f60c81a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c810c5b0 0x7f60c81a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 -- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 msgr2=0x7f60c819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 0x7f60c819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:17.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.899+0000 7f60cce00700 1 -- 172.21.15.47:0/2488601869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c81a1fb0 con 0x7f60c8106570 2024-05-14T12:21:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.900+0000 7f60cce00700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c8106570 0x7f60c819d0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00e970 tx=0x7f60bc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.900+0000 7f60c5600700 1 -- 172.21.15.47:0/2488601869 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc004a30 con 0x7f60c8106570 2024-05-14T12:21:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.900+0000 7f60c5600700 1 -- 172.21.15.47:0/2488601869 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60bc00cc90 con 0x7f60c8106570 2024-05-14T12:21:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.900+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c81a22a0 con 0x7f60c8106570 2024-05-14T12:21:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.900+0000 7f60c5600700 1 -- 172.21.15.47:0/2488601869 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc005610 con 0x7f60c8106570 2024-05-14T12:21:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.900+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c81a9bc0 con 0x7f60c8106570 2024-05-14T12:21:17.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.901+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c80512c0 con 0x7f60c8106570 2024-05-14T12:21:17.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.904+0000 7f60c5600700 1 -- 172.21.15.47:0/2488601869 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f60bc00c7e0 con 0x7f60c8106570 2024-05-14T12:21:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.905+0000 7f60c5600700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f60b00b2880 0x7f60b00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.905+0000 7f60c5600700 1 -- 172.21.15.47:0/2488601869 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f60bc0e2250 con 0x7f60c8106570 2024-05-14T12:21:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.905+0000 7f60c7e00700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f60b00b2880 0x7f60b00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:17.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.906+0000 7f60c7e00700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f60b00b2880 0x7f60b00b4d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f60c81054b0 tx=0x7f60b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:17.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:17.910+0000 7f60c5600700 1 -- 172.21.15.47:0/2488601869 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f60bc0aa020 con 0x7f60c8106570 2024-05-14T12:21:18.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.198+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f60c819e440 con 0x7f60c8106570 2024-05-14T12:21:18.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.358+0000 7f60c5600700 1 -- 172.21.15.47:0/2488601869 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f60bc0a9920 con 0x7f60c8106570 2024-05-14T12:21:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f60b00b2880 msgr2=0x7f60b00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f60b00b2880 0x7f60b00b4d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f60c81054b0 tx=0x7f60b4009260 comp rx=0 tx=0).stop 2024-05-14T12:21:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c8106570 msgr2=0x7f60c819d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c8106570 0x7f60c819d0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00e970 tx=0x7f60bc00ec80 comp rx=0 tx=0).stop 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 shutdown_connections 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f60b00b2880 0x7f60b00b4d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c810c5b0 0x7f60c81a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60c8106570 0x7f60c819d0e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 --2- 172.21.15.47:0/2488601869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60c8106ec0 0x7f60c819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.362+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 >> 172.21.15.47:0/2488601869 conn(0x7f60c8102050 msgr2=0x7f60c81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.363+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 shutdown_connections 2024-05-14T12:21:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:18.363+0000 7f60cf800700 1 -- 172.21.15.47:0/2488601869 wait complete. 2024-05-14T12:21:18.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:18 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2488601869' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T12:21:18.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:18 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T12:21:18.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:18 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2488601869' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T12:21:18.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:18 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T12:21:18.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:18 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2488601869' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T12:21:18.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:18 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T12:21:19.193 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-14T12:21:19.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:19 smithi047 ceph-mon[31254]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T12:21:19.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:19 smithi047 ceph-mon[31254]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T12:21:19.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:19 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T12:21:19.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:19 smithi047 ceph-mon[31254]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T12:21:19.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:19 smithi047 ceph-mon[31254]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:19.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:19 smithi047 ceph-mon[31254]: fsmap cephfs:2 {0=a=up:active,1=b=up:creating} 10 up:standby 2024-05-14T12:21:19.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:19 smithi047 ceph-mon[31254]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-14T12:21:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:19 smithi073 ceph-mon[35809]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T12:21:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:19 smithi073 ceph-mon[35809]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T12:21:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:19 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T12:21:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:19 smithi073 ceph-mon[35809]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T12:21:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:19 smithi073 ceph-mon[35809]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:19 smithi073 ceph-mon[35809]: fsmap cephfs:2 {0=a=up:active,1=b=up:creating} 10 up:standby 2024-05-14T12:21:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:19 smithi073 ceph-mon[35809]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-14T12:21:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:19 smithi066 ceph-mon[35981]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-14T12:21:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:19 smithi066 ceph-mon[35981]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T12:21:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:19 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T12:21:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:19 smithi066 ceph-mon[35981]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T12:21:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:19 smithi066 ceph-mon[35981]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-05-14T12:21:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:19 smithi066 ceph-mon[35981]: fsmap cephfs:2 {0=a=up:active,1=b=up:creating} 10 up:standby 2024-05-14T12:21:19.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:19 smithi066 ceph-mon[35981]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-14T12:21:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:20 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] up:active 2024-05-14T12:21:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:20 smithi047 ceph-mon[31254]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T12:21:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:20 smithi047 ceph-mon[31254]: fsmap cephfs:2 {0=a=up:active,1=b=up:active} 10 up:standby 2024-05-14T12:21:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:20 smithi047 ceph-mon[31254]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:creating} 9 up:standby 2024-05-14T12:21:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:20 smithi047 ceph-mon[31254]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-14T12:21:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:20 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] up:active 2024-05-14T12:21:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:20 smithi073 ceph-mon[35809]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T12:21:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:20 smithi073 ceph-mon[35809]: fsmap cephfs:2 {0=a=up:active,1=b=up:active} 10 up:standby 2024-05-14T12:21:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:20 smithi073 ceph-mon[35809]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:creating} 9 up:standby 2024-05-14T12:21:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:20 smithi073 ceph-mon[35809]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-14T12:21:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:20 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] up:active 2024-05-14T12:21:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:20 smithi066 ceph-mon[35981]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T12:21:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:20 smithi066 ceph-mon[35981]: fsmap cephfs:2 {0=a=up:active,1=b=up:active} 10 up:standby 2024-05-14T12:21:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:20 smithi066 ceph-mon[35981]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:creating} 9 up:standby 2024-05-14T12:21:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:20 smithi066 ceph-mon[35981]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-14T12:21:21.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:21 smithi047 ceph-mon[31254]: pgmap v333: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 2 op/s 2024-05-14T12:21:21.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:21 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] up:active 2024-05-14T12:21:21.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:21 smithi047 ceph-mon[31254]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T12:21:21.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:21 smithi047 ceph-mon[31254]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 9 up:standby 2024-05-14T12:21:21.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:21 smithi047 ceph-mon[31254]: fsmap cephfs:4 {0=a=up:active,1=b=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-05-14T12:21:21.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:21 smithi047 ceph-mon[31254]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-05-14T12:21:21.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:21 smithi073 ceph-mon[35809]: pgmap v333: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 2 op/s 2024-05-14T12:21:21.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:21 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] up:active 2024-05-14T12:21:21.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:21 smithi073 ceph-mon[35809]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T12:21:21.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:21 smithi073 ceph-mon[35809]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 9 up:standby 2024-05-14T12:21:21.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:21 smithi073 ceph-mon[35809]: fsmap cephfs:4 {0=a=up:active,1=b=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-05-14T12:21:21.653 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:21 smithi073 ceph-mon[35809]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-05-14T12:21:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.735+0000 7ff4bea00700 1 -- 172.21.15.47:0/1288299323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b80764b0 msgr2=0x7ff4b8114c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.735+0000 7ff4bea00700 1 --2- 172.21.15.47:0/1288299323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b80764b0 0x7ff4b8114c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009990 tx=0x7ff4a4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:21:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.736+0000 7ff4bea00700 1 -- 172.21.15.47:0/1288299323 shutdown_connections 2024-05-14T12:21:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.736+0000 7ff4bea00700 1 --2- 172.21.15.47:0/1288299323 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b8115180 0x7ff4b81175a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.736+0000 7ff4bea00700 1 --2- 172.21.15.47:0/1288299323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8075b60 0x7ff4b8075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.736+0000 7ff4bea00700 1 --2- 172.21.15.47:0/1288299323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b80764b0 0x7ff4b8114c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.736+0000 7ff4bea00700 1 -- 172.21.15.47:0/1288299323 >> 172.21.15.47:0/1288299323 conn(0x7ff4b8079d10 msgr2=0x7ff4b807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.736+0000 7ff4bea00700 1 -- 172.21.15.47:0/1288299323 shutdown_connections 2024-05-14T12:21:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.736+0000 7ff4bea00700 1 -- 172.21.15.47:0/1288299323 wait complete. 2024-05-14T12:21:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.737+0000 7ff4bea00700 1 Processor -- start 2024-05-14T12:21:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.737+0000 7ff4bea00700 1 -- start start 2024-05-14T12:21:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8075b60 0x7ff4b81a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80764b0 0x7ff4b81a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b8115180 0x7ff4b81a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b811a890 con 0x7ff4b80764b0 2024-05-14T12:21:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bea00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b811a710 con 0x7ff4b8115180 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bea00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b811aa10 con 0x7ff4b8075b60 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bd600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8075b60 0x7ff4b81a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bd600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8075b60 0x7ff4b81a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49392/0 (socket says 172.21.15.47:49392) 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bd600700 1 -- 172.21.15.47:0/3232878251 learned_addr learned my addr 172.21.15.47:0/3232878251 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4be000700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b8115180 0x7ff4b81a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.738+0000 7ff4bcc00700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80764b0 0x7ff4b81a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4be000700 1 -- 172.21.15.47:0/3232878251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8075b60 msgr2=0x7ff4b81a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4be000700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8075b60 0x7ff4b81a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4be000700 1 -- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80764b0 msgr2=0x7ff4b81a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4be000700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80764b0 0x7ff4b81a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4be000700 1 -- 172.21.15.47:0/3232878251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b81a6130 con 0x7ff4b8115180 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4be000700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b8115180 0x7ff4b81a5a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000efc0 tx=0x7ff4b000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4b6000700 1 -- 172.21.15.47:0/3232878251 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00092e0 con 0x7ff4b8115180 2024-05-14T12:21:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b81a63c0 con 0x7ff4b8115180 2024-05-14T12:21:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4b6000700 1 -- 172.21.15.47:0/3232878251 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4b0004bb0 con 0x7ff4b8115180 2024-05-14T12:21:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.739+0000 7ff4b6000700 1 -- 172.21.15.47:0/3232878251 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0004020 con 0x7ff4b8115180 2024-05-14T12:21:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.740+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b81a6880 con 0x7ff4b8115180 2024-05-14T12:21:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.741+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b80772a0 con 0x7ff4b8115180 2024-05-14T12:21:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.745+0000 7ff4b6000700 1 -- 172.21.15.47:0/3232878251 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff4b001b030 con 0x7ff4b8115180 2024-05-14T12:21:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.747+0000 7ff4b6000700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff4a00b2880 0x7ff4a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.748+0000 7ff4b6000700 1 -- 172.21.15.47:0/3232878251 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7ff4b00e1d20 con 0x7ff4b8115180 2024-05-14T12:21:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.748+0000 7ff4bd600700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff4a00b2880 0x7ff4a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.748+0000 7ff4b6000700 1 -- 172.21.15.47:0/3232878251 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff4b0022020 con 0x7ff4b8115180 2024-05-14T12:21:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:21.748+0000 7ff4bd600700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff4a00b2880 0x7ff4a00b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009d20 tx=0x7ff4ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:21 smithi066 ceph-mon[35981]: pgmap v333: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 2 op/s 2024-05-14T12:21:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:21 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] up:active 2024-05-14T12:21:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:21 smithi066 ceph-mon[35981]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T12:21:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:21 smithi066 ceph-mon[35981]: fsmap cephfs:3 {0=a=up:active,1=b=up:active,2=i=up:active} 9 up:standby 2024-05-14T12:21:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:21 smithi066 ceph-mon[35981]: fsmap cephfs:4 {0=a=up:active,1=b=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-05-14T12:21:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:21 smithi066 ceph-mon[35981]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-05-14T12:21:22.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.032+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7ff4b81a25f0 con 0x7ff4b8115180 2024-05-14T12:21:22.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.424+0000 7ff4b6000700 1 -- 172.21.15.47:0/3232878251 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7ff4b81a25f0 con 0x7ff4b8115180 2024-05-14T12:21:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff4a00b2880 msgr2=0x7ff4a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff4a00b2880 0x7ff4a00b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009d20 tx=0x7ff4ac009260 comp rx=0 tx=0).stop 2024-05-14T12:21:22.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b8115180 msgr2=0x7ff4b81a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:22.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b8115180 0x7ff4b81a5a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000efc0 tx=0x7ff4b000c3a0 comp rx=0 tx=0).stop 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 shutdown_connections 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff4a00b2880 0x7ff4a00b4d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b8115180 0x7ff4b81a5a90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b8075b60 0x7ff4b81a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 --2- 172.21.15.47:0/3232878251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80764b0 0x7ff4b81a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.428+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 >> 172.21.15.47:0/3232878251 conn(0x7ff4b8079d10 msgr2=0x7ff4b8100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.429+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 shutdown_connections 2024-05-14T12:21:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:22.429+0000 7ff4bea00700 1 -- 172.21.15.47:0/3232878251 wait complete. 2024-05-14T12:21:22.735 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: 2024-05-14T12:21:22.342+0000 7f3c07800700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-14T12:21:22.735 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: 2024-05-14T12:21:22.342+0000 7f3c07800700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-14T12:21:22.735 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: 2024-05-14T12:21:22.342+0000 7f3c07800700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-05-14T12:21:22.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] up:active 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: Cluster is now healthy 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: fsmap cephfs:4 {0=a=up:active,1=b=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3232878251' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T12:21:22.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:22 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] up:active 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: Cluster is now healthy 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: fsmap cephfs:4 {0=a=up:active,1=b=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3232878251' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T12:21:22.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:22 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] up:active 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: Cluster is now healthy 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: fsmap cephfs:4 {0=a=up:active,1=b=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3232878251' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T12:21:22.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:22 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T12:21:23.227 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-14T12:21:23.679 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:23 smithi047 ceph-mon[31254]: pgmap v334: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 4 op/s 2024-05-14T12:21:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:23 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T12:21:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:23 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] up:active 2024-05-14T12:21:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:23 smithi047 ceph-mon[31254]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T12:21:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:23 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:21:23.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:23 smithi073 ceph-mon[35809]: pgmap v334: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 4 op/s 2024-05-14T12:21:23.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:23 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T12:21:23.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:23 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] up:active 2024-05-14T12:21:23.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:23 smithi073 ceph-mon[35809]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T12:21:23.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:23 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:21:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:23 smithi066 ceph-mon[35981]: pgmap v334: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 4 op/s 2024-05-14T12:21:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:23 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T12:21:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:23 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] up:active 2024-05-14T12:21:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:23 smithi066 ceph-mon[35981]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T12:21:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:23 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:21:25.603 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:25 smithi047 ceph-mon[31254]: pgmap v335: 97 pgs: 97 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.6 KiB/s wr, 10 op/s 2024-05-14T12:21:25.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:25 smithi073 ceph-mon[35809]: pgmap v335: 97 pgs: 97 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.6 KiB/s wr, 10 op/s 2024-05-14T12:21:25.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:25 smithi066 ceph-mon[35981]: pgmap v335: 97 pgs: 97 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.6 KiB/s wr, 10 op/s 2024-05-14T12:21:25.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 -- 172.21.15.47:0/3968821061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410b110 msgr2=0x7f3a24117640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 --2- 172.21.15.47:0/3968821061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410b110 0x7f3a24117640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b0a0 tx=0x7f3a1c00b3b0 comp rx=0 tx=0).stop 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 -- 172.21.15.47:0/3968821061 shutdown_connections 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 --2- 172.21.15.47:0/3968821061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410b110 0x7f3a24117640 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 --2- 172.21.15.47:0/3968821061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a241107a0 0x7f3a24110bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 --2- 172.21.15.47:0/3968821061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2410a7c0 0x7f3a2410abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 -- 172.21.15.47:0/3968821061 >> 172.21.15.47:0/3968821061 conn(0x7f3a24076b00 msgr2=0x7f3a24076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 -- 172.21.15.47:0/3968821061 shutdown_connections 2024-05-14T12:21:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.855+0000 7f3a2b000700 1 -- 172.21.15.47:0/3968821061 wait complete. 2024-05-14T12:21:25.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 Processor -- start 2024-05-14T12:21:25.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 -- start start 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410a7c0 0x7f3a241a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a2410b110 0x7f3a241a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a241107a0 0x7f3a241a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2411a900 con 0x7f3a2410a7c0 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2411a780 con 0x7f3a2410b110 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.857+0000 7f3a2b000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2411aa80 con 0x7f3a241107a0 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410a7c0 0x7f3a241a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a2410b110 0x7f3a241a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410a7c0 0x7f3a241a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35322/0 (socket says 172.21.15.47:35322) 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29c00700 1 -- 172.21.15.47:0/568058079 learned_addr learned my addr 172.21.15.47:0/568058079 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a2a600700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a241107a0 0x7f3a241a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29200700 1 -- 172.21.15.47:0/568058079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a241107a0 msgr2=0x7f3a241a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:25.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29200700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a241107a0 0x7f3a241a5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:25.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29200700 1 -- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410a7c0 msgr2=0x7f3a241a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:25.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29200700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410a7c0 0x7f3a241a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29200700 1 -- 172.21.15.47:0/568058079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a241a60e0 con 0x7f3a2410b110 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a29c00700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410a7c0 0x7f3a241a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.858+0000 7f3a2a600700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a241107a0 0x7f3a241a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.859+0000 7f3a29200700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a2410b110 0x7f3a241a17b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e9c0 tx=0x7f3a1000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.859+0000 7f3a22000700 1 -- 172.21.15.47:0/568058079 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000c9c0 con 0x7f3a2410b110 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.859+0000 7f3a22000700 1 -- 172.21.15.47:0/568058079 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a1000cb60 con 0x7f3a2410b110 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.859+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a241a63d0 con 0x7f3a2410b110 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.859+0000 7f3a22000700 1 -- 172.21.15.47:0/568058079 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10018680 con 0x7f3a2410b110 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.859+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241adcf0 con 0x7f3a2410b110 2024-05-14T12:21:25.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.860+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a240512c0 con 0x7f3a2410b110 2024-05-14T12:21:25.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.863+0000 7f3a22000700 1 -- 172.21.15.47:0/568058079 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3a10010430 con 0x7f3a2410b110 2024-05-14T12:21:25.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.864+0000 7f3a22000700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3a0c0b2900 0x7f3a0c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:25.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.865+0000 7f3a22000700 1 -- 172.21.15.47:0/568058079 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f3a100e25e0 con 0x7f3a2410b110 2024-05-14T12:21:25.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.865+0000 7f3a29c00700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3a0c0b2900 0x7f3a0c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:25.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.866+0000 7f3a29c00700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3a0c0b2900 0x7f3a0c0b4e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009680 tx=0x7f3a18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:25.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:25.867+0000 7f3a22000700 1 -- 172.21.15.47:0/568058079 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3a100aa3b0 con 0x7f3a2410b110 2024-05-14T12:21:26.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.157+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3a241a2570 con 0x7f3a2410b110 2024-05-14T12:21:26.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.446+0000 7f3a22000700 1 -- 172.21.15.47:0/568058079 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f3a100b2430 con 0x7f3a2410b110 2024-05-14T12:21:26.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3a0c0b2900 msgr2=0x7f3a0c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:26.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3a0c0b2900 0x7f3a0c0b4e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009680 tx=0x7f3a18009260 comp rx=0 tx=0).stop 2024-05-14T12:21:26.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a2410b110 msgr2=0x7f3a241a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:26.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a2410b110 0x7f3a241a17b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e9c0 tx=0x7f3a1000ecd0 comp rx=0 tx=0).stop 2024-05-14T12:21:26.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 shutdown_connections 2024-05-14T12:21:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3a0c0b2900 0x7f3a0c0b4e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a241107a0 0x7f3a241a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2410a7c0 0x7f3a241a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 --2- 172.21.15.47:0/568058079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a2410b110 0x7f3a241a17b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.451+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 >> 172.21.15.47:0/568058079 conn(0x7f3a24076b00 msgr2=0x7f3a24108880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.452+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 shutdown_connections 2024-05-14T12:21:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:26.452+0000 7f3a2b000700 1 -- 172.21.15.47:0/568058079 wait complete. 2024-05-14T12:21:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:26 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/568058079' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T12:21:26.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:26 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T12:21:26.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:26 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/568058079' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T12:21:26.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:26 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T12:21:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:26 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/568058079' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T12:21:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:26 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T12:21:27.207 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-05-14T12:21:27.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-14T12:21:27.705 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:27.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:27 smithi047 ceph-mon[31254]: pgmap v336: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-14T12:21:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:27 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T12:21:27.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:27 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:21:27.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:27 smithi073 ceph-mon[35809]: pgmap v336: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-14T12:21:27.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:27 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T12:21:27.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:27 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:21:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:27 smithi066 ceph-mon[35981]: pgmap v336: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-14T12:21:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:27 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T12:21:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:27 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:21:29.634 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:29 smithi047 ceph-mon[31254]: pgmap v337: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-14T12:21:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:29 smithi073 ceph-mon[35809]: pgmap v337: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-14T12:21:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:29 smithi066 ceph-mon[35981]: pgmap v337: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.045+0000 7f3f73600700 1 -- 172.21.15.47:0/3039898520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c106ed0 msgr2=0x7f3f6c113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.045+0000 7f3f73600700 1 --2- 172.21.15.47:0/3039898520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c106ed0 0x7f3f6c113360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b0a0 tx=0x7f3f6400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.045+0000 7f3f73600700 1 -- 172.21.15.47:0/3039898520 shutdown_connections 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.045+0000 7f3f73600700 1 --2- 172.21.15.47:0/3039898520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c106ed0 0x7f3f6c113360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.045+0000 7f3f73600700 1 --2- 172.21.15.47:0/3039898520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6c10c5c0 0x7f3f6c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.045+0000 7f3f73600700 1 --2- 172.21.15.47:0/3039898520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f6c106580 0x7f3f6c106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.045+0000 7f3f73600700 1 -- 172.21.15.47:0/3039898520 >> 172.21.15.47:0/3039898520 conn(0x7f3f6c102080 msgr2=0x7f3f6c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.046+0000 7f3f73600700 1 -- 172.21.15.47:0/3039898520 shutdown_connections 2024-05-14T12:21:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.046+0000 7f3f73600700 1 -- 172.21.15.47:0/3039898520 wait complete. 2024-05-14T12:21:30.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.047+0000 7f3f73600700 1 Processor -- start 2024-05-14T12:21:30.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.047+0000 7f3f73600700 1 -- start start 2024-05-14T12:21:30.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f73600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f6c106580 0x7f3f6c19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:30.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f73600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6c106ed0 0x7f3f6c19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:30.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f73600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c10c5c0 0x7f3f6c1a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:30.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f73600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c116740 con 0x7f3f6c106580 2024-05-14T12:21:30.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f73600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c1165c0 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f73600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c1168c0 con 0x7f3f6c106ed0 2024-05-14T12:21:30.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f71600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c10c5c0 0x7f3f6c1a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:30.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f71600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c10c5c0 0x7f3f6c1a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33170/0 (socket says 172.21.15.47:33170) 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f70c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f6c106580 0x7f3f6c19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f71600700 1 -- 172.21.15.47:0/2338075921 learned_addr learned my addr 172.21.15.47:0/2338075921 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.048+0000 7f3f6be00700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6c106ed0 0x7f3f6c19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f71600700 1 -- 172.21.15.47:0/2338075921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6c106ed0 msgr2=0x7f3f6c19d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f71600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6c106ed0 0x7f3f6c19d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f71600700 1 -- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f6c106580 msgr2=0x7f3f6c19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f71600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f6c106580 0x7f3f6c19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f71600700 1 -- 172.21.15.47:0/2338075921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c1a1ee0 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f71600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c10c5c0 0x7f3f6c1a1840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b070 tx=0x7f3f64009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f69600700 1 -- 172.21.15.47:0/2338075921 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64021070 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f69600700 1 -- 172.21.15.47:0/2338075921 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f64004e40 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f69600700 1 -- 172.21.15.47:0/2338075921 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64004630 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.049+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6c1a2170 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.050+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6c1a2660 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.051+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6c10e980 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.053+0000 7f3f69600700 1 -- 172.21.15.47:0/2338075921 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3f64007980 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.055+0000 7f3f69600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f540b2900 0x7f3f540b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.055+0000 7f3f69600700 1 -- 172.21.15.47:0/2338075921 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f3f6400f020 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.055+0000 7f3f70c00700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f540b2900 0x7f3f540b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.056+0000 7f3f70c00700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f540b2900 0x7f3f540b4e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c1079f0 tx=0x7f3f60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:30.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.057+0000 7f3f69600700 1 -- 172.21.15.47:0/2338075921 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3f6402a020 con 0x7f3f6c10c5c0 2024-05-14T12:21:30.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.333+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3f6c063c00 con 0x7f3f540b2900 2024-05-14T12:21:30.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.378+0000 7f3f69600700 1 -- 172.21.15.47:0/2338075921 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3f6c063c00 con 0x7f3f540b2900 2024-05-14T12:21:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.381+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f540b2900 msgr2=0x7f3f540b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f540b2900 0x7f3f540b4e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c1079f0 tx=0x7f3f60009260 comp rx=0 tx=0).stop 2024-05-14T12:21:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c10c5c0 msgr2=0x7f3f6c1a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:30.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c10c5c0 0x7f3f6c1a1840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b070 tx=0x7f3f64009c90 comp rx=0 tx=0).stop 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 shutdown_connections 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f540b2900 0x7f3f540b4e10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c10c5c0 0x7f3f6c1a1840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f6c106580 0x7f3f6c19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 --2- 172.21.15.47:0/2338075921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6c106ed0 0x7f3f6c19d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 >> 172.21.15.47:0/2338075921 conn(0x7f3f6c102080 msgr2=0x7f3f6c104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 shutdown_connections 2024-05-14T12:21:30.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:30.382+0000 7f3f73600700 1 -- 172.21.15.47:0/2338075921 wait complete. 2024-05-14T12:21:30.736 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:21:30 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:21:30.342+0000 7f85ff400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T12:21:30.736 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:21:30 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:21:30.342+0000 7f85ff400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T12:21:30.736 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:21:30 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:21:30.342+0000 7f85ff400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T12:21:30.736 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:21:30 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:21:30.342+0000 7f85ff400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T12:21:30.737 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:21:30 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:21:30.342+0000 7f85ff400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T12:21:31.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-14T12:21:31.715 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:31.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:31 smithi047 ceph-mon[31254]: pgmap v338: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-14T12:21:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:31 smithi047 ceph-mon[31254]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:31 smithi047 ceph-mon[31254]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-14T12:21:31.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:31 smithi073 ceph-mon[35809]: pgmap v338: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-14T12:21:31.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:31 smithi073 ceph-mon[35809]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:31.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:31 smithi073 ceph-mon[35809]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-14T12:21:31.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:31 smithi066 ceph-mon[35981]: pgmap v338: 97 pgs: 97 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-14T12:21:31.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:31 smithi066 ceph-mon[35981]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:31.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:31 smithi066 ceph-mon[35981]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-14T12:21:33.497 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:33 smithi047 ceph-mon[31254]: pgmap v339: 97 pgs: 97 active+clean; 591 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.9 KiB/s wr, 20 op/s 2024-05-14T12:21:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:33 smithi073 ceph-mon[35809]: pgmap v339: 97 pgs: 97 active+clean; 591 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.9 KiB/s wr, 20 op/s 2024-05-14T12:21:33.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:33 smithi066 ceph-mon[35981]: pgmap v339: 97 pgs: 97 active+clean; 591 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.9 KiB/s wr, 20 op/s 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 -- 172.21.15.47:0/2809241290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 msgr2=0x7f8378105930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 --2- 172.21.15.47:0/2809241290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378105930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f836800b0a0 tx=0x7f836800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 -- 172.21.15.47:0/2809241290 shutdown_connections 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 --2- 172.21.15.47:0/2809241290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f837810e900 0x7f8378110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 --2- 172.21.15.47:0/2809241290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378105930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 --2- 172.21.15.47:0/2809241290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8378105e70 0x7f837810e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 -- 172.21.15.47:0/2809241290 >> 172.21.15.47:0/2809241290 conn(0x7f83780fedc0 msgr2=0x7f83781011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 -- 172.21.15.47:0/2809241290 shutdown_connections 2024-05-14T12:21:33.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.880+0000 7f837ea00700 1 -- 172.21.15.47:0/2809241290 wait complete. 2024-05-14T12:21:33.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 Processor -- start 2024-05-14T12:21:33.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 -- start start 2024-05-14T12:21:33.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:33.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8378105e70 0x7f8378103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:33.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f837810e900 0x7f8378103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:33.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8378114430 con 0x7f8378105520 2024-05-14T12:21:33.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83781142b0 con 0x7f837810e900 2024-05-14T12:21:33.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.882+0000 7f837ea00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f83781145b0 con 0x7f8378105e70 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378103210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51308/0 (socket says 172.21.15.47:51308) 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 -- 172.21.15.47:0/2082685798 learned_addr learned my addr 172.21.15.47:0/2082685798 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377400700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8378105e70 0x7f8378103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f837ca00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f837810e900 0x7f8378103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 -- 172.21.15.47:0/2082685798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8378105e70 msgr2=0x7f8378103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8378105e70 0x7f8378103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 -- 172.21.15.47:0/2082685798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f837810e900 msgr2=0x7f8378103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f837810e900 0x7f8378103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377e00700 1 -- 172.21.15.47:0/2082685798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83781a9140 con 0x7f8378105520 2024-05-14T12:21:33.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.883+0000 7f8377400700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8378105e70 0x7f8378103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:33.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.884+0000 7f8377e00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378103210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f836800b070 tx=0x7f8368004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:33.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.884+0000 7f8374c00700 1 -- 172.21.15.47:0/2082685798 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368021070 con 0x7f8378105520 2024-05-14T12:21:33.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.884+0000 7f8374c00700 1 -- 172.21.15.47:0/2082685798 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8368007e30 con 0x7f8378105520 2024-05-14T12:21:33.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.884+0000 7f8374c00700 1 -- 172.21.15.47:0/2082685798 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83680046c0 con 0x7f8378105520 2024-05-14T12:21:33.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.884+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83781a93d0 con 0x7f8378105520 2024-05-14T12:21:33.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.884+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83781a98c0 con 0x7f8378105520 2024-05-14T12:21:33.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.885+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83780512c0 con 0x7f8378105520 2024-05-14T12:21:33.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.888+0000 7f8374c00700 1 -- 172.21.15.47:0/2082685798 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8368007980 con 0x7f8378105520 2024-05-14T12:21:33.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.889+0000 7f8374c00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f835c0b2990 0x7f835c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:33.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.890+0000 7f8374c00700 1 -- 172.21.15.47:0/2082685798 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f836800f020 con 0x7f8378105520 2024-05-14T12:21:33.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.890+0000 7f8377400700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f835c0b2990 0x7f835c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:33.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.891+0000 7f8377400700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f835c0b2990 0x7f835c0b4ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83781023e0 tx=0x7f8364009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:33.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:33.892+0000 7f8374c00700 1 -- 172.21.15.47:0/2082685798 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f836802a020 con 0x7f8378105520 2024-05-14T12:21:34.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.168+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8378063c00 con 0x7f835c0b2990 2024-05-14T12:21:34.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.215+0000 7f8374c00700 1 -- 172.21.15.47:0/2082685798 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8378063c00 con 0x7f835c0b2990 2024-05-14T12:21:34.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.218+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f835c0b2990 msgr2=0x7f835c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:34.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.218+0000 7f837ea00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f835c0b2990 0x7f835c0b4ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83781023e0 tx=0x7f8364009260 comp rx=0 tx=0).stop 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.218+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 msgr2=0x7f8378103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.218+0000 7f837ea00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378103210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f836800b070 tx=0x7f8368004d00 comp rx=0 tx=0).stop 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 shutdown_connections 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f835c0b2990 0x7f835c0b4ea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f837810e900 0x7f8378103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8378105520 0x7f8378103210 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 --2- 172.21.15.47:0/2082685798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8378105e70 0x7f8378103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 >> 172.21.15.47:0/2082685798 conn(0x7f83780fedc0 msgr2=0x7f83780ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 shutdown_connections 2024-05-14T12:21:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:34.219+0000 7f837ea00700 1 -- 172.21.15.47:0/2082685798 wait complete. 2024-05-14T12:21:35.013 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-14T12:21:35.491 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:35.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:35 smithi047 ceph-mon[31254]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:35.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:35 smithi047 ceph-mon[31254]: pgmap v340: 97 pgs: 97 active+clean; 591 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-14T12:21:35.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:35 smithi073 ceph-mon[35809]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:35.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:35 smithi073 ceph-mon[35809]: pgmap v340: 97 pgs: 97 active+clean; 591 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-14T12:21:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:35 smithi066 ceph-mon[35981]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:35 smithi066 ceph-mon[35981]: pgmap v340: 97 pgs: 97 active+clean; 591 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 KiB/s wr, 19 op/s 2024-05-14T12:21:37.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:37 smithi047 ceph-mon[31254]: pgmap v341: 97 pgs: 97 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-05-14T12:21:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:37 smithi073 ceph-mon[35809]: pgmap v341: 97 pgs: 97 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-05-14T12:21:37.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:37 smithi066 ceph-mon[35981]: pgmap v341: 97 pgs: 97 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-05-14T12:21:37.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 -- 172.21.15.47:0/742091006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d0110970 msgr2=0x7f23d0110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:37.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 --2- 172.21.15.47:0/742091006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d0110970 0x7f23d0110d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009990 tx=0x7f23c4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:21:37.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 -- 172.21.15.47:0/742091006 shutdown_connections 2024-05-14T12:21:37.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 --2- 172.21.15.47:0/742091006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010b2e0 0x7f23d0117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:37.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 --2- 172.21.15.47:0/742091006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d0110970 0x7f23d0110d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:37.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 --2- 172.21.15.47:0/742091006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23d010a990 0x7f23d010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:37.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 -- 172.21.15.47:0/742091006 >> 172.21.15.47:0/742091006 conn(0x7f23d0077c80 msgr2=0x7f23d00780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:37.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 -- 172.21.15.47:0/742091006 shutdown_connections 2024-05-14T12:21:37.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.851+0000 7f23d7e00700 1 -- 172.21.15.47:0/742091006 wait complete. 2024-05-14T12:21:37.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.853+0000 7f23d7e00700 1 Processor -- start 2024-05-14T12:21:37.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.853+0000 7f23d7e00700 1 -- start start 2024-05-14T12:21:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d7e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010a990 0x7f23d01a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d7e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d010b2e0 0x7f23d01a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23d0110970 0x7f23d01a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d7e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23d011aac0 con 0x7f23d0110970 2024-05-14T12:21:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d7e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23d011a940 con 0x7f23d010a990 2024-05-14T12:21:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d7e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23d011ac40 con 0x7f23d010b2e0 2024-05-14T12:21:37.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d5400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010a990 0x7f23d01a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d5400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010a990 0x7f23d01a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33230/0 (socket says 172.21.15.47:33230) 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d5400700 1 -- 172.21.15.47:0/1538234321 learned_addr learned my addr 172.21.15.47:0/1538234321 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d4a00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d010b2e0 0x7f23d01a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.854+0000 7f23d5e00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23d0110970 0x7f23d01a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.855+0000 7f23d5400700 1 -- 172.21.15.47:0/1538234321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d010b2e0 msgr2=0x7f23d01a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.855+0000 7f23d5400700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d010b2e0 0x7f23d01a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.855+0000 7f23d5400700 1 -- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23d0110970 msgr2=0x7f23d01a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.855+0000 7f23d5400700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23d0110970 0x7f23d01a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.855+0000 7f23d5400700 1 -- 172.21.15.47:0/1538234321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d01a6360 con 0x7f23d010a990 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.855+0000 7f23d4a00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d010b2e0 0x7f23d01a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.855+0000 7f23d5400700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010a990 0x7f23d01a1490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000c00 tx=0x7f23c40047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.856+0000 7f23ce000700 1 -- 172.21.15.47:0/1538234321 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4026070 con 0x7f23d010a990 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.856+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d01a65f0 con 0x7f23d010a990 2024-05-14T12:21:37.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.856+0000 7f23ce000700 1 -- 172.21.15.47:0/1538234321 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23c4021410 con 0x7f23d010a990 2024-05-14T12:21:37.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.856+0000 7f23ce000700 1 -- 172.21.15.47:0/1538234321 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4017650 con 0x7f23d010a990 2024-05-14T12:21:37.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.856+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d01adf70 con 0x7f23d010a990 2024-05-14T12:21:37.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.857+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d010c080 con 0x7f23d010a990 2024-05-14T12:21:37.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.859+0000 7f23ce000700 1 -- 172.21.15.47:0/1538234321 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f23c4029070 con 0x7f23d010a990 2024-05-14T12:21:37.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.861+0000 7f23ce000700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f23b80b2990 0x7f23b80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:37.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.861+0000 7f23ce000700 1 -- 172.21.15.47:0/1538234321 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f23c40e2ff0 con 0x7f23d010a990 2024-05-14T12:21:37.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.861+0000 7f23d4a00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f23b80b2990 0x7f23b80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:37.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.862+0000 7f23d4a00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f23b80b2990 0x7f23b80b4ea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23d007b060 tx=0x7f23bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:37.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:37.864+0000 7f23ce000700 1 -- 172.21.15.47:0/1538234321 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f23c4013070 con 0x7f23d010a990 2024-05-14T12:21:38.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.156+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f23d01a27f0 con 0x7f23b80b2990 2024-05-14T12:21:38.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.168+0000 7f23ce000700 1 -- 172.21.15.47:0/1538234321 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f23d01a27f0 con 0x7f23b80b2990 2024-05-14T12:21:38.168 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_0/e83d5940-fb07-475e-88fe-e971159c9b78 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f23b80b2990 msgr2=0x7f23b80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f23b80b2990 0x7f23b80b4ea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23d007b060 tx=0x7f23bc009260 comp rx=0 tx=0).stop 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010a990 msgr2=0x7f23d01a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010a990 0x7f23d01a1490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000c00 tx=0x7f23c40047b0 comp rx=0 tx=0).stop 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 shutdown_connections 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f23b80b2990 0x7f23b80b4ea0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23d0110970 0x7f23d01a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23d010a990 0x7f23d01a1490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 --2- 172.21.15.47:0/1538234321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d010b2e0 0x7f23d01a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.171+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 >> 172.21.15.47:0/1538234321 conn(0x7f23d0077c80 msgr2=0x7f23d007bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.172+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 shutdown_connections 2024-05-14T12:21:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:38.172+0000 7f23d7e00700 1 -- 172.21.15.47:0/1538234321 wait complete. 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-05-14T12:21:38.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-05-14T12:21:38.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-05-14T12:21:38.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-05-14T12:21:38.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-14T12:21:39.480 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: pgmap v342: 97 pgs: 97 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-05-14T12:21:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-14T12:21:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-14T12:21:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-14T12:21:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-05-14T12:21:39.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-05-14T12:21:39.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-14T12:21:39.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-14T12:21:39.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-05-14T12:21:39.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-05-14T12:21:39.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:39 smithi066 ceph-mon[35981]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T12:21:39.849 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:39.849 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: pgmap v342: 97 pgs: 97 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-05-14T12:21:39.850 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:39 smithi047 ceph-mon[31254]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T12:21:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: pgmap v342: 97 pgs: 97 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-05-14T12:21:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-14T12:21:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-14T12:21:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-14T12:21:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-05-14T12:21:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-05-14T12:21:40.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-14T12:21:40.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-14T12:21:40.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-05-14T12:21:40.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-05-14T12:21:40.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:39 smithi073 ceph-mon[35809]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T12:21:40.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:40 smithi047 ceph-mon[31254]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T12:21:40.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:40 smithi066 ceph-mon[35981]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T12:21:41.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:40 smithi073 ceph-mon[35809]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T12:21:41.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:41 smithi047 ceph-mon[31254]: pgmap v345: 97 pgs: 2 peering, 95 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:41.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 -- 172.21.15.47:0/194819630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04104400 msgr2=0x7feb04104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 --2- 172.21.15.47:0/194819630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04104400 0x7feb04104810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feaf80099c0 tx=0x7feaf8009cd0 comp rx=0 tx=0).stop 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 -- 172.21.15.47:0/194819630 shutdown_connections 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 --2- 172.21.15.47:0/194819630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb04109680 0x7feb04110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 --2- 172.21.15.47:0/194819630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04104400 0x7feb04104810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 --2- 172.21.15.47:0/194819630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb04108d30 0x7feb04109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 -- 172.21.15.47:0/194819630 >> 172.21.15.47:0/194819630 conn(0x7feb04079d50 msgr2=0x7feb0407a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 -- 172.21.15.47:0/194819630 shutdown_connections 2024-05-14T12:21:41.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.819+0000 7feb0a800700 1 -- 172.21.15.47:0/194819630 wait complete. 2024-05-14T12:21:41.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.820+0000 7feb0a800700 1 Processor -- start 2024-05-14T12:21:41.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.821+0000 7feb0a800700 1 -- start start 2024-05-14T12:21:41.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.821+0000 7feb0a800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb04104400 0x7feb041a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:41.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.821+0000 7feb0a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb04108d30 0x7feb041a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:41.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.821+0000 7feb0a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04109680 0x7feb0419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:41.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.821+0000 7feb0a800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb041142b0 con 0x7feb04109680 2024-05-14T12:21:41.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.821+0000 7feb0a800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feb04114130 con 0x7feb04104400 2024-05-14T12:21:41.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.821+0000 7feb0a800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feb04114430 con 0x7feb04108d30 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb09e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04109680 0x7feb0419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb08a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb04108d30 0x7feb041a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb09e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04109680 0x7feb0419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34412/0 (socket says 172.21.15.47:34412) 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb09400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb04104400 0x7feb041a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb09e00700 1 -- 172.21.15.47:0/1541018489 learned_addr learned my addr 172.21.15.47:0/1541018489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb08a00700 1 -- 172.21.15.47:0/1541018489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb04104400 msgr2=0x7feb041a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb08a00700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb04104400 0x7feb041a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb08a00700 1 -- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04109680 msgr2=0x7feb0419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:41.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb08a00700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04109680 0x7feb0419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb08a00700 1 -- 172.21.15.47:0/1541018489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0419b120 con 0x7feb04108d30 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.822+0000 7feb09e00700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04109680 0x7feb0419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.823+0000 7feb08a00700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb04108d30 0x7feb041a0d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feaf000e9c0 tx=0x7feaf000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.823+0000 7feb02000700 1 -- 172.21.15.47:0/1541018489 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf000c9c0 con 0x7feb04108d30 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.823+0000 7feb02000700 1 -- 172.21.15.47:0/1541018489 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feaf000cb60 con 0x7feb04108d30 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.823+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0419b410 con 0x7feb04108d30 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.823+0000 7feb02000700 1 -- 172.21.15.47:0/1541018489 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0018680 con 0x7feb04108d30 2024-05-14T12:21:41.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.823+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb041a76e0 con 0x7feb04108d30 2024-05-14T12:21:41.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.824+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb040512c0 con 0x7feb04108d30 2024-05-14T12:21:41.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:41 smithi066 ceph-mon[35981]: pgmap v345: 97 pgs: 2 peering, 95 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:41.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.827+0000 7feb02000700 1 -- 172.21.15.47:0/1541018489 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7feaf0010430 con 0x7feb04108d30 2024-05-14T12:21:41.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.828+0000 7feb02000700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feaec0b2990 0x7feaec0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:41.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.828+0000 7feb02000700 1 -- 172.21.15.47:0/1541018489 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7feaf00e2860 con 0x7feb04108d30 2024-05-14T12:21:41.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.829+0000 7feb09400700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feaec0b2990 0x7feaec0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:41.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.829+0000 7feb09400700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feaec0b2990 0x7feaec0b4ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feaf8000c00 tx=0x7feaf801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:41.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:41.830+0000 7feb02000700 1 -- 172.21.15.47:0/1541018489 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feaf00aa3e0 con 0x7feb04108d30 2024-05-14T12:21:42.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:41 smithi073 ceph-mon[35809]: pgmap v345: 97 pgs: 2 peering, 95 active+clean; 605 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.109+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7feb04063c00 con 0x7feaec0b2990 2024-05-14T12:21:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.160+0000 7feb02000700 1 -- 172.21.15.47:0/1541018489 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feb04063c00 con 0x7feaec0b2990 2024-05-14T12:21:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feaec0b2990 msgr2=0x7feaec0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feaec0b2990 0x7feaec0b4ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feaf8000c00 tx=0x7feaf801a040 comp rx=0 tx=0).stop 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb04108d30 msgr2=0x7feb041a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb04108d30 0x7feb041a0d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feaf000e9c0 tx=0x7feaf000ecd0 comp rx=0 tx=0).stop 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 shutdown_connections 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7feaec0b2990 0x7feaec0b4ea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04109680 0x7feb0419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb04104400 0x7feb041a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 --2- 172.21.15.47:0/1541018489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb04108d30 0x7feb041a0d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 >> 172.21.15.47:0/1541018489 conn(0x7feb04079d50 msgr2=0x7feb04101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 shutdown_connections 2024-05-14T12:21:42.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:42.165+0000 7feb0a800700 1 -- 172.21.15.47:0/1541018489 wait complete. 2024-05-14T12:21:42.948 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-14T12:21:43.426 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:43.794 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:43 smithi047 ceph-mon[31254]: from='client.24643 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:43.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:43 smithi047 ceph-mon[31254]: pgmap v346: 97 pgs: 2 peering, 95 active+clean; 611 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.2 KiB/s wr, 9 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:43 smithi066 ceph-mon[35981]: from='client.24643 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:43 smithi066 ceph-mon[35981]: pgmap v346: 97 pgs: 2 peering, 95 active+clean; 611 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.2 KiB/s wr, 9 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:44.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:43 smithi073 ceph-mon[35809]: from='client.24643 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:44.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:43 smithi073 ceph-mon[35809]: pgmap v346: 97 pgs: 2 peering, 95 active+clean; 611 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.2 KiB/s wr, 9 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:45.565 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:45 smithi047 ceph-mon[31254]: pgmap v347: 97 pgs: 97 active+clean; 611 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.564+0000 7f0abe600700 1 -- 172.21.15.47:0/3389108773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8109300 msgr2=0x7f0ab8109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.564+0000 7f0abe600700 1 --2- 172.21.15.47:0/3389108773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8109300 0x7f0ab8109710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800b0a0 tx=0x7f0aa800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.564+0000 7f0abe600700 1 -- 172.21.15.47:0/3389108773 shutdown_connections 2024-05-14T12:21:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.564+0000 7f0abe600700 1 --2- 172.21.15.47:0/3389108773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab81031d0 0x7f0ab8111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.564+0000 7f0abe600700 1 --2- 172.21.15.47:0/3389108773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8109300 0x7f0ab8109710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.564+0000 7f0abe600700 1 --2- 172.21.15.47:0/3389108773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ab8102880 0x7f0ab8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.564+0000 7f0abe600700 1 -- 172.21.15.47:0/3389108773 >> 172.21.15.47:0/3389108773 conn(0x7f0ab80fe6f0 msgr2=0x7f0ab8100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.565+0000 7f0abe600700 1 -- 172.21.15.47:0/3389108773 shutdown_connections 2024-05-14T12:21:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.565+0000 7f0abe600700 1 -- 172.21.15.47:0/3389108773 wait complete. 2024-05-14T12:21:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.566+0000 7f0abe600700 1 Processor -- start 2024-05-14T12:21:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.567+0000 7f0abe600700 1 -- start start 2024-05-14T12:21:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.567+0000 7f0abe600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8102880 0x7f0ab819aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.567+0000 7f0abe600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ab81031d0 0x7f0ab819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.567+0000 7f0abe600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8109300 0x7f0ab819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.567+0000 7f0abe600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81145e0 con 0x7f0ab81031d0 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.567+0000 7f0abe600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8114460 con 0x7f0ab8102880 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.567+0000 7f0abe600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8114760 con 0x7f0ab8109300 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8102880 0x7f0ab819aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8102880 0x7f0ab819aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35358/0 (socket says 172.21.15.47:35358) 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 -- 172.21.15.47:0/2287113442 learned_addr learned my addr 172.21.15.47:0/2287113442 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0aaea00700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ab81031d0 0x7f0ab819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7e00700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8109300 0x7f0ab819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 -- 172.21.15.47:0/2287113442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8109300 msgr2=0x7f0ab819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8109300 0x7f0ab819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 -- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ab81031d0 msgr2=0x7f0ab819b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ab81031d0 0x7f0ab819b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 -- 172.21.15.47:0/2287113442 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab819fec0 con 0x7f0ab8102880 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0aaea00700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ab81031d0 0x7f0ab819b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.568+0000 7f0ab7400700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8102880 0x7f0ab819aff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800b780 tx=0x7f0aa8004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.569+0000 7f0ab4c00700 1 -- 172.21.15.47:0/2287113442 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8021070 con 0x7f0ab8102880 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.569+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab81a0150 con 0x7f0ab8102880 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.569+0000 7f0ab4c00700 1 -- 172.21.15.47:0/2287113442 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa8007e30 con 0x7f0ab8102880 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.569+0000 7f0ab4c00700 1 -- 172.21.15.47:0/2287113442 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8004750 con 0x7f0ab8102880 2024-05-14T12:21:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.569+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab81a7ad0 con 0x7f0ab8102880 2024-05-14T12:21:45.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.570+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab810c8a0 con 0x7f0ab8102880 2024-05-14T12:21:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.573+0000 7f0ab4c00700 1 -- 172.21.15.47:0/2287113442 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0aa8007980 con 0x7f0ab8102880 2024-05-14T12:21:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.574+0000 7f0ab4c00700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0a9c0b2910 0x7f0a9c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.574+0000 7f0ab4c00700 1 -- 172.21.15.47:0/2287113442 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0aa800f020 con 0x7f0ab8102880 2024-05-14T12:21:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.574+0000 7f0aaea00700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0a9c0b2910 0x7f0a9c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.575+0000 7f0aaea00700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0a9c0b2910 0x7f0a9c0b4e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8102110 tx=0x7f0aa0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:45.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.579+0000 7f0ab4c00700 1 -- 172.21.15.47:0/2287113442 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0aa802a020 con 0x7f0ab8102880 2024-05-14T12:21:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:45 smithi066 ceph-mon[35981]: pgmap v347: 97 pgs: 97 active+clean; 611 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.853+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0ab80512c0 con 0x7f0a9c0b2910 2024-05-14T12:21:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.872+0000 7f0ab4c00700 1 -- 172.21.15.47:0/2287113442 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0ab80512c0 con 0x7f0a9c0b2910 2024-05-14T12:21:45.873 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_1/861dd1bf-e8ef-4241-938f-ed5a8904f261 2024-05-14T12:21:45.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0a9c0b2910 msgr2=0x7f0a9c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0a9c0b2910 0x7f0a9c0b4e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8102110 tx=0x7f0aa0009260 comp rx=0 tx=0).stop 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8102880 msgr2=0x7f0ab819aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8102880 0x7f0ab819aff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800b780 tx=0x7f0aa8004d00 comp rx=0 tx=0).stop 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 shutdown_connections 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0a9c0b2910 0x7f0a9c0b4e20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ab8109300 0x7f0ab819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ab8102880 0x7f0ab819aff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 --2- 172.21.15.47:0/2287113442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ab81031d0 0x7f0ab819b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.875+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 >> 172.21.15.47:0/2287113442 conn(0x7f0ab80fe6f0 msgr2=0x7f0ab810a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.876+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 shutdown_connections 2024-05-14T12:21:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:45.876+0000 7f0abe600700 1 -- 172.21.15.47:0/2287113442 wait complete. 2024-05-14T12:21:46.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:45 smithi073 ceph-mon[35809]: pgmap v347: 97 pgs: 97 active+clean; 611 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:46.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:21:47.129 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:47.631 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:47 smithi047 ceph-mon[31254]: from='client.24623 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:47.631 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:47 smithi047 ceph-mon[31254]: pgmap v348: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 11 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:47 smithi066 ceph-mon[35981]: from='client.24623 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:47 smithi066 ceph-mon[35981]: pgmap v348: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 11 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:47 smithi073 ceph-mon[35809]: from='client.24623 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:21:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:47 smithi073 ceph-mon[35809]: pgmap v348: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 11 op/s; 80 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:49.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 -- 172.21.15.47:0/3663901337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc06810c5c0 msgr2=0x7fc06810c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3663901337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc06810c5c0 0x7fc06810c9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc058009990 tx=0x7fc058009ca0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 -- 172.21.15.47:0/3663901337 shutdown_connections 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3663901337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc068106ed0 0x7fc068113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3663901337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc06810c5c0 0x7fc06810c9d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3663901337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc068106580 0x7fc068106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 -- 172.21.15.47:0/3663901337 >> 172.21.15.47:0/3663901337 conn(0x7fc068102080 msgr2=0x7fc0681044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.313+0000 7fc06fa00700 1 -- 172.21.15.47:0/3663901337 shutdown_connections 2024-05-14T12:21:49.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.314+0000 7fc06fa00700 1 -- 172.21.15.47:0/3663901337 wait complete. 2024-05-14T12:21:49.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.315+0000 7fc06fa00700 1 Processor -- start 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.315+0000 7fc06fa00700 1 -- start start 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06fa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc068106580 0x7fc06819d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06fa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc068106ed0 0x7fc06819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06fa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc06810c5c0 0x7fc0681a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06fa00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681166d0 con 0x7fc068106580 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06fa00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc068116550 con 0x7fc06810c5c0 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06fa00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc068116850 con 0x7fc068106ed0 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06d000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc068106580 0x7fc06819d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06d000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc068106580 0x7fc06819d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39376/0 (socket says 172.21.15.47:39376) 2024-05-14T12:21:49.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06d000700 1 -- 172.21.15.47:0/3003704187 learned_addr learned my addr 172.21.15.47:0/3003704187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc05fe00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc068106ed0 0x7fc06819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:49.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06da00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc06810c5c0 0x7fc0681a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.316+0000 7fc06d000700 1 -- 172.21.15.47:0/3003704187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc068106ed0 msgr2=0x7fc06819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06d000700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc068106ed0 0x7fc06819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06d000700 1 -- 172.21.15.47:0/3003704187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc06810c5c0 msgr2=0x7fc0681a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06d000700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc06810c5c0 0x7fc0681a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06d000700 1 -- 172.21.15.47:0/3003704187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0681a1fb0 con 0x7fc068106580 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06da00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc06810c5c0 0x7fc0681a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc05fe00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc068106ed0 0x7fc06819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06d000700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc068106580 0x7fc06819d0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc058000c00 tx=0x7fc058009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc066000700 1 -- 172.21.15.47:0/3003704187 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058026070 con 0x7fc068106580 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc066000700 1 -- 172.21.15.47:0/3003704187 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc058021410 con 0x7fc068106580 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0681a2240 con 0x7fc068106580 2024-05-14T12:21:49.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc066000700 1 -- 172.21.15.47:0/3003704187 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058017650 con 0x7fc068106580 2024-05-14T12:21:49.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.317+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0681a9bc0 con 0x7fc068106580 2024-05-14T12:21:49.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.319+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc068107ca0 con 0x7fc068106580 2024-05-14T12:21:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.321+0000 7fc066000700 1 -- 172.21.15.47:0/3003704187 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc058029070 con 0x7fc068106580 2024-05-14T12:21:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.323+0000 7fc066000700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc04c0b2990 0x7fc04c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.323+0000 7fc066000700 1 -- 172.21.15.47:0/3003704187 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc0580e3370 con 0x7fc068106580 2024-05-14T12:21:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.323+0000 7fc05fe00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc04c0b2990 0x7fc04c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:49.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.324+0000 7fc05fe00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc04c0b2990 0x7fc04c0b4ea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc068103db0 tx=0x7fc050009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:49.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.326+0000 7fc066000700 1 -- 172.21.15.47:0/3003704187 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc058013070 con 0x7fc068106580 2024-05-14T12:21:49.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.630+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc06819e440 con 0x7fc068106580 2024-05-14T12:21:49.632 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:49 smithi047 ceph-mon[31254]: pgmap v349: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 65 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:49.632 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:21:49.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.632+0000 7fc066000700 1 -- 172.21.15.47:0/3003704187 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11919 (secure 0 0 0) 0x7fc0580aaf80 con 0x7fc068106580 2024-05-14T12:21:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:21:49.633 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:21:26.159710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:21:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.635+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc04c0b2990 msgr2=0x7fc04c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:49.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.635+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc04c0b2990 0x7fc04c0b4ea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc068103db0 tx=0x7fc050009260 comp rx=0 tx=0).stop 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.635+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc068106580 msgr2=0x7fc06819d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.635+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc068106580 0x7fc06819d0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc058000c00 tx=0x7fc058009510 comp rx=0 tx=0).stop 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 shutdown_connections 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc04c0b2990 0x7fc04c0b4ea0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc06810c5c0 0x7fc0681a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc068106580 0x7fc06819d0e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 --2- 172.21.15.47:0/3003704187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc068106ed0 0x7fc06819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 >> 172.21.15.47:0/3003704187 conn(0x7fc068102080 msgr2=0x7fc0681048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:49.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 shutdown_connections 2024-05-14T12:21:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:49.636+0000 7fc06fa00700 1 -- 172.21.15.47:0/3003704187 wait complete. 2024-05-14T12:21:49.638 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-05-14T12:21:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:49 smithi066 ceph-mon[35981]: pgmap v349: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 65 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:21:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:49 smithi073 ceph-mon[35809]: pgmap v349: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 65 B/s, 1 keys/s, 1 objects/s recovering 2024-05-14T12:21:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:21:50.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:21:50.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:50 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3003704187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:21:50.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:50 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3003704187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:21:51.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:50 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3003704187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:21:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:51.704 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:51 smithi047 ceph-mon[31254]: pgmap v350: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s; 59 B/s, 0 keys/s, 1 objects/s recovering 2024-05-14T12:21:51.704 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:51.704 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:51.704 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:51.704 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:51 smithi066 ceph-mon[35981]: pgmap v350: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s; 59 B/s, 0 keys/s, 1 objects/s recovering 2024-05-14T12:21:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:52.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:51 smithi073 ceph-mon[35809]: pgmap v350: 97 pgs: 97 active+clean; 628 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s; 59 B/s, 0 keys/s, 1 objects/s recovering 2024-05-14T12:21:52.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:52.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:52.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:52.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:53.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:53 smithi047 ceph-mon[31254]: pgmap v351: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 10 op/s; 53 B/s, 0 objects/s recovering 2024-05-14T12:21:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:53 smithi066 ceph-mon[35981]: pgmap v351: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 10 op/s; 53 B/s, 0 objects/s recovering 2024-05-14T12:21:54.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:53 smithi073 ceph-mon[35809]: pgmap v351: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 10 op/s; 53 B/s, 0 objects/s recovering 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 -- 172.21.15.47:0/989028200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105be0 msgr2=0x7f5ce410e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 --2- 172.21.15.47:0/989028200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105be0 0x7f5ce410e130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009990 tx=0x7f5cd0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 -- 172.21.15.47:0/989028200 shutdown_connections 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 --2- 172.21.15.47:0/989028200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ce410e700 0x7f5ce4110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 --2- 172.21.15.47:0/989028200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105290 0x7f5ce41056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 --2- 172.21.15.47:0/989028200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105be0 0x7f5ce410e130 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 -- 172.21.15.47:0/989028200 >> 172.21.15.47:0/989028200 conn(0x7f5ce4078b50 msgr2=0x7f5ce4078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 -- 172.21.15.47:0/989028200 shutdown_connections 2024-05-14T12:21:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.016+0000 7f5ce9600700 1 -- 172.21.15.47:0/989028200 wait complete. 2024-05-14T12:21:54.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.017+0000 7f5ce9600700 1 Processor -- start 2024-05-14T12:21:54.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.017+0000 7f5ce9600700 1 -- start start 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce9600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105290 0x7f5ce41a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce9600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105be0 0x7f5ce41a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce9600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ce410e700 0x7f5ce419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce9600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41142b0 con 0x7f5ce4105290 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce9600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4114130 con 0x7f5ce410e700 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce9600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4114430 con 0x7f5ce4105be0 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105290 0x7f5ce41a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:54.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105be0 0x7f5ce41a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:54.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105be0 0x7f5ce41a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:46086/0 (socket says 172.21.15.47:46086) 2024-05-14T12:21:54.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105290 0x7f5ce41a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39388/0 (socket says 172.21.15.47:39388) 2024-05-14T12:21:54.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.018+0000 7f5ce3400700 1 -- 172.21.15.47:0/3522145827 learned_addr learned my addr 172.21.15.47:0/3522145827 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:54.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.019+0000 7f5ce8c00700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ce410e700 0x7f5ce419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.019+0000 7f5ce3400700 1 -- 172.21.15.47:0/3522145827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ce410e700 msgr2=0x7f5ce419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.019+0000 7f5ce3400700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ce410e700 0x7f5ce419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.019+0000 7f5ce3400700 1 -- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105290 msgr2=0x7f5ce41a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.019+0000 7f5ce3400700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105290 0x7f5ce41a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.019+0000 7f5ce3400700 1 -- 172.21.15.47:0/3522145827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce419b100 con 0x7f5ce4105be0 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.019+0000 7f5ce3400700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105be0 0x7f5ce41a0d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0000c00 tx=0x7f5cd00057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.020+0000 7f5ce0c00700 1 -- 172.21.15.47:0/3522145827 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0027070 con 0x7f5ce4105be0 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.020+0000 7f5ce0c00700 1 -- 172.21.15.47:0/3522145827 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cd0022470 con 0x7f5ce4105be0 2024-05-14T12:21:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.020+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce419b390 con 0x7f5ce4105be0 2024-05-14T12:21:54.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.020+0000 7f5ce0c00700 1 -- 172.21.15.47:0/3522145827 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0017650 con 0x7f5ce4105be0 2024-05-14T12:21:54.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.020+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce419b870 con 0x7f5ce4105be0 2024-05-14T12:21:54.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.021+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce40512c0 con 0x7f5ce4105be0 2024-05-14T12:21:54.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.023+0000 7f5ce0c00700 1 -- 172.21.15.47:0/3522145827 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5cd002a070 con 0x7f5ce4105be0 2024-05-14T12:21:54.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.025+0000 7f5ce0c00700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5cc80b2910 0x7f5cc80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:54.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.025+0000 7f5ce0c00700 1 -- 172.21.15.47:0/3522145827 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5cd00e3340 con 0x7f5ce4105be0 2024-05-14T12:21:54.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.025+0000 7f5ce3e00700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5cc80b2910 0x7f5cc80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:54.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.026+0000 7f5ce3e00700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5cc80b2910 0x7f5cc80b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ce419bb90 tx=0x7f5cd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:54.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.027+0000 7f5ce0c00700 1 -- 172.21.15.47:0/3522145827 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5cd0013070 con 0x7f5ce4105be0 2024-05-14T12:21:54.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.269+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ce402e5f0 con 0x7f5ce4105be0 2024-05-14T12:21:54.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.271+0000 7f5ce0c00700 1 -- 172.21.15.47:0/3522145827 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7f5cd00aaf50 con 0x7f5ce4105be0 2024-05-14T12:21:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:21:54.273 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5cc80b2910 msgr2=0x7f5cc80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5cc80b2910 0x7f5cc80b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ce419bb90 tx=0x7f5cd4009260 comp rx=0 tx=0).stop 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105be0 msgr2=0x7f5ce41a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105be0 0x7f5ce41a0d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0000c00 tx=0x7f5cd00057c0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 shutdown_connections 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5cc80b2910 0x7f5cc80b4e20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ce410e700 0x7f5ce419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ce4105290 0x7f5ce41a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 --2- 172.21.15.47:0/3522145827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce4105be0 0x7f5ce41a0d70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:54.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 >> 172.21.15.47:0/3522145827 conn(0x7f5ce4078b50 msgr2=0x7f5ce40ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:54.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 shutdown_connections 2024-05-14T12:21:54.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:54.275+0000 7f5ce9600700 1 -- 172.21.15.47:0/3522145827 wait complete. 2024-05-14T12:21:55.133 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-14T12:21:55.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T12:21:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:55 smithi047 ceph-mon[31254]: pgmap v352: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-14T12:21:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:55 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3522145827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:55 smithi073 ceph-mon[35809]: pgmap v352: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-14T12:21:55.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:55 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3522145827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:55 smithi066 ceph-mon[35981]: pgmap v352: 97 pgs: 97 active+clean; 637 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-14T12:21:55.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:55 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3522145827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:21:55.594 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:56.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:21:56.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:21:56.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:56.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:21:56.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:21:56.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:21:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:21:56.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:21:57.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:57 smithi047 ceph-mon[31254]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-05-14T12:21:57.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:57 smithi073 ceph-mon[35809]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-05-14T12:21:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:57 smithi066 ceph-mon[35981]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 -- 172.21.15.47:0/2606226532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a881030e0 msgr2=0x7f1a881034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 --2- 172.21.15.47:0/2606226532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a881030e0 0x7f1a881034f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a780098f0 tx=0x7f1a78009c00 comp rx=0 tx=0).stop 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 -- 172.21.15.47:0/2606226532 shutdown_connections 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 --2- 172.21.15.47:0/2606226532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a88110c90 0x7f1a881130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 --2- 172.21.15.47:0/2606226532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a881030e0 0x7f1a881034f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 --2- 172.21.15.47:0/2606226532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a88103a30 0x7f1a88110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 -- 172.21.15.47:0/2606226532 >> 172.21.15.47:0/2606226532 conn(0x7f1a880fedc0 msgr2=0x7f1a881011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:57.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 -- 172.21.15.47:0/2606226532 shutdown_connections 2024-05-14T12:21:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.841+0000 7f1a8d600700 1 -- 172.21.15.47:0/2606226532 wait complete. 2024-05-14T12:21:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.842+0000 7f1a8d600700 1 Processor -- start 2024-05-14T12:21:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.842+0000 7f1a8d600700 1 -- start start 2024-05-14T12:21:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a8d600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881030e0 0x7f1a8819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:57.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a8d600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a88103a30 0x7f1a8819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a8d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a88110c90 0x7f1a881a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a8d600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a881166c0 con 0x7f1a88110c90 2024-05-14T12:21:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a8d600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88116540 con 0x7f1a881030e0 2024-05-14T12:21:57.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a8d600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88116840 con 0x7f1a88103a30 2024-05-14T12:21:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a86a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881030e0 0x7f1a8819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a7e000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a88103a30 0x7f1a8819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a86a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881030e0 0x7f1a8819d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57186/0 (socket says 172.21.15.47:57186) 2024-05-14T12:21:57.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a86a00700 1 -- 172.21.15.47:0/4110054848 learned_addr learned my addr 172.21.15.47:0/4110054848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a87400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a88110c90 0x7f1a881a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a86a00700 1 -- 172.21.15.47:0/4110054848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a88103a30 msgr2=0x7f1a8819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a86a00700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a88103a30 0x7f1a8819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a86a00700 1 -- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a88110c90 msgr2=0x7f1a881a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.843+0000 7f1a86a00700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a88110c90 0x7f1a881a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.844+0000 7f1a86a00700 1 -- 172.21.15.47:0/4110054848 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a881a2080 con 0x7f1a881030e0 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.844+0000 7f1a86a00700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881030e0 0x7f1a8819d1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009230 tx=0x7f1a7800fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.844+0000 7f1a7fe00700 1 -- 172.21.15.47:0/4110054848 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78005140 con 0x7f1a881030e0 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.844+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a881a2310 con 0x7f1a881030e0 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.844+0000 7f1a7fe00700 1 -- 172.21.15.47:0/4110054848 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a7800b560 con 0x7f1a881030e0 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.844+0000 7f1a7fe00700 1 -- 172.21.15.47:0/4110054848 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78003970 con 0x7f1a881030e0 2024-05-14T12:21:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.844+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a881a9c90 con 0x7f1a881030e0 2024-05-14T12:21:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.845+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a8806be90 con 0x7f1a881030e0 2024-05-14T12:21:57.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.848+0000 7f1a7fe00700 1 -- 172.21.15.47:0/4110054848 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1a7800ba50 con 0x7f1a881030e0 2024-05-14T12:21:57.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.850+0000 7f1a7fe00700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a6c0b2990 0x7f1a6c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:21:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.850+0000 7f1a7fe00700 1 -- 172.21.15.47:0/4110054848 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1a780e34c0 con 0x7f1a881030e0 2024-05-14T12:21:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.850+0000 7f1a7e000700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a6c0b2990 0x7f1a6c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:21:57.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.851+0000 7f1a7e000700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a6c0b2990 0x7f1a6c0b4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009750 tx=0x7f1a70009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:21:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:57.852+0000 7f1a7fe00700 1 -- 172.21.15.47:0/4110054848 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a78013030 con 0x7f1a881030e0 2024-05-14T12:21:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.083+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a8819e510 con 0x7f1a6c0b2990 2024-05-14T12:21:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.100+0000 7f1a7fe00700 1 -- 172.21.15.47:0/4110054848 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7f1a8819e510 con 0x7f1a6c0b2990 2024-05-14T12:21:58.103 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a6c0b2990 msgr2=0x7f1a6c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a6c0b2990 0x7f1a6c0b4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009750 tx=0x7f1a70009310 comp rx=0 tx=0).stop 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881030e0 msgr2=0x7f1a8819d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881030e0 0x7f1a8819d1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009230 tx=0x7f1a7800fa70 comp rx=0 tx=0).stop 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 shutdown_connections 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a6c0b2990 0x7f1a6c0b4ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a88110c90 0x7f1a881a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a881030e0 0x7f1a8819d1b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 --2- 172.21.15.47:0/4110054848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a88103a30 0x7f1a8819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:21:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.108+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 >> 172.21.15.47:0/4110054848 conn(0x7f1a880fedc0 msgr2=0x7f1a88101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:21:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.109+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 shutdown_connections 2024-05-14T12:21:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:21:58.109+0000 7f1a8d600700 1 -- 172.21.15.47:0/4110054848 wait complete. 2024-05-14T12:21:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-14T12:21:59.026 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":353,"stamp":"2024-05-14T12:21:56.267978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660878,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":420,"num_read_kb":322,"num_write":371,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2952484,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374680,"kb_used_data":13024,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567144,"statfs":{"total":1151940427776,"available":1151556755456,"internally_reserved":0,"allocated":13336576,"data_stored":7293865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35106,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":101,"num_write":18,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005464"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499404+0000","last_change":"2024-05-14T12:20:59.669913+0000","last_active":"2024-05-14T12:21:39.499404+0000","last_peered":"2024-05-14T12:21:39.499404+0000","last_clean":"2024-05-14T12:21:39.499404+0000","last_became_active":"2024-05-14T12:20:59.668481+0000","last_became_peered":"2024-05-14T12:20:59.668481+0000","last_unstale":"2024-05-14T12:21:39.499404+0000","last_undegraded":"2024-05-14T12:21:39.499404+0000","last_fullsized":"2024-05-14T12:21:39.499404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:13.671516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356115+0000","last_change":"2024-05-14T12:20:59.665032+0000","last_active":"2024-05-14T12:21:40.356115+0000","last_peered":"2024-05-14T12:21:40.356115+0000","last_clean":"2024-05-14T12:21:40.356115+0000","last_became_active":"2024-05-14T12:20:59.664471+0000","last_became_peered":"2024-05-14T12:20:59.664471+0000","last_unstale":"2024-05-14T12:21:40.356115+0000","last_undegraded":"2024-05-14T12:21:40.356115+0000","last_fullsized":"2024-05-14T12:21:40.356115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:58:02.354064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356122+0000","last_change":"2024-05-14T12:20:59.679975+0000","last_active":"2024-05-14T12:21:40.356122+0000","last_peered":"2024-05-14T12:21:40.356122+0000","last_clean":"2024-05-14T12:21:40.356122+0000","last_became_active":"2024-05-14T12:20:59.679586+0000","last_became_peered":"2024-05-14T12:20:59.679586+0000","last_unstale":"2024-05-14T12:21:40.356122+0000","last_undegraded":"2024-05-14T12:21:40.356122+0000","last_fullsized":"2024-05-14T12:21:40.356122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:45:37.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501598+0000","last_change":"2024-05-14T12:20:59.668125+0000","last_active":"2024-05-14T12:21:39.501598+0000","last_peered":"2024-05-14T12:21:39.501598+0000","last_clean":"2024-05-14T12:21:39.501598+0000","last_became_active":"2024-05-14T12:20:59.667664+0000","last_became_peered":"2024-05-14T12:20:59.667664+0000","last_unstale":"2024-05-14T12:21:39.501598+0000","last_undegraded":"2024-05-14T12:21:39.501598+0000","last_fullsized":"2024-05-14T12:21:39.501598+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:29.995159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.503460+0000","last_change":"2024-05-14T12:20:59.682787+0000","last_active":"2024-05-14T12:21:39.503460+0000","last_peered":"2024-05-14T12:21:39.503460+0000","last_clean":"2024-05-14T12:21:39.503460+0000","last_became_active":"2024-05-14T12:20:59.682462+0000","last_became_peered":"2024-05-14T12:20:59.682462+0000","last_unstale":"2024-05-14T12:21:39.503460+0000","last_undegraded":"2024-05-14T12:21:39.503460+0000","last_fullsized":"2024-05-14T12:21:39.503460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:27.287750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.506661+0000","last_change":"2024-05-14T12:21:39.506661+0000","last_active":"2024-05-14T12:21:39.506661+0000","last_peered":"2024-05-14T12:21:39.506661+0000","last_clean":"2024-05-14T12:21:39.506661+0000","last_became_active":"2024-05-14T12:21:39.506116+0000","last_became_peered":"2024-05-14T12:21:39.506116+0000","last_unstale":"2024-05-14T12:21:39.506661+0000","last_undegraded":"2024-05-14T12:21:39.506661+0000","last_fullsized":"2024-05-14T12:21:39.506661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:18.551207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498269+0000","last_change":"2024-05-14T12:20:59.671683+0000","last_active":"2024-05-14T12:21:39.498269+0000","last_peered":"2024-05-14T12:21:39.498269+0000","last_clean":"2024-05-14T12:21:39.498269+0000","last_became_active":"2024-05-14T12:20:59.671307+0000","last_became_peered":"2024-05-14T12:20:59.671307+0000","last_unstale":"2024-05-14T12:21:39.498269+0000","last_undegraded":"2024-05-14T12:21:39.498269+0000","last_fullsized":"2024-05-14T12:21:39.498269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.744159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.504953+0000","last_change":"2024-05-14T12:21:39.504953+0000","last_active":"2024-05-14T12:21:39.504953+0000","last_peered":"2024-05-14T12:21:39.504953+0000","last_clean":"2024-05-14T12:21:39.504953+0000","last_became_active":"2024-05-14T12:21:39.504267+0000","last_became_peered":"2024-05-14T12:21:39.504267+0000","last_unstale":"2024-05-14T12:21:39.504953+0000","last_undegraded":"2024-05-14T12:21:39.504953+0000","last_fullsized":"2024-05-14T12:21:39.504953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:04.329324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721613+0000","last_change":"2024-05-14T12:20:59.663319+0000","last_active":"2024-05-14T12:21:39.721613+0000","last_peered":"2024-05-14T12:21:39.721613+0000","last_clean":"2024-05-14T12:21:39.721613+0000","last_became_active":"2024-05-14T12:20:59.662618+0000","last_became_peered":"2024-05-14T12:20:59.662618+0000","last_unstale":"2024-05-14T12:21:39.721613+0000","last_undegraded":"2024-05-14T12:21:39.721613+0000","last_fullsized":"2024-05-14T12:21:39.721613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:18.032899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502736+0000","last_change":"2024-05-14T12:20:59.671006+0000","last_active":"2024-05-14T12:21:39.502736+0000","last_peered":"2024-05-14T12:21:39.502736+0000","last_clean":"2024-05-14T12:21:39.502736+0000","last_became_active":"2024-05-14T12:20:59.670632+0000","last_became_peered":"2024-05-14T12:20:59.670632+0000","last_unstale":"2024-05-14T12:21:39.502736+0000","last_undegraded":"2024-05-14T12:21:39.502736+0000","last_fullsized":"2024-05-14T12:21:39.502736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:12:30.144637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498577+0000","last_change":"2024-05-14T12:20:59.675968+0000","last_active":"2024-05-14T12:21:39.498577+0000","last_peered":"2024-05-14T12:21:39.498577+0000","last_clean":"2024-05-14T12:21:39.498577+0000","last_became_active":"2024-05-14T12:20:59.675551+0000","last_became_peered":"2024-05-14T12:20:59.675551+0000","last_unstale":"2024-05-14T12:21:39.498577+0000","last_undegraded":"2024-05-14T12:21:39.498577+0000","last_fullsized":"2024-05-14T12:21:39.498577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:39.562658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501450+0000","last_change":"2024-05-14T12:20:59.671011+0000","last_active":"2024-05-14T12:21:39.501450+0000","last_peered":"2024-05-14T12:21:39.501450+0000","last_clean":"2024-05-14T12:21:39.501450+0000","last_became_active":"2024-05-14T12:20:59.670637+0000","last_became_peered":"2024-05-14T12:20:59.670637+0000","last_unstale":"2024-05-14T12:21:39.501450+0000","last_undegraded":"2024-05-14T12:21:39.501450+0000","last_fullsized":"2024-05-14T12:21:39.501450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:53.808936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499658+0000","last_change":"2024-05-14T12:20:59.680039+0000","last_active":"2024-05-14T12:21:39.499658+0000","last_peered":"2024-05-14T12:21:39.499658+0000","last_clean":"2024-05-14T12:21:39.499658+0000","last_became_active":"2024-05-14T12:20:59.678120+0000","last_became_peered":"2024-05-14T12:20:59.678120+0000","last_unstale":"2024-05-14T12:21:39.499658+0000","last_undegraded":"2024-05-14T12:21:39.499658+0000","last_fullsized":"2024-05-14T12:21:39.499658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:19:28.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.355657+0000","last_change":"2024-05-14T12:20:59.675301+0000","last_active":"2024-05-14T12:21:40.355657+0000","last_peered":"2024-05-14T12:21:40.355657+0000","last_clean":"2024-05-14T12:21:40.355657+0000","last_became_active":"2024-05-14T12:20:59.669861+0000","last_became_peered":"2024-05-14T12:20:59.669861+0000","last_unstale":"2024-05-14T12:21:40.355657+0000","last_undegraded":"2024-05-14T12:21:40.355657+0000","last_fullsized":"2024-05-14T12:21:40.355657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:19:17.931719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.355414+0000","last_change":"2024-05-14T12:20:59.682378+0000","last_active":"2024-05-14T12:21:40.355414+0000","last_peered":"2024-05-14T12:21:40.355414+0000","last_clean":"2024-05-14T12:21:40.355414+0000","last_became_active":"2024-05-14T12:20:59.680598+0000","last_became_peered":"2024-05-14T12:20:59.680598+0000","last_unstale":"2024-05-14T12:21:40.355414+0000","last_undegraded":"2024-05-14T12:21:40.355414+0000","last_fullsized":"2024-05-14T12:21:40.355414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:22.189038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.720973+0000","last_change":"2024-05-14T12:20:59.685447+0000","last_active":"2024-05-14T12:21:39.720973+0000","last_peered":"2024-05-14T12:21:39.720973+0000","last_clean":"2024-05-14T12:21:39.720973+0000","last_became_active":"2024-05-14T12:20:59.684963+0000","last_became_peered":"2024-05-14T12:20:59.684963+0000","last_unstale":"2024-05-14T12:21:39.720973+0000","last_undegraded":"2024-05-14T12:21:39.720973+0000","last_fullsized":"2024-05-14T12:21:39.720973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:47.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499185+0000","last_change":"2024-05-14T12:20:59.681870+0000","last_active":"2024-05-14T12:21:39.499185+0000","last_peered":"2024-05-14T12:21:39.499185+0000","last_clean":"2024-05-14T12:21:39.499185+0000","last_became_active":"2024-05-14T12:20:59.681405+0000","last_became_peered":"2024-05-14T12:20:59.681405+0000","last_unstale":"2024-05-14T12:21:39.499185+0000","last_undegraded":"2024-05-14T12:21:39.499185+0000","last_fullsized":"2024-05-14T12:21:39.499185+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:20.002496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501134+0000","last_change":"2024-05-14T12:20:59.667486+0000","last_active":"2024-05-14T12:21:39.501134+0000","last_peered":"2024-05-14T12:21:39.501134+0000","last_clean":"2024-05-14T12:21:39.501134+0000","last_became_active":"2024-05-14T12:20:59.667032+0000","last_became_peered":"2024-05-14T12:20:59.667032+0000","last_unstale":"2024-05-14T12:21:39.501134+0000","last_undegraded":"2024-05-14T12:21:39.501134+0000","last_fullsized":"2024-05-14T12:21:39.501134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:25.325504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502078+0000","last_change":"2024-05-14T12:20:59.672065+0000","last_active":"2024-05-14T12:21:39.502078+0000","last_peered":"2024-05-14T12:21:39.502078+0000","last_clean":"2024-05-14T12:21:39.502078+0000","last_became_active":"2024-05-14T12:20:59.671692+0000","last_became_peered":"2024-05-14T12:20:59.671692+0000","last_unstale":"2024-05-14T12:21:39.502078+0000","last_undegraded":"2024-05-14T12:21:39.502078+0000","last_fullsized":"2024-05-14T12:21:39.502078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:11:47.952421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:52.496076+0000","last_change":"2024-05-14T12:20:55.611507+0000","last_active":"2024-05-14T12:21:52.496076+0000","last_peered":"2024-05-14T12:21:52.496076+0000","last_clean":"2024-05-14T12:21:52.496076+0000","last_became_active":"2024-05-14T12:20:55.606794+0000","last_became_peered":"2024-05-14T12:20:55.606794+0000","last_unstale":"2024-05-14T12:21:52.496076+0000","last_undegraded":"2024-05-14T12:21:52.496076+0000","last_fullsized":"2024-05-14T12:21:52.496076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:51.301124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702639+0000","last_change":"2024-05-14T12:20:59.673013+0000","last_active":"2024-05-14T12:21:39.702639+0000","last_peered":"2024-05-14T12:21:39.702639+0000","last_clean":"2024-05-14T12:21:39.702639+0000","last_became_active":"2024-05-14T12:20:59.672575+0000","last_became_peered":"2024-05-14T12:20:59.672575+0000","last_unstale":"2024-05-14T12:21:39.702639+0000","last_undegraded":"2024-05-14T12:21:39.702639+0000","last_fullsized":"2024-05-14T12:21:39.702639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:00:26.549099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703763+0000","last_change":"2024-05-14T12:20:55.963853+0000","last_active":"2024-05-14T12:21:39.703763+0000","last_peered":"2024-05-14T12:21:39.703763+0000","last_clean":"2024-05-14T12:21:39.703763+0000","last_became_active":"2024-05-14T12:20:55.962018+0000","last_became_peered":"2024-05-14T12:20:55.962018+0000","last_unstale":"2024-05-14T12:21:39.703763+0000","last_undegraded":"2024-05-14T12:21:39.703763+0000","last_fullsized":"2024-05-14T12:21:39.703763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:06:22.374595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.357139+0000","last_change":"2024-05-14T12:20:59.671243+0000","last_active":"2024-05-14T12:21:40.357139+0000","last_peered":"2024-05-14T12:21:40.357139+0000","last_clean":"2024-05-14T12:21:40.357139+0000","last_became_active":"2024-05-14T12:20:59.665885+0000","last_became_peered":"2024-05-14T12:20:59.665885+0000","last_unstale":"2024-05-14T12:21:40.357139+0000","last_undegraded":"2024-05-14T12:21:40.357139+0000","last_fullsized":"2024-05-14T12:21:40.357139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:48.656774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.526944+0000","last_change":"2024-05-14T12:21:39.526944+0000","last_active":"2024-05-14T12:21:39.526944+0000","last_peered":"2024-05-14T12:21:39.526944+0000","last_clean":"2024-05-14T12:21:39.526944+0000","last_became_active":"2024-05-14T12:21:39.506478+0000","last_became_peered":"2024-05-14T12:21:39.506478+0000","last_unstale":"2024-05-14T12:21:39.526944+0000","last_undegraded":"2024-05-14T12:21:39.526944+0000","last_fullsized":"2024-05-14T12:21:39.526944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:41.812733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721087+0000","last_change":"2024-05-14T12:20:59.671282+0000","last_active":"2024-05-14T12:21:39.721087+0000","last_peered":"2024-05-14T12:21:39.721087+0000","last_clean":"2024-05-14T12:21:39.721087+0000","last_became_active":"2024-05-14T12:20:59.670645+0000","last_became_peered":"2024-05-14T12:20:59.670645+0000","last_unstale":"2024-05-14T12:21:39.721087+0000","last_undegraded":"2024-05-14T12:21:39.721087+0000","last_fullsized":"2024-05-14T12:21:39.721087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:51:57.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501842+0000","last_change":"2024-05-14T12:20:55.604757+0000","last_active":"2024-05-14T12:21:39.501842+0000","last_peered":"2024-05-14T12:21:39.501842+0000","last_clean":"2024-05-14T12:21:39.501842+0000","last_became_active":"2024-05-14T12:20:55.604281+0000","last_became_peered":"2024-05-14T12:20:55.604281+0000","last_unstale":"2024-05-14T12:21:39.501842+0000","last_undegraded":"2024-05-14T12:21:39.501842+0000","last_fullsized":"2024-05-14T12:21:39.501842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:52.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496398+0000","last_change":"2024-05-14T12:20:59.672498+0000","last_active":"2024-05-14T12:21:39.496398+0000","last_peered":"2024-05-14T12:21:39.496398+0000","last_clean":"2024-05-14T12:21:39.496398+0000","last_became_active":"2024-05-14T12:20:59.672116+0000","last_became_peered":"2024-05-14T12:20:59.672116+0000","last_unstale":"2024-05-14T12:21:39.496398+0000","last_undegraded":"2024-05-14T12:21:39.496398+0000","last_fullsized":"2024-05-14T12:21:39.496398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:47:34.614427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:50.527744+0000","last_change":"2024-05-14T12:21:39.515431+0000","last_active":"2024-05-14T12:21:50.527744+0000","last_peered":"2024-05-14T12:21:50.527744+0000","last_clean":"2024-05-14T12:21:50.527744+0000","last_became_active":"2024-05-14T12:21:39.503217+0000","last_became_peered":"2024-05-14T12:21:39.503217+0000","last_unstale":"2024-05-14T12:21:50.527744+0000","last_undegraded":"2024-05-14T12:21:50.527744+0000","last_fullsized":"2024-05-14T12:21:50.527744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:52:21.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501590+0000","last_change":"2024-05-14T12:20:59.664725+0000","last_active":"2024-05-14T12:21:39.501590+0000","last_peered":"2024-05-14T12:21:39.501590+0000","last_clean":"2024-05-14T12:21:39.501590+0000","last_became_active":"2024-05-14T12:20:59.664323+0000","last_became_peered":"2024-05-14T12:20:59.664323+0000","last_unstale":"2024-05-14T12:21:39.501590+0000","last_undegraded":"2024-05-14T12:21:39.501590+0000","last_fullsized":"2024-05-14T12:21:39.501590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.729236+0000","last_change":"2024-05-14T12:21:39.729236+0000","last_active":"2024-05-14T12:21:39.729236+0000","last_peered":"2024-05-14T12:21:39.729236+0000","last_clean":"2024-05-14T12:21:39.729236+0000","last_became_active":"2024-05-14T12:21:39.722405+0000","last_became_peered":"2024-05-14T12:21:39.722405+0000","last_unstale":"2024-05-14T12:21:39.729236+0000","last_undegraded":"2024-05-14T12:21:39.729236+0000","last_fullsized":"2024-05-14T12:21:39.729236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:14:19.461411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496228+0000","last_change":"2024-05-14T12:20:59.671870+0000","last_active":"2024-05-14T12:21:39.496228+0000","last_peered":"2024-05-14T12:21:39.496228+0000","last_clean":"2024-05-14T12:21:39.496228+0000","last_became_active":"2024-05-14T12:20:59.671467+0000","last_became_peered":"2024-05-14T12:20:59.671467+0000","last_unstale":"2024-05-14T12:21:39.496228+0000","last_undegraded":"2024-05-14T12:21:39.496228+0000","last_fullsized":"2024-05-14T12:21:39.496228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:18.195518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498486+0000","last_change":"2024-05-14T12:20:55.613626+0000","last_active":"2024-05-14T12:21:39.498486+0000","last_peered":"2024-05-14T12:21:39.498486+0000","last_clean":"2024-05-14T12:21:39.498486+0000","last_became_active":"2024-05-14T12:20:55.613039+0000","last_became_peered":"2024-05-14T12:20:55.613039+0000","last_unstale":"2024-05-14T12:21:39.498486+0000","last_undegraded":"2024-05-14T12:21:39.498486+0000","last_fullsized":"2024-05-14T12:21:39.498486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:19.479433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.701883+0000","last_change":"2024-05-14T12:20:59.683152+0000","last_active":"2024-05-14T12:21:39.701883+0000","last_peered":"2024-05-14T12:21:39.701883+0000","last_clean":"2024-05-14T12:21:39.701883+0000","last_became_active":"2024-05-14T12:20:59.682863+0000","last_became_peered":"2024-05-14T12:20:59.682863+0000","last_unstale":"2024-05-14T12:21:39.701883+0000","last_undegraded":"2024-05-14T12:21:39.701883+0000","last_fullsized":"2024-05-14T12:21:39.701883+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:26.975487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496367+0000","last_change":"2024-05-14T12:20:55.604785+0000","last_active":"2024-05-14T12:21:39.496367+0000","last_peered":"2024-05-14T12:21:39.496367+0000","last_clean":"2024-05-14T12:21:39.496367+0000","last_became_active":"2024-05-14T12:20:55.604249+0000","last_became_peered":"2024-05-14T12:20:55.604249+0000","last_unstale":"2024-05-14T12:21:39.496367+0000","last_undegraded":"2024-05-14T12:21:39.496367+0000","last_fullsized":"2024-05-14T12:21:39.496367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:51.954691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498840+0000","last_change":"2024-05-14T12:20:59.677047+0000","last_active":"2024-05-14T12:21:39.498840+0000","last_peered":"2024-05-14T12:21:39.498840+0000","last_clean":"2024-05-14T12:21:39.498840+0000","last_became_active":"2024-05-14T12:20:59.673314+0000","last_became_peered":"2024-05-14T12:20:59.673314+0000","last_unstale":"2024-05-14T12:21:39.498840+0000","last_undegraded":"2024-05-14T12:21:39.498840+0000","last_fullsized":"2024-05-14T12:21:39.498840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:54.069762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:55.488721+0000","last_change":"2024-05-14T12:20:55.608986+0000","last_active":"2024-05-14T12:21:55.488721+0000","last_peered":"2024-05-14T12:21:55.488721+0000","last_clean":"2024-05-14T12:21:55.488721+0000","last_became_active":"2024-05-14T12:20:55.608476+0000","last_became_peered":"2024-05-14T12:20:55.608476+0000","last_unstale":"2024-05-14T12:21:55.488721+0000","last_undegraded":"2024-05-14T12:21:55.488721+0000","last_fullsized":"2024-05-14T12:21:55.488721+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:15:40.777724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721533+0000","last_change":"2024-05-14T12:20:59.673404+0000","last_active":"2024-05-14T12:21:39.721533+0000","last_peered":"2024-05-14T12:21:39.721533+0000","last_clean":"2024-05-14T12:21:39.721533+0000","last_became_active":"2024-05-14T12:20:59.673035+0000","last_became_peered":"2024-05-14T12:20:59.673035+0000","last_unstale":"2024-05-14T12:21:39.721533+0000","last_undegraded":"2024-05-14T12:21:39.721533+0000","last_fullsized":"2024-05-14T12:21:39.721533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:29:42.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498488+0000","last_change":"2024-05-14T12:20:55.605789+0000","last_active":"2024-05-14T12:21:39.498488+0000","last_peered":"2024-05-14T12:21:39.498488+0000","last_clean":"2024-05-14T12:21:39.498488+0000","last_became_active":"2024-05-14T12:20:55.605166+0000","last_became_peered":"2024-05-14T12:20:55.605166+0000","last_unstale":"2024-05-14T12:21:39.498488+0000","last_undegraded":"2024-05-14T12:21:39.498488+0000","last_fullsized":"2024-05-14T12:21:39.498488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:44.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.357153+0000","last_change":"2024-05-14T12:20:59.678373+0000","last_active":"2024-05-14T12:21:40.357153+0000","last_peered":"2024-05-14T12:21:40.357153+0000","last_clean":"2024-05-14T12:21:40.357153+0000","last_became_active":"2024-05-14T12:20:59.673378+0000","last_became_peered":"2024-05-14T12:20:59.673378+0000","last_unstale":"2024-05-14T12:21:40.357153+0000","last_undegraded":"2024-05-14T12:21:40.357153+0000","last_fullsized":"2024-05-14T12:21:40.357153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:17:36.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496483+0000","last_change":"2024-05-14T12:20:55.966507+0000","last_active":"2024-05-14T12:21:39.496483+0000","last_peered":"2024-05-14T12:21:39.496483+0000","last_clean":"2024-05-14T12:21:39.496483+0000","last_became_active":"2024-05-14T12:20:55.966066+0000","last_became_peered":"2024-05-14T12:20:55.966066+0000","last_unstale":"2024-05-14T12:21:39.496483+0000","last_undegraded":"2024-05-14T12:21:39.496483+0000","last_fullsized":"2024-05-14T12:21:39.496483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:20.276346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721147+0000","last_change":"2024-05-14T12:20:59.669926+0000","last_active":"2024-05-14T12:21:39.721147+0000","last_peered":"2024-05-14T12:21:39.721147+0000","last_clean":"2024-05-14T12:21:39.721147+0000","last_became_active":"2024-05-14T12:20:59.669502+0000","last_became_peered":"2024-05-14T12:20:59.669502+0000","last_unstale":"2024-05-14T12:21:39.721147+0000","last_undegraded":"2024-05-14T12:21:39.721147+0000","last_fullsized":"2024-05-14T12:21:39.721147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:02.036442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'32","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:55.531112+0000","last_change":"2024-05-14T12:20:55.602307+0000","last_active":"2024-05-14T12:21:55.531112+0000","last_peered":"2024-05-14T12:21:55.531112+0000","last_clean":"2024-05-14T12:21:55.531112+0000","last_became_active":"2024-05-14T12:20:55.601879+0000","last_became_peered":"2024-05-14T12:20:55.601879+0000","last_unstale":"2024-05-14T12:21:55.531112+0000","last_undegraded":"2024-05-14T12:21:55.531112+0000","last_fullsized":"2024-05-14T12:21:55.531112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:10.839268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":99,"num_write":34,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502465+0000","last_change":"2024-05-14T12:20:59.676162+0000","last_active":"2024-05-14T12:21:39.502465+0000","last_peered":"2024-05-14T12:21:39.502465+0000","last_clean":"2024-05-14T12:21:39.502465+0000","last_became_active":"2024-05-14T12:20:59.675742+0000","last_became_peered":"2024-05-14T12:20:59.675742+0000","last_unstale":"2024-05-14T12:21:39.502465+0000","last_undegraded":"2024-05-14T12:21:39.502465+0000","last_fullsized":"2024-05-14T12:21:39.502465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:52:00.100743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501390+0000","last_change":"2024-05-14T12:20:55.616014+0000","last_active":"2024-05-14T12:21:39.501390+0000","last_peered":"2024-05-14T12:21:39.501390+0000","last_clean":"2024-05-14T12:21:39.501390+0000","last_became_active":"2024-05-14T12:20:55.615331+0000","last_became_peered":"2024-05-14T12:20:55.615331+0000","last_unstale":"2024-05-14T12:21:39.501390+0000","last_undegraded":"2024-05-14T12:21:39.501390+0000","last_fullsized":"2024-05-14T12:21:39.501390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:53.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498365+0000","last_change":"2024-05-14T12:20:59.690299+0000","last_active":"2024-05-14T12:21:39.498365+0000","last_peered":"2024-05-14T12:21:39.498365+0000","last_clean":"2024-05-14T12:21:39.498365+0000","last_became_active":"2024-05-14T12:20:59.689959+0000","last_became_peered":"2024-05-14T12:20:59.689959+0000","last_unstale":"2024-05-14T12:21:39.498365+0000","last_undegraded":"2024-05-14T12:21:39.498365+0000","last_fullsized":"2024-05-14T12:21:39.498365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:53.017238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496193+0000","last_change":"2024-05-14T12:20:55.615860+0000","last_active":"2024-05-14T12:21:39.496193+0000","last_peered":"2024-05-14T12:21:39.496193+0000","last_clean":"2024-05-14T12:21:39.496193+0000","last_became_active":"2024-05-14T12:20:55.615415+0000","last_became_peered":"2024-05-14T12:20:55.615415+0000","last_unstale":"2024-05-14T12:21:39.496193+0000","last_undegraded":"2024-05-14T12:21:39.496193+0000","last_fullsized":"2024-05-14T12:21:39.496193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:27:55.368122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498617+0000","last_change":"2024-05-14T12:20:59.684759+0000","last_active":"2024-05-14T12:21:39.498617+0000","last_peered":"2024-05-14T12:21:39.498617+0000","last_clean":"2024-05-14T12:21:39.498617+0000","last_became_active":"2024-05-14T12:20:59.684277+0000","last_became_peered":"2024-05-14T12:20:59.684277+0000","last_unstale":"2024-05-14T12:21:39.498617+0000","last_undegraded":"2024-05-14T12:21:39.498617+0000","last_fullsized":"2024-05-14T12:21:39.498617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:42:08.535580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":63,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:50.493379+0000","last_change":"2024-05-14T12:20:55.602130+0000","last_active":"2024-05-14T12:21:50.493379+0000","last_peered":"2024-05-14T12:21:50.493379+0000","last_clean":"2024-05-14T12:21:50.493379+0000","last_became_active":"2024-05-14T12:20:55.601635+0000","last_became_peered":"2024-05-14T12:20:55.601635+0000","last_unstale":"2024-05-14T12:21:50.493379+0000","last_undegraded":"2024-05-14T12:21:50.493379+0000","last_fullsized":"2024-05-14T12:21:50.493379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:24:34.599413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.505509+0000","last_change":"2024-05-14T12:21:39.505509+0000","last_active":"2024-05-14T12:21:39.505509+0000","last_peered":"2024-05-14T12:21:39.505509+0000","last_clean":"2024-05-14T12:21:39.505509+0000","last_became_active":"2024-05-14T12:21:39.504817+0000","last_became_peered":"2024-05-14T12:21:39.504817+0000","last_unstale":"2024-05-14T12:21:39.505509+0000","last_undegraded":"2024-05-14T12:21:39.505509+0000","last_fullsized":"2024-05-14T12:21:39.505509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:05:08.309898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501496+0000","last_change":"2024-05-14T12:20:55.962404+0000","last_active":"2024-05-14T12:21:39.501496+0000","last_peered":"2024-05-14T12:21:39.501496+0000","last_clean":"2024-05-14T12:21:39.501496+0000","last_became_active":"2024-05-14T12:20:55.961886+0000","last_became_peered":"2024-05-14T12:20:55.961886+0000","last_unstale":"2024-05-14T12:21:39.501496+0000","last_undegraded":"2024-05-14T12:21:39.501496+0000","last_fullsized":"2024-05-14T12:21:39.501496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:30.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496074+0000","last_change":"2024-05-14T12:20:59.674010+0000","last_active":"2024-05-14T12:21:39.496074+0000","last_peered":"2024-05-14T12:21:39.496074+0000","last_clean":"2024-05-14T12:21:39.496074+0000","last_became_active":"2024-05-14T12:20:59.673546+0000","last_became_peered":"2024-05-14T12:20:59.673546+0000","last_unstale":"2024-05-14T12:21:39.496074+0000","last_undegraded":"2024-05-14T12:21:39.496074+0000","last_fullsized":"2024-05-14T12:21:39.496074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:59.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.513347+0000","last_change":"2024-05-14T12:21:39.512745+0000","last_active":"2024-05-14T12:21:39.513347+0000","last_peered":"2024-05-14T12:21:39.513347+0000","last_clean":"2024-05-14T12:21:39.513347+0000","last_became_active":"2024-05-14T12:21:39.502690+0000","last_became_peered":"2024-05-14T12:21:39.502690+0000","last_unstale":"2024-05-14T12:21:39.513347+0000","last_undegraded":"2024-05-14T12:21:39.513347+0000","last_fullsized":"2024-05-14T12:21:39.513347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:55:22.829094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498710+0000","last_change":"2024-05-14T12:20:59.671773+0000","last_active":"2024-05-14T12:21:39.498710+0000","last_peered":"2024-05-14T12:21:39.498710+0000","last_clean":"2024-05-14T12:21:39.498710+0000","last_became_active":"2024-05-14T12:20:59.671380+0000","last_became_peered":"2024-05-14T12:20:59.671380+0000","last_unstale":"2024-05-14T12:21:39.498710+0000","last_undegraded":"2024-05-14T12:21:39.498710+0000","last_fullsized":"2024-05-14T12:21:39.498710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:23.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500574+0000","last_change":"2024-05-14T12:20:55.965843+0000","last_active":"2024-05-14T12:21:39.500574+0000","last_peered":"2024-05-14T12:21:39.500574+0000","last_clean":"2024-05-14T12:21:39.500574+0000","last_became_active":"2024-05-14T12:20:55.963827+0000","last_became_peered":"2024-05-14T12:20:55.963827+0000","last_unstale":"2024-05-14T12:21:39.500574+0000","last_undegraded":"2024-05-14T12:21:39.500574+0000","last_fullsized":"2024-05-14T12:21:39.500574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:22.464989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501913+0000","last_change":"2024-05-14T12:20:59.674932+0000","last_active":"2024-05-14T12:21:39.501913+0000","last_peered":"2024-05-14T12:21:39.501913+0000","last_clean":"2024-05-14T12:21:39.501913+0000","last_became_active":"2024-05-14T12:20:59.674259+0000","last_became_peered":"2024-05-14T12:20:59.674259+0000","last_unstale":"2024-05-14T12:21:39.501913+0000","last_undegraded":"2024-05-14T12:21:39.501913+0000","last_fullsized":"2024-05-14T12:21:39.501913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:45.362069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:53.498996+0000","last_change":"2024-05-14T12:20:55.610031+0000","last_active":"2024-05-14T12:21:53.498996+0000","last_peered":"2024-05-14T12:21:53.498996+0000","last_clean":"2024-05-14T12:21:53.498996+0000","last_became_active":"2024-05-14T12:20:55.609730+0000","last_became_peered":"2024-05-14T12:20:55.609730+0000","last_unstale":"2024-05-14T12:21:53.498996+0000","last_undegraded":"2024-05-14T12:21:53.498996+0000","last_fullsized":"2024-05-14T12:21:53.498996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:35.763466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502053+0000","last_change":"2024-05-14T12:20:59.673504+0000","last_active":"2024-05-14T12:21:39.502053+0000","last_peered":"2024-05-14T12:21:39.502053+0000","last_clean":"2024-05-14T12:21:39.502053+0000","last_became_active":"2024-05-14T12:20:59.673100+0000","last_became_peered":"2024-05-14T12:20:59.673100+0000","last_unstale":"2024-05-14T12:21:39.502053+0000","last_undegraded":"2024-05-14T12:21:39.502053+0000","last_fullsized":"2024-05-14T12:21:39.502053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:02.262916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496651+0000","last_change":"2024-05-14T12:20:59.674694+0000","last_active":"2024-05-14T12:21:39.496651+0000","last_peered":"2024-05-14T12:21:39.496651+0000","last_clean":"2024-05-14T12:21:39.496651+0000","last_became_active":"2024-05-14T12:20:59.673566+0000","last_became_peered":"2024-05-14T12:20:59.673566+0000","last_unstale":"2024-05-14T12:21:39.496651+0000","last_undegraded":"2024-05-14T12:21:39.496651+0000","last_fullsized":"2024-05-14T12:21:39.496651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:49:28.596919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":64,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:52.496214+0000","last_change":"2024-05-14T12:20:55.963207+0000","last_active":"2024-05-14T12:21:52.496214+0000","last_peered":"2024-05-14T12:21:52.496214+0000","last_clean":"2024-05-14T12:21:52.496214+0000","last_became_active":"2024-05-14T12:20:55.962084+0000","last_became_peered":"2024-05-14T12:20:55.962084+0000","last_unstale":"2024-05-14T12:21:52.496214+0000","last_undegraded":"2024-05-14T12:21:52.496214+0000","last_fullsized":"2024-05-14T12:21:52.496214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:17.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703996+0000","last_change":"2024-05-14T12:20:59.682629+0000","last_active":"2024-05-14T12:21:39.703996+0000","last_peered":"2024-05-14T12:21:39.703996+0000","last_clean":"2024-05-14T12:21:39.703996+0000","last_became_active":"2024-05-14T12:20:59.672656+0000","last_became_peered":"2024-05-14T12:20:59.672656+0000","last_unstale":"2024-05-14T12:21:39.703996+0000","last_undegraded":"2024-05-14T12:21:39.703996+0000","last_fullsized":"2024-05-14T12:21:39.703996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:23:29.651740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500995+0000","last_change":"2024-05-14T12:20:55.605223+0000","last_active":"2024-05-14T12:21:39.500995+0000","last_peered":"2024-05-14T12:21:39.500995+0000","last_clean":"2024-05-14T12:21:39.500995+0000","last_became_active":"2024-05-14T12:20:55.604743+0000","last_became_peered":"2024-05-14T12:20:55.604743+0000","last_unstale":"2024-05-14T12:21:39.500995+0000","last_undegraded":"2024-05-14T12:21:39.500995+0000","last_fullsized":"2024-05-14T12:21:39.500995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:15.258776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499294+0000","last_change":"2024-05-14T12:19:22.477995+0000","last_active":"2024-05-14T12:21:39.499294+0000","last_peered":"2024-05-14T12:21:39.499294+0000","last_clean":"2024-05-14T12:21:39.499294+0000","last_became_active":"2024-05-14T12:19:22.471890+0000","last_became_peered":"2024-05-14T12:19:22.471890+0000","last_unstale":"2024-05-14T12:21:39.499294+0000","last_undegraded":"2024-05-14T12:21:39.499294+0000","last_fullsized":"2024-05-14T12:21:39.499294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_clean_scrub_stamp":"2024-05-14T12:15:26.966159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:18.761547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498264+0000","last_change":"2024-05-14T12:20:59.674341+0000","last_active":"2024-05-14T12:21:39.498264+0000","last_peered":"2024-05-14T12:21:39.498264+0000","last_clean":"2024-05-14T12:21:39.498264+0000","last_became_active":"2024-05-14T12:20:59.672199+0000","last_became_peered":"2024-05-14T12:20:59.672199+0000","last_unstale":"2024-05-14T12:21:39.498264+0000","last_undegraded":"2024-05-14T12:21:39.498264+0000","last_fullsized":"2024-05-14T12:21:39.498264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.666708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499417+0000","last_change":"2024-05-14T12:20:55.605513+0000","last_active":"2024-05-14T12:21:39.499417+0000","last_peered":"2024-05-14T12:21:39.499417+0000","last_clean":"2024-05-14T12:21:39.499417+0000","last_became_active":"2024-05-14T12:20:55.605131+0000","last_became_peered":"2024-05-14T12:20:55.605131+0000","last_unstale":"2024-05-14T12:21:39.499417+0000","last_undegraded":"2024-05-14T12:21:39.499417+0000","last_fullsized":"2024-05-14T12:21:39.499417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:56.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502639+0000","last_change":"2024-05-14T12:20:55.966357+0000","last_active":"2024-05-14T12:21:39.502639+0000","last_peered":"2024-05-14T12:21:39.502639+0000","last_clean":"2024-05-14T12:21:39.502639+0000","last_became_active":"2024-05-14T12:20:55.965946+0000","last_became_peered":"2024-05-14T12:20:55.965946+0000","last_unstale":"2024-05-14T12:21:39.502639+0000","last_undegraded":"2024-05-14T12:21:39.502639+0000","last_fullsized":"2024-05-14T12:21:39.502639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:20.843819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498526+0000","last_change":"2024-05-14T12:20:59.675130+0000","last_active":"2024-05-14T12:21:39.498526+0000","last_peered":"2024-05-14T12:21:39.498526+0000","last_clean":"2024-05-14T12:21:39.498526+0000","last_became_active":"2024-05-14T12:20:59.674639+0000","last_became_peered":"2024-05-14T12:20:59.674639+0000","last_unstale":"2024-05-14T12:21:39.498526+0000","last_undegraded":"2024-05-14T12:21:39.498526+0000","last_fullsized":"2024-05-14T12:21:39.498526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:34:47.167894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:47.700114+0000","last_change":"2024-05-14T12:20:55.615975+0000","last_active":"2024-05-14T12:21:47.700114+0000","last_peered":"2024-05-14T12:21:47.700114+0000","last_clean":"2024-05-14T12:21:47.700114+0000","last_became_active":"2024-05-14T12:20:55.615542+0000","last_became_peered":"2024-05-14T12:20:55.615542+0000","last_unstale":"2024-05-14T12:21:47.700114+0000","last_undegraded":"2024-05-14T12:21:47.700114+0000","last_fullsized":"2024-05-14T12:21:47.700114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:52:46.621227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702722+0000","last_change":"2024-05-14T12:20:59.679047+0000","last_active":"2024-05-14T12:21:39.702722+0000","last_peered":"2024-05-14T12:21:39.702722+0000","last_clean":"2024-05-14T12:21:39.702722+0000","last_became_active":"2024-05-14T12:20:59.678620+0000","last_became_peered":"2024-05-14T12:20:59.678620+0000","last_unstale":"2024-05-14T12:21:39.702722+0000","last_undegraded":"2024-05-14T12:21:39.702722+0000","last_fullsized":"2024-05-14T12:21:39.702722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:30.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501328+0000","last_change":"2024-05-14T12:20:55.836121+0000","last_active":"2024-05-14T12:21:39.501328+0000","last_peered":"2024-05-14T12:21:39.501328+0000","last_clean":"2024-05-14T12:21:39.501328+0000","last_became_active":"2024-05-14T12:20:55.835758+0000","last_became_peered":"2024-05-14T12:20:55.835758+0000","last_unstale":"2024-05-14T12:21:39.501328+0000","last_undegraded":"2024-05-14T12:21:39.501328+0000","last_fullsized":"2024-05-14T12:21:39.501328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:29:12.627760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356471+0000","last_change":"2024-05-14T12:20:59.679664+0000","last_active":"2024-05-14T12:21:40.356471+0000","last_peered":"2024-05-14T12:21:40.356471+0000","last_clean":"2024-05-14T12:21:40.356471+0000","last_became_active":"2024-05-14T12:20:59.679242+0000","last_became_peered":"2024-05-14T12:20:59.679242+0000","last_unstale":"2024-05-14T12:21:40.356471+0000","last_undegraded":"2024-05-14T12:21:40.356471+0000","last_fullsized":"2024-05-14T12:21:40.356471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:38:17.910624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.720987+0000","last_change":"2024-05-14T12:20:55.965927+0000","last_active":"2024-05-14T12:21:39.720987+0000","last_peered":"2024-05-14T12:21:39.720987+0000","last_clean":"2024-05-14T12:21:39.720987+0000","last_became_active":"2024-05-14T12:20:55.965570+0000","last_became_peered":"2024-05-14T12:20:55.965570+0000","last_unstale":"2024-05-14T12:21:39.720987+0000","last_undegraded":"2024-05-14T12:21:39.720987+0000","last_fullsized":"2024-05-14T12:21:39.720987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:16:23.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502579+0000","last_change":"2024-05-14T12:20:59.662521+0000","last_active":"2024-05-14T12:21:39.502579+0000","last_peered":"2024-05-14T12:21:39.502579+0000","last_clean":"2024-05-14T12:21:39.502579+0000","last_became_active":"2024-05-14T12:20:59.662140+0000","last_became_peered":"2024-05-14T12:20:59.662140+0000","last_unstale":"2024-05-14T12:21:39.502579+0000","last_undegraded":"2024-05-14T12:21:39.502579+0000","last_fullsized":"2024-05-14T12:21:39.502579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:44.471630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702608+0000","last_change":"2024-05-14T12:20:55.614124+0000","last_active":"2024-05-14T12:21:39.702608+0000","last_peered":"2024-05-14T12:21:39.702608+0000","last_clean":"2024-05-14T12:21:39.702608+0000","last_became_active":"2024-05-14T12:20:55.610826+0000","last_became_peered":"2024-05-14T12:20:55.610826+0000","last_unstale":"2024-05-14T12:21:39.702608+0000","last_undegraded":"2024-05-14T12:21:39.702608+0000","last_fullsized":"2024-05-14T12:21:39.702608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:01:30.296978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498376+0000","last_change":"2024-05-14T12:20:59.684356+0000","last_active":"2024-05-14T12:21:39.498376+0000","last_peered":"2024-05-14T12:21:39.498376+0000","last_clean":"2024-05-14T12:21:39.498376+0000","last_became_active":"2024-05-14T12:20:59.683942+0000","last_became_peered":"2024-05-14T12:20:59.683942+0000","last_unstale":"2024-05-14T12:21:39.498376+0000","last_undegraded":"2024-05-14T12:21:39.498376+0000","last_fullsized":"2024-05-14T12:21:39.498376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:50.421104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501255+0000","last_change":"2024-05-14T12:20:55.615921+0000","last_active":"2024-05-14T12:21:39.501255+0000","last_peered":"2024-05-14T12:21:39.501255+0000","last_clean":"2024-05-14T12:21:39.501255+0000","last_became_active":"2024-05-14T12:20:55.615448+0000","last_became_peered":"2024-05-14T12:20:55.615448+0000","last_unstale":"2024-05-14T12:21:39.501255+0000","last_undegraded":"2024-05-14T12:21:39.501255+0000","last_fullsized":"2024-05-14T12:21:39.501255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:41:00.260869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703516+0000","last_change":"2024-05-14T12:20:59.690629+0000","last_active":"2024-05-14T12:21:39.703516+0000","last_peered":"2024-05-14T12:21:39.703516+0000","last_clean":"2024-05-14T12:21:39.703516+0000","last_became_active":"2024-05-14T12:20:59.689696+0000","last_became_peered":"2024-05-14T12:20:59.689696+0000","last_unstale":"2024-05-14T12:21:39.703516+0000","last_undegraded":"2024-05-14T12:21:39.703516+0000","last_fullsized":"2024-05-14T12:21:39.703516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:27.678235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.530824+0000","last_change":"2024-05-14T12:21:39.530824+0000","last_active":"2024-05-14T12:21:39.530824+0000","last_peered":"2024-05-14T12:21:39.530824+0000","last_clean":"2024-05-14T12:21:39.530824+0000","last_became_active":"2024-05-14T12:21:39.507316+0000","last_became_peered":"2024-05-14T12:21:39.507316+0000","last_unstale":"2024-05-14T12:21:39.530824+0000","last_undegraded":"2024-05-14T12:21:39.530824+0000","last_fullsized":"2024-05-14T12:21:39.530824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:06:46.506545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498422+0000","last_change":"2024-05-14T12:20:59.679078+0000","last_active":"2024-05-14T12:21:39.498422+0000","last_peered":"2024-05-14T12:21:39.498422+0000","last_clean":"2024-05-14T12:21:39.498422+0000","last_became_active":"2024-05-14T12:20:59.678713+0000","last_became_peered":"2024-05-14T12:20:59.678713+0000","last_unstale":"2024-05-14T12:21:39.498422+0000","last_undegraded":"2024-05-14T12:21:39.498422+0000","last_fullsized":"2024-05-14T12:21:39.498422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:46:44.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:53.486070+0000","last_change":"2024-05-14T12:20:55.965829+0000","last_active":"2024-05-14T12:21:53.486070+0000","last_peered":"2024-05-14T12:21:53.486070+0000","last_clean":"2024-05-14T12:21:53.486070+0000","last_became_active":"2024-05-14T12:20:55.965316+0000","last_became_peered":"2024-05-14T12:20:55.965316+0000","last_unstale":"2024-05-14T12:21:53.486070+0000","last_undegraded":"2024-05-14T12:21:53.486070+0000","last_fullsized":"2024-05-14T12:21:53.486070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:46:36.879599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498730+0000","last_change":"2024-05-14T12:20:59.673582+0000","last_active":"2024-05-14T12:21:39.498730+0000","last_peered":"2024-05-14T12:21:39.498730+0000","last_clean":"2024-05-14T12:21:39.498730+0000","last_became_active":"2024-05-14T12:20:59.672475+0000","last_became_peered":"2024-05-14T12:20:59.672475+0000","last_unstale":"2024-05-14T12:21:39.498730+0000","last_undegraded":"2024-05-14T12:21:39.498730+0000","last_fullsized":"2024-05-14T12:21:39.498730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:06:04.861177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496333+0000","last_change":"2024-05-14T12:20:55.615870+0000","last_active":"2024-05-14T12:21:39.496333+0000","last_peered":"2024-05-14T12:21:39.496333+0000","last_clean":"2024-05-14T12:21:39.496333+0000","last_became_active":"2024-05-14T12:20:55.615444+0000","last_became_peered":"2024-05-14T12:20:55.615444+0000","last_unstale":"2024-05-14T12:21:39.496333+0000","last_undegraded":"2024-05-14T12:21:39.496333+0000","last_fullsized":"2024-05-14T12:21:39.496333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:03.081164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498529+0000","last_change":"2024-05-14T12:20:59.688252+0000","last_active":"2024-05-14T12:21:39.498529+0000","last_peered":"2024-05-14T12:21:39.498529+0000","last_clean":"2024-05-14T12:21:39.498529+0000","last_became_active":"2024-05-14T12:20:59.687861+0000","last_became_peered":"2024-05-14T12:20:59.687861+0000","last_unstale":"2024-05-14T12:21:39.498529+0000","last_undegraded":"2024-05-14T12:21:39.498529+0000","last_fullsized":"2024-05-14T12:21:39.498529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:29:00.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500378+0000","last_change":"2024-05-14T12:20:55.616119+0000","last_active":"2024-05-14T12:21:39.500378+0000","last_peered":"2024-05-14T12:21:39.500378+0000","last_clean":"2024-05-14T12:21:39.500378+0000","last_became_active":"2024-05-14T12:20:55.615700+0000","last_became_peered":"2024-05-14T12:20:55.615700+0000","last_unstale":"2024-05-14T12:21:39.500378+0000","last_undegraded":"2024-05-14T12:21:39.500378+0000","last_fullsized":"2024-05-14T12:21:39.500378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:39.342610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498823+0000","last_change":"2024-05-14T12:20:59.672495+0000","last_active":"2024-05-14T12:21:39.498823+0000","last_peered":"2024-05-14T12:21:39.498823+0000","last_clean":"2024-05-14T12:21:39.498823+0000","last_became_active":"2024-05-14T12:20:59.671983+0000","last_became_peered":"2024-05-14T12:20:59.671983+0000","last_unstale":"2024-05-14T12:21:39.498823+0000","last_undegraded":"2024-05-14T12:21:39.498823+0000","last_fullsized":"2024-05-14T12:21:39.498823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:41.336895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498459+0000","last_change":"2024-05-14T12:20:59.663818+0000","last_active":"2024-05-14T12:21:39.498459+0000","last_peered":"2024-05-14T12:21:39.498459+0000","last_clean":"2024-05-14T12:21:39.498459+0000","last_became_active":"2024-05-14T12:20:59.663431+0000","last_became_peered":"2024-05-14T12:20:59.663431+0000","last_unstale":"2024-05-14T12:21:39.498459+0000","last_undegraded":"2024-05-14T12:21:39.498459+0000","last_fullsized":"2024-05-14T12:21:39.498459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:40:10.435481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501151+0000","last_change":"2024-05-14T12:20:59.668412+0000","last_active":"2024-05-14T12:21:39.501151+0000","last_peered":"2024-05-14T12:21:39.501151+0000","last_clean":"2024-05-14T12:21:39.501151+0000","last_became_active":"2024-05-14T12:20:59.667963+0000","last_became_peered":"2024-05-14T12:20:59.667963+0000","last_unstale":"2024-05-14T12:21:39.501151+0000","last_undegraded":"2024-05-14T12:21:39.501151+0000","last_fullsized":"2024-05-14T12:21:39.501151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:50:19.463843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501044+0000","last_change":"2024-05-14T12:20:59.668796+0000","last_active":"2024-05-14T12:21:39.501044+0000","last_peered":"2024-05-14T12:21:39.501044+0000","last_clean":"2024-05-14T12:21:39.501044+0000","last_became_active":"2024-05-14T12:20:59.668414+0000","last_became_peered":"2024-05-14T12:20:59.668414+0000","last_unstale":"2024-05-14T12:21:39.501044+0000","last_undegraded":"2024-05-14T12:21:39.501044+0000","last_fullsized":"2024-05-14T12:21:39.501044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:28.669547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356599+0000","last_change":"2024-05-14T12:20:59.687417+0000","last_active":"2024-05-14T12:21:40.356599+0000","last_peered":"2024-05-14T12:21:40.356599+0000","last_clean":"2024-05-14T12:21:40.356599+0000","last_became_active":"2024-05-14T12:20:59.686373+0000","last_became_peered":"2024-05-14T12:20:59.686373+0000","last_unstale":"2024-05-14T12:21:40.356599+0000","last_undegraded":"2024-05-14T12:21:40.356599+0000","last_fullsized":"2024-05-14T12:21:40.356599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:55.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.359831+0000","last_change":"2024-05-14T12:21:40.359831+0000","last_active":"2024-05-14T12:21:40.359831+0000","last_peered":"2024-05-14T12:21:40.359831+0000","last_clean":"2024-05-14T12:21:40.359831+0000","last_became_active":"2024-05-14T12:21:40.358347+0000","last_became_peered":"2024-05-14T12:21:40.358347+0000","last_unstale":"2024-05-14T12:21:40.359831+0000","last_undegraded":"2024-05-14T12:21:40.359831+0000","last_fullsized":"2024-05-14T12:21:40.359831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:03:58.165602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498814+0000","last_change":"2024-05-14T12:20:59.663332+0000","last_active":"2024-05-14T12:21:39.498814+0000","last_peered":"2024-05-14T12:21:39.498814+0000","last_clean":"2024-05-14T12:21:39.498814+0000","last_became_active":"2024-05-14T12:20:59.662714+0000","last_became_peered":"2024-05-14T12:20:59.662714+0000","last_unstale":"2024-05-14T12:21:39.498814+0000","last_undegraded":"2024-05-14T12:21:39.498814+0000","last_fullsized":"2024-05-14T12:21:39.498814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:59.140579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501533+0000","last_change":"2024-05-14T12:20:59.665482+0000","last_active":"2024-05-14T12:21:39.501533+0000","last_peered":"2024-05-14T12:21:39.501533+0000","last_clean":"2024-05-14T12:21:39.501533+0000","last_became_active":"2024-05-14T12:20:59.665001+0000","last_became_peered":"2024-05-14T12:20:59.665001+0000","last_unstale":"2024-05-14T12:21:39.501533+0000","last_undegraded":"2024-05-14T12:21:39.501533+0000","last_fullsized":"2024-05-14T12:21:39.501533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:26.074054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702526+0000","last_change":"2024-05-14T12:20:59.679317+0000","last_active":"2024-05-14T12:21:39.702526+0000","last_peered":"2024-05-14T12:21:39.702526+0000","last_clean":"2024-05-14T12:21:39.702526+0000","last_became_active":"2024-05-14T12:20:59.675797+0000","last_became_peered":"2024-05-14T12:20:59.675797+0000","last_unstale":"2024-05-14T12:21:39.702526+0000","last_undegraded":"2024-05-14T12:21:39.702526+0000","last_fullsized":"2024-05-14T12:21:39.702526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:58.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496268+0000","last_change":"2024-05-14T12:20:59.669982+0000","last_active":"2024-05-14T12:21:39.496268+0000","last_peered":"2024-05-14T12:21:39.496268+0000","last_clean":"2024-05-14T12:21:39.496268+0000","last_became_active":"2024-05-14T12:20:59.669587+0000","last_became_peered":"2024-05-14T12:20:59.669587+0000","last_unstale":"2024-05-14T12:21:39.496268+0000","last_undegraded":"2024-05-14T12:21:39.496268+0000","last_fullsized":"2024-05-14T12:21:39.496268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:31.474906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702154+0000","last_change":"2024-05-14T12:20:59.672672+0000","last_active":"2024-05-14T12:21:39.702154+0000","last_peered":"2024-05-14T12:21:39.702154+0000","last_clean":"2024-05-14T12:21:39.702154+0000","last_became_active":"2024-05-14T12:20:59.672191+0000","last_became_peered":"2024-05-14T12:20:59.672191+0000","last_unstale":"2024-05-14T12:21:39.702154+0000","last_undegraded":"2024-05-14T12:21:39.702154+0000","last_fullsized":"2024-05-14T12:21:39.702154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:53:14.530296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721711+0000","last_change":"2024-05-14T12:20:59.684548+0000","last_active":"2024-05-14T12:21:39.721711+0000","last_peered":"2024-05-14T12:21:39.721711+0000","last_clean":"2024-05-14T12:21:39.721711+0000","last_became_active":"2024-05-14T12:20:59.684069+0000","last_became_peered":"2024-05-14T12:20:59.684069+0000","last_unstale":"2024-05-14T12:21:39.721711+0000","last_undegraded":"2024-05-14T12:21:39.721711+0000","last_fullsized":"2024-05-14T12:21:39.721711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:58.759384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499515+0000","last_change":"2024-05-14T12:20:59.682386+0000","last_active":"2024-05-14T12:21:39.499515+0000","last_peered":"2024-05-14T12:21:39.499515+0000","last_clean":"2024-05-14T12:21:39.499515+0000","last_became_active":"2024-05-14T12:20:59.682037+0000","last_became_peered":"2024-05-14T12:20:59.682037+0000","last_unstale":"2024-05-14T12:21:39.499515+0000","last_undegraded":"2024-05-14T12:21:39.499515+0000","last_fullsized":"2024-05-14T12:21:39.499515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:24.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498613+0000","last_change":"2024-05-14T12:20:59.672679+0000","last_active":"2024-05-14T12:21:39.498613+0000","last_peered":"2024-05-14T12:21:39.498613+0000","last_clean":"2024-05-14T12:21:39.498613+0000","last_became_active":"2024-05-14T12:20:59.672324+0000","last_became_peered":"2024-05-14T12:20:59.672324+0000","last_unstale":"2024-05-14T12:21:39.498613+0000","last_undegraded":"2024-05-14T12:21:39.498613+0000","last_fullsized":"2024-05-14T12:21:39.498613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:45.513792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70276,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":344,"num_read_kb":258,"num_write":246,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":644,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":202123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":445555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1098621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939686,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":444450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":444806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364850,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1544192,"data_stored":1037346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561081,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":933888,"data_stored":444558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":499838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":445897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":508763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953539,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":444028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1548288,"data_stored":1036011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T12:21:59.033 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T12:21:59.559 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:21:59.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:59 smithi047 ceph-mon[31254]: from='client.24641 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:21:59.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:21:59 smithi047 ceph-mon[31254]: pgmap v354: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-14T12:21:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:59 smithi073 ceph-mon[35809]: from='client.24641 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:21:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:21:59 smithi073 ceph-mon[35809]: pgmap v354: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-14T12:21:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:59 smithi066 ceph-mon[35981]: from='client.24641 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:21:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:21:59 smithi066 ceph-mon[35981]: pgmap v354: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-14T12:22:01.479 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:01 smithi047 ceph-mon[31254]: pgmap v355: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-14T12:22:01.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 -- 172.21.15.47:0/2249644010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c105290 msgr2=0x7fc27c1056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:01.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 --2- 172.21.15.47:0/2249644010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c105290 0x7fc27c1056a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0098f0 tx=0x7fc26c009c00 comp rx=0 tx=0).stop 2024-05-14T12:22:01.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 -- 172.21.15.47:0/2249644010 shutdown_connections 2024-05-14T12:22:01.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 --2- 172.21.15.47:0/2249644010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c10e700 0x7fc27c110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:01.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 --2- 172.21.15.47:0/2249644010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c105290 0x7fc27c1056a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:01.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 --2- 172.21.15.47:0/2249644010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27c105be0 0x7fc27c10e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:01.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 -- 172.21.15.47:0/2249644010 >> 172.21.15.47:0/2249644010 conn(0x7fc27c078b50 msgr2=0x7fc27c078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:01.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 -- 172.21.15.47:0/2249644010 shutdown_connections 2024-05-14T12:22:01.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.730+0000 7fc27be00700 1 -- 172.21.15.47:0/2249644010 wait complete. 2024-05-14T12:22:01.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 Processor -- start 2024-05-14T12:22:01.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 -- start start 2024-05-14T12:22:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c105290 0x7fc27c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27c105be0 0x7fc27c19d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c10e700 0x7fc27c1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c1142a0 con 0x7fc27c105be0 2024-05-14T12:22:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c114120 con 0x7fc27c105290 2024-05-14T12:22:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.732+0000 7fc27be00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c114420 con 0x7fc27c10e700 2024-05-14T12:22:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c105290 0x7fc27c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc273e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27c105be0 0x7fc27c19d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c105290 0x7fc27c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56144/0 (socket says 172.21.15.47:56144) 2024-05-14T12:22:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 -- 172.21.15.47:0/1395410781 learned_addr learned my addr 172.21.15.47:0/1395410781 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27b400700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c10e700 0x7fc27c1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 -- 172.21.15.47:0/1395410781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c10e700 msgr2=0x7fc27c1a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c10e700 0x7fc27c1a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:01.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 -- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27c105be0 msgr2=0x7fc27c19d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:01.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27c105be0 0x7fc27c19d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:01.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc27aa00700 1 -- 172.21.15.47:0/1395410781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c1a1de0 con 0x7fc27c105290 2024-05-14T12:22:01.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.733+0000 7fc273e00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27c105be0 0x7fc27c19d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:01.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.734+0000 7fc27aa00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c105290 0x7fc27c19cf10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009230 tx=0x7fc26c0094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:01.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.734+0000 7fc273400700 1 -- 172.21.15.47:0/1395410781 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c005220 con 0x7fc27c105290 2024-05-14T12:22:01.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.734+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27c1a2070 con 0x7fc27c105290 2024-05-14T12:22:01.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.734+0000 7fc273400700 1 -- 172.21.15.47:0/1395410781 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc26c00b560 con 0x7fc27c105290 2024-05-14T12:22:01.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.734+0000 7fc273400700 1 -- 172.21.15.47:0/1395410781 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c003a60 con 0x7fc27c105290 2024-05-14T12:22:01.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.734+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27c1a2550 con 0x7fc27c105290 2024-05-14T12:22:01.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.735+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27c0512c0 con 0x7fc27c105290 2024-05-14T12:22:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.738+0000 7fc273400700 1 -- 172.21.15.47:0/1395410781 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc26c00ba10 con 0x7fc27c105290 2024-05-14T12:22:01.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.739+0000 7fc273400700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2600b2910 0x7fc2600b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:01.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.740+0000 7fc273400700 1 -- 172.21.15.47:0/1395410781 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc26c0e3570 con 0x7fc27c105290 2024-05-14T12:22:01.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.740+0000 7fc273e00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2600b2910 0x7fc2600b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:01.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.741+0000 7fc273e00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2600b2910 0x7fc2600b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc27c102680 tx=0x7fc264009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:01.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.742+0000 7fc273400700 1 -- 172.21.15.47:0/1395410781 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc26c013030 con 0x7fc27c105290 2024-05-14T12:22:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:01 smithi073 ceph-mon[35809]: pgmap v355: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-14T12:22:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:01 smithi066 ceph-mon[35981]: pgmap v355: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-05-14T12:22:01.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.974+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc27c101520 con 0x7fc2600b2910 2024-05-14T12:22:01.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:01.998+0000 7fc273400700 1 -- 172.21.15.47:0/1395410781 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7fc27c101520 con 0x7fc2600b2910 2024-05-14T12:22:02.003 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:22:02.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2600b2910 msgr2=0x7fc2600b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:02.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2600b2910 0x7fc2600b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc27c102680 tx=0x7fc264009310 comp rx=0 tx=0).stop 2024-05-14T12:22:02.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c105290 msgr2=0x7fc27c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:02.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c105290 0x7fc27c19cf10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009230 tx=0x7fc26c0094a0 comp rx=0 tx=0).stop 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 shutdown_connections 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2600b2910 0x7fc2600b4e20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c10e700 0x7fc27c1a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc27c105290 0x7fc27c19cf10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 --2- 172.21.15.47:0/1395410781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27c105be0 0x7fc27c19d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.004+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 >> 172.21.15.47:0/1395410781 conn(0x7fc27c078b50 msgr2=0x7fc27c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.005+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 shutdown_connections 2024-05-14T12:22:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:02.005+0000 7fc27be00700 1 -- 172.21.15.47:0/1395410781 wait complete. 2024-05-14T12:22:02.007 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-14T12:22:02.803 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-05-14T12:22:00.270155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660878,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":450,"num_read_kb":332,"num_write":371,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2952484,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374688,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567136,"statfs":{"total":1151940427776,"available":1151556747264,"internally_reserved":0,"allocated":13344768,"data_stored":7302570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17561,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":78,"num_write":11,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005470"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499404+0000","last_change":"2024-05-14T12:20:59.669913+0000","last_active":"2024-05-14T12:21:39.499404+0000","last_peered":"2024-05-14T12:21:39.499404+0000","last_clean":"2024-05-14T12:21:39.499404+0000","last_became_active":"2024-05-14T12:20:59.668481+0000","last_became_peered":"2024-05-14T12:20:59.668481+0000","last_unstale":"2024-05-14T12:21:39.499404+0000","last_undegraded":"2024-05-14T12:21:39.499404+0000","last_fullsized":"2024-05-14T12:21:39.499404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:13.671516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356115+0000","last_change":"2024-05-14T12:20:59.665032+0000","last_active":"2024-05-14T12:21:40.356115+0000","last_peered":"2024-05-14T12:21:40.356115+0000","last_clean":"2024-05-14T12:21:40.356115+0000","last_became_active":"2024-05-14T12:20:59.664471+0000","last_became_peered":"2024-05-14T12:20:59.664471+0000","last_unstale":"2024-05-14T12:21:40.356115+0000","last_undegraded":"2024-05-14T12:21:40.356115+0000","last_fullsized":"2024-05-14T12:21:40.356115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:58:02.354064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356122+0000","last_change":"2024-05-14T12:20:59.679975+0000","last_active":"2024-05-14T12:21:40.356122+0000","last_peered":"2024-05-14T12:21:40.356122+0000","last_clean":"2024-05-14T12:21:40.356122+0000","last_became_active":"2024-05-14T12:20:59.679586+0000","last_became_peered":"2024-05-14T12:20:59.679586+0000","last_unstale":"2024-05-14T12:21:40.356122+0000","last_undegraded":"2024-05-14T12:21:40.356122+0000","last_fullsized":"2024-05-14T12:21:40.356122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:45:37.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501598+0000","last_change":"2024-05-14T12:20:59.668125+0000","last_active":"2024-05-14T12:21:39.501598+0000","last_peered":"2024-05-14T12:21:39.501598+0000","last_clean":"2024-05-14T12:21:39.501598+0000","last_became_active":"2024-05-14T12:20:59.667664+0000","last_became_peered":"2024-05-14T12:20:59.667664+0000","last_unstale":"2024-05-14T12:21:39.501598+0000","last_undegraded":"2024-05-14T12:21:39.501598+0000","last_fullsized":"2024-05-14T12:21:39.501598+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:29.995159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.503460+0000","last_change":"2024-05-14T12:20:59.682787+0000","last_active":"2024-05-14T12:21:39.503460+0000","last_peered":"2024-05-14T12:21:39.503460+0000","last_clean":"2024-05-14T12:21:39.503460+0000","last_became_active":"2024-05-14T12:20:59.682462+0000","last_became_peered":"2024-05-14T12:20:59.682462+0000","last_unstale":"2024-05-14T12:21:39.503460+0000","last_undegraded":"2024-05-14T12:21:39.503460+0000","last_fullsized":"2024-05-14T12:21:39.503460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:27.287750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.506661+0000","last_change":"2024-05-14T12:21:39.506661+0000","last_active":"2024-05-14T12:21:39.506661+0000","last_peered":"2024-05-14T12:21:39.506661+0000","last_clean":"2024-05-14T12:21:39.506661+0000","last_became_active":"2024-05-14T12:21:39.506116+0000","last_became_peered":"2024-05-14T12:21:39.506116+0000","last_unstale":"2024-05-14T12:21:39.506661+0000","last_undegraded":"2024-05-14T12:21:39.506661+0000","last_fullsized":"2024-05-14T12:21:39.506661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:18.551207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498269+0000","last_change":"2024-05-14T12:20:59.671683+0000","last_active":"2024-05-14T12:21:39.498269+0000","last_peered":"2024-05-14T12:21:39.498269+0000","last_clean":"2024-05-14T12:21:39.498269+0000","last_became_active":"2024-05-14T12:20:59.671307+0000","last_became_peered":"2024-05-14T12:20:59.671307+0000","last_unstale":"2024-05-14T12:21:39.498269+0000","last_undegraded":"2024-05-14T12:21:39.498269+0000","last_fullsized":"2024-05-14T12:21:39.498269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.744159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.504953+0000","last_change":"2024-05-14T12:21:39.504953+0000","last_active":"2024-05-14T12:21:39.504953+0000","last_peered":"2024-05-14T12:21:39.504953+0000","last_clean":"2024-05-14T12:21:39.504953+0000","last_became_active":"2024-05-14T12:21:39.504267+0000","last_became_peered":"2024-05-14T12:21:39.504267+0000","last_unstale":"2024-05-14T12:21:39.504953+0000","last_undegraded":"2024-05-14T12:21:39.504953+0000","last_fullsized":"2024-05-14T12:21:39.504953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:04.329324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721613+0000","last_change":"2024-05-14T12:20:59.663319+0000","last_active":"2024-05-14T12:21:39.721613+0000","last_peered":"2024-05-14T12:21:39.721613+0000","last_clean":"2024-05-14T12:21:39.721613+0000","last_became_active":"2024-05-14T12:20:59.662618+0000","last_became_peered":"2024-05-14T12:20:59.662618+0000","last_unstale":"2024-05-14T12:21:39.721613+0000","last_undegraded":"2024-05-14T12:21:39.721613+0000","last_fullsized":"2024-05-14T12:21:39.721613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:18.032899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502736+0000","last_change":"2024-05-14T12:20:59.671006+0000","last_active":"2024-05-14T12:21:39.502736+0000","last_peered":"2024-05-14T12:21:39.502736+0000","last_clean":"2024-05-14T12:21:39.502736+0000","last_became_active":"2024-05-14T12:20:59.670632+0000","last_became_peered":"2024-05-14T12:20:59.670632+0000","last_unstale":"2024-05-14T12:21:39.502736+0000","last_undegraded":"2024-05-14T12:21:39.502736+0000","last_fullsized":"2024-05-14T12:21:39.502736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:12:30.144637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498577+0000","last_change":"2024-05-14T12:20:59.675968+0000","last_active":"2024-05-14T12:21:39.498577+0000","last_peered":"2024-05-14T12:21:39.498577+0000","last_clean":"2024-05-14T12:21:39.498577+0000","last_became_active":"2024-05-14T12:20:59.675551+0000","last_became_peered":"2024-05-14T12:20:59.675551+0000","last_unstale":"2024-05-14T12:21:39.498577+0000","last_undegraded":"2024-05-14T12:21:39.498577+0000","last_fullsized":"2024-05-14T12:21:39.498577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:39.562658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501450+0000","last_change":"2024-05-14T12:20:59.671011+0000","last_active":"2024-05-14T12:21:39.501450+0000","last_peered":"2024-05-14T12:21:39.501450+0000","last_clean":"2024-05-14T12:21:39.501450+0000","last_became_active":"2024-05-14T12:20:59.670637+0000","last_became_peered":"2024-05-14T12:20:59.670637+0000","last_unstale":"2024-05-14T12:21:39.501450+0000","last_undegraded":"2024-05-14T12:21:39.501450+0000","last_fullsized":"2024-05-14T12:21:39.501450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:53.808936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499658+0000","last_change":"2024-05-14T12:20:59.680039+0000","last_active":"2024-05-14T12:21:39.499658+0000","last_peered":"2024-05-14T12:21:39.499658+0000","last_clean":"2024-05-14T12:21:39.499658+0000","last_became_active":"2024-05-14T12:20:59.678120+0000","last_became_peered":"2024-05-14T12:20:59.678120+0000","last_unstale":"2024-05-14T12:21:39.499658+0000","last_undegraded":"2024-05-14T12:21:39.499658+0000","last_fullsized":"2024-05-14T12:21:39.499658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:19:28.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.355657+0000","last_change":"2024-05-14T12:20:59.675301+0000","last_active":"2024-05-14T12:21:40.355657+0000","last_peered":"2024-05-14T12:21:40.355657+0000","last_clean":"2024-05-14T12:21:40.355657+0000","last_became_active":"2024-05-14T12:20:59.669861+0000","last_became_peered":"2024-05-14T12:20:59.669861+0000","last_unstale":"2024-05-14T12:21:40.355657+0000","last_undegraded":"2024-05-14T12:21:40.355657+0000","last_fullsized":"2024-05-14T12:21:40.355657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:19:17.931719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.355414+0000","last_change":"2024-05-14T12:20:59.682378+0000","last_active":"2024-05-14T12:21:40.355414+0000","last_peered":"2024-05-14T12:21:40.355414+0000","last_clean":"2024-05-14T12:21:40.355414+0000","last_became_active":"2024-05-14T12:20:59.680598+0000","last_became_peered":"2024-05-14T12:20:59.680598+0000","last_unstale":"2024-05-14T12:21:40.355414+0000","last_undegraded":"2024-05-14T12:21:40.355414+0000","last_fullsized":"2024-05-14T12:21:40.355414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:22.189038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.720973+0000","last_change":"2024-05-14T12:20:59.685447+0000","last_active":"2024-05-14T12:21:39.720973+0000","last_peered":"2024-05-14T12:21:39.720973+0000","last_clean":"2024-05-14T12:21:39.720973+0000","last_became_active":"2024-05-14T12:20:59.684963+0000","last_became_peered":"2024-05-14T12:20:59.684963+0000","last_unstale":"2024-05-14T12:21:39.720973+0000","last_undegraded":"2024-05-14T12:21:39.720973+0000","last_fullsized":"2024-05-14T12:21:39.720973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:47.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499185+0000","last_change":"2024-05-14T12:20:59.681870+0000","last_active":"2024-05-14T12:21:39.499185+0000","last_peered":"2024-05-14T12:21:39.499185+0000","last_clean":"2024-05-14T12:21:39.499185+0000","last_became_active":"2024-05-14T12:20:59.681405+0000","last_became_peered":"2024-05-14T12:20:59.681405+0000","last_unstale":"2024-05-14T12:21:39.499185+0000","last_undegraded":"2024-05-14T12:21:39.499185+0000","last_fullsized":"2024-05-14T12:21:39.499185+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:20.002496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501134+0000","last_change":"2024-05-14T12:20:59.667486+0000","last_active":"2024-05-14T12:21:39.501134+0000","last_peered":"2024-05-14T12:21:39.501134+0000","last_clean":"2024-05-14T12:21:39.501134+0000","last_became_active":"2024-05-14T12:20:59.667032+0000","last_became_peered":"2024-05-14T12:20:59.667032+0000","last_unstale":"2024-05-14T12:21:39.501134+0000","last_undegraded":"2024-05-14T12:21:39.501134+0000","last_fullsized":"2024-05-14T12:21:39.501134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:25.325504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502078+0000","last_change":"2024-05-14T12:20:59.672065+0000","last_active":"2024-05-14T12:21:39.502078+0000","last_peered":"2024-05-14T12:21:39.502078+0000","last_clean":"2024-05-14T12:21:39.502078+0000","last_became_active":"2024-05-14T12:20:59.671692+0000","last_became_peered":"2024-05-14T12:20:59.671692+0000","last_unstale":"2024-05-14T12:21:39.502078+0000","last_undegraded":"2024-05-14T12:21:39.502078+0000","last_fullsized":"2024-05-14T12:21:39.502078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:11:47.952421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":77,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:57.505846+0000","last_change":"2024-05-14T12:20:55.611507+0000","last_active":"2024-05-14T12:21:57.505846+0000","last_peered":"2024-05-14T12:21:57.505846+0000","last_clean":"2024-05-14T12:21:57.505846+0000","last_became_active":"2024-05-14T12:20:55.606794+0000","last_became_peered":"2024-05-14T12:20:55.606794+0000","last_unstale":"2024-05-14T12:21:57.505846+0000","last_undegraded":"2024-05-14T12:21:57.505846+0000","last_fullsized":"2024-05-14T12:21:57.505846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:51.301124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702639+0000","last_change":"2024-05-14T12:20:59.673013+0000","last_active":"2024-05-14T12:21:39.702639+0000","last_peered":"2024-05-14T12:21:39.702639+0000","last_clean":"2024-05-14T12:21:39.702639+0000","last_became_active":"2024-05-14T12:20:59.672575+0000","last_became_peered":"2024-05-14T12:20:59.672575+0000","last_unstale":"2024-05-14T12:21:39.702639+0000","last_undegraded":"2024-05-14T12:21:39.702639+0000","last_fullsized":"2024-05-14T12:21:39.702639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:00:26.549099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703763+0000","last_change":"2024-05-14T12:20:55.963853+0000","last_active":"2024-05-14T12:21:39.703763+0000","last_peered":"2024-05-14T12:21:39.703763+0000","last_clean":"2024-05-14T12:21:39.703763+0000","last_became_active":"2024-05-14T12:20:55.962018+0000","last_became_peered":"2024-05-14T12:20:55.962018+0000","last_unstale":"2024-05-14T12:21:39.703763+0000","last_undegraded":"2024-05-14T12:21:39.703763+0000","last_fullsized":"2024-05-14T12:21:39.703763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:06:22.374595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.357139+0000","last_change":"2024-05-14T12:20:59.671243+0000","last_active":"2024-05-14T12:21:40.357139+0000","last_peered":"2024-05-14T12:21:40.357139+0000","last_clean":"2024-05-14T12:21:40.357139+0000","last_became_active":"2024-05-14T12:20:59.665885+0000","last_became_peered":"2024-05-14T12:20:59.665885+0000","last_unstale":"2024-05-14T12:21:40.357139+0000","last_undegraded":"2024-05-14T12:21:40.357139+0000","last_fullsized":"2024-05-14T12:21:40.357139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:48.656774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.526944+0000","last_change":"2024-05-14T12:21:39.526944+0000","last_active":"2024-05-14T12:21:39.526944+0000","last_peered":"2024-05-14T12:21:39.526944+0000","last_clean":"2024-05-14T12:21:39.526944+0000","last_became_active":"2024-05-14T12:21:39.506478+0000","last_became_peered":"2024-05-14T12:21:39.506478+0000","last_unstale":"2024-05-14T12:21:39.526944+0000","last_undegraded":"2024-05-14T12:21:39.526944+0000","last_fullsized":"2024-05-14T12:21:39.526944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:41.812733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721087+0000","last_change":"2024-05-14T12:20:59.671282+0000","last_active":"2024-05-14T12:21:39.721087+0000","last_peered":"2024-05-14T12:21:39.721087+0000","last_clean":"2024-05-14T12:21:39.721087+0000","last_became_active":"2024-05-14T12:20:59.670645+0000","last_became_peered":"2024-05-14T12:20:59.670645+0000","last_unstale":"2024-05-14T12:21:39.721087+0000","last_undegraded":"2024-05-14T12:21:39.721087+0000","last_fullsized":"2024-05-14T12:21:39.721087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:51:57.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501842+0000","last_change":"2024-05-14T12:20:55.604757+0000","last_active":"2024-05-14T12:21:39.501842+0000","last_peered":"2024-05-14T12:21:39.501842+0000","last_clean":"2024-05-14T12:21:39.501842+0000","last_became_active":"2024-05-14T12:20:55.604281+0000","last_became_peered":"2024-05-14T12:20:55.604281+0000","last_unstale":"2024-05-14T12:21:39.501842+0000","last_undegraded":"2024-05-14T12:21:39.501842+0000","last_fullsized":"2024-05-14T12:21:39.501842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:52.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496398+0000","last_change":"2024-05-14T12:20:59.672498+0000","last_active":"2024-05-14T12:21:39.496398+0000","last_peered":"2024-05-14T12:21:39.496398+0000","last_clean":"2024-05-14T12:21:39.496398+0000","last_became_active":"2024-05-14T12:20:59.672116+0000","last_became_peered":"2024-05-14T12:20:59.672116+0000","last_unstale":"2024-05-14T12:21:39.496398+0000","last_undegraded":"2024-05-14T12:21:39.496398+0000","last_fullsized":"2024-05-14T12:21:39.496398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:47:34.614427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:55.538161+0000","last_change":"2024-05-14T12:21:39.515431+0000","last_active":"2024-05-14T12:21:55.538161+0000","last_peered":"2024-05-14T12:21:55.538161+0000","last_clean":"2024-05-14T12:21:55.538161+0000","last_became_active":"2024-05-14T12:21:39.503217+0000","last_became_peered":"2024-05-14T12:21:39.503217+0000","last_unstale":"2024-05-14T12:21:55.538161+0000","last_undegraded":"2024-05-14T12:21:55.538161+0000","last_fullsized":"2024-05-14T12:21:55.538161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:52:21.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501590+0000","last_change":"2024-05-14T12:20:59.664725+0000","last_active":"2024-05-14T12:21:39.501590+0000","last_peered":"2024-05-14T12:21:39.501590+0000","last_clean":"2024-05-14T12:21:39.501590+0000","last_became_active":"2024-05-14T12:20:59.664323+0000","last_became_peered":"2024-05-14T12:20:59.664323+0000","last_unstale":"2024-05-14T12:21:39.501590+0000","last_undegraded":"2024-05-14T12:21:39.501590+0000","last_fullsized":"2024-05-14T12:21:39.501590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.729236+0000","last_change":"2024-05-14T12:21:39.729236+0000","last_active":"2024-05-14T12:21:39.729236+0000","last_peered":"2024-05-14T12:21:39.729236+0000","last_clean":"2024-05-14T12:21:39.729236+0000","last_became_active":"2024-05-14T12:21:39.722405+0000","last_became_peered":"2024-05-14T12:21:39.722405+0000","last_unstale":"2024-05-14T12:21:39.729236+0000","last_undegraded":"2024-05-14T12:21:39.729236+0000","last_fullsized":"2024-05-14T12:21:39.729236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:14:19.461411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496228+0000","last_change":"2024-05-14T12:20:59.671870+0000","last_active":"2024-05-14T12:21:39.496228+0000","last_peered":"2024-05-14T12:21:39.496228+0000","last_clean":"2024-05-14T12:21:39.496228+0000","last_became_active":"2024-05-14T12:20:59.671467+0000","last_became_peered":"2024-05-14T12:20:59.671467+0000","last_unstale":"2024-05-14T12:21:39.496228+0000","last_undegraded":"2024-05-14T12:21:39.496228+0000","last_fullsized":"2024-05-14T12:21:39.496228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:18.195518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498486+0000","last_change":"2024-05-14T12:20:55.613626+0000","last_active":"2024-05-14T12:21:39.498486+0000","last_peered":"2024-05-14T12:21:39.498486+0000","last_clean":"2024-05-14T12:21:39.498486+0000","last_became_active":"2024-05-14T12:20:55.613039+0000","last_became_peered":"2024-05-14T12:20:55.613039+0000","last_unstale":"2024-05-14T12:21:39.498486+0000","last_undegraded":"2024-05-14T12:21:39.498486+0000","last_fullsized":"2024-05-14T12:21:39.498486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:19.479433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.701883+0000","last_change":"2024-05-14T12:20:59.683152+0000","last_active":"2024-05-14T12:21:39.701883+0000","last_peered":"2024-05-14T12:21:39.701883+0000","last_clean":"2024-05-14T12:21:39.701883+0000","last_became_active":"2024-05-14T12:20:59.682863+0000","last_became_peered":"2024-05-14T12:20:59.682863+0000","last_unstale":"2024-05-14T12:21:39.701883+0000","last_undegraded":"2024-05-14T12:21:39.701883+0000","last_fullsized":"2024-05-14T12:21:39.701883+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:26.975487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496367+0000","last_change":"2024-05-14T12:20:55.604785+0000","last_active":"2024-05-14T12:21:39.496367+0000","last_peered":"2024-05-14T12:21:39.496367+0000","last_clean":"2024-05-14T12:21:39.496367+0000","last_became_active":"2024-05-14T12:20:55.604249+0000","last_became_peered":"2024-05-14T12:20:55.604249+0000","last_unstale":"2024-05-14T12:21:39.496367+0000","last_undegraded":"2024-05-14T12:21:39.496367+0000","last_fullsized":"2024-05-14T12:21:39.496367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:51.954691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498840+0000","last_change":"2024-05-14T12:20:59.677047+0000","last_active":"2024-05-14T12:21:39.498840+0000","last_peered":"2024-05-14T12:21:39.498840+0000","last_clean":"2024-05-14T12:21:39.498840+0000","last_became_active":"2024-05-14T12:20:59.673314+0000","last_became_peered":"2024-05-14T12:20:59.673314+0000","last_unstale":"2024-05-14T12:21:39.498840+0000","last_undegraded":"2024-05-14T12:21:39.498840+0000","last_fullsized":"2024-05-14T12:21:39.498840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:54.069762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:55.488721+0000","last_change":"2024-05-14T12:20:55.608986+0000","last_active":"2024-05-14T12:21:55.488721+0000","last_peered":"2024-05-14T12:21:55.488721+0000","last_clean":"2024-05-14T12:21:55.488721+0000","last_became_active":"2024-05-14T12:20:55.608476+0000","last_became_peered":"2024-05-14T12:20:55.608476+0000","last_unstale":"2024-05-14T12:21:55.488721+0000","last_undegraded":"2024-05-14T12:21:55.488721+0000","last_fullsized":"2024-05-14T12:21:55.488721+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:15:40.777724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721533+0000","last_change":"2024-05-14T12:20:59.673404+0000","last_active":"2024-05-14T12:21:39.721533+0000","last_peered":"2024-05-14T12:21:39.721533+0000","last_clean":"2024-05-14T12:21:39.721533+0000","last_became_active":"2024-05-14T12:20:59.673035+0000","last_became_peered":"2024-05-14T12:20:59.673035+0000","last_unstale":"2024-05-14T12:21:39.721533+0000","last_undegraded":"2024-05-14T12:21:39.721533+0000","last_fullsized":"2024-05-14T12:21:39.721533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:29:42.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498488+0000","last_change":"2024-05-14T12:20:55.605789+0000","last_active":"2024-05-14T12:21:39.498488+0000","last_peered":"2024-05-14T12:21:39.498488+0000","last_clean":"2024-05-14T12:21:39.498488+0000","last_became_active":"2024-05-14T12:20:55.605166+0000","last_became_peered":"2024-05-14T12:20:55.605166+0000","last_unstale":"2024-05-14T12:21:39.498488+0000","last_undegraded":"2024-05-14T12:21:39.498488+0000","last_fullsized":"2024-05-14T12:21:39.498488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:44.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.357153+0000","last_change":"2024-05-14T12:20:59.678373+0000","last_active":"2024-05-14T12:21:40.357153+0000","last_peered":"2024-05-14T12:21:40.357153+0000","last_clean":"2024-05-14T12:21:40.357153+0000","last_became_active":"2024-05-14T12:20:59.673378+0000","last_became_peered":"2024-05-14T12:20:59.673378+0000","last_unstale":"2024-05-14T12:21:40.357153+0000","last_undegraded":"2024-05-14T12:21:40.357153+0000","last_fullsized":"2024-05-14T12:21:40.357153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:17:36.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496483+0000","last_change":"2024-05-14T12:20:55.966507+0000","last_active":"2024-05-14T12:21:39.496483+0000","last_peered":"2024-05-14T12:21:39.496483+0000","last_clean":"2024-05-14T12:21:39.496483+0000","last_became_active":"2024-05-14T12:20:55.966066+0000","last_became_peered":"2024-05-14T12:20:55.966066+0000","last_unstale":"2024-05-14T12:21:39.496483+0000","last_undegraded":"2024-05-14T12:21:39.496483+0000","last_fullsized":"2024-05-14T12:21:39.496483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:20.276346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721147+0000","last_change":"2024-05-14T12:20:59.669926+0000","last_active":"2024-05-14T12:21:39.721147+0000","last_peered":"2024-05-14T12:21:39.721147+0000","last_clean":"2024-05-14T12:21:39.721147+0000","last_became_active":"2024-05-14T12:20:59.669502+0000","last_became_peered":"2024-05-14T12:20:59.669502+0000","last_unstale":"2024-05-14T12:21:39.721147+0000","last_undegraded":"2024-05-14T12:21:39.721147+0000","last_fullsized":"2024-05-14T12:21:39.721147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:02.036442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'32","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:55.531112+0000","last_change":"2024-05-14T12:20:55.602307+0000","last_active":"2024-05-14T12:21:55.531112+0000","last_peered":"2024-05-14T12:21:55.531112+0000","last_clean":"2024-05-14T12:21:55.531112+0000","last_became_active":"2024-05-14T12:20:55.601879+0000","last_became_peered":"2024-05-14T12:20:55.601879+0000","last_unstale":"2024-05-14T12:21:55.531112+0000","last_undegraded":"2024-05-14T12:21:55.531112+0000","last_fullsized":"2024-05-14T12:21:55.531112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:10.839268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":99,"num_write":34,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502465+0000","last_change":"2024-05-14T12:20:59.676162+0000","last_active":"2024-05-14T12:21:39.502465+0000","last_peered":"2024-05-14T12:21:39.502465+0000","last_clean":"2024-05-14T12:21:39.502465+0000","last_became_active":"2024-05-14T12:20:59.675742+0000","last_became_peered":"2024-05-14T12:20:59.675742+0000","last_unstale":"2024-05-14T12:21:39.502465+0000","last_undegraded":"2024-05-14T12:21:39.502465+0000","last_fullsized":"2024-05-14T12:21:39.502465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:52:00.100743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501390+0000","last_change":"2024-05-14T12:20:55.616014+0000","last_active":"2024-05-14T12:21:39.501390+0000","last_peered":"2024-05-14T12:21:39.501390+0000","last_clean":"2024-05-14T12:21:39.501390+0000","last_became_active":"2024-05-14T12:20:55.615331+0000","last_became_peered":"2024-05-14T12:20:55.615331+0000","last_unstale":"2024-05-14T12:21:39.501390+0000","last_undegraded":"2024-05-14T12:21:39.501390+0000","last_fullsized":"2024-05-14T12:21:39.501390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:53.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498365+0000","last_change":"2024-05-14T12:20:59.690299+0000","last_active":"2024-05-14T12:21:39.498365+0000","last_peered":"2024-05-14T12:21:39.498365+0000","last_clean":"2024-05-14T12:21:39.498365+0000","last_became_active":"2024-05-14T12:20:59.689959+0000","last_became_peered":"2024-05-14T12:20:59.689959+0000","last_unstale":"2024-05-14T12:21:39.498365+0000","last_undegraded":"2024-05-14T12:21:39.498365+0000","last_fullsized":"2024-05-14T12:21:39.498365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:53.017238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496193+0000","last_change":"2024-05-14T12:20:55.615860+0000","last_active":"2024-05-14T12:21:39.496193+0000","last_peered":"2024-05-14T12:21:39.496193+0000","last_clean":"2024-05-14T12:21:39.496193+0000","last_became_active":"2024-05-14T12:20:55.615415+0000","last_became_peered":"2024-05-14T12:20:55.615415+0000","last_unstale":"2024-05-14T12:21:39.496193+0000","last_undegraded":"2024-05-14T12:21:39.496193+0000","last_fullsized":"2024-05-14T12:21:39.496193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:27:55.368122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498617+0000","last_change":"2024-05-14T12:20:59.684759+0000","last_active":"2024-05-14T12:21:39.498617+0000","last_peered":"2024-05-14T12:21:39.498617+0000","last_clean":"2024-05-14T12:21:39.498617+0000","last_became_active":"2024-05-14T12:20:59.684277+0000","last_became_peered":"2024-05-14T12:20:59.684277+0000","last_unstale":"2024-05-14T12:21:39.498617+0000","last_undegraded":"2024-05-14T12:21:39.498617+0000","last_fullsized":"2024-05-14T12:21:39.498617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:42:08.535580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:55.502500+0000","last_change":"2024-05-14T12:20:55.602130+0000","last_active":"2024-05-14T12:21:55.502500+0000","last_peered":"2024-05-14T12:21:55.502500+0000","last_clean":"2024-05-14T12:21:55.502500+0000","last_became_active":"2024-05-14T12:20:55.601635+0000","last_became_peered":"2024-05-14T12:20:55.601635+0000","last_unstale":"2024-05-14T12:21:55.502500+0000","last_undegraded":"2024-05-14T12:21:55.502500+0000","last_fullsized":"2024-05-14T12:21:55.502500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:24:34.599413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.505509+0000","last_change":"2024-05-14T12:21:39.505509+0000","last_active":"2024-05-14T12:21:39.505509+0000","last_peered":"2024-05-14T12:21:39.505509+0000","last_clean":"2024-05-14T12:21:39.505509+0000","last_became_active":"2024-05-14T12:21:39.504817+0000","last_became_peered":"2024-05-14T12:21:39.504817+0000","last_unstale":"2024-05-14T12:21:39.505509+0000","last_undegraded":"2024-05-14T12:21:39.505509+0000","last_fullsized":"2024-05-14T12:21:39.505509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:05:08.309898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501496+0000","last_change":"2024-05-14T12:20:55.962404+0000","last_active":"2024-05-14T12:21:39.501496+0000","last_peered":"2024-05-14T12:21:39.501496+0000","last_clean":"2024-05-14T12:21:39.501496+0000","last_became_active":"2024-05-14T12:20:55.961886+0000","last_became_peered":"2024-05-14T12:20:55.961886+0000","last_unstale":"2024-05-14T12:21:39.501496+0000","last_undegraded":"2024-05-14T12:21:39.501496+0000","last_fullsized":"2024-05-14T12:21:39.501496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:30.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496074+0000","last_change":"2024-05-14T12:20:59.674010+0000","last_active":"2024-05-14T12:21:39.496074+0000","last_peered":"2024-05-14T12:21:39.496074+0000","last_clean":"2024-05-14T12:21:39.496074+0000","last_became_active":"2024-05-14T12:20:59.673546+0000","last_became_peered":"2024-05-14T12:20:59.673546+0000","last_unstale":"2024-05-14T12:21:39.496074+0000","last_undegraded":"2024-05-14T12:21:39.496074+0000","last_fullsized":"2024-05-14T12:21:39.496074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:59.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.513347+0000","last_change":"2024-05-14T12:21:39.512745+0000","last_active":"2024-05-14T12:21:39.513347+0000","last_peered":"2024-05-14T12:21:39.513347+0000","last_clean":"2024-05-14T12:21:39.513347+0000","last_became_active":"2024-05-14T12:21:39.502690+0000","last_became_peered":"2024-05-14T12:21:39.502690+0000","last_unstale":"2024-05-14T12:21:39.513347+0000","last_undegraded":"2024-05-14T12:21:39.513347+0000","last_fullsized":"2024-05-14T12:21:39.513347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:55:22.829094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498710+0000","last_change":"2024-05-14T12:20:59.671773+0000","last_active":"2024-05-14T12:21:39.498710+0000","last_peered":"2024-05-14T12:21:39.498710+0000","last_clean":"2024-05-14T12:21:39.498710+0000","last_became_active":"2024-05-14T12:20:59.671380+0000","last_became_peered":"2024-05-14T12:20:59.671380+0000","last_unstale":"2024-05-14T12:21:39.498710+0000","last_undegraded":"2024-05-14T12:21:39.498710+0000","last_fullsized":"2024-05-14T12:21:39.498710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:23.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500574+0000","last_change":"2024-05-14T12:20:55.965843+0000","last_active":"2024-05-14T12:21:39.500574+0000","last_peered":"2024-05-14T12:21:39.500574+0000","last_clean":"2024-05-14T12:21:39.500574+0000","last_became_active":"2024-05-14T12:20:55.963827+0000","last_became_peered":"2024-05-14T12:20:55.963827+0000","last_unstale":"2024-05-14T12:21:39.500574+0000","last_undegraded":"2024-05-14T12:21:39.500574+0000","last_fullsized":"2024-05-14T12:21:39.500574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:22.464989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501913+0000","last_change":"2024-05-14T12:20:59.674932+0000","last_active":"2024-05-14T12:21:39.501913+0000","last_peered":"2024-05-14T12:21:39.501913+0000","last_clean":"2024-05-14T12:21:39.501913+0000","last_became_active":"2024-05-14T12:20:59.674259+0000","last_became_peered":"2024-05-14T12:20:59.674259+0000","last_unstale":"2024-05-14T12:21:39.501913+0000","last_undegraded":"2024-05-14T12:21:39.501913+0000","last_fullsized":"2024-05-14T12:21:39.501913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:45.362069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:58.508916+0000","last_change":"2024-05-14T12:20:55.610031+0000","last_active":"2024-05-14T12:21:58.508916+0000","last_peered":"2024-05-14T12:21:58.508916+0000","last_clean":"2024-05-14T12:21:58.508916+0000","last_became_active":"2024-05-14T12:20:55.609730+0000","last_became_peered":"2024-05-14T12:20:55.609730+0000","last_unstale":"2024-05-14T12:21:58.508916+0000","last_undegraded":"2024-05-14T12:21:58.508916+0000","last_fullsized":"2024-05-14T12:21:58.508916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:35.763466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502053+0000","last_change":"2024-05-14T12:20:59.673504+0000","last_active":"2024-05-14T12:21:39.502053+0000","last_peered":"2024-05-14T12:21:39.502053+0000","last_clean":"2024-05-14T12:21:39.502053+0000","last_became_active":"2024-05-14T12:20:59.673100+0000","last_became_peered":"2024-05-14T12:20:59.673100+0000","last_unstale":"2024-05-14T12:21:39.502053+0000","last_undegraded":"2024-05-14T12:21:39.502053+0000","last_fullsized":"2024-05-14T12:21:39.502053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:02.262916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496651+0000","last_change":"2024-05-14T12:20:59.674694+0000","last_active":"2024-05-14T12:21:39.496651+0000","last_peered":"2024-05-14T12:21:39.496651+0000","last_clean":"2024-05-14T12:21:39.496651+0000","last_became_active":"2024-05-14T12:20:59.673566+0000","last_became_peered":"2024-05-14T12:20:59.673566+0000","last_unstale":"2024-05-14T12:21:39.496651+0000","last_undegraded":"2024-05-14T12:21:39.496651+0000","last_fullsized":"2024-05-14T12:21:39.496651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:49:28.596919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":69,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:57.505922+0000","last_change":"2024-05-14T12:20:55.963207+0000","last_active":"2024-05-14T12:21:57.505922+0000","last_peered":"2024-05-14T12:21:57.505922+0000","last_clean":"2024-05-14T12:21:57.505922+0000","last_became_active":"2024-05-14T12:20:55.962084+0000","last_became_peered":"2024-05-14T12:20:55.962084+0000","last_unstale":"2024-05-14T12:21:57.505922+0000","last_undegraded":"2024-05-14T12:21:57.505922+0000","last_fullsized":"2024-05-14T12:21:57.505922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:17.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703996+0000","last_change":"2024-05-14T12:20:59.682629+0000","last_active":"2024-05-14T12:21:39.703996+0000","last_peered":"2024-05-14T12:21:39.703996+0000","last_clean":"2024-05-14T12:21:39.703996+0000","last_became_active":"2024-05-14T12:20:59.672656+0000","last_became_peered":"2024-05-14T12:20:59.672656+0000","last_unstale":"2024-05-14T12:21:39.703996+0000","last_undegraded":"2024-05-14T12:21:39.703996+0000","last_fullsized":"2024-05-14T12:21:39.703996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:23:29.651740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500995+0000","last_change":"2024-05-14T12:20:55.605223+0000","last_active":"2024-05-14T12:21:39.500995+0000","last_peered":"2024-05-14T12:21:39.500995+0000","last_clean":"2024-05-14T12:21:39.500995+0000","last_became_active":"2024-05-14T12:20:55.604743+0000","last_became_peered":"2024-05-14T12:20:55.604743+0000","last_unstale":"2024-05-14T12:21:39.500995+0000","last_undegraded":"2024-05-14T12:21:39.500995+0000","last_fullsized":"2024-05-14T12:21:39.500995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:15.258776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499375+0000","last_change":"2024-05-14T12:19:22.477995+0000","last_active":"2024-05-14T12:21:39.499375+0000","last_peered":"2024-05-14T12:21:39.499375+0000","last_clean":"2024-05-14T12:21:39.499375+0000","last_became_active":"2024-05-14T12:19:22.471890+0000","last_became_peered":"2024-05-14T12:19:22.471890+0000","last_unstale":"2024-05-14T12:21:39.499375+0000","last_undegraded":"2024-05-14T12:21:39.499375+0000","last_fullsized":"2024-05-14T12:21:39.499375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_clean_scrub_stamp":"2024-05-14T12:15:26.966159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:18.761547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498264+0000","last_change":"2024-05-14T12:20:59.674341+0000","last_active":"2024-05-14T12:21:39.498264+0000","last_peered":"2024-05-14T12:21:39.498264+0000","last_clean":"2024-05-14T12:21:39.498264+0000","last_became_active":"2024-05-14T12:20:59.672199+0000","last_became_peered":"2024-05-14T12:20:59.672199+0000","last_unstale":"2024-05-14T12:21:39.498264+0000","last_undegraded":"2024-05-14T12:21:39.498264+0000","last_fullsized":"2024-05-14T12:21:39.498264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.666708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499417+0000","last_change":"2024-05-14T12:20:55.605513+0000","last_active":"2024-05-14T12:21:39.499417+0000","last_peered":"2024-05-14T12:21:39.499417+0000","last_clean":"2024-05-14T12:21:39.499417+0000","last_became_active":"2024-05-14T12:20:55.605131+0000","last_became_peered":"2024-05-14T12:20:55.605131+0000","last_unstale":"2024-05-14T12:21:39.499417+0000","last_undegraded":"2024-05-14T12:21:39.499417+0000","last_fullsized":"2024-05-14T12:21:39.499417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:56.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502639+0000","last_change":"2024-05-14T12:20:55.966357+0000","last_active":"2024-05-14T12:21:39.502639+0000","last_peered":"2024-05-14T12:21:39.502639+0000","last_clean":"2024-05-14T12:21:39.502639+0000","last_became_active":"2024-05-14T12:20:55.965946+0000","last_became_peered":"2024-05-14T12:20:55.965946+0000","last_unstale":"2024-05-14T12:21:39.502639+0000","last_undegraded":"2024-05-14T12:21:39.502639+0000","last_fullsized":"2024-05-14T12:21:39.502639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:20.843819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498526+0000","last_change":"2024-05-14T12:20:59.675130+0000","last_active":"2024-05-14T12:21:39.498526+0000","last_peered":"2024-05-14T12:21:39.498526+0000","last_clean":"2024-05-14T12:21:39.498526+0000","last_became_active":"2024-05-14T12:20:59.674639+0000","last_became_peered":"2024-05-14T12:20:59.674639+0000","last_unstale":"2024-05-14T12:21:39.498526+0000","last_undegraded":"2024-05-14T12:21:39.498526+0000","last_fullsized":"2024-05-14T12:21:39.498526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:34:47.167894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:47.700114+0000","last_change":"2024-05-14T12:20:55.615975+0000","last_active":"2024-05-14T12:21:47.700114+0000","last_peered":"2024-05-14T12:21:47.700114+0000","last_clean":"2024-05-14T12:21:47.700114+0000","last_became_active":"2024-05-14T12:20:55.615542+0000","last_became_peered":"2024-05-14T12:20:55.615542+0000","last_unstale":"2024-05-14T12:21:47.700114+0000","last_undegraded":"2024-05-14T12:21:47.700114+0000","last_fullsized":"2024-05-14T12:21:47.700114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:52:46.621227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702722+0000","last_change":"2024-05-14T12:20:59.679047+0000","last_active":"2024-05-14T12:21:39.702722+0000","last_peered":"2024-05-14T12:21:39.702722+0000","last_clean":"2024-05-14T12:21:39.702722+0000","last_became_active":"2024-05-14T12:20:59.678620+0000","last_became_peered":"2024-05-14T12:20:59.678620+0000","last_unstale":"2024-05-14T12:21:39.702722+0000","last_undegraded":"2024-05-14T12:21:39.702722+0000","last_fullsized":"2024-05-14T12:21:39.702722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:30.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501328+0000","last_change":"2024-05-14T12:20:55.836121+0000","last_active":"2024-05-14T12:21:39.501328+0000","last_peered":"2024-05-14T12:21:39.501328+0000","last_clean":"2024-05-14T12:21:39.501328+0000","last_became_active":"2024-05-14T12:20:55.835758+0000","last_became_peered":"2024-05-14T12:20:55.835758+0000","last_unstale":"2024-05-14T12:21:39.501328+0000","last_undegraded":"2024-05-14T12:21:39.501328+0000","last_fullsized":"2024-05-14T12:21:39.501328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:29:12.627760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356471+0000","last_change":"2024-05-14T12:20:59.679664+0000","last_active":"2024-05-14T12:21:40.356471+0000","last_peered":"2024-05-14T12:21:40.356471+0000","last_clean":"2024-05-14T12:21:40.356471+0000","last_became_active":"2024-05-14T12:20:59.679242+0000","last_became_peered":"2024-05-14T12:20:59.679242+0000","last_unstale":"2024-05-14T12:21:40.356471+0000","last_undegraded":"2024-05-14T12:21:40.356471+0000","last_fullsized":"2024-05-14T12:21:40.356471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:38:17.910624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.720987+0000","last_change":"2024-05-14T12:20:55.965927+0000","last_active":"2024-05-14T12:21:39.720987+0000","last_peered":"2024-05-14T12:21:39.720987+0000","last_clean":"2024-05-14T12:21:39.720987+0000","last_became_active":"2024-05-14T12:20:55.965570+0000","last_became_peered":"2024-05-14T12:20:55.965570+0000","last_unstale":"2024-05-14T12:21:39.720987+0000","last_undegraded":"2024-05-14T12:21:39.720987+0000","last_fullsized":"2024-05-14T12:21:39.720987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:16:23.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502579+0000","last_change":"2024-05-14T12:20:59.662521+0000","last_active":"2024-05-14T12:21:39.502579+0000","last_peered":"2024-05-14T12:21:39.502579+0000","last_clean":"2024-05-14T12:21:39.502579+0000","last_became_active":"2024-05-14T12:20:59.662140+0000","last_became_peered":"2024-05-14T12:20:59.662140+0000","last_unstale":"2024-05-14T12:21:39.502579+0000","last_undegraded":"2024-05-14T12:21:39.502579+0000","last_fullsized":"2024-05-14T12:21:39.502579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:44.471630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702608+0000","last_change":"2024-05-14T12:20:55.614124+0000","last_active":"2024-05-14T12:21:39.702608+0000","last_peered":"2024-05-14T12:21:39.702608+0000","last_clean":"2024-05-14T12:21:39.702608+0000","last_became_active":"2024-05-14T12:20:55.610826+0000","last_became_peered":"2024-05-14T12:20:55.610826+0000","last_unstale":"2024-05-14T12:21:39.702608+0000","last_undegraded":"2024-05-14T12:21:39.702608+0000","last_fullsized":"2024-05-14T12:21:39.702608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:01:30.296978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498376+0000","last_change":"2024-05-14T12:20:59.684356+0000","last_active":"2024-05-14T12:21:39.498376+0000","last_peered":"2024-05-14T12:21:39.498376+0000","last_clean":"2024-05-14T12:21:39.498376+0000","last_became_active":"2024-05-14T12:20:59.683942+0000","last_became_peered":"2024-05-14T12:20:59.683942+0000","last_unstale":"2024-05-14T12:21:39.498376+0000","last_undegraded":"2024-05-14T12:21:39.498376+0000","last_fullsized":"2024-05-14T12:21:39.498376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:50.421104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501255+0000","last_change":"2024-05-14T12:20:55.615921+0000","last_active":"2024-05-14T12:21:39.501255+0000","last_peered":"2024-05-14T12:21:39.501255+0000","last_clean":"2024-05-14T12:21:39.501255+0000","last_became_active":"2024-05-14T12:20:55.615448+0000","last_became_peered":"2024-05-14T12:20:55.615448+0000","last_unstale":"2024-05-14T12:21:39.501255+0000","last_undegraded":"2024-05-14T12:21:39.501255+0000","last_fullsized":"2024-05-14T12:21:39.501255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:41:00.260869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703516+0000","last_change":"2024-05-14T12:20:59.690629+0000","last_active":"2024-05-14T12:21:39.703516+0000","last_peered":"2024-05-14T12:21:39.703516+0000","last_clean":"2024-05-14T12:21:39.703516+0000","last_became_active":"2024-05-14T12:20:59.689696+0000","last_became_peered":"2024-05-14T12:20:59.689696+0000","last_unstale":"2024-05-14T12:21:39.703516+0000","last_undegraded":"2024-05-14T12:21:39.703516+0000","last_fullsized":"2024-05-14T12:21:39.703516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:27.678235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.530824+0000","last_change":"2024-05-14T12:21:39.530824+0000","last_active":"2024-05-14T12:21:39.530824+0000","last_peered":"2024-05-14T12:21:39.530824+0000","last_clean":"2024-05-14T12:21:39.530824+0000","last_became_active":"2024-05-14T12:21:39.507316+0000","last_became_peered":"2024-05-14T12:21:39.507316+0000","last_unstale":"2024-05-14T12:21:39.530824+0000","last_undegraded":"2024-05-14T12:21:39.530824+0000","last_fullsized":"2024-05-14T12:21:39.530824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:06:46.506545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498422+0000","last_change":"2024-05-14T12:20:59.679078+0000","last_active":"2024-05-14T12:21:39.498422+0000","last_peered":"2024-05-14T12:21:39.498422+0000","last_clean":"2024-05-14T12:21:39.498422+0000","last_became_active":"2024-05-14T12:20:59.678713+0000","last_became_peered":"2024-05-14T12:20:59.678713+0000","last_unstale":"2024-05-14T12:21:39.498422+0000","last_undegraded":"2024-05-14T12:21:39.498422+0000","last_fullsized":"2024-05-14T12:21:39.498422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:46:44.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:58.494824+0000","last_change":"2024-05-14T12:20:55.965829+0000","last_active":"2024-05-14T12:21:58.494824+0000","last_peered":"2024-05-14T12:21:58.494824+0000","last_clean":"2024-05-14T12:21:58.494824+0000","last_became_active":"2024-05-14T12:20:55.965316+0000","last_became_peered":"2024-05-14T12:20:55.965316+0000","last_unstale":"2024-05-14T12:21:58.494824+0000","last_undegraded":"2024-05-14T12:21:58.494824+0000","last_fullsized":"2024-05-14T12:21:58.494824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:46:36.879599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498730+0000","last_change":"2024-05-14T12:20:59.673582+0000","last_active":"2024-05-14T12:21:39.498730+0000","last_peered":"2024-05-14T12:21:39.498730+0000","last_clean":"2024-05-14T12:21:39.498730+0000","last_became_active":"2024-05-14T12:20:59.672475+0000","last_became_peered":"2024-05-14T12:20:59.672475+0000","last_unstale":"2024-05-14T12:21:39.498730+0000","last_undegraded":"2024-05-14T12:21:39.498730+0000","last_fullsized":"2024-05-14T12:21:39.498730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:06:04.861177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496333+0000","last_change":"2024-05-14T12:20:55.615870+0000","last_active":"2024-05-14T12:21:39.496333+0000","last_peered":"2024-05-14T12:21:39.496333+0000","last_clean":"2024-05-14T12:21:39.496333+0000","last_became_active":"2024-05-14T12:20:55.615444+0000","last_became_peered":"2024-05-14T12:20:55.615444+0000","last_unstale":"2024-05-14T12:21:39.496333+0000","last_undegraded":"2024-05-14T12:21:39.496333+0000","last_fullsized":"2024-05-14T12:21:39.496333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:03.081164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498529+0000","last_change":"2024-05-14T12:20:59.688252+0000","last_active":"2024-05-14T12:21:39.498529+0000","last_peered":"2024-05-14T12:21:39.498529+0000","last_clean":"2024-05-14T12:21:39.498529+0000","last_became_active":"2024-05-14T12:20:59.687861+0000","last_became_peered":"2024-05-14T12:20:59.687861+0000","last_unstale":"2024-05-14T12:21:39.498529+0000","last_undegraded":"2024-05-14T12:21:39.498529+0000","last_fullsized":"2024-05-14T12:21:39.498529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:29:00.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500378+0000","last_change":"2024-05-14T12:20:55.616119+0000","last_active":"2024-05-14T12:21:39.500378+0000","last_peered":"2024-05-14T12:21:39.500378+0000","last_clean":"2024-05-14T12:21:39.500378+0000","last_became_active":"2024-05-14T12:20:55.615700+0000","last_became_peered":"2024-05-14T12:20:55.615700+0000","last_unstale":"2024-05-14T12:21:39.500378+0000","last_undegraded":"2024-05-14T12:21:39.500378+0000","last_fullsized":"2024-05-14T12:21:39.500378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:39.342610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498823+0000","last_change":"2024-05-14T12:20:59.672495+0000","last_active":"2024-05-14T12:21:39.498823+0000","last_peered":"2024-05-14T12:21:39.498823+0000","last_clean":"2024-05-14T12:21:39.498823+0000","last_became_active":"2024-05-14T12:20:59.671983+0000","last_became_peered":"2024-05-14T12:20:59.671983+0000","last_unstale":"2024-05-14T12:21:39.498823+0000","last_undegraded":"2024-05-14T12:21:39.498823+0000","last_fullsized":"2024-05-14T12:21:39.498823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:41.336895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498459+0000","last_change":"2024-05-14T12:20:59.663818+0000","last_active":"2024-05-14T12:21:39.498459+0000","last_peered":"2024-05-14T12:21:39.498459+0000","last_clean":"2024-05-14T12:21:39.498459+0000","last_became_active":"2024-05-14T12:20:59.663431+0000","last_became_peered":"2024-05-14T12:20:59.663431+0000","last_unstale":"2024-05-14T12:21:39.498459+0000","last_undegraded":"2024-05-14T12:21:39.498459+0000","last_fullsized":"2024-05-14T12:21:39.498459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:40:10.435481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501151+0000","last_change":"2024-05-14T12:20:59.668412+0000","last_active":"2024-05-14T12:21:39.501151+0000","last_peered":"2024-05-14T12:21:39.501151+0000","last_clean":"2024-05-14T12:21:39.501151+0000","last_became_active":"2024-05-14T12:20:59.667963+0000","last_became_peered":"2024-05-14T12:20:59.667963+0000","last_unstale":"2024-05-14T12:21:39.501151+0000","last_undegraded":"2024-05-14T12:21:39.501151+0000","last_fullsized":"2024-05-14T12:21:39.501151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:50:19.463843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501044+0000","last_change":"2024-05-14T12:20:59.668796+0000","last_active":"2024-05-14T12:21:39.501044+0000","last_peered":"2024-05-14T12:21:39.501044+0000","last_clean":"2024-05-14T12:21:39.501044+0000","last_became_active":"2024-05-14T12:20:59.668414+0000","last_became_peered":"2024-05-14T12:20:59.668414+0000","last_unstale":"2024-05-14T12:21:39.501044+0000","last_undegraded":"2024-05-14T12:21:39.501044+0000","last_fullsized":"2024-05-14T12:21:39.501044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:28.669547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.356599+0000","last_change":"2024-05-14T12:20:59.687417+0000","last_active":"2024-05-14T12:21:40.356599+0000","last_peered":"2024-05-14T12:21:40.356599+0000","last_clean":"2024-05-14T12:21:40.356599+0000","last_became_active":"2024-05-14T12:20:59.686373+0000","last_became_peered":"2024-05-14T12:20:59.686373+0000","last_unstale":"2024-05-14T12:21:40.356599+0000","last_undegraded":"2024-05-14T12:21:40.356599+0000","last_fullsized":"2024-05-14T12:21:40.356599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:55.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:40.359831+0000","last_change":"2024-05-14T12:21:40.359831+0000","last_active":"2024-05-14T12:21:40.359831+0000","last_peered":"2024-05-14T12:21:40.359831+0000","last_clean":"2024-05-14T12:21:40.359831+0000","last_became_active":"2024-05-14T12:21:40.358347+0000","last_became_peered":"2024-05-14T12:21:40.358347+0000","last_unstale":"2024-05-14T12:21:40.359831+0000","last_undegraded":"2024-05-14T12:21:40.359831+0000","last_fullsized":"2024-05-14T12:21:40.359831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:03:58.165602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498814+0000","last_change":"2024-05-14T12:20:59.663332+0000","last_active":"2024-05-14T12:21:39.498814+0000","last_peered":"2024-05-14T12:21:39.498814+0000","last_clean":"2024-05-14T12:21:39.498814+0000","last_became_active":"2024-05-14T12:20:59.662714+0000","last_became_peered":"2024-05-14T12:20:59.662714+0000","last_unstale":"2024-05-14T12:21:39.498814+0000","last_undegraded":"2024-05-14T12:21:39.498814+0000","last_fullsized":"2024-05-14T12:21:39.498814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:59.140579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501533+0000","last_change":"2024-05-14T12:20:59.665482+0000","last_active":"2024-05-14T12:21:39.501533+0000","last_peered":"2024-05-14T12:21:39.501533+0000","last_clean":"2024-05-14T12:21:39.501533+0000","last_became_active":"2024-05-14T12:20:59.665001+0000","last_became_peered":"2024-05-14T12:20:59.665001+0000","last_unstale":"2024-05-14T12:21:39.501533+0000","last_undegraded":"2024-05-14T12:21:39.501533+0000","last_fullsized":"2024-05-14T12:21:39.501533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:26.074054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702526+0000","last_change":"2024-05-14T12:20:59.679317+0000","last_active":"2024-05-14T12:21:39.702526+0000","last_peered":"2024-05-14T12:21:39.702526+0000","last_clean":"2024-05-14T12:21:39.702526+0000","last_became_active":"2024-05-14T12:20:59.675797+0000","last_became_peered":"2024-05-14T12:20:59.675797+0000","last_unstale":"2024-05-14T12:21:39.702526+0000","last_undegraded":"2024-05-14T12:21:39.702526+0000","last_fullsized":"2024-05-14T12:21:39.702526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:58.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496268+0000","last_change":"2024-05-14T12:20:59.669982+0000","last_active":"2024-05-14T12:21:39.496268+0000","last_peered":"2024-05-14T12:21:39.496268+0000","last_clean":"2024-05-14T12:21:39.496268+0000","last_became_active":"2024-05-14T12:20:59.669587+0000","last_became_peered":"2024-05-14T12:20:59.669587+0000","last_unstale":"2024-05-14T12:21:39.496268+0000","last_undegraded":"2024-05-14T12:21:39.496268+0000","last_fullsized":"2024-05-14T12:21:39.496268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:31.474906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702154+0000","last_change":"2024-05-14T12:20:59.672672+0000","last_active":"2024-05-14T12:21:39.702154+0000","last_peered":"2024-05-14T12:21:39.702154+0000","last_clean":"2024-05-14T12:21:39.702154+0000","last_became_active":"2024-05-14T12:20:59.672191+0000","last_became_peered":"2024-05-14T12:20:59.672191+0000","last_unstale":"2024-05-14T12:21:39.702154+0000","last_undegraded":"2024-05-14T12:21:39.702154+0000","last_fullsized":"2024-05-14T12:21:39.702154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:53:14.530296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721711+0000","last_change":"2024-05-14T12:20:59.684548+0000","last_active":"2024-05-14T12:21:39.721711+0000","last_peered":"2024-05-14T12:21:39.721711+0000","last_clean":"2024-05-14T12:21:39.721711+0000","last_became_active":"2024-05-14T12:20:59.684069+0000","last_became_peered":"2024-05-14T12:20:59.684069+0000","last_unstale":"2024-05-14T12:21:39.721711+0000","last_undegraded":"2024-05-14T12:21:39.721711+0000","last_fullsized":"2024-05-14T12:21:39.721711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:58.759384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499515+0000","last_change":"2024-05-14T12:20:59.682386+0000","last_active":"2024-05-14T12:21:39.499515+0000","last_peered":"2024-05-14T12:21:39.499515+0000","last_clean":"2024-05-14T12:21:39.499515+0000","last_became_active":"2024-05-14T12:20:59.682037+0000","last_became_peered":"2024-05-14T12:20:59.682037+0000","last_unstale":"2024-05-14T12:21:39.499515+0000","last_undegraded":"2024-05-14T12:21:39.499515+0000","last_fullsized":"2024-05-14T12:21:39.499515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:24.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498613+0000","last_change":"2024-05-14T12:20:59.672679+0000","last_active":"2024-05-14T12:21:39.498613+0000","last_peered":"2024-05-14T12:21:39.498613+0000","last_clean":"2024-05-14T12:21:39.498613+0000","last_became_active":"2024-05-14T12:20:59.672324+0000","last_became_peered":"2024-05-14T12:20:59.672324+0000","last_unstale":"2024-05-14T12:21:39.498613+0000","last_undegraded":"2024-05-14T12:21:39.498613+0000","last_fullsized":"2024-05-14T12:21:39.498613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:45.513792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70276,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":374,"num_read_kb":268,"num_write":246,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":644,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579932,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":445555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1098621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939687,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":444450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135918,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":444806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364851,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1544192,"data_stored":1037346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561082,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":933888,"data_stored":444558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":508543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":445897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":508763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":444028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1548288,"data_stored":1036011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T12:22:02.809 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-14T12:22:02.809 INFO:tasks.cephadm:Setting up client nodes... 2024-05-14T12:22:02.809 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-14T12:22:03.306 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:03.654 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:03 smithi047 ceph-mon[31254]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:22:03.654 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:03 smithi047 ceph-mon[31254]: pgmap v356: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T12:22:03.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:03 smithi073 ceph-mon[35809]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:22:03.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:03 smithi073 ceph-mon[35809]: pgmap v356: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T12:22:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:03 smithi066 ceph-mon[35981]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:22:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:03 smithi066 ceph-mon[35981]: pgmap v356: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T12:22:05.446 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:05 smithi047 ceph-mon[31254]: pgmap v357: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.711+0000 7fe474a00700 1 -- 172.21.15.47:0/2837613892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe470104e50 msgr2=0x7fe470107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.711+0000 7fe474a00700 1 --2- 172.21.15.47:0/2837613892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe470104e50 0x7fe470107270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe460009990 tx=0x7fe460009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.712+0000 7fe474a00700 1 -- 172.21.15.47:0/2837613892 shutdown_connections 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.712+0000 7fe474a00700 1 --2- 172.21.15.47:0/2837613892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47010a110 0x7fe47010c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.712+0000 7fe474a00700 1 --2- 172.21.15.47:0/2837613892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe470104e50 0x7fe470107270 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.712+0000 7fe474a00700 1 --2- 172.21.15.47:0/2837613892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4701077b0 0x7fe470109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.712+0000 7fe474a00700 1 -- 172.21.15.47:0/2837613892 >> 172.21.15.47:0/2837613892 conn(0x7fe4700fe870 msgr2=0x7fe470100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.712+0000 7fe474a00700 1 -- 172.21.15.47:0/2837613892 shutdown_connections 2024-05-14T12:22:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.712+0000 7fe474a00700 1 -- 172.21.15.47:0/2837613892 wait complete. 2024-05-14T12:22:05.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.714+0000 7fe474a00700 1 Processor -- start 2024-05-14T12:22:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.714+0000 7fe474a00700 1 -- start start 2024-05-14T12:22:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe474a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470104e50 0x7fe47019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe474a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4701077b0 0x7fe47019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe474a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47010a110 0x7fe4701a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe474a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe47010fd90 con 0x7fe470104e50 2024-05-14T12:22:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe474a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe47010fc10 con 0x7fe4701077b0 2024-05-14T12:22:05.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe474a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe47010ff10 con 0x7fe47010a110 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe46de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470104e50 0x7fe47019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe46de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470104e50 0x7fe47019a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57786/0 (socket says 172.21.15.47:57786) 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.715+0000 7fe46de00700 1 -- 172.21.15.47:0/3331364988 learned_addr learned my addr 172.21.15.47:0/3331364988 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46d400700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4701077b0 0x7fe47019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46e800700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47010a110 0x7fe4701a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46de00700 1 -- 172.21.15.47:0/3331364988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47010a110 msgr2=0x7fe4701a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46de00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47010a110 0x7fe4701a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46de00700 1 -- 172.21.15.47:0/3331364988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4701077b0 msgr2=0x7fe47019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46de00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4701077b0 0x7fe47019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46de00700 1 -- 172.21.15.47:0/3331364988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4701a2460 con 0x7fe470104e50 2024-05-14T12:22:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.716+0000 7fe46de00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470104e50 0x7fe47019a900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe460000c00 tx=0x7fe4600057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.717+0000 7fe466a00700 1 -- 172.21.15.47:0/3331364988 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460026070 con 0x7fe470104e50 2024-05-14T12:22:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.717+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4701a26f0 con 0x7fe470104e50 2024-05-14T12:22:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.717+0000 7fe466a00700 1 -- 172.21.15.47:0/3331364988 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe460021410 con 0x7fe470104e50 2024-05-14T12:22:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.717+0000 7fe466a00700 1 -- 172.21.15.47:0/3331364988 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460017650 con 0x7fe470104e50 2024-05-14T12:22:05.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.717+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4701a2b50 con 0x7fe470104e50 2024-05-14T12:22:05.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.718+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4700512c0 con 0x7fe470104e50 2024-05-14T12:22:05.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.721+0000 7fe466a00700 1 -- 172.21.15.47:0/3331364988 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe460029070 con 0x7fe470104e50 2024-05-14T12:22:05.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.722+0000 7fe466a00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4540b2910 0x7fe4540b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:05.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.722+0000 7fe466a00700 1 -- 172.21.15.47:0/3331364988 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe4600e3430 con 0x7fe470104e50 2024-05-14T12:22:05.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.722+0000 7fe46d400700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4540b2910 0x7fe4540b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:05.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.723+0000 7fe46d400700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4540b2910 0x7fe4540b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe47019b9b0 tx=0x7fe45c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:05.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:05.725+0000 7fe466a00700 1 -- 172.21.15.47:0/3331364988 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe46005edf0 con 0x7fe470104e50 2024-05-14T12:22:05.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:05 smithi073 ceph-mon[35809]: pgmap v357: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T12:22:05.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:05 smithi066 ceph-mon[35981]: pgmap v357: 97 pgs: 97 active+clean; 645 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T12:22:06.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.058+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fe47002e5f0 con 0x7fe470104e50 2024-05-14T12:22:06.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.065+0000 7fe466a00700 1 -- 172.21.15.47:0/3331364988 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fe460013070 con 0x7fe470104e50 2024-05-14T12:22:06.066 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-05-14T12:22:06.066 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBuV0Nmuv6pAxAA2M1hCinSXe4a2K2Iff5a1g== 2024-05-14T12:22:06.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.068+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4540b2910 msgr2=0x7fe4540b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:06.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.068+0000 7fe474a00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4540b2910 0x7fe4540b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe47019b9b0 tx=0x7fe45c009260 comp rx=0 tx=0).stop 2024-05-14T12:22:06.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.068+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470104e50 msgr2=0x7fe47019a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:06.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.068+0000 7fe474a00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470104e50 0x7fe47019a900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe460000c00 tx=0x7fe4600057c0 comp rx=0 tx=0).stop 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 shutdown_connections 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4540b2910 0x7fe4540b4e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47010a110 0x7fe4701a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470104e50 0x7fe47019a900 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 --2- 172.21.15.47:0/3331364988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4701077b0 0x7fe47019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 >> 172.21.15.47:0/3331364988 conn(0x7fe4700fe870 msgr2=0x7fe470105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 shutdown_connections 2024-05-14T12:22:06.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:06.069+0000 7fe474a00700 1 -- 172.21.15.47:0/3331364988 wait complete. 2024-05-14T12:22:06.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:06 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3331364988' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T12:22:06.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:06 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3331364988' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T12:22:06.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:06 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3331364988' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T12:22:06.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:06 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3331364988' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T12:22:06.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:06 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3331364988' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T12:22:06.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:06 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3331364988' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T12:22:06.921 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:22:06.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-14T12:22:06.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-14T12:22:07.065 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-14T12:22:07.065 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-14T12:22:07.065 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph mgr dump --format=json 2024-05-14T12:22:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:07 smithi047 ceph-mon[31254]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T12:22:07.573 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:07 smithi073 ceph-mon[35809]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T12:22:07.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:07 smithi066 ceph-mon[35981]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T12:22:09.634 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:09 smithi047 ceph-mon[31254]: pgmap v359: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:22:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:09 smithi073 ceph-mon[35809]: pgmap v359: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:22:09.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:09 smithi066 ceph-mon[35981]: pgmap v359: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:22:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 -- 172.21.15.47:0/794847137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194076680 msgr2=0x7f0194110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 --2- 172.21.15.47:0/794847137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194076680 0x7f0194110660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f017c009990 tx=0x7f017c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 -- 172.21.15.47:0/794847137 shutdown_connections 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 --2- 172.21.15.47:0/794847137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0194110ba0 0x7f0194113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 --2- 172.21.15.47:0/794847137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194075d30 0x7f0194076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 --2- 172.21.15.47:0/794847137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194076680 0x7f0194110660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 -- 172.21.15.47:0/794847137 >> 172.21.15.47:0/794847137 conn(0x7f0194100040 msgr2=0x7f0194102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 -- 172.21.15.47:0/794847137 shutdown_connections 2024-05-14T12:22:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.988+0000 7f0198a00700 1 -- 172.21.15.47:0/794847137 wait complete. 2024-05-14T12:22:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 Processor -- start 2024-05-14T12:22:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 -- start start 2024-05-14T12:22:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194075d30 0x7f019419d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0194076680 0x7f019419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194110ba0 0x7f01941a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01941166a0 con 0x7f0194075d30 2024-05-14T12:22:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0194116520 con 0x7f0194110ba0 2024-05-14T12:22:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.990+0000 7f0198a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0194116820 con 0x7f0194076680 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0191e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194075d30 0x7f019419d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194110ba0 0x7f01941a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194110ba0 0x7f01941a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52620/0 (socket says 172.21.15.47:52620) 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 -- 172.21.15.47:0/3205401740 learned_addr learned my addr 172.21.15.47:0/3205401740 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0191e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194075d30 0x7f019419d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40126/0 (socket says 172.21.15.47:40126) 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0189400700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0194076680 0x7f019419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 -- 172.21.15.47:0/3205401740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0194076680 msgr2=0x7f019419d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0194076680 0x7f019419d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 -- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194075d30 msgr2=0x7f019419d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194075d30 0x7f019419d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0192800700 1 -- 172.21.15.47:0/3205401740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01941a1f20 con 0x7f0194110ba0 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.991+0000 7f0189400700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0194076680 0x7f019419d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.992+0000 7f0192800700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194110ba0 0x7f01941a1880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f018c00ef90 tx=0x7f018c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.992+0000 7f018b400700 1 -- 172.21.15.47:0/3205401740 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c0092e0 con 0x7f0194110ba0 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.992+0000 7f018b400700 1 -- 172.21.15.47:0/3205401740 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f018c004bb0 con 0x7f0194110ba0 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.992+0000 7f018b400700 1 -- 172.21.15.47:0/3205401740 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c004280 con 0x7f0194110ba0 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.992+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01941a21b0 con 0x7f0194110ba0 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.992+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01941a26a0 con 0x7f0194110ba0 2024-05-14T12:22:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.994+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01940512c0 con 0x7f0194110ba0 2024-05-14T12:22:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.996+0000 7f018b400700 1 -- 172.21.15.47:0/3205401740 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f018c01b030 con 0x7f0194110ba0 2024-05-14T12:22:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.997+0000 7f018b400700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f01740b2910 0x7f01740b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.998+0000 7f018b400700 1 -- 172.21.15.47:0/3205401740 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f018c0e2050 con 0x7f0194110ba0 2024-05-14T12:22:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.998+0000 7f0191e00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f01740b2910 0x7f01740b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:09.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:09.999+0000 7f0191e00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f01740b2910 0x7f01740b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0184009c60 tx=0x7f0184009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:09.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.000+0000 7f018b400700 1 -- 172.21.15.47:0/3205401740 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f018c022020 con 0x7f0194110ba0 2024-05-14T12:22:10.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.303+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f019402e5f0 con 0x7f0194110ba0 2024-05-14T12:22:10.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.310+0000 7f018b400700 1 -- 172.21.15.47:0/3205401740 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288646 (secure 0 0 0) 0x7f018c010040 con 0x7f0194110ba0 2024-05-14T12:22:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f01740b2910 msgr2=0x7f01740b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f01740b2910 0x7f01740b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0184009c60 tx=0x7f0184009260 comp rx=0 tx=0).stop 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194110ba0 msgr2=0x7f01941a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194110ba0 0x7f01941a1880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f018c00ef90 tx=0x7f018c00c3a0 comp rx=0 tx=0).stop 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 shutdown_connections 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f01740b2910 0x7f01740b4e20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0194110ba0 0x7f01941a1880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0194075d30 0x7f019419d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 --2- 172.21.15.47:0/3205401740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0194076680 0x7f019419d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:10.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 >> 172.21.15.47:0/3205401740 conn(0x7f0194100040 msgr2=0x7f0194101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:10.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 shutdown_connections 2024-05-14T12:22:10.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:10.316+0000 7f0198a00700 1 -- 172.21.15.47:0/3205401740 wait complete. 2024-05-14T12:22:10.713 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:10 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3205401740' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T12:22:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:10 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3205401740' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T12:22:10.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:10 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3205401740' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T12:22:11.142 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1176244093},{"type":"v1","addr":"172.21.15.47:6801","nonce":1176244093}]},"active_addr":"172.21.15.47:6801/1176244093","active_change":"2024-05-14T12:12:38.075109+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.47:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1071422478}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2171760509}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":629731935}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2205434082}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3671908767}]}]} 2024-05-14T12:22:11.148 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-14T12:22:11.149 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-14T12:22:11.149 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:22:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:11.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:11 smithi047 ceph-mon[31254]: pgmap v360: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:22:11.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:11 smithi073 ceph-mon[35809]: pgmap v360: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:22:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:11 smithi066 ceph-mon[35981]: pgmap v360: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:22:13.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:13 smithi047 ceph-mon[31254]: pgmap v361: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:22:13.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:13 smithi073 ceph-mon[35809]: pgmap v361: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:22:13.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:13 smithi066 ceph-mon[35981]: pgmap v361: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:22:14.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 -- 172.21.15.47:0/2245706681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918410af50 msgr2=0x7f918410b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 --2- 172.21.15.47:0/2245706681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918410af50 0x7f918410b360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91700099c0 tx=0x7f9170009cd0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 -- 172.21.15.47:0/2245706681 shutdown_connections 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 --2- 172.21.15.47:0/2245706681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f918410b8a0 0x7f9184113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 --2- 172.21.15.47:0/2245706681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9184106620 0x7f9184106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 --2- 172.21.15.47:0/2245706681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f918410af50 0x7f918410b360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 -- 172.21.15.47:0/2245706681 >> 172.21.15.47:0/2245706681 conn(0x7f9184102030 msgr2=0x7f9184104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 -- 172.21.15.47:0/2245706681 shutdown_connections 2024-05-14T12:22:14.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.102+0000 7f9183e00700 1 -- 172.21.15.47:0/2245706681 wait complete. 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.103+0000 7f9183e00700 1 Processor -- start 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9183e00700 1 -- start start 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9183e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9184106620 0x7f918419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9183e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918410af50 0x7f918419d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9183e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f918410b8a0 0x7f91841a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9183e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9184116500 con 0x7f9184106620 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9183e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9184116380 con 0x7f918410b8a0 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9183e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9184116680 con 0x7f918410af50 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9182a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9184106620 0x7f918419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9182a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9184106620 0x7f918419cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40140/0 (socket says 172.21.15.47:40140) 2024-05-14T12:22:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.104+0000 7f9182a00700 1 -- 172.21.15.47:0/3643185569 learned_addr learned my addr 172.21.15.47:0/3643185569 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9182000700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918410af50 0x7f918419d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9183400700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f918410b8a0 0x7f91841a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9182a00700 1 -- 172.21.15.47:0/3643185569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918410af50 msgr2=0x7f918419d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9182a00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918410af50 0x7f918419d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9182a00700 1 -- 172.21.15.47:0/3643185569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f918410b8a0 msgr2=0x7f91841a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9182a00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f918410b8a0 0x7f91841a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9182a00700 1 -- 172.21.15.47:0/3643185569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91841a1e20 con 0x7f9184106620 2024-05-14T12:22:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.105+0000 7f9182a00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9184106620 0x7f918419cf50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f917400d980 tx=0x7f917400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.106+0000 7f917b400700 1 -- 172.21.15.47:0/3643185569 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174016070 con 0x7f9184106620 2024-05-14T12:22:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.106+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91841a2110 con 0x7f9184106620 2024-05-14T12:22:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.106+0000 7f917b400700 1 -- 172.21.15.47:0/3643185569 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9174004830 con 0x7f9184106620 2024-05-14T12:22:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.106+0000 7f917b400700 1 -- 172.21.15.47:0/3643185569 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174005540 con 0x7f9184106620 2024-05-14T12:22:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.106+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91841a9a30 con 0x7f9184106620 2024-05-14T12:22:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.107+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91840512c0 con 0x7f9184106620 2024-05-14T12:22:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.110+0000 7f917b400700 1 -- 172.21.15.47:0/3643185569 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9174004220 con 0x7f9184106620 2024-05-14T12:22:14.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.111+0000 7f917b400700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f91680b2910 0x7f91680b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:14.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.112+0000 7f917b400700 1 -- 172.21.15.47:0/3643185569 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f91740e2680 con 0x7f9184106620 2024-05-14T12:22:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.112+0000 7f9182000700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f91680b2910 0x7f91680b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.113+0000 7f9182000700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f91680b2910 0x7f91680b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c00 tx=0x7f917001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.114+0000 7f917b400700 1 -- 172.21.15.47:0/3643185569 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f917401f020 con 0x7f9184106620 2024-05-14T12:22:14.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.350+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f918402e5f0 con 0x7f9184106620 2024-05-14T12:22:14.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.352+0000 7f917b400700 1 -- 172.21.15.47:0/3643185569 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7f91740aa200 con 0x7f9184106620 2024-05-14T12:22:14.353 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:22:14.353 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f91680b2910 msgr2=0x7f91680b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f91680b2910 0x7f91680b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c00 tx=0x7f917001a040 comp rx=0 tx=0).stop 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9184106620 msgr2=0x7f918419cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9184106620 0x7f918419cf50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f917400d980 tx=0x7f917400dc90 comp rx=0 tx=0).stop 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 shutdown_connections 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f91680b2910 0x7f91680b4e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f918410b8a0 0x7f91841a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9184106620 0x7f918419cf50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 --2- 172.21.15.47:0/3643185569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918410af50 0x7f918419d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:14.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.356+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 >> 172.21.15.47:0/3643185569 conn(0x7f9184102030 msgr2=0x7f918410a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:14.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.357+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 shutdown_connections 2024-05-14T12:22:14.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:14.357+0000 7f9183e00700 1 -- 172.21.15.47:0/3643185569 wait complete. 2024-05-14T12:22:14.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:14 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3643185569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:22:14.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:14 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3643185569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:22:14.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:14 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3643185569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:22:15.196 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-14T12:22:15.196 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:22:15.674 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:15.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:15 smithi047 ceph-mon[31254]: pgmap v362: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:22:15.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:15 smithi073 ceph-mon[35809]: pgmap v362: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:22:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:15 smithi066 ceph-mon[35981]: pgmap v362: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:22:17.663 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:17 smithi047 ceph-mon[31254]: pgmap v363: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:22:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:17 smithi073 ceph-mon[35809]: pgmap v363: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:22:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:17 smithi066 ceph-mon[35981]: pgmap v363: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:22:18.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 -- 172.21.15.47:0/783083939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514104400 msgr2=0x7fb514104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:18.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 --2- 172.21.15.47:0/783083939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514104400 0x7fb514104810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5040099c0 tx=0x7fb504009cd0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 -- 172.21.15.47:0/783083939 shutdown_connections 2024-05-14T12:22:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 --2- 172.21.15.47:0/783083939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb514109680 0x7fb514110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 --2- 172.21.15.47:0/783083939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514104400 0x7fb514104810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 --2- 172.21.15.47:0/783083939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514108d30 0x7fb514109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 -- 172.21.15.47:0/783083939 >> 172.21.15.47:0/783083939 conn(0x7fb514079d10 msgr2=0x7fb51407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 -- 172.21.15.47:0/783083939 shutdown_connections 2024-05-14T12:22:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.049+0000 7fb519c00700 1 -- 172.21.15.47:0/783083939 wait complete. 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.050+0000 7fb519c00700 1 Processor -- start 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519c00700 1 -- start start 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514104400 0x7fb5141a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb514108d30 0x7fb5141a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514109680 0x7fb51419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb5141142b0 con 0x7fb514109680 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519c00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb514114130 con 0x7fb514108d30 2024-05-14T12:22:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519c00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb514114430 con 0x7fb514104400 2024-05-14T12:22:18.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb513e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514104400 0x7fb5141a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:18.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb513e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514104400 0x7fb5141a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39754/0 (socket says 172.21.15.47:39754) 2024-05-14T12:22:18.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb513e00700 1 -- 172.21.15.47:0/3221695373 learned_addr learned my addr 172.21.15.47:0/3221695373 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:18.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.051+0000 7fb519200700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514109680 0x7fb51419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:18.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb513400700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb514108d30 0x7fb5141a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb513e00700 1 -- 172.21.15.47:0/3221695373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb514108d30 msgr2=0x7fb5141a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb513e00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb514108d30 0x7fb5141a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb513e00700 1 -- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514109680 msgr2=0x7fb51419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb513e00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514109680 0x7fb51419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb513e00700 1 -- 172.21.15.47:0/3221695373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51419b0c0 con 0x7fb514104400 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb519200700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514109680 0x7fb51419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb513e00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514104400 0x7fb5141a07f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb504006010 tx=0x7fb504005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:18.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.052+0000 7fb510c00700 1 -- 172.21.15.47:0/3221695373 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504026070 con 0x7fb514104400 2024-05-14T12:22:18.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.053+0000 7fb510c00700 1 -- 172.21.15.47:0/3221695373 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb504003c70 con 0x7fb514104400 2024-05-14T12:22:18.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.053+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51419b350 con 0x7fb514104400 2024-05-14T12:22:18.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.053+0000 7fb510c00700 1 -- 172.21.15.47:0/3221695373 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50400fc20 con 0x7fb514104400 2024-05-14T12:22:18.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.053+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51419b830 con 0x7fb514104400 2024-05-14T12:22:18.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.054+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5140512c0 con 0x7fb514104400 2024-05-14T12:22:18.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.057+0000 7fb510c00700 1 -- 172.21.15.47:0/3221695373 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb504029070 con 0x7fb514104400 2024-05-14T12:22:18.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.058+0000 7fb510c00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4f80b2910 0x7fb4f80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:18.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.058+0000 7fb510c00700 1 -- 172.21.15.47:0/3221695373 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb5040e3230 con 0x7fb514104400 2024-05-14T12:22:18.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.059+0000 7fb513400700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4f80b2910 0x7fb4f80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:18.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.059+0000 7fb513400700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4f80b2910 0x7fb4f80b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb500009680 tx=0x7fb500009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:18.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.060+0000 7fb510c00700 1 -- 172.21.15.47:0/3221695373 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb504030080 con 0x7fb514104400 2024-05-14T12:22:18.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.298+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb51402e5f0 con 0x7fb514104400 2024-05-14T12:22:18.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.300+0000 7fb510c00700 1 -- 172.21.15.47:0/3221695373 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7fb504013070 con 0x7fb514104400 2024-05-14T12:22:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:22:18.300 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:22:18.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.303+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4f80b2910 msgr2=0x7fb4f80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:18.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.303+0000 7fb519c00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4f80b2910 0x7fb4f80b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb500009680 tx=0x7fb500009260 comp rx=0 tx=0).stop 2024-05-14T12:22:18.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.303+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514104400 msgr2=0x7fb5141a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:18.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.303+0000 7fb519c00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514104400 0x7fb5141a07f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb504006010 tx=0x7fb504005280 comp rx=0 tx=0).stop 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 shutdown_connections 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4f80b2910 0x7fb4f80b4e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb514109680 0x7fb51419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb514104400 0x7fb5141a07f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 --2- 172.21.15.47:0/3221695373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb514108d30 0x7fb5141a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 >> 172.21.15.47:0/3221695373 conn(0x7fb514079d10 msgr2=0x7fb514102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 shutdown_connections 2024-05-14T12:22:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:18.304+0000 7fb519c00700 1 -- 172.21.15.47:0/3221695373 wait complete. 2024-05-14T12:22:18.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:18 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3221695373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:22:18.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:18 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3221695373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:22:18.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:18 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3221695373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:22:19.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-14T12:22:19.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-14T12:22:19.183 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-14T12:22:19.183 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-14T12:22:19.183 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-14T12:22:19.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-14T12:22:19.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-14T12:22:19.185 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-14T12:22:19.185 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-14T12:22:19.185 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-14T12:22:19.186 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-14T12:22:19.186 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-14T12:22:19.737 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:19 smithi047 ceph-mon[31254]: pgmap v364: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:19.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:19 smithi073 ceph-mon[35809]: pgmap v364: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:19 smithi066 ceph-mon[35981]: pgmap v364: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:20.145 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.194 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.382 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.402 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.403 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.406 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.412 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.417 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:20.418 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:21.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:21 smithi047 ceph-mon[31254]: pgmap v365: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:21.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:21 smithi073 ceph-mon[35809]: pgmap v365: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:21.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:21 smithi066 ceph-mon[35981]: pgmap v365: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:23.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:23 smithi047 ceph-mon[31254]: pgmap v366: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:23.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:23 smithi073 ceph-mon[35809]: pgmap v366: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:23 smithi066 ceph-mon[35981]: pgmap v366: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:24.164 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:25.668 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:25 smithi047 ceph-mon[31254]: pgmap v367: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:25.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:25 smithi073 ceph-mon[35809]: pgmap v367: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:25.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:25 smithi066 ceph-mon[35981]: pgmap v367: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:27.470 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:27 smithi047 ceph-mon[31254]: pgmap v368: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:27.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:27 smithi073 ceph-mon[35809]: pgmap v368: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:27 smithi066 ceph-mon[35981]: pgmap v368: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:29 smithi047 ceph-mon[31254]: pgmap v369: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:29 smithi073 ceph-mon[35809]: pgmap v369: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:29 smithi066 ceph-mon[35981]: pgmap v369: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:31.627 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:31 smithi047 ceph-mon[31254]: pgmap v370: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:31.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:31 smithi073 ceph-mon[35809]: pgmap v370: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:31.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:31 smithi066 ceph-mon[35981]: pgmap v370: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.026+0000 7feaaa000700 1 -- 172.21.15.47:0/36091914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4109870 msgr2=0x7feaa41111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.026+0000 7feaaa000700 1 --2- 172.21.15.47:0/36091914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4109870 0x7feaa41111d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00b0d0 tx=0x7fea9c00b3e0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.026+0000 7feaaa000700 1 -- 172.21.15.47:0/36091914 shutdown_connections 2024-05-14T12:22:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.026+0000 7feaaa000700 1 --2- 172.21.15.47:0/36091914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4109870 0x7feaa41111d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.026+0000 7feaaa000700 1 --2- 172.21.15.47:0/36091914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaa41045f0 0x7feaa4104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.026+0000 7feaaa000700 1 --2- 172.21.15.47:0/36091914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4108f20 0x7feaa4109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.026+0000 7feaaa000700 1 -- 172.21.15.47:0/36091914 >> 172.21.15.47:0/36091914 conn(0x7feaa4100040 msgr2=0x7feaa4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.027+0000 7feaaa000700 1 -- 172.21.15.47:0/36091914 shutdown_connections 2024-05-14T12:22:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.027+0000 7feaaa000700 1 -- 172.21.15.47:0/36091914 wait complete. 2024-05-14T12:22:32.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.028+0000 7feaaa000700 1 Processor -- start 2024-05-14T12:22:32.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.028+0000 7feaaa000700 1 -- start start 2024-05-14T12:22:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaaa000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41045f0 0x7feaa419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaaa000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4108f20 0x7feaa419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaaa000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaa4109870 0x7feaa41a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaaa000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41144a0 con 0x7feaa4108f20 2024-05-14T12:22:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaaa000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4114320 con 0x7feaa4109870 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaaa000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4114620 con 0x7feaa41045f0 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaa3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41045f0 0x7feaa419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaa3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41045f0 0x7feaa419d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38948/0 (socket says 172.21.15.47:38948) 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaa3400700 1 -- 172.21.15.47:0/3711132904 learned_addr learned my addr 172.21.15.47:0/3711132904 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaa2a00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4108f20 0x7feaa419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.029+0000 7feaa3e00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaa4109870 0x7feaa41a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7feaa3400700 1 -- 172.21.15.47:0/3711132904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaa4109870 msgr2=0x7feaa41a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7feaa3400700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaa4109870 0x7feaa41a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7feaa3400700 1 -- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4108f20 msgr2=0x7feaa419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7feaa3400700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feaa4108f20 0x7feaa419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7feaa3400700 1 -- 172.21.15.47:0/3711132904 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa41a1f60 con 0x7feaa41045f0 2024-05-14T12:22:32.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7feaa3400700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41045f0 0x7feaa419d090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9a0 tx=0x7fea9400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:32.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9400cbd0 con 0x7feaa41045f0 2024-05-14T12:22:32.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa41a2250 con 0x7feaa41045f0 2024-05-14T12:22:32.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea9400cd70 con 0x7feaa41045f0 2024-05-14T12:22:32.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.030+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94018680 con 0x7feaa41045f0 2024-05-14T12:22:32.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.031+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa41a9b70 con 0x7feaa41045f0 2024-05-14T12:22:32.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.032+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feaa4076cd0 con 0x7feaa41045f0 2024-05-14T12:22:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.034+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fea94010970 con 0x7feaa41045f0 2024-05-14T12:22:32.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.037+0000 7fea9be00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea880b2990 0x7fea880b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.037+0000 7feaa2a00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea880b2990 0x7fea880b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.037+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fea940e2ef0 con 0x7feaa41045f0 2024-05-14T12:22:32.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.038+0000 7feaa2a00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea880b2990 0x7fea880b4ea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea90009680 tx=0x7fea90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:32.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.038+0000 7fea9be00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] conn(0x7fea880bc600 0x7fea880beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.038+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 --> [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea880bf1c0 con 0x7fea880bc600 2024-05-14T12:22:32.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.038+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fea940e32a0 con 0x7feaa41045f0 2024-05-14T12:22:32.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.039+0000 7feaa3e00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] conn(0x7fea880bc600 0x7fea880beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.040+0000 7feaa3e00700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] conn(0x7fea880bc600 0x7fea880beaf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:32.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.041+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== osd.6 v2:172.21.15.47:6818/1409128354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea880bf1c0 con 0x7fea880bc600 2024-05-14T12:22:32.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.060+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 --> [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feaa4105aa0 con 0x7fea880bc600 2024-05-14T12:22:32.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.061+0000 7fea9be00700 1 -- 172.21.15.47:0/3711132904 <== osd.6 v2:172.21.15.47:6818/1409128354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feaa4105aa0 con 0x7fea880bc600 2024-05-14T12:22:32.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.061+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] conn(0x7fea880bc600 msgr2=0x7fea880beaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.061+0000 7feaaa000700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] conn(0x7fea880bc600 0x7fea880beaf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea880b2990 msgr2=0x7fea880b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fea880b2990 0x7fea880b4ea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea90009680 tx=0x7fea90009260 comp rx=0 tx=0).stop 2024-05-14T12:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41045f0 msgr2=0x7feaa419d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 --2- 172.21.15.47:0/3711132904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa41045f0 0x7feaa419d090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9a0 tx=0x7fea9400ed60 comp rx=0 tx=0).stop 2024-05-14T12:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaa3e00700 1 -- 172.21.15.47:0/3711132904 reap_dead start 2024-05-14T12:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 shutdown_connections 2024-05-14T12:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 >> 172.21.15.47:0/3711132904 conn(0x7feaa4100040 msgr2=0x7feaa4110d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 shutdown_connections 2024-05-14T12:22:32.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:32.062+0000 7feaaa000700 1 -- 172.21.15.47:0/3711132904 wait complete. 2024-05-14T12:22:32.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 -- 172.21.15.47:0/1795790503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97b8103a50 msgr2=0x7f97b8110770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 --2- 172.21.15.47:0/1795790503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97b8103a50 0x7f97b8110770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f97a40098f0 tx=0x7f97a4009c00 comp rx=0 tx=0).stop 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 -- 172.21.15.47:0/1795790503 shutdown_connections 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 --2- 172.21.15.47:0/1795790503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97b8110cb0 0x7f97b81130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 --2- 172.21.15.47:0/1795790503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97b8103100 0x7f97b8103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 --2- 172.21.15.47:0/1795790503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97b8103a50 0x7f97b8110770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 -- 172.21.15.47:0/1795790503 >> 172.21.15.47:0/1795790503 conn(0x7f97b80fedc0 msgr2=0x7f97b81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 -- 172.21.15.47:0/1795790503 shutdown_connections 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.913+0000 7f97be800700 1 -- 172.21.15.47:0/1795790503 wait complete. 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 Processor -- start 2024-05-14T12:22:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 -- start start 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97b8103100 0x7f97b819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97b8103a50 0x7f97b819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97b8110cb0 0x7f97b81a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97b81166b0 con 0x7f97b8103100 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8116530 con 0x7f97b8110cb0 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.915+0000 7f97be800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8116830 con 0x7f97b8103a50 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97b8103a50 0x7f97b819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97b8103a50 0x7f97b819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38924/0 (socket says 172.21.15.47:38924) 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 -- 172.21.15.47:0/3991077880 learned_addr learned my addr 172.21.15.47:0/3991077880 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97b8103100 0x7f97b819d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b7e00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97b8110cb0 0x7f97b81a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 -- 172.21.15.47:0/3991077880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97b8110cb0 msgr2=0x7f97b81a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97b8110cb0 0x7f97b81a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 -- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97b8103100 msgr2=0x7f97b819d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97b8103100 0x7f97b819d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.916+0000 7f97b6a00700 1 -- 172.21.15.47:0/3991077880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b81a1f90 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.917+0000 7f97b6a00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97b8103a50 0x7f97b819d660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009230 tx=0x7f97a400f990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.917+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a4027070 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.917+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b81a2220 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.917+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97a4005570 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.917+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a4004930 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.917+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b81a9ba0 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.918+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97b8063f50 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.921+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f97a402a070 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.922+0000 7f97afe00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f979c0b2990 0x7f979c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.923+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f97a40e3770 con 0x7f97b8103a50 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.923+0000 7f97b7400700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f979c0b2990 0x7f979c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.923+0000 7f97afe00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] conn(0x7f979c0bc5a0 0x7f979c0bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:32.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.923+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 --> [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97a401ce50 con 0x7f979c0bc5a0 2024-05-14T12:22:32.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.923+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f97a40e3b20 con 0x7f97b8103a50 2024-05-14T12:22:32.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.923+0000 7f97b7e00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] conn(0x7f979c0bc5a0 0x7f979c0bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:32.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.924+0000 7f97b7400700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f979c0b2990 0x7f979c0b4ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009c60 tx=0x7f97a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:32.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.924+0000 7f97b7e00700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] conn(0x7f979c0bc5a0 0x7f979c0bea90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:32.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.925+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== osd.9 v2:172.21.15.47:6826/3151826793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97a401ce50 con 0x7f979c0bc5a0 2024-05-14T12:22:32.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.945+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 --> [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97b8064350 con 0x7f979c0bc5a0 2024-05-14T12:22:32.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.946+0000 7f97afe00700 1 -- 172.21.15.47:0/3991077880 <== osd.9 v2:172.21.15.47:6826/3151826793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f97b8064350 con 0x7f979c0bc5a0 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.946+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] conn(0x7f979c0bc5a0 msgr2=0x7f979c0bea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.946+0000 7f97be800700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] conn(0x7f979c0bc5a0 0x7f979c0bea90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f979c0b2990 msgr2=0x7f979c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f979c0b2990 0x7f979c0b4ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009c60 tx=0x7f97a8009260 comp rx=0 tx=0).stop 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97b8103a50 msgr2=0x7f97b819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 --2- 172.21.15.47:0/3991077880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97b8103a50 0x7f97b819d660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009230 tx=0x7f97a400f990 comp rx=0 tx=0).stop 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97b7e00700 1 -- 172.21.15.47:0/3991077880 reap_dead start 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 shutdown_connections 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 >> 172.21.15.47:0/3991077880 conn(0x7f97b80fedc0 msgr2=0x7f97b8112900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 shutdown_connections 2024-05-14T12:22:32.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:31.947+0000 7f97be800700 1 -- 172.21.15.47:0/3991077880 wait complete. 2024-05-14T12:22:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:33 smithi047 ceph-mon[31254]: pgmap v371: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-05-14T12:22:33.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:33 smithi073 ceph-mon[35809]: pgmap v371: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-05-14T12:22:33.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:33 smithi066 ceph-mon[35981]: pgmap v371: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-05-14T12:22:34.828 INFO:teuthology.orchestra.run.smithi047.stdout:188978561089 2024-05-14T12:22:34.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-14T12:22:35.603 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:35 smithi047 ceph-mon[31254]: pgmap v372: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:35.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:35 smithi073 ceph-mon[35809]: pgmap v372: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:35 smithi066 ceph-mon[35981]: pgmap v372: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:22:36.259 INFO:teuthology.orchestra.run.smithi047.stdout:270582939694 2024-05-14T12:22:36.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-14T12:22:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 -- 172.21.15.47:0/3785366651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105500 msgr2=0x7f00ec105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 --2- 172.21.15.47:0/3785366651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105500 0x7f00ec105910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009990 tx=0x7f00dc009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 -- 172.21.15.47:0/3785366651 shutdown_connections 2024-05-14T12:22:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 --2- 172.21.15.47:0/3785366651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00ec10e8e0 0x7f00ec110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 --2- 172.21.15.47:0/3785366651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105500 0x7f00ec105910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 --2- 172.21.15.47:0/3785366651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00ec105e50 0x7f00ec10e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 -- 172.21.15.47:0/3785366651 >> 172.21.15.47:0/3785366651 conn(0x7f00ec0fedc0 msgr2=0x7f00ec1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 -- 172.21.15.47:0/3785366651 shutdown_connections 2024-05-14T12:22:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.455+0000 7f00f0e00700 1 -- 172.21.15.47:0/3785366651 wait complete. 2024-05-14T12:22:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.457+0000 7f00f0e00700 1 Processor -- start 2024-05-14T12:22:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.457+0000 7f00f0e00700 1 -- start start 2024-05-14T12:22:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00f0e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00ec105500 0x7f00ec19cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00f0e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105e50 0x7f00ec19d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00f0e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00ec10e8e0 0x7f00ec1a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00f0e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec114480 con 0x7f00ec10e8e0 2024-05-14T12:22:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00f0e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec114300 con 0x7f00ec105500 2024-05-14T12:22:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00f0e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec114600 con 0x7f00ec105e50 2024-05-14T12:22:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00e9400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105e50 0x7f00ec19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00ea800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00ec10e8e0 0x7f00ec1a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00e9400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105e50 0x7f00ec19d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38970/0 (socket says 172.21.15.47:38970) 2024-05-14T12:22:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00e9400700 1 -- 172.21.15.47:0/4054288136 learned_addr learned my addr 172.21.15.47:0/4054288136 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.458+0000 7f00e9e00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00ec105500 0x7f00ec19cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.459+0000 7f00ea800700 1 -- 172.21.15.47:0/4054288136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105e50 msgr2=0x7f00ec19d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.459+0000 7f00ea800700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ec105e50 0x7f00ec19d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.459+0000 7f00ea800700 1 -- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00ec105500 msgr2=0x7f00ec19cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.459+0000 7f00ea800700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00ec105500 0x7f00ec19cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.459+0000 7f00ea800700 1 -- 172.21.15.47:0/4054288136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec1a1ec0 con 0x7f00ec10e8e0 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.459+0000 7f00e9e00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00ec105500 0x7f00ec19cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.459+0000 7f00ea800700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00ec10e8e0 0x7f00ec1a1820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00e400efc0 tx=0x7f00e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.460+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e40092e0 con 0x7f00ec10e8e0 2024-05-14T12:22:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.460+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00e4004bb0 con 0x7f00ec10e8e0 2024-05-14T12:22:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.460+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4004020 con 0x7f00ec10e8e0 2024-05-14T12:22:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.460+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec1a2150 con 0x7f00ec10e8e0 2024-05-14T12:22:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.460+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec1a2640 con 0x7f00ec10e8e0 2024-05-14T12:22:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.462+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00ec0ffc90 con 0x7f00ec10e8e0 2024-05-14T12:22:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.465+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f00e401b030 con 0x7f00ec10e8e0 2024-05-14T12:22:36.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.466+0000 7f00e2a00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f00d00b2990 0x7f00d00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.466+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f00e40e2740 con 0x7f00ec10e8e0 2024-05-14T12:22:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.467+0000 7f00e9e00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f00d00b2990 0x7f00d00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.467+0000 7f00e2a00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] conn(0x7f00d00bc5a0 0x7f00d00bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.467+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 --> [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00e4011e50 con 0x7f00d00bc5a0 2024-05-14T12:22:36.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.467+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f00e40e2af0 con 0x7f00ec10e8e0 2024-05-14T12:22:36.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.467+0000 7f00e9400700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] conn(0x7f00d00bc5a0 0x7f00d00bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.468+0000 7f00e9e00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f00d00b2990 0x7f00d00b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00b2e0 tx=0x7f00dc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.468+0000 7f00e9400700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] conn(0x7f00d00bc5a0 0x7f00d00bea90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.469+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== osd.1 v2:172.21.15.66:6800/3104926440 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00e4011e50 con 0x7f00d00bc5a0 2024-05-14T12:22:36.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.488+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 --> [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00ec06be50 con 0x7f00d00bc5a0 2024-05-14T12:22:36.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.488+0000 7f00e2a00700 1 -- 172.21.15.47:0/4054288136 <== osd.1 v2:172.21.15.66:6800/3104926440 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00ec06be50 con 0x7f00d00bc5a0 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] conn(0x7f00d00bc5a0 msgr2=0x7f00d00bea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] conn(0x7f00d00bc5a0 0x7f00d00bea90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f00d00b2990 msgr2=0x7f00d00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f00d00b2990 0x7f00d00b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00b2e0 tx=0x7f00dc005fd0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00ec10e8e0 msgr2=0x7f00ec1a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 --2- 172.21.15.47:0/4054288136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00ec10e8e0 0x7f00ec1a1820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00e400efc0 tx=0x7f00e400c3a0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00ea800700 1 -- 172.21.15.47:0/4054288136 reap_dead start 2024-05-14T12:22:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 shutdown_connections 2024-05-14T12:22:36.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.489+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 >> 172.21.15.47:0/4054288136 conn(0x7f00ec0fedc0 msgr2=0x7f00ec0ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:36.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.490+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 shutdown_connections 2024-05-14T12:22:36.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:36.490+0000 7f00f0e00700 1 -- 172.21.15.47:0/4054288136 wait complete. 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 -- 172.21.15.47:0/1249157821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 msgr2=0x7f0b681100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 --2- 172.21.15.47:0/1249157821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 0x7f0b681100a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000b0d0 tx=0x7f0b6000b3e0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 -- 172.21.15.47:0/1249157821 shutdown_connections 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 --2- 172.21.15.47:0/1249157821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 0x7f0b681100a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 --2- 172.21.15.47:0/1249157821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b681034c0 0x7f0b681038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 --2- 172.21.15.47:0/1249157821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b68107df0 0x7f0b68108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 -- 172.21.15.47:0/1249157821 >> 172.21.15.47:0/1249157821 conn(0x7f0b680fedc0 msgr2=0x7f0b681011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 -- 172.21.15.47:0/1249157821 shutdown_connections 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.088+0000 7f0b6ca00700 1 -- 172.21.15.47:0/1249157821 wait complete. 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.090+0000 7f0b6ca00700 1 Processor -- start 2024-05-14T12:22:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.090+0000 7f0b6ca00700 1 -- start start 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.090+0000 7f0b6ca00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b681034c0 0x7f0b6819aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b6ca00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b68107df0 0x7f0b6819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b6ca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 0x7f0b6819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b6ca00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681133c0 con 0x7f0b68108740 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b6ca00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0b68113240 con 0x7f0b681034c0 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b6ca00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0b68113540 con 0x7f0b68107df0 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b65e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b681034c0 0x7f0b6819aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b65e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b681034c0 0x7f0b6819aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41520/0 (socket says 172.21.15.47:41520) 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b65e00700 1 -- 172.21.15.47:0/4265506945 learned_addr learned my addr 172.21.15.47:0/4265506945 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b66800700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 0x7f0b6819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.091+0000 7f0b65400700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b68107df0 0x7f0b6819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b66800700 1 -- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b68107df0 msgr2=0x7f0b6819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b66800700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b68107df0 0x7f0b6819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b66800700 1 -- 172.21.15.47:0/4265506945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b681034c0 msgr2=0x7f0b6819aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b66800700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b681034c0 0x7f0b6819aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b66800700 1 -- 172.21.15.47:0/4265506945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6819fd90 con 0x7f0b68108740 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b65e00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b681034c0 0x7f0b6819aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b65400700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b68107df0 0x7f0b6819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b66800700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 0x7f0b6819f6f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000b770 tx=0x7f0b60007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6001f070 con 0x7f0b68108740 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b60007dc0 con 0x7f0b68108740 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6001b430 con 0x7f0b68108740 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.092+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b681a0020 con 0x7f0b68108740 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.093+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b681a04b0 con 0x7f0b68108740 2024-05-14T12:22:36.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.094+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b68063ed0 con 0x7f0b68108740 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.096+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0b60022070 con 0x7f0b68108740 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.098+0000 7f0b5ea00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b4c0b2910 0x7f0b4c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.098+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0b6000f020 con 0x7f0b68108740 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.098+0000 7f0b65e00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b4c0b2910 0x7f0b4c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.098+0000 7f0b5ea00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] conn(0x7f0b4c0bc520 0x7f0b4c0bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.098+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 --> [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b4c0bf0e0 con 0x7f0b4c0bc520 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.098+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f0b600e39c0 con 0x7f0b68108740 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.099+0000 7f0b65400700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] conn(0x7f0b4c0bc520 0x7f0b4c0bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.099+0000 7f0b65e00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b4c0b2910 0x7f0b4c0b4e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b58011550 tx=0x7f0b58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.099+0000 7f0b65400700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] conn(0x7f0b4c0bc520 0x7f0b4c0bea10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:36.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.100+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== osd.5 v2:172.21.15.73:6808/3780521249 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b4c0bf0e0 con 0x7f0b4c0bc520 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.119+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 --> [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b68064350 con 0x7f0b4c0bc520 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.120+0000 7f0b5ea00700 1 -- 172.21.15.47:0/4265506945 <== osd.5 v2:172.21.15.73:6808/3780521249 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0b68064350 con 0x7f0b4c0bc520 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.120+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] conn(0x7f0b4c0bc520 msgr2=0x7f0b4c0bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.120+0000 7f0b6ca00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] conn(0x7f0b4c0bc520 0x7f0b4c0bea10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b4c0b2910 msgr2=0x7f0b4c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b4c0b2910 0x7f0b4c0b4e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b58011550 tx=0x7f0b58009260 comp rx=0 tx=0).stop 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 msgr2=0x7f0b6819f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:36.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 --2- 172.21.15.47:0/4265506945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b68108740 0x7f0b6819f6f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000b770 tx=0x7f0b60007980 comp rx=0 tx=0).stop 2024-05-14T12:22:36.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b66800700 1 -- 172.21.15.47:0/4265506945 reap_dead start 2024-05-14T12:22:36.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 shutdown_connections 2024-05-14T12:22:36.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 >> 172.21.15.47:0/4265506945 conn(0x7f0b680fedc0 msgr2=0x7f0b6806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:36.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 shutdown_connections 2024-05-14T12:22:36.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:35.121+0000 7f0b6ca00700 1 -- 172.21.15.47:0/4265506945 wait complete. 2024-05-14T12:22:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:37 smithi047 ceph-mon[31254]: pgmap v373: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:37 smithi073 ceph-mon[35809]: pgmap v373: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:37.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:37 smithi066 ceph-mon[35981]: pgmap v373: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:38.202 INFO:teuthology.orchestra.run.smithi047.stdout:55834574940 2024-05-14T12:22:38.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-14T12:22:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 -- 172.21.15.47:0/1040071857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff4105c20 msgr2=0x7f8ff410e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 --2- 172.21.15.47:0/1040071857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff4105c20 0x7f8ff410e170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009990 tx=0x7f8fe0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 -- 172.21.15.47:0/1040071857 shutdown_connections 2024-05-14T12:22:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 --2- 172.21.15.47:0/1040071857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ff410e740 0x7f8ff4110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 --2- 172.21.15.47:0/1040071857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff41052d0 0x7f8ff41056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 --2- 172.21.15.47:0/1040071857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff4105c20 0x7f8ff410e170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 -- 172.21.15.47:0/1040071857 >> 172.21.15.47:0/1040071857 conn(0x7f8ff4078b00 msgr2=0x7f8ff4078f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.710+0000 7f8ff3e00700 1 -- 172.21.15.47:0/1040071857 shutdown_connections 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.711+0000 7f8ff3e00700 1 -- 172.21.15.47:0/1040071857 wait complete. 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.712+0000 7f8ff3e00700 1 Processor -- start 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.712+0000 7f8ff3e00700 1 -- start start 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.713+0000 7f8ff3e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ff41052d0 0x7f8ff41a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.713+0000 7f8ff3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4105c20 0x7f8ff41a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.713+0000 7f8ff3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410e740 0x7f8ff419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.713+0000 7f8ff3e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4114280 con 0x7f8ff410e740 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.713+0000 7f8ff3e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4114100 con 0x7f8ff4105c20 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.713+0000 7f8ff3e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4114400 con 0x7f8ff41052d0 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ff41052d0 0x7f8ff41a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410e740 0x7f8ff419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ff41052d0 0x7f8ff41a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38988/0 (socket says 172.21.15.47:38988) 2024-05-14T12:22:38.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410e740 0x7f8ff419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58194/0 (socket says 172.21.15.47:58194) 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 -- 172.21.15.47:0/2272936004 learned_addr learned my addr 172.21.15.47:0/2272936004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2000700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4105c20 0x7f8ff41a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 -- 172.21.15.47:0/2272936004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4105c20 msgr2=0x7f8ff41a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4105c20 0x7f8ff41a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 -- 172.21.15.47:0/2272936004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410e740 msgr2=0x7f8ff419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ff410e740 0x7f8ff419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 -- 172.21.15.47:0/2272936004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff419b1c0 con 0x7f8ff41052d0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.714+0000 7f8ff2a00700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ff41052d0 0x7f8ff41a08a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400e9a0 tx=0x7f8fe400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.715+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400ca10 con 0x7f8ff41052d0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.715+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff419b4b0 con 0x7f8ff41052d0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.715+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41a7750 con 0x7f8ff41052d0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.715+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe400cbb0 con 0x7f8ff41052d0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.715+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4018420 con 0x7f8ff41052d0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.716+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ff4063ed0 con 0x7f8ff41052d0 2024-05-14T12:22:38.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.718+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8fe4010430 con 0x7f8ff41052d0 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.720+0000 7f8feb400700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8fd80b2910 0x7f8fd80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.720+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8fe40e2620 con 0x7f8ff41052d0 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.720+0000 7f8ff2000700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8fd80b2910 0x7f8fd80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.721+0000 7f8feb400700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] conn(0x7f8fd80bc520 0x7f8fd80bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.721+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 --> [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fe401ae50 con 0x7f8fd80bc520 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.721+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f8fe40e9050 con 0x7f8ff41052d0 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.721+0000 7f8ff3400700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] conn(0x7f8fd80bc520 0x7f8fd80bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.721+0000 7f8ff2000700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8fd80b2910 0x7f8fd80b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0006010 tx=0x7f8fe0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.722+0000 7f8ff3400700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] conn(0x7f8fd80bc520 0x7f8fd80bea10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.723+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== osd.11 v2:172.21.15.73:6824/4073821208 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fe401ae50 con 0x7f8fd80bc520 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.741+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 --> [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ff4064300 con 0x7f8fd80bc520 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.742+0000 7f8feb400700 1 -- 172.21.15.47:0/2272936004 <== osd.11 v2:172.21.15.73:6824/4073821208 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8ff4064300 con 0x7f8fd80bc520 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] conn(0x7f8fd80bc520 msgr2=0x7f8fd80bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] conn(0x7f8fd80bc520 0x7f8fd80bea10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8fd80b2910 msgr2=0x7f8fd80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8fd80b2910 0x7f8fd80b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0006010 tx=0x7f8fe0005960 comp rx=0 tx=0).stop 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ff41052d0 msgr2=0x7f8ff41a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 --2- 172.21.15.47:0/2272936004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ff41052d0 0x7f8ff41a08a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400e9a0 tx=0x7f8fe400ecb0 comp rx=0 tx=0).stop 2024-05-14T12:22:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3400700 1 -- 172.21.15.47:0/2272936004 reap_dead start 2024-05-14T12:22:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 shutdown_connections 2024-05-14T12:22:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.743+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 >> 172.21.15.47:0/2272936004 conn(0x7f8ff4078b00 msgr2=0x7f8ff4101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.744+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 shutdown_connections 2024-05-14T12:22:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.744+0000 7f8ff3e00700 1 -- 172.21.15.47:0/2272936004 wait complete. 2024-05-14T12:22:39.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 -- 172.21.15.47:0/1976941640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830106620 msgr2=0x7f1830106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:39.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 --2- 172.21.15.47:0/1976941640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830106620 0x7f1830106a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f18200098f0 tx=0x7f1820009c00 comp rx=0 tx=0).stop 2024-05-14T12:22:39.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 -- 172.21.15.47:0/1976941640 shutdown_connections 2024-05-14T12:22:39.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 --2- 172.21.15.47:0/1976941640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f183010b8a0 0x7f1830113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:39.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 --2- 172.21.15.47:0/1976941640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830106620 0x7f1830106a30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 --2- 172.21.15.47:0/1976941640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183010af50 0x7f183010b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 -- 172.21.15.47:0/1976941640 >> 172.21.15.47:0/1976941640 conn(0x7f1830102030 msgr2=0x7f1830104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 -- 172.21.15.47:0/1976941640 shutdown_connections 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.928+0000 7f1835800700 1 -- 172.21.15.47:0/1976941640 wait complete. 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.929+0000 7f1835800700 1 Processor -- start 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f1835800700 1 -- start start 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f1835800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1830106620 0x7f183019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f1835800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f183010af50 0x7f183019d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f1835800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f183010b8a0 0x7f18301a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f1835800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1830116520 con 0x7f1830106620 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f1835800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f18301163a0 con 0x7f183010af50 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f1835800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f18301166a0 con 0x7f183010b8a0 2024-05-14T12:22:39.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f182fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1830106620 0x7f183019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f182fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1830106620 0x7f183019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34766/0 (socket says 172.21.15.47:34766) 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.930+0000 7f182fe00700 1 -- 172.21.15.47:0/1210622727 learned_addr learned my addr 172.21.15.47:0/1210622727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f1827400700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f183010af50 0x7f183019d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f1834e00700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f183010b8a0 0x7f18301a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f182fe00700 1 -- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f183010b8a0 msgr2=0x7f18301a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f182fe00700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f183010b8a0 0x7f18301a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f182fe00700 1 -- 172.21.15.47:0/1210622727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f183010af50 msgr2=0x7f183019d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f182fe00700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f183010af50 0x7f183019d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f182fe00700 1 -- 172.21.15.47:0/1210622727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18301a1d40 con 0x7f1830106620 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.931+0000 7f182fe00700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1830106620 0x7f183019ce70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1820009230 tx=0x7f182000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.932+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820005140 con 0x7f1830106620 2024-05-14T12:22:39.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.932+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f182000b560 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.932+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18301a1fd0 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.932+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820003970 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.932+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18301a24b0 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.933+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1830063f50 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.936+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f182000ba50 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.938+0000 7f182d600700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18140b2910 0x7f18140b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.938+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f18200e3790 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.938+0000 7f1827400700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18140b2910 0x7f18140b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.938+0000 7f182d600700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] conn(0x7f18140bc520 0x7f18140bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.938+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 --> [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1820030ea0 con 0x7f18140bc520 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.938+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f18200e3b40 con 0x7f1830106620 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.939+0000 7f1827400700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18140b2910 0x7f18140b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1830109690 tx=0x7f1818009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:39.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.939+0000 7f1834e00700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] conn(0x7f18140bc520 0x7f18140bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:39.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.939+0000 7f1834e00700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] conn(0x7f18140bc520 0x7f18140bea10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:39.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.940+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== osd.2 v2:172.21.15.73:6800/4201489932 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1820030ea0 con 0x7f18140bc520 2024-05-14T12:22:39.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.959+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 --> [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18300643d0 con 0x7f18140bc520 2024-05-14T12:22:39.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f182d600700 1 -- 172.21.15.47:0/1210622727 <== osd.2 v2:172.21.15.73:6800/4201489932 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f18300643d0 con 0x7f18140bc520 2024-05-14T12:22:39.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] conn(0x7f18140bc520 msgr2=0x7f18140bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] conn(0x7f18140bc520 0x7f18140bea10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18140b2910 msgr2=0x7f18140b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18140b2910 0x7f18140b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1830109690 tx=0x7f1818009310 comp rx=0 tx=0).stop 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1830106620 msgr2=0x7f183019ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 --2- 172.21.15.47:0/1210622727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1830106620 0x7f183019ce70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1820009230 tx=0x7f182000fa70 comp rx=0 tx=0).stop 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1834e00700 1 -- 172.21.15.47:0/1210622727 reap_dead start 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 shutdown_connections 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.960+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 >> 172.21.15.47:0/1210622727 conn(0x7f1830102030 msgr2=0x7f183010a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.961+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 shutdown_connections 2024-05-14T12:22:39.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:37.961+0000 7f1835800700 1 -- 172.21.15.47:0/1210622727 wait complete. 2024-05-14T12:22:39.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:39 smithi047 ceph-mon[31254]: pgmap v374: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:39.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:39 smithi073 ceph-mon[35809]: pgmap v374: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:39 smithi066 ceph-mon[35981]: pgmap v374: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:22:39.834 INFO:teuthology.orchestra.run.smithi047.stdout:77309411417 2024-05-14T12:22:39.834 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.834+0000 7f6150600700 1 -- 172.21.15.47:0/4190919750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61481054a0 msgr2=0x7f61481058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.834+0000 7f6150600700 1 --2- 172.21.15.47:0/4190919750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61481054a0 0x7f61481058b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f613c009990 tx=0x7f613c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.835+0000 7f6150600700 1 -- 172.21.15.47:0/4190919750 shutdown_connections 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.835+0000 7f6150600700 1 --2- 172.21.15.47:0/4190919750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614810e910 0x7f6148110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.835+0000 7f6150600700 1 --2- 172.21.15.47:0/4190919750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61481054a0 0x7f61481058b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.835+0000 7f6150600700 1 --2- 172.21.15.47:0/4190919750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6148105df0 0x7f614810e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.835+0000 7f6150600700 1 -- 172.21.15.47:0/4190919750 >> 172.21.15.47:0/4190919750 conn(0x7f61480fedc0 msgr2=0x7f61481011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.835+0000 7f6150600700 1 -- 172.21.15.47:0/4190919750 shutdown_connections 2024-05-14T12:22:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.835+0000 7f6150600700 1 -- 172.21.15.47:0/4190919750 wait complete. 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.836+0000 7f6150600700 1 Processor -- start 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.836+0000 7f6150600700 1 -- start start 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f6150600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481054a0 0x7f6148103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f6150600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6148105df0 0x7f61481036d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f6150600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f614810e910 0x7f6148103c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f6150600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f61481144b0 con 0x7f614810e910 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f6150600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6148114330 con 0x7f6148105df0 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f6150600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6148114630 con 0x7f61481054a0 2024-05-14T12:22:40.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f614d200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6148105df0 0x7f61481036d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:40.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f614e600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f614810e910 0x7f6148103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:40.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f614d200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6148105df0 0x7f61481036d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:53098/0 (socket says 172.21.15.47:53098) 2024-05-14T12:22:40.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f614d200700 1 -- 172.21.15.47:0/1413470033 learned_addr learned my addr 172.21.15.47:0/1413470033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:40.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.837+0000 7f614dc00700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481054a0 0x7f6148103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:40.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f614e600700 1 -- 172.21.15.47:0/1413470033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481054a0 msgr2=0x7f6148103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f614e600700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61481054a0 0x7f6148103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f614e600700 1 -- 172.21.15.47:0/1413470033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6148105df0 msgr2=0x7f61481036d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f614e600700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6148105df0 0x7f61481036d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f614e600700 1 -- 172.21.15.47:0/1413470033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61481a91a0 con 0x7f614810e910 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f614d200700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6148105df0 0x7f61481036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f614e600700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f614810e910 0x7f6148103c10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f614000efc0 tx=0x7f614000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.838+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400092e0 con 0x7f614810e910 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.839+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6140004bb0 con 0x7f614810e910 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.839+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61481a9430 con 0x7f614810e910 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.839+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140004020 con 0x7f614810e910 2024-05-14T12:22:40.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.839+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61481a9970 con 0x7f614810e910 2024-05-14T12:22:40.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.840+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6148063ed0 con 0x7f614810e910 2024-05-14T12:22:40.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.845+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f614001b030 con 0x7f614810e910 2024-05-14T12:22:40.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.846+0000 7f6146000700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f61300b2990 0x7f61300b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:40.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.846+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f61400e2740 con 0x7f614810e910 2024-05-14T12:22:40.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.847+0000 7f614dc00700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f61300b2990 0x7f61300b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:40.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.847+0000 7f6146000700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] conn(0x7f61300bc5a0 0x7f61300bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:40.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.847+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 --> [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6140011e50 con 0x7f61300bc5a0 2024-05-14T12:22:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.847+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f61400e2af0 con 0x7f614810e910 2024-05-14T12:22:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.847+0000 7f614d200700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] conn(0x7f61300bc5a0 0x7f61300bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.848+0000 7f614dc00700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f61300b2990 0x7f61300b4ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f613c00b2e0 tx=0x7f613c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.848+0000 7f614d200700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] conn(0x7f61300bc5a0 0x7f61300bea90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.849+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== osd.0 v2:172.21.15.47:6802/2686634727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6140011e50 con 0x7f61300bc5a0 2024-05-14T12:22:40.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.867+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 --> [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6148064350 con 0x7f61300bc5a0 2024-05-14T12:22:40.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.868+0000 7f6146000700 1 -- 172.21.15.47:0/1413470033 <== osd.0 v2:172.21.15.47:6802/2686634727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6148064350 con 0x7f61300bc5a0 2024-05-14T12:22:40.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.869+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] conn(0x7f61300bc5a0 msgr2=0x7f61300bea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:40.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.869+0000 7f6150600700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] conn(0x7f61300bc5a0 0x7f61300bea90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.869+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f61300b2990 msgr2=0x7f61300b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.869+0000 7f6150600700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f61300b2990 0x7f61300b4ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f613c00b2e0 tx=0x7f613c005fd0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.869+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f614810e910 msgr2=0x7f6148103c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.869+0000 7f6150600700 1 --2- 172.21.15.47:0/1413470033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f614810e910 0x7f6148103c10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f614000efc0 tx=0x7f614000c3a0 comp rx=0 tx=0).stop 2024-05-14T12:22:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.869+0000 7f614e600700 1 -- 172.21.15.47:0/1413470033 reap_dead start 2024-05-14T12:22:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.870+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 shutdown_connections 2024-05-14T12:22:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.870+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 >> 172.21.15.47:0/1413470033 conn(0x7f61480fedc0 msgr2=0x7f61480ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.870+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 shutdown_connections 2024-05-14T12:22:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.870+0000 7f6150600700 1 -- 172.21.15.47:0/1413470033 wait complete. 2024-05-14T12:22:41.645 INFO:teuthology.orchestra.run.smithi047.stdout:163208757320 2024-05-14T12:22:41.645 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-14T12:22:41.729 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:41 smithi047 ceph-mon[31254]: pgmap v375: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T12:22:41.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:41 smithi073 ceph-mon[35809]: pgmap v375: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T12:22:41.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:41 smithi066 ceph-mon[35981]: pgmap v375: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T12:22:41.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 -- 172.21.15.47:0/425657889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb45810e900 msgr2=0x7fb458110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:41.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 --2- 172.21.15.47:0/425657889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb45810e900 0x7fb458110dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb450009f90 tx=0x7fb45000b330 comp rx=0 tx=0).stop 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 -- 172.21.15.47:0/425657889 shutdown_connections 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 --2- 172.21.15.47:0/425657889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb45810e900 0x7fb458110dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 --2- 172.21.15.47:0/425657889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb458105520 0x7fb458105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 --2- 172.21.15.47:0/425657889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb458105e70 0x7fb45810e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 -- 172.21.15.47:0/425657889 >> 172.21.15.47:0/425657889 conn(0x7fb4580fedc0 msgr2=0x7fb4581011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 -- 172.21.15.47:0/425657889 shutdown_connections 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.940+0000 7fb45fe00700 1 -- 172.21.15.47:0/425657889 wait complete. 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.942+0000 7fb45fe00700 1 Processor -- start 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.942+0000 7fb45fe00700 1 -- start start 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.942+0000 7fb45fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458105520 0x7fb45819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.942+0000 7fb45fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb458105e70 0x7fb45819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb45810e900 0x7fb45819f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:41.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45fe00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb458114440 con 0x7fb458105e70 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45fe00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581142c0 con 0x7fb45810e900 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45fe00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581145c0 con 0x7fb458105520 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458105520 0x7fb45819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45de00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb45810e900 0x7fb45819f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458105520 0x7fb45819ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:41076/0 (socket says 172.21.15.47:41076) 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 -- 172.21.15.47:0/3976048902 learned_addr learned my addr 172.21.15.47:0/3976048902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45ca00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb458105e70 0x7fb45819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 -- 172.21.15.47:0/3976048902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb45810e900 msgr2=0x7fb45819f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb45810e900 0x7fb45819f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 -- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb458105e70 msgr2=0x7fb45819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb458105e70 0x7fb45819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.943+0000 7fb45d400700 1 -- 172.21.15.47:0/3976048902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45819fc20 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.944+0000 7fb45d400700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458105520 0x7fb45819ad50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00ec10 tx=0x7fb44c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.944+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00cc90 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.944+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb44c00ce30 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.944+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c010430 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.944+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45819ff10 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.944+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4581a7830 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.945+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4580ffdd0 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.949+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb44c004000 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.950+0000 7fb456000700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4400b2990 0x7fb4400b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.951+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb44c0e2a30 con 0x7fb458105520 2024-05-14T12:22:41.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.951+0000 7fb45ca00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4400b2990 0x7fb4400b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:41.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.951+0000 7fb456000700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] conn(0x7fb4400bc5a0 0x7fb4400bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:41.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.951+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 --> [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb44c025ea0 con 0x7fb4400bc5a0 2024-05-14T12:22:41.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.951+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fb44c0e2de0 con 0x7fb458105520 2024-05-14T12:22:41.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.951+0000 7fb45de00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] conn(0x7fb4400bc5a0 0x7fb4400bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:41.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.952+0000 7fb45ca00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4400b2990 0x7fb4400b4ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb444009680 tx=0x7fb444009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:41.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.952+0000 7fb45de00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] conn(0x7fb4400bc5a0 0x7fb4400bea90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.953+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== osd.3 v2:172.21.15.47:6810/2176301728 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb44c025ea0 con 0x7fb4400bc5a0 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.972+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 --> [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb45806be30 con 0x7fb4400bc5a0 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.972+0000 7fb456000700 1 -- 172.21.15.47:0/3976048902 <== osd.3 v2:172.21.15.47:6810/2176301728 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb45806be30 con 0x7fb4400bc5a0 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] conn(0x7fb4400bc5a0 msgr2=0x7fb4400bea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] conn(0x7fb4400bc5a0 0x7fb4400bea90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4400b2990 msgr2=0x7fb4400b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4400b2990 0x7fb4400b4ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb444009680 tx=0x7fb444009260 comp rx=0 tx=0).stop 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458105520 msgr2=0x7fb45819ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 --2- 172.21.15.47:0/3976048902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458105520 0x7fb45819ad50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00ec10 tx=0x7fb44c00ef20 comp rx=0 tx=0).stop 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45de00700 1 -- 172.21.15.47:0/3976048902 reap_dead start 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 shutdown_connections 2024-05-14T12:22:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 >> 172.21.15.47:0/3976048902 conn(0x7fb4580fedc0 msgr2=0x7fb4580ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 shutdown_connections 2024-05-14T12:22:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:40.973+0000 7fb45fe00700 1 -- 172.21.15.47:0/3976048902 wait complete. 2024-05-14T12:22:42.869 INFO:teuthology.orchestra.run.smithi047.stdout:111669149778 2024-05-14T12:22:42.869 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-14T12:22:43.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.132+0000 7f1673e00700 1 -- 172.21.15.47:0/3683507145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1674106620 msgr2=0x7f1674106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.132+0000 7f1673e00700 1 --2- 172.21.15.47:0/3683507145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1674106620 0x7f1674106a30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16640099c0 tx=0x7f1664009cd0 comp rx=0 tx=0).stop 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.132+0000 7f1673e00700 1 -- 172.21.15.47:0/3683507145 shutdown_connections 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.132+0000 7f1673e00700 1 --2- 172.21.15.47:0/3683507145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f167410b8a0 0x7f1674113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.132+0000 7f1673e00700 1 --2- 172.21.15.47:0/3683507145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1674106620 0x7f1674106a30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.132+0000 7f1673e00700 1 --2- 172.21.15.47:0/3683507145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f167410af50 0x7f167410b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.132+0000 7f1673e00700 1 -- 172.21.15.47:0/3683507145 >> 172.21.15.47:0/3683507145 conn(0x7f1674102030 msgr2=0x7f1674104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.133+0000 7f1673e00700 1 -- 172.21.15.47:0/3683507145 shutdown_connections 2024-05-14T12:22:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.133+0000 7f1673e00700 1 -- 172.21.15.47:0/3683507145 wait complete. 2024-05-14T12:22:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.134+0000 7f1673e00700 1 Processor -- start 2024-05-14T12:22:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.134+0000 7f1673e00700 1 -- start start 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1673e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1674106620 0x7f167419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1673e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f167410af50 0x7f167419d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1673e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f167410b8a0 0x7f16741a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1673e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1674116520 con 0x7f167410b8a0 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1673e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f16741163a0 con 0x7f1674106620 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1673e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16741166a0 con 0x7f167410af50 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1672a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1674106620 0x7f167419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1672a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1674106620 0x7f167419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:53116/0 (socket says 172.21.15.47:53116) 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1672a00700 1 -- 172.21.15.47:0/507729099 learned_addr learned my addr 172.21.15.47:0/507729099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1673400700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f167410b8a0 0x7f16741a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.135+0000 7f1672000700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f167410af50 0x7f167419d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.136+0000 7f1672a00700 1 -- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f167410af50 msgr2=0x7f167419d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.136+0000 7f1672a00700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f167410af50 0x7f167419d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.136+0000 7f1672a00700 1 -- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f167410b8a0 msgr2=0x7f16741a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.136+0000 7f1672a00700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f167410b8a0 0x7f16741a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.136+0000 7f1672a00700 1 -- 172.21.15.47:0/507729099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16741a1d20 con 0x7f1674106620 2024-05-14T12:22:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.136+0000 7f1672000700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f167410af50 0x7f167419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.136+0000 7f1672a00700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1674106620 0x7f167419ce50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1664005910 tx=0x7f1664004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.137+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664026070 con 0x7f1674106620 2024-05-14T12:22:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.137+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1664003c70 con 0x7f1674106620 2024-05-14T12:22:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.137+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166400fa40 con 0x7f1674106620 2024-05-14T12:22:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.137+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16741a1fb0 con 0x7f1674106620 2024-05-14T12:22:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.137+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16741a2440 con 0x7f1674106620 2024-05-14T12:22:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.138+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1674063f50 con 0x7f1674106620 2024-05-14T12:22:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.141+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1664029070 con 0x7f1674106620 2024-05-14T12:22:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.143+0000 7f166b400700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f16580b2910 0x7f16580b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.143+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f16640e34f0 con 0x7f1674106620 2024-05-14T12:22:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.143+0000 7f1672000700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f16580b2910 0x7f16580b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.143+0000 7f166b400700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] conn(0x7f16580bc520 0x7f16580bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.143+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 --> [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f166400eea0 con 0x7f16580bc520 2024-05-14T12:22:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.143+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f16640e38a0 con 0x7f1674106620 2024-05-14T12:22:43.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.144+0000 7f1672000700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f16580b2910 0x7f16580b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1674109d90 tx=0x7f1660009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:43.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.145+0000 7f1673400700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] conn(0x7f16580bc520 0x7f16580bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:43.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.146+0000 7f1673400700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] conn(0x7f16580bc520 0x7f16580bea10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:43.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.147+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== osd.8 v2:172.21.15.73:6816/1194835774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f166400eea0 con 0x7f16580bc520 2024-05-14T12:22:43.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 --> [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1674064380 con 0x7f16580bc520 2024-05-14T12:22:43.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f166b400700 1 -- 172.21.15.47:0/507729099 <== osd.8 v2:172.21.15.73:6816/1194835774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1674064380 con 0x7f16580bc520 2024-05-14T12:22:43.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] conn(0x7f16580bc520 msgr2=0x7f16580bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:43.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] conn(0x7f16580bc520 0x7f16580bea10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f16580b2910 msgr2=0x7f16580b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f16580b2910 0x7f16580b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1674109d90 tx=0x7f1660009260 comp rx=0 tx=0).stop 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1674106620 msgr2=0x7f167419ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 --2- 172.21.15.47:0/507729099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1674106620 0x7f167419ce50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1664005910 tx=0x7f1664004270 comp rx=0 tx=0).stop 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673400700 1 -- 172.21.15.47:0/507729099 reap_dead start 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 shutdown_connections 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 >> 172.21.15.47:0/507729099 conn(0x7f1674102030 msgr2=0x7f167410a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 shutdown_connections 2024-05-14T12:22:43.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:43.166+0000 7f1673e00700 1 -- 172.21.15.47:0/507729099 wait complete. 2024-05-14T12:22:43.402 INFO:teuthology.orchestra.run.smithi047.stdout:317827579941 2024-05-14T12:22:43.402 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-14T12:22:43.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:43 smithi047 ceph-mon[31254]: pgmap v376: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:43.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:43 smithi073 ceph-mon[35809]: pgmap v376: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:43 smithi066 ceph-mon[35981]: pgmap v376: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:44.151 INFO:teuthology.orchestra.run.smithi047.stdout:34359738469 2024-05-14T12:22:44.151 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.437+0000 7fc8e4400700 1 -- 172.21.15.47:0/1043348637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc1030c0 msgr2=0x7fc8dc1034d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.437+0000 7fc8e4400700 1 --2- 172.21.15.47:0/1043348637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc1030c0 0x7fc8dc1034d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009990 tx=0x7fc8d0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.437+0000 7fc8e4400700 1 -- 172.21.15.47:0/1043348637 shutdown_connections 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.437+0000 7fc8e4400700 1 --2- 172.21.15.47:0/1043348637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8dc110c70 0x7fc8dc113090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.437+0000 7fc8e4400700 1 --2- 172.21.15.47:0/1043348637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc1030c0 0x7fc8dc1034d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.437+0000 7fc8e4400700 1 --2- 172.21.15.47:0/1043348637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8dc103a10 0x7fc8dc110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.437+0000 7fc8e4400700 1 -- 172.21.15.47:0/1043348637 >> 172.21.15.47:0/1043348637 conn(0x7fc8dc0fedc0 msgr2=0x7fc8dc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.438+0000 7fc8e4400700 1 -- 172.21.15.47:0/1043348637 shutdown_connections 2024-05-14T12:22:44.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.438+0000 7fc8e4400700 1 -- 172.21.15.47:0/1043348637 wait complete. 2024-05-14T12:22:44.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.439+0000 7fc8e4400700 1 Processor -- start 2024-05-14T12:22:44.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.439+0000 7fc8e4400700 1 -- start start 2024-05-14T12:22:44.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e4400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8dc1030c0 0x7fc8dc19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:44.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e4400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8dc103a10 0x7fc8dc19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:44.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e4400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc110c70 0x7fc8dc1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:44.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e4400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc1166d0 con 0x7fc8dc110c70 2024-05-14T12:22:44.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e4400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc116550 con 0x7fc8dc1030c0 2024-05-14T12:22:44.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e4400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc116850 con 0x7fc8dc103a10 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e1000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8dc103a10 0x7fc8dc19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e1000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8dc103a10 0x7fc8dc19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:41138/0 (socket says 172.21.15.47:41138) 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e1000700 1 -- 172.21.15.47:0/1622032625 learned_addr learned my addr 172.21.15.47:0/1622032625 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.440+0000 7fc8e2400700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc110c70 0x7fc8dc1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8e1a00700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8dc1030c0 0x7fc8dc19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8e1000700 1 -- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8dc1030c0 msgr2=0x7fc8dc19d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8e1000700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8dc1030c0 0x7fc8dc19d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8e1000700 1 -- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc110c70 msgr2=0x7fc8dc1a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8e1000700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc110c70 0x7fc8dc1a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8e1000700 1 -- 172.21.15.47:0/1622032625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc1a1f30 con 0x7fc8dc103a10 2024-05-14T12:22:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8e1000700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8dc103a10 0x7fc8dc19d600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800e9f0 tx=0x7fc8c800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:44.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.441+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800cbd0 con 0x7fc8dc103a10 2024-05-14T12:22:44.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.442+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc1a2220 con 0x7fc8dc103a10 2024-05-14T12:22:44.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.442+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c800cd70 con 0x7fc8dc103a10 2024-05-14T12:22:44.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.442+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc1a9b40 con 0x7fc8dc103a10 2024-05-14T12:22:44.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.442+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8005650 con 0x7fc8dc103a10 2024-05-14T12:22:44.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.443+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8bc001030 con 0x7fc8dc103a10 2024-05-14T12:22:44.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.446+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc8c8004750 con 0x7fc8dc103a10 2024-05-14T12:22:44.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.447+0000 7fc8da000700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc8c40b2990 0x7fc8c40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:44.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.447+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc8c80e2b20 con 0x7fc8dc103a10 2024-05-14T12:22:44.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.448+0000 7fc8e1a00700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc8c40b2990 0x7fc8c40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:44.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.448+0000 7fc8da000700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] conn(0x7fc8c40bc5a0 0x7fc8c40bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:44.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.448+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 --> [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8c8026ea0 con 0x7fc8c40bc5a0 2024-05-14T12:22:44.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.448+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fc8c80e2f10 con 0x7fc8dc103a10 2024-05-14T12:22:44.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.448+0000 7fc8e2400700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] conn(0x7fc8c40bc5a0 0x7fc8c40bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:44.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.449+0000 7fc8e1a00700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc8c40b2990 0x7fc8c40b4ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000b2e0 tx=0x7fc8d0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:44.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.449+0000 7fc8e2400700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] conn(0x7fc8c40bc5a0 0x7fc8c40bea90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:44.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.450+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== osd.10 v2:172.21.15.66:6824/609811860 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8c8026ea0 con 0x7fc8c40bc5a0 2024-05-14T12:22:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.470+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 --> [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8bc002e60 con 0x7fc8c40bc5a0 2024-05-14T12:22:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.470+0000 7fc8da000700 1 -- 172.21.15.47:0/1622032625 <== osd.10 v2:172.21.15.66:6824/609811860 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc8bc002e60 con 0x7fc8c40bc5a0 2024-05-14T12:22:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.471+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] conn(0x7fc8c40bc5a0 msgr2=0x7fc8c40bea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.471+0000 7fc8e4400700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] conn(0x7fc8c40bc5a0 0x7fc8c40bea90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.471+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc8c40b2990 msgr2=0x7fc8c40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.471+0000 7fc8e4400700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc8c40b2990 0x7fc8c40b4ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000b2e0 tx=0x7fc8d0005fb0 comp rx=0 tx=0).stop 2024-05-14T12:22:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.471+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8dc103a10 msgr2=0x7fc8dc19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.471+0000 7fc8e4400700 1 --2- 172.21.15.47:0/1622032625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8dc103a10 0x7fc8dc19d600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800e9f0 tx=0x7fc8c800ed00 comp rx=0 tx=0).stop 2024-05-14T12:22:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.471+0000 7fc8e2400700 1 -- 172.21.15.47:0/1622032625 reap_dead start 2024-05-14T12:22:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.472+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 shutdown_connections 2024-05-14T12:22:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.472+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 >> 172.21.15.47:0/1622032625 conn(0x7fc8dc0fedc0 msgr2=0x7fc8dc112790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.472+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 shutdown_connections 2024-05-14T12:22:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:44.472+0000 7fc8e4400700 1 -- 172.21.15.47:0/1622032625 wait complete. 2024-05-14T12:22:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 -- 172.21.15.47:0/747163705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9800075d30 msgr2=0x7f9800076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 --2- 172.21.15.47:0/747163705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9800075d30 0x7f9800076140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97f00098f0 tx=0x7f97f0009c00 comp rx=0 tx=0).stop 2024-05-14T12:22:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 -- 172.21.15.47:0/747163705 shutdown_connections 2024-05-14T12:22:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 --2- 172.21.15.47:0/747163705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9800110ba0 0x7f9800113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 --2- 172.21.15.47:0/747163705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9800075d30 0x7f9800076140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 --2- 172.21.15.47:0/747163705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800076680 0x7f9800110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 -- 172.21.15.47:0/747163705 >> 172.21.15.47:0/747163705 conn(0x7f9800100040 msgr2=0x7f9800102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:45.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 -- 172.21.15.47:0/747163705 shutdown_connections 2024-05-14T12:22:45.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.380+0000 7f9804a00700 1 -- 172.21.15.47:0/747163705 wait complete. 2024-05-14T12:22:45.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.381+0000 7f9804a00700 1 Processor -- start 2024-05-14T12:22:45.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.381+0000 7f9804a00700 1 -- start start 2024-05-14T12:22:45.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f9804a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9800075d30 0x7f980019d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:45.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f9804a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800076680 0x7f980019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:45.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f9804a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9800110ba0 0x7f98001a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:45.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f9804a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98001166e0 con 0x7f9800075d30 2024-05-14T12:22:45.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f9804a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9800116560 con 0x7f9800076680 2024-05-14T12:22:45.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f9804a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9800116860 con 0x7f9800110ba0 2024-05-14T12:22:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f97fde00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9800075d30 0x7f980019d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f97fde00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9800075d30 0x7f980019d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34864/0 (socket says 172.21.15.47:34864) 2024-05-14T12:22:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f97fde00700 1 -- 172.21.15.47:0/3254141741 learned_addr learned my addr 172.21.15.47:0/3254141741 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f97fd400700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800076680 0x7f980019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.382+0000 7f97fe800700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9800110ba0 0x7f98001a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:45.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.383+0000 7f97fde00700 1 -- 172.21.15.47:0/3254141741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9800110ba0 msgr2=0x7f98001a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.383+0000 7f97fde00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9800110ba0 0x7f98001a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.383+0000 7f97fde00700 1 -- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800076680 msgr2=0x7f980019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.383+0000 7f97fde00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800076680 0x7f980019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.383+0000 7f97fde00700 1 -- 172.21.15.47:0/3254141741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98001a1f80 con 0x7f9800075d30 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.383+0000 7f97fde00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9800075d30 0x7f980019d0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009230 tx=0x7f97f00094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.383+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0005140 con 0x7f9800075d30 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.384+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98001a2210 con 0x7f9800075d30 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.384+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f000b560 con 0x7f9800075d30 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.384+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0003a80 con 0x7f9800075d30 2024-05-14T12:22:45.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.385+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98001a26f0 con 0x7f9800075d30 2024-05-14T12:22:45.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.386+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9800063f50 con 0x7f9800075d30 2024-05-14T12:22:45.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.388+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f97f000ba10 con 0x7f9800075d30 2024-05-14T12:22:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.390+0000 7f97f6a00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f97e40b2910 0x7f97e40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.391+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f97f00e33a0 con 0x7f9800075d30 2024-05-14T12:22:45.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.391+0000 7f97fd400700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f97e40b2910 0x7f97e40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.391+0000 7f97f6a00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] conn(0x7f97e40bc520 0x7f97e40bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.391+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 --> [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97f000bdb0 con 0x7f97e40bc520 2024-05-14T12:22:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.391+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f97f00ea050 con 0x7f9800075d30 2024-05-14T12:22:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.391+0000 7f97fe800700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] conn(0x7f97e40bc520 0x7f97e40bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:45.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.392+0000 7f97fd400700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f97e40b2910 0x7f97e40b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98001034d0 tx=0x7f97ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.392+0000 7f97fe800700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] conn(0x7f97e40bc520 0x7f97e40bea10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:45.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.393+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== osd.4 v2:172.21.15.66:6808/1977323226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97f000bdb0 con 0x7f97e40bc520 2024-05-14T12:22:45.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.411+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 --> [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f98000643d0 con 0x7f97e40bc520 2024-05-14T12:22:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.412+0000 7f97f6a00700 1 -- 172.21.15.47:0/3254141741 <== osd.4 v2:172.21.15.66:6808/1977323226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f98000643d0 con 0x7f97e40bc520 2024-05-14T12:22:45.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] conn(0x7f97e40bc520 msgr2=0x7f97e40bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] conn(0x7f97e40bc520 0x7f97e40bea10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f97e40b2910 msgr2=0x7f97e40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f97e40b2910 0x7f97e40b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98001034d0 tx=0x7f97ec00b410 comp rx=0 tx=0).stop 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9800075d30 msgr2=0x7f980019d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 --2- 172.21.15.47:0/3254141741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9800075d30 0x7f980019d0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009230 tx=0x7f97f00094a0 comp rx=0 tx=0).stop 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f97fe800700 1 -- 172.21.15.47:0/3254141741 reap_dead start 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 shutdown_connections 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 >> 172.21.15.47:0/3254141741 conn(0x7f9800100040 msgr2=0x7f9800100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 shutdown_connections 2024-05-14T12:22:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:45.413+0000 7f9804a00700 1 -- 172.21.15.47:0/3254141741 wait complete. 2024-05-14T12:22:45.553 INFO:teuthology.orchestra.run.smithi047.stdout:292057776170 2024-05-14T12:22:45.553 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-14T12:22:45.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:45 smithi047 ceph-mon[31254]: pgmap v377: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-14T12:22:45.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:45 smithi073 ceph-mon[35809]: pgmap v377: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-14T12:22:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:45 smithi066 ceph-mon[35981]: pgmap v377: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-14T12:22:46.303 INFO:teuthology.orchestra.run.smithi047.stdout:137438953550 2024-05-14T12:22:46.303 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-14T12:22:46.962 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:46.963 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:47.334 INFO:teuthology.orchestra.run.smithi047.stdout:244813135927 2024-05-14T12:22:47.334 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-14T12:22:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:47.613 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:47.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:47 smithi047 ceph-mon[31254]: pgmap v378: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:22:47.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 -- 172.21.15.47:0/694217588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c1045d0 msgr2=0x7fd22c1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:47.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 --2- 172.21.15.47:0/694217588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c1045d0 0x7fd22c1049e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0099c0 tx=0x7fd21c009cd0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 -- 172.21.15.47:0/694217588 shutdown_connections 2024-05-14T12:22:47.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 --2- 172.21.15.47:0/694217588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd22c109850 0x7fd22c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 --2- 172.21.15.47:0/694217588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c1045d0 0x7fd22c1049e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 --2- 172.21.15.47:0/694217588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22c108f00 0x7fd22c109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 -- 172.21.15.47:0/694217588 >> 172.21.15.47:0/694217588 conn(0x7fd22c0ffea0 msgr2=0x7fd22c1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:47.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 -- 172.21.15.47:0/694217588 shutdown_connections 2024-05-14T12:22:47.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.717+0000 7fd231200700 1 -- 172.21.15.47:0/694217588 wait complete. 2024-05-14T12:22:47.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.719+0000 7fd231200700 1 Processor -- start 2024-05-14T12:22:47.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.719+0000 7fd231200700 1 -- start start 2024-05-14T12:22:47.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.719+0000 7fd231200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd22c1045d0 0x7fd22c19ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:47.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.719+0000 7fd231200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c108f00 0x7fd22c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd231200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22c109850 0x7fd22c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd231200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c114480 con 0x7fd22c108f00 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd231200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c114300 con 0x7fd22c109850 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd231200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c114600 con 0x7fd22c1045d0 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd229e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd22c1045d0 0x7fd22c19ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd229400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c108f00 0x7fd22c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd229e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd22c1045d0 0x7fd22c19ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:41156/0 (socket says 172.21.15.47:41156) 2024-05-14T12:22:47.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd229e00700 1 -- 172.21.15.47:0/3598590586 learned_addr learned my addr 172.21.15.47:0/3598590586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.720+0000 7fd22a800700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22c109850 0x7fd22c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd22a800700 1 -- 172.21.15.47:0/3598590586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd22c1045d0 msgr2=0x7fd22c19ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd22a800700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd22c1045d0 0x7fd22c19ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd22a800700 1 -- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c108f00 msgr2=0x7fd22c19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd22a800700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c108f00 0x7fd22c19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd22a800700 1 -- 172.21.15.47:0/3598590586 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22c19fce0 con 0x7fd22c109850 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd229e00700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd22c1045d0 0x7fd22c19ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd229400700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd22c108f00 0x7fd22c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd22a800700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22c109850 0x7fd22c19f640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd22400efc0 tx=0x7fd22400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224004bb0 con 0x7fd22c109850 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd224004d50 con 0x7fd22c109850 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224004280 con 0x7fd22c109850 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.721+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22c19ffd0 con 0x7fd22c109850 2024-05-14T12:22:47.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.722+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22c076b00 con 0x7fd22c109850 2024-05-14T12:22:47.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.722+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd22c063f50 con 0x7fd22c109850 2024-05-14T12:22:47.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.726+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd224003a00 con 0x7fd22c109850 2024-05-14T12:22:47.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.727+0000 7fd222a00700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2100b2990 0x7fd2100b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:47.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.728+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd2240e5c30 con 0x7fd22c109850 2024-05-14T12:22:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.728+0000 7fd229e00700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2100b2990 0x7fd2100b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.728+0000 7fd222a00700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] conn(0x7fd2100bc5a0 0x7fd2100bea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.728+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 --> [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2100bf160 con 0x7fd2100bc5a0 2024-05-14T12:22:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.728+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fd2240e6060 con 0x7fd22c109850 2024-05-14T12:22:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.728+0000 7fd229400700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] conn(0x7fd2100bc5a0 0x7fd2100bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:47.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.729+0000 7fd229e00700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2100b2990 0x7fd2100b4ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd21c003760 tx=0x7fd21c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:47.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.729+0000 7fd229400700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] conn(0x7fd2100bc5a0 0x7fd2100bea90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:47.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.730+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== osd.7 v2:172.21.15.66:6816/1666910569 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2100bf160 con 0x7fd2100bc5a0 2024-05-14T12:22:47.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:47 smithi073 ceph-mon[35809]: pgmap v378: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:22:47.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.751+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 --> [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd22c064350 con 0x7fd2100bc5a0 2024-05-14T12:22:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.752+0000 7fd222a00700 1 -- 172.21.15.47:0/3598590586 <== osd.7 v2:172.21.15.66:6816/1666910569 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd22c064350 con 0x7fd2100bc5a0 2024-05-14T12:22:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] conn(0x7fd2100bc5a0 msgr2=0x7fd2100bea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:47.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] conn(0x7fd2100bc5a0 0x7fd2100bea90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2100b2990 msgr2=0x7fd2100b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2100b2990 0x7fd2100b4ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd21c003760 tx=0x7fd21c01a040 comp rx=0 tx=0).stop 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22c109850 msgr2=0x7fd22c19f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 --2- 172.21.15.47:0/3598590586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd22c109850 0x7fd22c19f640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd22400efc0 tx=0x7fd22400c3a0 comp rx=0 tx=0).stop 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd22a800700 1 -- 172.21.15.47:0/3598590586 reap_dead start 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 shutdown_connections 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 >> 172.21.15.47:0/3598590586 conn(0x7fd22c0ffea0 msgr2=0x7fd22c10a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:47.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 shutdown_connections 2024-05-14T12:22:47.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:47.753+0000 7fd231200700 1 -- 172.21.15.47:0/3598590586 wait complete. 2024-05-14T12:22:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:47 smithi066 ceph-mon[35981]: pgmap v378: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:22:49.220 INFO:teuthology.orchestra.run.smithi047.stdout:214748364861 2024-05-14T12:22:49.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-14T12:22:49.716 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:49 smithi047 ceph-mon[31254]: pgmap v379: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T12:22:49.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:49 smithi073 ceph-mon[35809]: pgmap v379: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T12:22:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:49 smithi066 ceph-mon[35981]: pgmap v379: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T12:22:51.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:51 smithi073 ceph-mon[35809]: pgmap v380: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:22:51.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:51 smithi047 ceph-mon[31254]: pgmap v380: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:22:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:51 smithi066 ceph-mon[35981]: pgmap v380: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:22:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:53.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:53 smithi073 ceph-mon[35809]: pgmap v381: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:22:53.799 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:53 smithi047 ceph-mon[31254]: pgmap v381: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:22:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:53 smithi066 ceph-mon[35981]: pgmap v381: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:22:54.279 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:22:55.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 -- 172.21.15.47:0/1731140194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c106ed0 msgr2=0x7f199c113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:55.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 --2- 172.21.15.47:0/1731140194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c106ed0 0x7f199c113360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f199400b0a0 tx=0x7f199400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 -- 172.21.15.47:0/1731140194 shutdown_connections 2024-05-14T12:22:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 --2- 172.21.15.47:0/1731140194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c106ed0 0x7f199c113360 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 --2- 172.21.15.47:0/1731140194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c10c5c0 0x7f199c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 --2- 172.21.15.47:0/1731140194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c106580 0x7f199c106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 -- 172.21.15.47:0/1731140194 >> 172.21.15.47:0/1731140194 conn(0x7f199c102080 msgr2=0x7f199c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 -- 172.21.15.47:0/1731140194 shutdown_connections 2024-05-14T12:22:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.104+0000 7f19a1800700 1 -- 172.21.15.47:0/1731140194 wait complete. 2024-05-14T12:22:55.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.105+0000 7f19a1800700 1 Processor -- start 2024-05-14T12:22:55.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.105+0000 7f19a1800700 1 -- start start 2024-05-14T12:22:55.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f19a1800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c106580 0x7f199c19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f19a1800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c106ed0 0x7f199c19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f19a1800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c10c5c0 0x7f199c1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f19a1800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f199c116740 con 0x7f199c10c5c0 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f19a1800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1165c0 con 0x7f199c106ed0 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f19a1800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1168c0 con 0x7f199c106580 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f199b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c10c5c0 0x7f199c1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f199aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c106580 0x7f199c19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f199b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c10c5c0 0x7f199c1a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47496/0 (socket says 172.21.15.47:47496) 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f199b400700 1 -- 172.21.15.47:0/3212826901 learned_addr learned my addr 172.21.15.47:0/3212826901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.106+0000 7f199a000700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c106ed0 0x7f199c19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f199b400700 1 -- 172.21.15.47:0/3212826901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c106580 msgr2=0x7f199c19d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f199b400700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c106580 0x7f199c19d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f199b400700 1 -- 172.21.15.47:0/3212826901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c106ed0 msgr2=0x7f199c19d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:55.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f199b400700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c106ed0 0x7f199c19d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f199b400700 1 -- 172.21.15.47:0/3212826901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c1a1f00 con 0x7f199c10c5c0 2024-05-14T12:22:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f199aa00700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c106580 0x7f199c19d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f199b400700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c10c5c0 0x7f199c1a1860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f199400b070 tx=0x7f1994009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.107+0000 7f1993400700 1 -- 172.21.15.47:0/3212826901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994021070 con 0x7f199c10c5c0 2024-05-14T12:22:55.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.108+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199c1a2190 con 0x7f199c10c5c0 2024-05-14T12:22:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.108+0000 7f1993400700 1 -- 172.21.15.47:0/3212826901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1994004e40 con 0x7f199c10c5c0 2024-05-14T12:22:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.108+0000 7f1993400700 1 -- 172.21.15.47:0/3212826901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994004630 con 0x7f199c10c5c0 2024-05-14T12:22:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.108+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199c1a9b10 con 0x7f199c10c5c0 2024-05-14T12:22:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.109+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199c10e980 con 0x7f199c10c5c0 2024-05-14T12:22:55.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.113+0000 7f1993400700 1 -- 172.21.15.47:0/3212826901 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1994007980 con 0x7f199c10c5c0 2024-05-14T12:22:55.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.114+0000 7f1993400700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19800b2910 0x7f19800b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:55.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.114+0000 7f1993400700 1 -- 172.21.15.47:0/3212826901 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f199400f020 con 0x7f199c10c5c0 2024-05-14T12:22:55.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.115+0000 7f199aa00700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19800b2910 0x7f19800b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:55.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.115+0000 7f199aa00700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19800b2910 0x7f19800b4e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f199c1079f0 tx=0x7f198c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.116+0000 7f1993400700 1 -- 172.21.15.47:0/3212826901 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f199402a020 con 0x7f199c10c5c0 2024-05-14T12:22:55.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.374+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f199c19e390 con 0x7f199c10c5c0 2024-05-14T12:22:55.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.375+0000 7f1993400700 1 -- 172.21.15.47:0/3212826901 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f199402e3e0 con 0x7f199c10c5c0 2024-05-14T12:22:55.375 INFO:teuthology.orchestra.run.smithi047.stdout:34359738471 2024-05-14T12:22:55.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19800b2910 msgr2=0x7f19800b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19800b2910 0x7f19800b4e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f199c1079f0 tx=0x7f198c009260 comp rx=0 tx=0).stop 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c10c5c0 msgr2=0x7f199c1a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c10c5c0 0x7f199c1a1860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f199400b070 tx=0x7f1994009c90 comp rx=0 tx=0).stop 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 shutdown_connections 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19800b2910 0x7f19800b4e20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c10c5c0 0x7f199c1a1860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f199c106580 0x7f199c19d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 --2- 172.21.15.47:0/3212826901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c106ed0 0x7f199c19d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.378+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 >> 172.21.15.47:0/3212826901 conn(0x7f199c102080 msgr2=0x7f199c104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.379+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 shutdown_connections 2024-05-14T12:22:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:55.379+0000 7f19a1800700 1 -- 172.21.15.47:0/3212826901 wait complete. 2024-05-14T12:22:55.731 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:55 smithi047 ceph-mon[31254]: pgmap v382: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:22:55.731 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:55 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3212826901' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T12:22:55.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:55 smithi073 ceph-mon[35809]: pgmap v382: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:22:55.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:55 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3212826901' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T12:22:55.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:55 smithi066 ceph-mon[35981]: pgmap v382: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:22:55.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:55 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3212826901' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T12:22:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 -- 172.21.15.47:0/1149431306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844108f20 msgr2=0x7f0844109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 --2- 172.21.15.47:0/1149431306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844108f20 0x7f0844109330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08300099c0 tx=0x7f0830009cd0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.702 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:22:56.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 -- 172.21.15.47:0/1149431306 shutdown_connections 2024-05-14T12:22:56.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 --2- 172.21.15.47:0/1149431306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0844109870 0x7f08441111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 --2- 172.21.15.47:0/1149431306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08441045f0 0x7f0844104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 --2- 172.21.15.47:0/1149431306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844108f20 0x7f0844109330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 -- 172.21.15.47:0/1149431306 >> 172.21.15.47:0/1149431306 conn(0x7f0844100040 msgr2=0x7f0844102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:56.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.702+0000 7f084aa00700 1 -- 172.21.15.47:0/1149431306 shutdown_connections 2024-05-14T12:22:56.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.703+0000 7f084aa00700 1 -- 172.21.15.47:0/1149431306 wait complete. 2024-05-14T12:22:56.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.704+0000 7f084aa00700 1 Processor -- start 2024-05-14T12:22:56.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.704+0000 7f084aa00700 1 -- start start 2024-05-14T12:22:56.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.704+0000 7f084aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08441045f0 0x7f084419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:56.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.704+0000 7f084aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0844108f20 0x7f084419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:56.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.704+0000 7f084aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844109870 0x7f084419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:56.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.704+0000 7f084aa00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08441144d0 con 0x7f08441045f0 2024-05-14T12:22:56.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f084aa00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0844114350 con 0x7f0844108f20 2024-05-14T12:22:56.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f084aa00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0844114650 con 0x7f0844109870 2024-05-14T12:22:56.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0844108f20 0x7f084419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:56.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08441045f0 0x7f084419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:56.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0848a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844109870 0x7f084419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:56.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08441045f0 0x7f084419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47516/0 (socket says 172.21.15.47:47516) 2024-05-14T12:22:56.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0848a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844109870 0x7f084419f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:40488/0 (socket says 172.21.15.47:40488) 2024-05-14T12:22:56.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843e00700 1 -- 172.21.15.47:0/3340588009 learned_addr learned my addr 172.21.15.47:0/3340588009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843400700 1 -- 172.21.15.47:0/3340588009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844109870 msgr2=0x7f084419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843400700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844109870 0x7f084419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843400700 1 -- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08441045f0 msgr2=0x7f084419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843400700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08441045f0 0x7f084419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0843400700 1 -- 172.21.15.47:0/3340588009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084419fd70 con 0x7f0844108f20 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.705+0000 7f0848a00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844109870 0x7f084419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.706+0000 7f0843400700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0844108f20 0x7f084419b440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08300098e0 tx=0x7f083001cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.706+0000 7f0840c00700 1 -- 172.21.15.47:0/3340588009 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830009e60 con 0x7f0844108f20 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.706+0000 7f0840c00700 1 -- 172.21.15.47:0/3340588009 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0830020030 con 0x7f0844108f20 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.706+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08441a0000 con 0x7f0844108f20 2024-05-14T12:22:56.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.706+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08440759f0 con 0x7f0844108f20 2024-05-14T12:22:56.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.706+0000 7f0840c00700 1 -- 172.21.15.47:0/3340588009 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830003a20 con 0x7f0844108f20 2024-05-14T12:22:56.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.707+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0844105aa0 con 0x7f0844108f20 2024-05-14T12:22:56.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.710+0000 7f0840c00700 1 -- 172.21.15.47:0/3340588009 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0830003bc0 con 0x7f0844108f20 2024-05-14T12:22:56.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.713+0000 7f0840c00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08280b2990 0x7f08280b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:56.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.713+0000 7f0840c00700 1 -- 172.21.15.47:0/3340588009 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f08300e2bc0 con 0x7f0844108f20 2024-05-14T12:22:56.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.713+0000 7f0843e00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08280b2990 0x7f08280b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:56.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.714+0000 7f0840c00700 1 -- 172.21.15.47:0/3340588009 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0830013070 con 0x7f0844108f20 2024-05-14T12:22:56.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.714+0000 7f0843e00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08280b2990 0x7f08280b4ea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0834009d20 tx=0x7f0834009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:56.793 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:22:56.807 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:22:56.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.978+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f084419c200 con 0x7f0844108f20 2024-05-14T12:22:56.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.978+0000 7f0840c00700 1 -- 172.21.15.47:0/3340588009 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f08300aa8e0 con 0x7f0844108f20 2024-05-14T12:22:56.978 INFO:teuthology.orchestra.run.smithi047.stdout:111669149781 2024-05-14T12:22:56.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08280b2990 msgr2=0x7f08280b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:56.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08280b2990 0x7f08280b4ea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0834009d20 tx=0x7f0834009260 comp rx=0 tx=0).stop 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0844108f20 msgr2=0x7f084419b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0844108f20 0x7f084419b440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08300098e0 tx=0x7f083001cac0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 shutdown_connections 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08280b2990 0x7f08280b4ea0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0844109870 0x7f084419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08441045f0 0x7f084419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 --2- 172.21.15.47:0/3340588009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0844108f20 0x7f084419b440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 >> 172.21.15.47:0/3340588009 conn(0x7f0844100040 msgr2=0x7f084410a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:56.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 shutdown_connections 2024-05-14T12:22:56.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:56.982+0000 7f084aa00700 1 -- 172.21.15.47:0/3340588009 wait complete. 2024-05-14T12:22:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:57 smithi066 ceph-mon[35981]: pgmap v383: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:57 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3340588009' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T12:22:57.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:57 smithi047 ceph-mon[31254]: pgmap v383: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:57.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:57.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:57.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:57 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3340588009' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T12:22:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:57 smithi073 ceph-mon[35809]: pgmap v383: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:22:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:57 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3340588009' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T12:22:58.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 -- 172.21.15.47:0/1385796183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a0110970 msgr2=0x7f74a0110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:58.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1385796183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a0110970 0x7f74a0110d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7490009990 tx=0x7f7490009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 -- 172.21.15.47:0/1385796183 shutdown_connections 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1385796183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a010b2e0 0x7f74a0117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1385796183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a0110970 0x7f74a0110d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1385796183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010a990 0x7f74a010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 -- 172.21.15.47:0/1385796183 >> 172.21.15.47:0/1385796183 conn(0x7f74a0077c80 msgr2=0x7f74a00780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 -- 172.21.15.47:0/1385796183 shutdown_connections 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.937+0000 7f74a5a00700 1 -- 172.21.15.47:0/1385796183 wait complete. 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 Processor -- start 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 -- start start 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a010a990 0x7f74a01a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010b2e0 0x7f74a01a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a0110970 0x7f74a01a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74a011aa70 con 0x7f74a010b2e0 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74a011a8f0 con 0x7f74a010a990 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f74a5a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f74a011abf0 con 0x7f74a0110970 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.939+0000 7f749ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a010a990 0x7f74a01a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010b2e0 0x7f74a01a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010b2e0 0x7f74a01a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39098/0 (socket says 172.21.15.47:39098) 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 -- 172.21.15.47:0/1661911220 learned_addr learned my addr 172.21.15.47:0/1661911220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a010a990 0x7f74a01a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54810/0 (socket says 172.21.15.47:54810) 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749f400700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a0110970 0x7f74a01a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 -- 172.21.15.47:0/1661911220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a0110970 msgr2=0x7f74a01a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a0110970 0x7f74a01a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 -- 172.21.15.47:0/1661911220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a010a990 msgr2=0x7f74a01a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a010a990 0x7f74a01a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 -- 172.21.15.47:0/1661911220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a01a6370 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749f400700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a0110970 0x7f74a01a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749ea00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a010a990 0x7f74a01a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.940+0000 7f749e000700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010b2e0 0x7f74a01a1a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f748c00e970 tx=0x7f748c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.941+0000 7f7497400700 1 -- 172.21.15.47:0/1661911220 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c004a30 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.941+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a01a6660 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.941+0000 7f7497400700 1 -- 172.21.15.47:0/1661911220 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f748c00cc90 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.941+0000 7f7497400700 1 -- 172.21.15.47:0/1661911220 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c005610 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.941+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a01adf80 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.942+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a010c080 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.945+0000 7f7497400700 1 -- 172.21.15.47:0/1661911220 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f748c00c7e0 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.946+0000 7f7497400700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74840b2910 0x7f74840b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.946+0000 7f7497400700 1 -- 172.21.15.47:0/1661911220 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f748c0e2520 con 0x7f74a010b2e0 2024-05-14T12:22:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.947+0000 7f749ea00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74840b2910 0x7f74840b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:58.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.947+0000 7f749ea00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74840b2910 0x7f74840b4e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f749000b2e0 tx=0x7f7490005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:58.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:57.951+0000 7f7497400700 1 -- 172.21.15.47:0/1661911220 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f748c0aa0a0 con 0x7f74a010b2e0 2024-05-14T12:22:58.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.200+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f74a01a2800 con 0x7f74a010b2e0 2024-05-14T12:22:58.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.200+0000 7f7497400700 1 -- 172.21.15.47:0/1661911220 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f748c0a99a0 con 0x7f74a010b2e0 2024-05-14T12:22:58.200 INFO:teuthology.orchestra.run.smithi047.stdout:77309411421 2024-05-14T12:22:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74840b2910 msgr2=0x7f74840b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74840b2910 0x7f74840b4e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f749000b2e0 tx=0x7f7490005960 comp rx=0 tx=0).stop 2024-05-14T12:22:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010b2e0 msgr2=0x7f74a01a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010b2e0 0x7f74a01a1a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f748c00e970 tx=0x7f748c00ec80 comp rx=0 tx=0).stop 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 shutdown_connections 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74840b2910 0x7f74840b4e20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a0110970 0x7f74a01a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74a010a990 0x7f74a01a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 --2- 172.21.15.47:0/1661911220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74a010b2e0 0x7f74a01a1a40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.203+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 >> 172.21.15.47:0/1661911220 conn(0x7f74a0077c80 msgr2=0x7f74a007bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.204+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 shutdown_connections 2024-05-14T12:22:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:58.204+0000 7f74a5a00700 1 -- 172.21.15.47:0/1661911220 wait complete. 2024-05-14T12:22:58.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:58 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:58 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1661911220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T12:22:58.817 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149778 got 111669149781 for osd.3 2024-05-14T12:22:58.817 DEBUG:teuthology.parallel:result is None 2024-05-14T12:22:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:58 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:58.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:58 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1661911220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T12:22:59.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:59.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:59.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:59.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:58 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:22:59.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:58 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1661911220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 -- 172.21.15.47:0/3282254553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 msgr2=0x7f0ef0075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 --2- 172.21.15.47:0/3282254553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef0075f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009990 tx=0x7f0ee0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 -- 172.21.15.47:0/3282254553 shutdown_connections 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 --2- 172.21.15.47:0/3282254553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef0115370 0x7f0ef0117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 --2- 172.21.15.47:0/3282254553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef0075f70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 --2- 172.21.15.47:0/3282254553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef00764b0 0x7f0ef0114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 -- 172.21.15.47:0/3282254553 >> 172.21.15.47:0/3282254553 conn(0x7f0ef0100040 msgr2=0x7f0ef0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 -- 172.21.15.47:0/3282254553 shutdown_connections 2024-05-14T12:22:59.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.123+0000 7f0ef5400700 1 -- 172.21.15.47:0/3282254553 wait complete. 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 Processor -- start 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 -- start start 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef01a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef00764b0 0x7f0ef01a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef0115370 0x7f0ef01a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef011aa70 con 0x7f0ef0075b60 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef011a8f0 con 0x7f0ef0115370 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.125+0000 7f0ef5400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef011abf0 con 0x7f0ef00764b0 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef01a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef01a1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39110/0 (socket says 172.21.15.47:39110) 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 -- 172.21.15.47:0/1672597271 learned_addr learned my addr 172.21.15.47:0/1672597271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eede00700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef00764b0 0x7f0ef01a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:59.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eef200700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef0115370 0x7f0ef01a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 -- 172.21.15.47:0/1672597271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef00764b0 msgr2=0x7f0ef01a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef00764b0 0x7f0ef01a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 -- 172.21.15.47:0/1672597271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef0115370 msgr2=0x7f0ef01a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef0115370 0x7f0ef01a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eee800700 1 -- 172.21.15.47:0/1672597271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef01a62f0 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.126+0000 7f0eede00700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef00764b0 0x7f0ef01a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.127+0000 7f0eee800700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef01a1420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00057c0 tx=0x7f0ee0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.127+0000 7f0ee7400700 1 -- 172.21.15.47:0/1672597271 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0026070 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.127+0000 7f0ee7400700 1 -- 172.21.15.47:0/1672597271 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee0021410 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.127+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef01a6580 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.127+0000 7f0ee7400700 1 -- 172.21.15.47:0/1672597271 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0017650 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.127+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef01a6a60 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.129+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef00512c0 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.131+0000 7f0ee7400700 1 -- 172.21.15.47:0/1672597271 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0ee0029070 con 0x7f0ef0075b60 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.133+0000 7f0ee7400700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0ed40b2910 0x7f0ed40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:22:59.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.133+0000 7f0ee7400700 1 -- 172.21.15.47:0/1672597271 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0ee00e3450 con 0x7f0ef0075b60 2024-05-14T12:22:59.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.133+0000 7f0eede00700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0ed40b2910 0x7f0ed40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:22:59.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.134+0000 7f0eede00700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0ed40b2910 0x7f0ed40b4e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ef01034f0 tx=0x7f0edc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:22:59.545 INFO:teuthology.orchestra.run.smithi047.stdout:188978561094 2024-05-14T12:22:59.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.135+0000 7f0ee7400700 1 -- 172.21.15.47:0/1672597271 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0ee005edf0 con 0x7f0ef0075b60 2024-05-14T12:22:59.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.380+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0ef002e5f0 con 0x7f0ef0075b60 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.382+0000 7f0ee7400700 1 -- 172.21.15.47:0/1672597271 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0ee0013070 con 0x7f0ef0075b60 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0ed40b2910 msgr2=0x7f0ed40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0ed40b2910 0x7f0ed40b4e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ef01034f0 tx=0x7f0edc009260 comp rx=0 tx=0).stop 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 msgr2=0x7f0ef01a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef01a1420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00057c0 tx=0x7f0ee0009580 comp rx=0 tx=0).stop 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 shutdown_connections 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0ed40b2910 0x7f0ed40b4e20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef0115370 0x7f0ef01a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ef0075b60 0x7f0ef01a1420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 --2- 172.21.15.47:0/1672597271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef00764b0 0x7f0ef01a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 >> 172.21.15.47:0/1672597271 conn(0x7f0ef0100040 msgr2=0x7f0ef0100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:22:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.385+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 shutdown_connections 2024-05-14T12:22:59.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:22:59.386+0000 7f0ef5400700 1 -- 172.21.15.47:0/1672597271 wait complete. 2024-05-14T12:22:59.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:59 smithi047 ceph-mon[31254]: pgmap v384: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:22:59.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:22:59 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1672597271' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T12:22:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:59 smithi066 ceph-mon[35981]: pgmap v384: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:22:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:22:59 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1672597271' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T12:23:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:59 smithi073 ceph-mon[35809]: pgmap v384: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:23:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:22:59 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1672597271' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T12:23:00.125 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411417 got 77309411421 for osd.2 2024-05-14T12:23:00.125 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:00.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 -- 172.21.15.47:0/770898173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc107e30 msgr2=0x7f3afc108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 --2- 172.21.15.47:0/770898173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc107e30 0x7f3afc108240 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8009920 tx=0x7f3ae8009c30 comp rx=0 tx=0).stop 2024-05-14T12:23:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 -- 172.21.15.47:0/770898173 shutdown_connections 2024-05-14T12:23:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 --2- 172.21.15.47:0/770898173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3afc108780 0x7f3afc1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 --2- 172.21.15.47:0/770898173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3afc103550 0x7f3afc103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 --2- 172.21.15.47:0/770898173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc107e30 0x7f3afc108240 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 -- 172.21.15.47:0/770898173 >> 172.21.15.47:0/770898173 conn(0x7f3afc078e40 msgr2=0x7f3afc079280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 -- 172.21.15.47:0/770898173 shutdown_connections 2024-05-14T12:23:00.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.411+0000 7f3b03600700 1 -- 172.21.15.47:0/770898173 wait complete. 2024-05-14T12:23:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.412+0000 7f3b03600700 1 Processor -- start 2024-05-14T12:23:00.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b03600700 1 -- start start 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b03600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc103550 0x7f3afc100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b03600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3afc107e30 0x7f3afc100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b03600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3afc108780 0x7f3afc1011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b03600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc113390 con 0x7f3afc107e30 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b03600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc113210 con 0x7f3afc108780 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b03600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc113510 con 0x7f3afc103550 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3afbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3afc107e30 0x7f3afc100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3b00c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc103550 0x7f3afc100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3afbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3afc107e30 0x7f3afc100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39128/0 (socket says 172.21.15.47:39128) 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.413+0000 7f3afbe00700 1 -- 172.21.15.47:0/214727349 learned_addr learned my addr 172.21.15.47:0/214727349 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3b01600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3afc108780 0x7f3afc1011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3b00c00700 1 -- 172.21.15.47:0/214727349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3afc108780 msgr2=0x7f3afc1011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3b00c00700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3afc108780 0x7f3afc1011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3b00c00700 1 -- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3afc107e30 msgr2=0x7f3afc100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3b00c00700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3afc107e30 0x7f3afc100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3b00c00700 1 -- 172.21.15.47:0/214727349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc1a9230 con 0x7f3afc103550 2024-05-14T12:23:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3b00c00700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc103550 0x7f3afc100720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e9c0 tx=0x7f3af000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.414+0000 7f3af9600700 1 -- 172.21.15.47:0/214727349 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af000c9c0 con 0x7f3afc103550 2024-05-14T12:23:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.415+0000 7f3af9600700 1 -- 172.21.15.47:0/214727349 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3af000cb60 con 0x7f3afc103550 2024-05-14T12:23:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.415+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc1a9520 con 0x7f3afc103550 2024-05-14T12:23:00.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.415+0000 7f3af9600700 1 -- 172.21.15.47:0/214727349 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0018420 con 0x7f3afc103550 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.415+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc1a9ab0 con 0x7f3afc103550 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.416+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc0512c0 con 0x7f3afc103550 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.418+0000 7f3af9600700 1 -- 172.21.15.47:0/214727349 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3af0010430 con 0x7f3afc103550 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.420+0000 7f3af9600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ae40b2990 0x7f3ae40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.420+0000 7f3af9600700 1 -- 172.21.15.47:0/214727349 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3af00e24d0 con 0x7f3afc103550 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.420+0000 7f3afbe00700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ae40b2990 0x7f3ae40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.421+0000 7f3afbe00700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ae40b2990 0x7f3ae40b4ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8005f40 tx=0x7f3ae8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.425+0000 7f3af9600700 1 -- 172.21.15.47:0/214727349 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3af00aa050 con 0x7f3afc103550 2024-05-14T12:23:00.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.669+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f3afc02e5f0 con 0x7f3afc103550 2024-05-14T12:23:00.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.670+0000 7f3af9600700 1 -- 172.21.15.47:0/214727349 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3af00a9950 con 0x7f3afc103550 2024-05-14T12:23:00.670 INFO:teuthology.orchestra.run.smithi047.stdout:270582939700 2024-05-14T12:23:00.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ae40b2990 msgr2=0x7f3ae40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:00.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ae40b2990 0x7f3ae40b4ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8005f40 tx=0x7f3ae8019040 comp rx=0 tx=0).stop 2024-05-14T12:23:00.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc103550 msgr2=0x7f3afc100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:00.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc103550 0x7f3afc100720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e9c0 tx=0x7f3af000ecd0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 shutdown_connections 2024-05-14T12:23:00.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ae40b2990 0x7f3ae40b4ea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3afc108780 0x7f3afc1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3afc103550 0x7f3afc100720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 --2- 172.21.15.47:0/214727349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3afc107e30 0x7f3afc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:00.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.673+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 >> 172.21.15.47:0/214727349 conn(0x7f3afc078e40 msgr2=0x7f3afc075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:00.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.674+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 shutdown_connections 2024-05-14T12:23:00.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:00.674+0000 7f3b03600700 1 -- 172.21.15.47:0/214727349 wait complete. 2024-05-14T12:23:00.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738469 got 34359738471 for osd.0 2024-05-14T12:23:00.785 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:01.131 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:01.466 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:01.468 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:01.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:01 smithi047 ceph-mon[31254]: pgmap v385: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:01.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:01 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/214727349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T12:23:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:01 smithi066 ceph-mon[35981]: pgmap v385: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:01 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/214727349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T12:23:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:01 smithi073 ceph-mon[35809]: pgmap v385: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:01 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/214727349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T12:23:02.764 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561089 got 188978561094 for osd.6 2024-05-14T12:23:02.764 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.871+0000 7f44ff800700 1 -- 172.21.15.47:0/1807897020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f81045f0 msgr2=0x7f44f8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.871+0000 7f44ff800700 1 --2- 172.21.15.47:0/1807897020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f81045f0 0x7f44f8104a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009920 tx=0x7f44ec009c30 comp rx=0 tx=0).stop 2024-05-14T12:23:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.871+0000 7f44ff800700 1 -- 172.21.15.47:0/1807897020 shutdown_connections 2024-05-14T12:23:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.871+0000 7f44ff800700 1 --2- 172.21.15.47:0/1807897020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 0x7f44f81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.871+0000 7f44ff800700 1 --2- 172.21.15.47:0/1807897020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f81045f0 0x7f44f8104a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.871+0000 7f44ff800700 1 --2- 172.21.15.47:0/1807897020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f8108f20 0x7f44f8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.871+0000 7f44ff800700 1 -- 172.21.15.47:0/1807897020 >> 172.21.15.47:0/1807897020 conn(0x7f44f8100040 msgr2=0x7f44f8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:02.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.872+0000 7f44ff800700 1 -- 172.21.15.47:0/1807897020 shutdown_connections 2024-05-14T12:23:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.872+0000 7f44ff800700 1 -- 172.21.15.47:0/1807897020 wait complete. 2024-05-14T12:23:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 Processor -- start 2024-05-14T12:23:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 -- start start 2024-05-14T12:23:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81045f0 0x7f44f819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f8108f20 0x7f44f819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 0x7f44f819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44f81144f0 con 0x7f44f8109870 2024-05-14T12:23:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8114370 con 0x7f44f81045f0 2024-05-14T12:23:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.873+0000 7f44ff800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8114670 con 0x7f44f8108f20 2024-05-14T12:23:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 0x7f44f819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 0x7f44f819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39148/0 (socket says 172.21.15.47:39148) 2024-05-14T12:23:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 -- 172.21.15.47:0/2154577168 learned_addr learned my addr 172.21.15.47:0/2154577168 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:02.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fce00700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81045f0 0x7f44f819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44f7e00700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f8108f20 0x7f44f819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 -- 172.21.15.47:0/2154577168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f8108f20 msgr2=0x7f44f819b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f8108f20 0x7f44f819b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 -- 172.21.15.47:0/2154577168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81045f0 msgr2=0x7f44f819af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81045f0 0x7f44f819af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44fd800700 1 -- 172.21.15.47:0/2154577168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f819fe10 con 0x7f44f8109870 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.874+0000 7f44f7e00700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f8108f20 0x7f44f819b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.875+0000 7f44fd800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 0x7f44f819f770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44f000e3c0 tx=0x7f44f000e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.875+0000 7f44f5600700 1 -- 172.21.15.47:0/2154577168 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f00090d0 con 0x7f44f8109870 2024-05-14T12:23:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.875+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f81a0100 con 0x7f44f8109870 2024-05-14T12:23:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.875+0000 7f44f5600700 1 -- 172.21.15.47:0/2154577168 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44f0009270 con 0x7f44f8109870 2024-05-14T12:23:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.875+0000 7f44f5600700 1 -- 172.21.15.47:0/2154577168 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0007df0 con 0x7f44f8109870 2024-05-14T12:23:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.875+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f81a7a20 con 0x7f44f8109870 2024-05-14T12:23:02.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.876+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f80512c0 con 0x7f44f8109870 2024-05-14T12:23:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.879+0000 7f44f5600700 1 -- 172.21.15.47:0/2154577168 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f44f0012050 con 0x7f44f8109870 2024-05-14T12:23:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.880+0000 7f44f5600700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44e00b2990 0x7f44e00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.881+0000 7f44f5600700 1 -- 172.21.15.47:0/2154577168 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f44f00e2420 con 0x7f44f8109870 2024-05-14T12:23:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.881+0000 7f44fce00700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44e00b2990 0x7f44e00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.881+0000 7f44fce00700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44e00b2990 0x7f44e00b4ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0098f0 tx=0x7f44ec019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:02.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:02.883+0000 7f44f5600700 1 -- 172.21.15.47:0/2154577168 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f44f0022060 con 0x7f44f8109870 2024-05-14T12:23:03.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.147+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f44f802e5f0 con 0x7f44f8109870 2024-05-14T12:23:03.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.148+0000 7f44f5600700 1 -- 172.21.15.47:0/2154577168 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44f0010040 con 0x7f44f8109870 2024-05-14T12:23:03.148 INFO:teuthology.orchestra.run.smithi047.stdout:55834574946 2024-05-14T12:23:03.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.151+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44e00b2990 msgr2=0x7f44e00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:03.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44e00b2990 0x7f44e00b4ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0098f0 tx=0x7f44ec019040 comp rx=0 tx=0).stop 2024-05-14T12:23:03.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 msgr2=0x7f44f819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:03.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 0x7f44f819f770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44f000e3c0 tx=0x7f44f000e6d0 comp rx=0 tx=0).stop 2024-05-14T12:23:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 shutdown_connections 2024-05-14T12:23:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44e00b2990 0x7f44e00b4ea0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44f8109870 0x7f44f819f770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81045f0 0x7f44f819af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 --2- 172.21.15.47:0/2154577168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f8108f20 0x7f44f819b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:03.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 >> 172.21.15.47:0/2154577168 conn(0x7f44f8100040 msgr2=0x7f44f8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:03.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 shutdown_connections 2024-05-14T12:23:03.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:03.152+0000 7f44ff800700 1 -- 172.21.15.47:0/2154577168 wait complete. 2024-05-14T12:23:03.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:03 smithi047 ceph-mon[31254]: pgmap v386: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:03.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:03 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2154577168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T12:23:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:03 smithi066 ceph-mon[35981]: pgmap v386: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:03 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2154577168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T12:23:03.955 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939694 got 270582939700 for osd.9 2024-05-14T12:23:03.955 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:03 smithi073 ceph-mon[35809]: pgmap v386: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:03 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2154577168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T12:23:04.531 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:05.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:05 smithi066 ceph-mon[35981]: pgmap v387: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:05.877 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:05 smithi047 ceph-mon[31254]: pgmap v387: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:06.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:05 smithi073 ceph-mon[35809]: pgmap v387: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.925+0000 7fb17d600700 1 -- 172.21.15.47:0/327631796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb178115180 msgr2=0x7fb1781175a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.925+0000 7fb17d600700 1 --2- 172.21.15.47:0/327631796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb178115180 0x7fb1781175a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b0a0 tx=0x7fb17000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.926+0000 7fb17d600700 1 -- 172.21.15.47:0/327631796 shutdown_connections 2024-05-14T12:23:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.926+0000 7fb17d600700 1 --2- 172.21.15.47:0/327631796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb178115180 0x7fb1781175a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.926+0000 7fb17d600700 1 --2- 172.21.15.47:0/327631796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb178075b60 0x7fb178075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.926+0000 7fb17d600700 1 --2- 172.21.15.47:0/327631796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1780764b0 0x7fb178114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.926+0000 7fb17d600700 1 -- 172.21.15.47:0/327631796 >> 172.21.15.47:0/327631796 conn(0x7fb178079d10 msgr2=0x7fb17807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.926+0000 7fb17d600700 1 -- 172.21.15.47:0/327631796 shutdown_connections 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.926+0000 7fb17d600700 1 -- 172.21.15.47:0/327631796 wait complete. 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 Processor -- start 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 -- start start 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb178075b60 0x7fb1781a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1780764b0 0x7fb1781a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb178115180 0x7fb1781a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb17811a8e0 con 0x7fb1780764b0 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb17811a760 con 0x7fb178115180 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.927+0000 7fb17d600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb17811aa60 con 0x7fb178075b60 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb177400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1780764b0 0x7fb1781a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:06.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb177400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1780764b0 0x7fb1781a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39166/0 (socket says 172.21.15.47:39166) 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb177400700 1 -- 172.21.15.47:0/2575784002 learned_addr learned my addr 172.21.15.47:0/2575784002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb17cc00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb178115180 0x7fb1781a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb177e00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb178075b60 0x7fb1781a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb17cc00700 1 -- 172.21.15.47:0/2575784002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb178075b60 msgr2=0x7fb1781a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb17cc00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb178075b60 0x7fb1781a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb17cc00700 1 -- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1780764b0 msgr2=0x7fb1781a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb17cc00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1780764b0 0x7fb1781a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb17cc00700 1 -- 172.21.15.47:0/2575784002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1781a60e0 con 0x7fb178115180 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.928+0000 7fb177400700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1780764b0 0x7fb1781a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.929+0000 7fb17cc00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb178115180 0x7fb1781a5a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b070 tx=0x7fb170004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.929+0000 7fb174c00700 1 -- 172.21.15.47:0/2575784002 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170021070 con 0x7fb178115180 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.929+0000 7fb174c00700 1 -- 172.21.15.47:0/2575784002 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb170007e30 con 0x7fb178115180 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.929+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1781a6370 con 0x7fb178115180 2024-05-14T12:23:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.929+0000 7fb174c00700 1 -- 172.21.15.47:0/2575784002 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1700045f0 con 0x7fb178115180 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.929+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1781adcf0 con 0x7fb178115180 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.930+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1780772a0 con 0x7fb178115180 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.933+0000 7fb174c00700 1 -- 172.21.15.47:0/2575784002 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb170007980 con 0x7fb178115180 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.935+0000 7fb174c00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb15c0b2990 0x7fb15c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.935+0000 7fb174c00700 1 -- 172.21.15.47:0/2575784002 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb17000f020 con 0x7fb178115180 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.935+0000 7fb177e00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb15c0b2990 0x7fb15c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.936+0000 7fb177e00700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb15c0b2990 0x7fb15c0b4ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb168009c60 tx=0x7fb168009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:05.937+0000 7fb174c00700 1 -- 172.21.15.47:0/2575784002 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb17002a020 con 0x7fb178115180 2024-05-14T12:23:06.539 INFO:teuthology.orchestra.run.smithi047.stdout:292057776174 2024-05-14T12:23:06.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.178+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fb17802e5f0 con 0x7fb178115180 2024-05-14T12:23:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.178+0000 7fb174c00700 1 -- 172.21.15.47:0/2575784002 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fb1700ab690 con 0x7fb178115180 2024-05-14T12:23:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb15c0b2990 msgr2=0x7fb15c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb15c0b2990 0x7fb15c0b4ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb168009c60 tx=0x7fb168009260 comp rx=0 tx=0).stop 2024-05-14T12:23:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb178115180 msgr2=0x7fb1781a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb178115180 0x7fb1781a5a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b070 tx=0x7fb170004c80 comp rx=0 tx=0).stop 2024-05-14T12:23:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 shutdown_connections 2024-05-14T12:23:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb15c0b2990 0x7fb15c0b4ea0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb178115180 0x7fb1781a5a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb178075b60 0x7fb1781a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 --2- 172.21.15.47:0/2575784002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1780764b0 0x7fb1781a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 >> 172.21.15.47:0/2575784002 conn(0x7fb178079d10 msgr2=0x7fb178100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 shutdown_connections 2024-05-14T12:23:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:06.182+0000 7fb17d600700 1 -- 172.21.15.47:0/2575784002 wait complete. 2024-05-14T12:23:06.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:06 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2575784002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T12:23:06.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:06 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2575784002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T12:23:07.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:06 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2575784002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T12:23:07.138 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574940 got 55834574946 for osd.1 2024-05-14T12:23:07.138 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:07.872 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:07 smithi047 ceph-mon[31254]: pgmap v388: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:07 smithi073 ceph-mon[35809]: pgmap v388: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:08.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:07 smithi066 ceph-mon[35981]: pgmap v388: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:08.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.543+0000 7f6b17200700 1 -- 172.21.15.47:0/33876966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18104400 msgr2=0x7f6b18104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.543+0000 7f6b17200700 1 --2- 172.21.15.47:0/33876966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18104400 0x7f6b18104810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800b0a0 tx=0x7f6b0800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.543+0000 7f6b17200700 1 -- 172.21.15.47:0/33876966 shutdown_connections 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.543+0000 7f6b17200700 1 --2- 172.21.15.47:0/33876966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18109680 0x7f6b18110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.543+0000 7f6b17200700 1 --2- 172.21.15.47:0/33876966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18104400 0x7f6b18104810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.543+0000 7f6b17200700 1 --2- 172.21.15.47:0/33876966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b18108d30 0x7f6b18109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.543+0000 7f6b17200700 1 -- 172.21.15.47:0/33876966 >> 172.21.15.47:0/33876966 conn(0x7f6b18079d10 msgr2=0x7f6b1807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.544+0000 7f6b17200700 1 -- 172.21.15.47:0/33876966 shutdown_connections 2024-05-14T12:23:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.544+0000 7f6b17200700 1 -- 172.21.15.47:0/33876966 wait complete. 2024-05-14T12:23:08.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.545+0000 7f6b17200700 1 Processor -- start 2024-05-14T12:23:08.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.545+0000 7f6b17200700 1 -- start start 2024-05-14T12:23:08.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b17200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18104400 0x7f6b1819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:08.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b17200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b18108d30 0x7f6b1819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:08.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b17200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18109680 0x7f6b181a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:08.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b17200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18114300 con 0x7f6b18108d30 2024-05-14T12:23:08.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b17200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18114180 con 0x7f6b18109680 2024-05-14T12:23:08.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b17200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b18114480 con 0x7f6b18104400 2024-05-14T12:23:08.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b15e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18104400 0x7f6b1819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b15e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18104400 0x7f6b1819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43246/0 (socket says 172.21.15.47:43246) 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b15e00700 1 -- 172.21.15.47:0/845110063 learned_addr learned my addr 172.21.15.47:0/845110063 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b16800700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18109680 0x7f6b181a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.546+0000 7f6b0d400700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b18108d30 0x7f6b1819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b15e00700 1 -- 172.21.15.47:0/845110063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18109680 msgr2=0x7f6b181a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b15e00700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18109680 0x7f6b181a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b15e00700 1 -- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b18108d30 msgr2=0x7f6b1819d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b15e00700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b18108d30 0x7f6b1819d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b15e00700 1 -- 172.21.15.47:0/845110063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b181a1d40 con 0x7f6b18104400 2024-05-14T12:23:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b15e00700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18104400 0x7f6b1819ce70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800b070 tx=0x7f6b08004d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08021070 con 0x7f6b18104400 2024-05-14T12:23:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b08003c00 con 0x7f6b18104400 2024-05-14T12:23:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b181a1fd0 con 0x7f6b18104400 2024-05-14T12:23:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.547+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08004790 con 0x7f6b18104400 2024-05-14T12:23:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.548+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b181a9950 con 0x7f6b18104400 2024-05-14T12:23:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.549+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b181058b0 con 0x7f6b18104400 2024-05-14T12:23:08.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.551+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6b08003db0 con 0x7f6b18104400 2024-05-14T12:23:08.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.553+0000 7f6b0f400700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6afc0b2910 0x7f6afc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:08.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.553+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6b0800f020 con 0x7f6b18104400 2024-05-14T12:23:08.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.553+0000 7f6b0d400700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6afc0b2910 0x7f6afc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:08.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.554+0000 7f6b0d400700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6afc0b2910 0x7f6afc0b4e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b18108c60 tx=0x7f6b00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:08.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.556+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b0802a020 con 0x7f6b18104400 2024-05-14T12:23:08.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.614+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6b080a7470 con 0x7f6b18104400 2024-05-14T12:23:08.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.817+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6b1819e200 con 0x7f6b18104400 2024-05-14T12:23:08.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.818+0000 7f6b0f400700 1 -- 172.21.15.47:0/845110063 <== mon.1 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6b1819e200 con 0x7f6b18104400 2024-05-14T12:23:08.817 INFO:teuthology.orchestra.run.smithi047.stdout:137438953555 2024-05-14T12:23:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6afc0b2910 msgr2=0x7f6afc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6afc0b2910 0x7f6afc0b4e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b18108c60 tx=0x7f6b00009260 comp rx=0 tx=0).stop 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18104400 msgr2=0x7f6b1819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18104400 0x7f6b1819ce70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800b070 tx=0x7f6b08004d30 comp rx=0 tx=0).stop 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 shutdown_connections 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6afc0b2910 0x7f6afc0b4e20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b18109680 0x7f6b181a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b18104400 0x7f6b1819ce70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 --2- 172.21.15.47:0/845110063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b18108d30 0x7f6b1819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 >> 172.21.15.47:0/845110063 conn(0x7f6b18079d10 msgr2=0x7f6b18102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 shutdown_connections 2024-05-14T12:23:08.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:08.821+0000 7f6b17200700 1 -- 172.21.15.47:0/845110063 wait complete. 2024-05-14T12:23:09.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:09 smithi047 ceph-mon[31254]: pgmap v389: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:09.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:09 smithi047 ceph-mon[31254]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-14T12:23:09.946 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:09 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/845110063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T12:23:10.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:09 smithi073 ceph-mon[35809]: pgmap v389: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:10.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:09 smithi073 ceph-mon[35809]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-14T12:23:10.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:09 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/845110063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T12:23:10.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:09 smithi066 ceph-mon[35981]: pgmap v389: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:10.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:09 smithi066 ceph-mon[35981]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-14T12:23:10.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:09 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/845110063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T12:23:11.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953550 got 137438953555 for osd.4 2024-05-14T12:23:11.420 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.437+0000 7f52f3800700 1 -- 172.21.15.47:0/2784801041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec1034c0 msgr2=0x7f52ec1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.437+0000 7f52f3800700 1 --2- 172.21.15.47:0/2784801041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec1034c0 0x7f52ec1038d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f52e00099c0 tx=0x7f52e0009cd0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.438+0000 7f52f3800700 1 -- 172.21.15.47:0/2784801041 shutdown_connections 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.438+0000 7f52f3800700 1 --2- 172.21.15.47:0/2784801041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52ec108740 0x7f52ec1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.438+0000 7f52f3800700 1 --2- 172.21.15.47:0/2784801041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec1034c0 0x7f52ec1038d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.438+0000 7f52f3800700 1 --2- 172.21.15.47:0/2784801041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec107df0 0x7f52ec108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.438+0000 7f52f3800700 1 -- 172.21.15.47:0/2784801041 >> 172.21.15.47:0/2784801041 conn(0x7f52ec0fedc0 msgr2=0x7f52ec1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.438+0000 7f52f3800700 1 -- 172.21.15.47:0/2784801041 shutdown_connections 2024-05-14T12:23:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.439+0000 7f52f3800700 1 -- 172.21.15.47:0/2784801041 wait complete. 2024-05-14T12:23:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.440+0000 7f52f3800700 1 Processor -- start 2024-05-14T12:23:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.440+0000 7f52f3800700 1 -- start start 2024-05-14T12:23:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f3800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec1034c0 0x7f52ec19d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f3800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec107df0 0x7f52ec19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f3800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52ec108740 0x7f52ec1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f3800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec113370 con 0x7f52ec107df0 2024-05-14T12:23:11.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f3800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec1131f0 con 0x7f52ec108740 2024-05-14T12:23:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f3800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec1134f0 con 0x7f52ec1034c0 2024-05-14T12:23:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52ebe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec107df0 0x7f52ec19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52ebe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec107df0 0x7f52ec19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52844/0 (socket says 172.21.15.47:52844) 2024-05-14T12:23:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52ebe00700 1 -- 172.21.15.47:0/596604714 learned_addr learned my addr 172.21.15.47:0/596604714 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f1800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52ec108740 0x7f52ec1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.441+0000 7f52f0e00700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec1034c0 0x7f52ec19d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52f1800700 1 -- 172.21.15.47:0/596604714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec1034c0 msgr2=0x7f52ec19d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52f1800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec1034c0 0x7f52ec19d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52f1800700 1 -- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec107df0 msgr2=0x7f52ec19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52f1800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec107df0 0x7f52ec19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52f1800700 1 -- 172.21.15.47:0/596604714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec1a1fb0 con 0x7f52ec108740 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52ebe00700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec107df0 0x7f52ec19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52f1800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52ec108740 0x7f52ec1a1910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f52e400efb0 tx=0x7f52e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52e9600700 1 -- 172.21.15.47:0/596604714 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4003a00 con 0x7f52ec108740 2024-05-14T12:23:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec1a22a0 con 0x7f52ec108740 2024-05-14T12:23:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52e9600700 1 -- 172.21.15.47:0/596604714 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52e400ce50 con 0x7f52ec108740 2024-05-14T12:23:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.442+0000 7f52e9600700 1 -- 172.21.15.47:0/596604714 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e40047c0 con 0x7f52ec108740 2024-05-14T12:23:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.443+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec1a9bc0 con 0x7f52ec108740 2024-05-14T12:23:11.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.445+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec0512c0 con 0x7f52ec108740 2024-05-14T12:23:11.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.446+0000 7f52e9600700 1 -- 172.21.15.47:0/596604714 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f52e4012050 con 0x7f52ec108740 2024-05-14T12:23:11.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.448+0000 7f52e9600700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f52d40b2900 0x7f52d40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:11.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.448+0000 7f52e9600700 1 -- 172.21.15.47:0/596604714 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f52e40e18d0 con 0x7f52ec108740 2024-05-14T12:23:11.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.448+0000 7f52f0e00700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f52d40b2900 0x7f52d40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:11.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.449+0000 7f52f0e00700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f52d40b2900 0x7f52d40b4e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52e0003760 tx=0x7f52e001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:11.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.453+0000 7f52e9600700 1 -- 172.21.15.47:0/596604714 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52e4010040 con 0x7f52ec108740 2024-05-14T12:23:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.709+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f52ec1a9d90 con 0x7f52ec108740 2024-05-14T12:23:11.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:11 smithi047 ceph-mon[31254]: pgmap v390: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:23:11.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.710+0000 7f52e9600700 1 -- 172.21.15.47:0/596604714 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f52e40a9640 con 0x7f52ec108740 2024-05-14T12:23:11.710 INFO:teuthology.orchestra.run.smithi047.stdout:317827579947 2024-05-14T12:23:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f52d40b2900 msgr2=0x7f52d40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f52d40b2900 0x7f52d40b4e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52e0003760 tx=0x7f52e001a040 comp rx=0 tx=0).stop 2024-05-14T12:23:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52ec108740 msgr2=0x7f52ec1a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:11.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52ec108740 0x7f52ec1a1910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f52e400efb0 tx=0x7f52e400c3a0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 shutdown_connections 2024-05-14T12:23:11.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f52d40b2900 0x7f52d40b4e10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52ec108740 0x7f52ec1a1910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52ec1034c0 0x7f52ec19d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 --2- 172.21.15.47:0/596604714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52ec107df0 0x7f52ec19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:11.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 >> 172.21.15.47:0/596604714 conn(0x7f52ec0fedc0 msgr2=0x7f52ec1069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:11.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.713+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 shutdown_connections 2024-05-14T12:23:11.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:11.714+0000 7f52f3800700 1 -- 172.21.15.47:0/596604714 wait complete. 2024-05-14T12:23:12.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:11 smithi073 ceph-mon[35809]: pgmap v390: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:23:12.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:11 smithi066 ceph-mon[35981]: pgmap v390: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:23:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 -- 172.21.15.47:0/2105556303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 msgr2=0x7f4ce0110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 --2- 172.21.15.47:0/2105556303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce0110660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009990 tx=0x7f4ccc009ca0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 -- 172.21.15.47:0/2105556303 shutdown_connections 2024-05-14T12:23:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 --2- 172.21.15.47:0/2105556303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ce0110ba0 0x7f4ce0113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 --2- 172.21.15.47:0/2105556303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ce0075d30 0x7f4ce0076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 --2- 172.21.15.47:0/2105556303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce0110660 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 -- 172.21.15.47:0/2105556303 >> 172.21.15.47:0/2105556303 conn(0x7f4ce0100040 msgr2=0x7f4ce0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 -- 172.21.15.47:0/2105556303 shutdown_connections 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.310+0000 7f4ce7400700 1 -- 172.21.15.47:0/2105556303 wait complete. 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.311+0000 7f4ce7400700 1 Processor -- start 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4ce7400700 1 -- start start 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4ce7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ce0075d30 0x7f4ce019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4ce7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce019d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4ce7400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ce0110ba0 0x7f4ce01a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4ce7400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01166a0 con 0x7f4ce0076680 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4ce7400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce0116520 con 0x7f4ce0075d30 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4ce7400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce0116820 con 0x7f4ce0110ba0 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4cdfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce019d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4cdfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce019d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52894/0 (socket says 172.21.15.47:52894) 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.312+0000 7f4cdfe00700 1 -- 172.21.15.47:0/465762067 learned_addr learned my addr 172.21.15.47:0/465762067 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4ce4a00700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ce0075d30 0x7f4ce019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4ce5400700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ce0110ba0 0x7f4ce01a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4cdfe00700 1 -- 172.21.15.47:0/465762067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ce0110ba0 msgr2=0x7f4ce01a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4cdfe00700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ce0110ba0 0x7f4ce01a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4cdfe00700 1 -- 172.21.15.47:0/465762067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ce0075d30 msgr2=0x7f4ce019d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4cdfe00700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ce0075d30 0x7f4ce019d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4cdfe00700 1 -- 172.21.15.47:0/465762067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce01a1f20 con 0x7f4ce0076680 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.313+0000 7f4cdfe00700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce019d5f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0057f0 tx=0x7f4ccc00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.314+0000 7f4cdd600700 1 -- 172.21.15.47:0/465762067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc026070 con 0x7f4ce0076680 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.314+0000 7f4cdd600700 1 -- 172.21.15.47:0/465762067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ccc021410 con 0x7f4ce0076680 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.314+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce01a21b0 con 0x7f4ce0076680 2024-05-14T12:23:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.314+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce01a2690 con 0x7f4ce0076680 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.314+0000 7f4cdd600700 1 -- 172.21.15.47:0/465762067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc017650 con 0x7f4ce0076680 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.315+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc0005330 con 0x7f4ce0076680 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.318+0000 7f4cdd600700 1 -- 172.21.15.47:0/465762067 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4ccc029070 con 0x7f4ce0076680 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.320+0000 7f4cdd600700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc80b2880 0x7f4cc80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.320+0000 7f4cdd600700 1 -- 172.21.15.47:0/465762067 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4ccc0e2e90 con 0x7f4ce0076680 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.320+0000 7f4ce4a00700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc80b2880 0x7f4cc80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.321+0000 7f4ce4a00700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc80b2880 0x7f4cc80b4d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009680 tx=0x7f4cd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:12.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.326+0000 7f4cdd600700 1 -- 172.21.15.47:0/465762067 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4ccc013070 con 0x7f4ce0076680 2024-05-14T12:23:12.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.587+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f4cc0005620 con 0x7f4ce0076680 2024-05-14T12:23:12.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.587+0000 7f4cdd600700 1 -- 172.21.15.47:0/465762067 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4ccc0aac00 con 0x7f4ce0076680 2024-05-14T12:23:12.587 INFO:teuthology.orchestra.run.smithi047.stdout:244813135933 2024-05-14T12:23:12.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc80b2880 msgr2=0x7f4cc80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc80b2880 0x7f4cc80b4d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009680 tx=0x7f4cd4009260 comp rx=0 tx=0).stop 2024-05-14T12:23:12.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 msgr2=0x7f4ce019d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce019d5f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0057f0 tx=0x7f4ccc00bfd0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 shutdown_connections 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc80b2880 0x7f4cc80b4d90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ce0110ba0 0x7f4ce01a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ce0075d30 0x7f4ce019d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 --2- 172.21.15.47:0/465762067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce0076680 0x7f4ce019d5f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.590+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 >> 172.21.15.47:0/465762067 conn(0x7f4ce0100040 msgr2=0x7f4ce01006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.591+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 shutdown_connections 2024-05-14T12:23:12.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.591+0000 7f4ce7400700 1 -- 172.21.15.47:0/465762067 wait complete. 2024-05-14T12:23:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 -- 172.21.15.47:0/2217040072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 msgr2=0x7ff26c117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 --2- 172.21.15.47:0/2217040072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 0x7ff26c117810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff26400b0a0 tx=0x7ff26400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 -- 172.21.15.47:0/2217040072 shutdown_connections 2024-05-14T12:23:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 --2- 172.21.15.47:0/2217040072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 0x7ff26c117810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 --2- 172.21.15.47:0/2217040072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c110970 0x7ff26c110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 --2- 172.21.15.47:0/2217040072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff26c10a990 0x7ff26c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 -- 172.21.15.47:0/2217040072 >> 172.21.15.47:0/2217040072 conn(0x7ff26c077c80 msgr2=0x7ff26c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 -- 172.21.15.47:0/2217040072 shutdown_connections 2024-05-14T12:23:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.788+0000 7ff272600700 1 -- 172.21.15.47:0/2217040072 wait complete. 2024-05-14T12:23:12.789 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:12 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/596604714' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T12:23:12.789 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:12 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2318789145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T12:23:12.789 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:12 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/465762067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T12:23:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 Processor -- start 2024-05-14T12:23:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 -- start start 2024-05-14T12:23:12.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c10a990 0x7ff26c1a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 0x7ff26c1a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff26c110970 0x7ff26c1a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c11aaf0 con 0x7ff26c10b2e0 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c11a970 con 0x7ff26c10a990 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.790+0000 7ff272600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c11ac70 con 0x7ff26c110970 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 0x7ff26c1a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26b400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c10a990 0x7ff26c1a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26b400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c10a990 0x7ff26c1a1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:38638/0 (socket says 172.21.15.47:38638) 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26b400700 1 -- 172.21.15.47:0/739561492 learned_addr learned my addr 172.21.15.47:0/739561492 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 0x7ff26c1a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52904/0 (socket says 172.21.15.47:52904) 2024-05-14T12:23:12.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26be00700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff26c110970 0x7ff26c1a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26be00700 1 -- 172.21.15.47:0/739561492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c10a990 msgr2=0x7ff26c1a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26be00700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c10a990 0x7ff26c1a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26be00700 1 -- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 msgr2=0x7ff26c1a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:12.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26be00700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 0x7ff26c1a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:12.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26be00700 1 -- 172.21.15.47:0/739561492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c1a62f0 con 0x7ff26c110970 2024-05-14T12:23:12.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.791+0000 7ff26b400700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c10a990 0x7ff26c1a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:12.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.792+0000 7ff26be00700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff26c110970 0x7ff26c1a5c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff26400b070 tx=0x7ff264004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:12.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.792+0000 7ff263e00700 1 -- 172.21.15.47:0/739561492 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264021070 con 0x7ff26c110970 2024-05-14T12:23:12.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.792+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c1a6580 con 0x7ff26c110970 2024-05-14T12:23:12.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.792+0000 7ff263e00700 1 -- 172.21.15.47:0/739561492 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff264007e30 con 0x7ff26c110970 2024-05-14T12:23:12.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.792+0000 7ff263e00700 1 -- 172.21.15.47:0/739561492 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2640045f0 con 0x7ff26c110970 2024-05-14T12:23:12.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.792+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c1adf00 con 0x7ff26c110970 2024-05-14T12:23:12.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.793+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26c10c080 con 0x7ff26c110970 2024-05-14T12:23:12.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.796+0000 7ff263e00700 1 -- 172.21.15.47:0/739561492 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff264007980 con 0x7ff26c110970 2024-05-14T12:23:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.797+0000 7ff263e00700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff2500b2880 0x7ff2500b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.797+0000 7ff263e00700 1 -- 172.21.15.47:0/739561492 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff26400f020 con 0x7ff26c110970 2024-05-14T12:23:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.797+0000 7ff26b400700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff2500b2880 0x7ff2500b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:12.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.798+0000 7ff26b400700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff2500b2880 0x7ff2500b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff25c005950 tx=0x7ff25c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:12.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.802+0000 7ff263e00700 1 -- 172.21.15.47:0/739561492 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff26402a020 con 0x7ff26c110970 2024-05-14T12:23:13.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:12 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/596604714' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T12:23:13.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:12 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2318789145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T12:23:13.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:12 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/465762067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T12:23:13.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 -- 172.21.15.47:0/1334109054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c01034c0 msgr2=0x7f74c01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 --2- 172.21.15.47:0/1334109054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c01034c0 0x7f74c01038d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f74b00099c0 tx=0x7f74b0009cd0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 -- 172.21.15.47:0/1334109054 shutdown_connections 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 --2- 172.21.15.47:0/1334109054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c0108740 0x7f74c01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 --2- 172.21.15.47:0/1334109054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c01034c0 0x7f74c01038d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 --2- 172.21.15.47:0/1334109054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c0107df0 0x7f74c0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 -- 172.21.15.47:0/1334109054 >> 172.21.15.47:0/1334109054 conn(0x7f74c00fedc0 msgr2=0x7f74c01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 -- 172.21.15.47:0/1334109054 shutdown_connections 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.240+0000 7f74c7200700 1 -- 172.21.15.47:0/1334109054 wait complete. 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.241+0000 7f74c7200700 1 Processor -- start 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.241+0000 7f74c7200700 1 -- start start 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74c7200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c01034c0 0x7f74c019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74c7200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c0107df0 0x7f74c019d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74c7200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0108740 0x7f74c01a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74c7200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0113370 con 0x7f74c01034c0 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74c7200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74c01131f0 con 0x7f74c0107df0 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74c7200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f74c01134f0 con 0x7f74c0108740 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74bfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c01034c0 0x7f74c019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74bfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c01034c0 0x7f74c019cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52866/0 (socket says 172.21.15.47:52866) 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74bf400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c0107df0 0x7f74c019d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74bfe00700 1 -- 172.21.15.47:0/2318789145 learned_addr learned my addr 172.21.15.47:0/2318789145 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.242+0000 7f74c5200700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0108740 0x7f74c01a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bf400700 1 -- 172.21.15.47:0/2318789145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0108740 msgr2=0x7f74c01a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bf400700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0108740 0x7f74c01a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bf400700 1 -- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c01034c0 msgr2=0x7f74c019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bf400700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c01034c0 0x7f74c019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bf400700 1 -- 172.21.15.47:0/2318789145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c01a1e80 con 0x7f74c0107df0 2024-05-14T12:23:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bfe00700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c01034c0 0x7f74c019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bf400700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c0107df0 0x7f74c019d550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00e9c0 tx=0x7f74ac00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.243+0000 7f74bcc00700 1 -- 172.21.15.47:0/2318789145 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00c9c0 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.244+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c01a2170 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.244+0000 7f74bcc00700 1 -- 172.21.15.47:0/2318789145 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74ac00cb60 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.244+0000 7f74bcc00700 1 -- 172.21.15.47:0/2318789145 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac018680 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.244+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c01a9a90 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.245+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c00512c0 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.247+0000 7f74bcc00700 1 -- 172.21.15.47:0/2318789145 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f74ac010430 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.249+0000 7f74bcc00700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74a40b2880 0x7f74a40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.249+0000 7f74bcc00700 1 -- 172.21.15.47:0/2318789145 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f74ac0e2720 con 0x7f74c0107df0 2024-05-14T12:23:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.249+0000 7f74bfe00700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74a40b2880 0x7f74a40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.250+0000 7f74bfe00700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74a40b2880 0x7f74a40b4d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009990 tx=0x7f74b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.251+0000 7f74bcc00700 1 -- 172.21.15.47:0/2318789145 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f74ac0aa400 con 0x7f74c0107df0 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.504+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f74c002e5f0 con 0x7f74c0107df0 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.505+0000 7f74bcc00700 1 -- 172.21.15.47:0/2318789145 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f74ac0a9d00 con 0x7f74c0107df0 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stdout:163208757327 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.508+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74a40b2880 msgr2=0x7f74a40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.508+0000 7f74c7200700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74a40b2880 0x7f74a40b4d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009990 tx=0x7f74b001a040 comp rx=0 tx=0).stop 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.508+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c0107df0 msgr2=0x7f74c019d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.508+0000 7f74c7200700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c0107df0 0x7f74c019d550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00e9c0 tx=0x7f74ac00ecd0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.508+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 shutdown_connections 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.509+0000 7f74c7200700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f74a40b2880 0x7f74a40b4d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.509+0000 7f74c7200700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0108740 0x7f74c01a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.509+0000 7f74c7200700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c01034c0 0x7f74c019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.509+0000 7f74c7200700 1 --2- 172.21.15.47:0/2318789145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c0107df0 0x7f74c019d550 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.509+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 >> 172.21.15.47:0/2318789145 conn(0x7f74c00fedc0 msgr2=0x7f74c0107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.509+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 shutdown_connections 2024-05-14T12:23:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:12.509+0000 7f74c7200700 1 -- 172.21.15.47:0/2318789145 wait complete. 2024-05-14T12:23:13.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.044+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff26c0512c0 con 0x7ff26c110970 2024-05-14T12:23:13.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.045+0000 7ff263e00700 1 -- 172.21.15.47:0/739561492 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff2640ab2b0 con 0x7ff26c110970 2024-05-14T12:23:13.044 INFO:teuthology.orchestra.run.smithi047.stdout:214748364866 2024-05-14T12:23:13.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff2500b2880 msgr2=0x7ff2500b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:13.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff2500b2880 0x7ff2500b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff25c005950 tx=0x7ff25c009260 comp rx=0 tx=0).stop 2024-05-14T12:23:13.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff26c110970 msgr2=0x7ff26c1a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:13.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff26c110970 0x7ff26c1a5c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff26400b070 tx=0x7ff264004c80 comp rx=0 tx=0).stop 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 shutdown_connections 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff2500b2880 0x7ff2500b4d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff26c110970 0x7ff26c1a5c50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff26c10a990 0x7ff26c1a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 --2- 172.21.15.47:0/739561492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff26c10b2e0 0x7ff26c1a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.048+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 >> 172.21.15.47:0/739561492 conn(0x7ff26c077c80 msgr2=0x7ff26c07b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.049+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 shutdown_connections 2024-05-14T12:23:13.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:13.049+0000 7ff272600700 1 -- 172.21.15.47:0/739561492 wait complete. 2024-05-14T12:23:13.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:12 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/596604714' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T12:23:13.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:12 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2318789145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T12:23:13.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:12 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/465762067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T12:23:13.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:13 smithi047 ceph-mon[31254]: pgmap v391: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:23:13.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:13 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/739561492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T12:23:14.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:13 smithi073 ceph-mon[35809]: pgmap v391: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:23:14.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:13 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/739561492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T12:23:14.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:13 smithi066 ceph-mon[35981]: pgmap v391: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:23:14.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:13 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/739561492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T12:23:14.572 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135927 got 244813135933 for osd.8 2024-05-14T12:23:14.572 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:14.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757320 got 163208757327 for osd.5 2024-05-14T12:23:14.893 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:15.318 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776170 got 292057776174 for osd.10 2024-05-14T12:23:15.319 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:15 smithi047 ceph-mon[31254]: pgmap v392: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:16.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:15 smithi073 ceph-mon[35809]: pgmap v392: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:16.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:15 smithi066 ceph-mon[35981]: pgmap v392: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:16.241 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364861 got 214748364866 for osd.7 2024-05-14T12:23:16.241 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:16.718 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579941 got 317827579947 for osd.11 2024-05-14T12:23:16.718 DEBUG:teuthology.parallel:result is None 2024-05-14T12:23:16.718 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-14T12:23:16.718 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T12:23:17.192 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:17.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:17 smithi047 ceph-mon[31254]: pgmap v393: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:23:18.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:17 smithi073 ceph-mon[35809]: pgmap v393: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:23:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:17 smithi066 ceph-mon[35981]: pgmap v393: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:23:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 -- 172.21.15.47:0/1112274451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade0105be0 msgr2=0x7fade010e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 --2- 172.21.15.47:0/1112274451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade0105be0 0x7fade010e130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009990 tx=0x7fadcc009ca0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 -- 172.21.15.47:0/1112274451 shutdown_connections 2024-05-14T12:23:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 --2- 172.21.15.47:0/1112274451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade010e700 0x7fade0110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 --2- 172.21.15.47:0/1112274451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade0105290 0x7fade01056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 --2- 172.21.15.47:0/1112274451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade0105be0 0x7fade010e130 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 -- 172.21.15.47:0/1112274451 >> 172.21.15.47:0/1112274451 conn(0x7fade0078b00 msgr2=0x7fade0078f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 -- 172.21.15.47:0/1112274451 shutdown_connections 2024-05-14T12:23:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.353+0000 7fade7000700 1 -- 172.21.15.47:0/1112274451 wait complete. 2024-05-14T12:23:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.354+0000 7fade7000700 1 Processor -- start 2024-05-14T12:23:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.355+0000 7fade7000700 1 -- start start 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.355+0000 7fade7000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade0105290 0x7fade01a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.355+0000 7fade7000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade0105be0 0x7fade01a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.355+0000 7fade7000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade010e700 0x7fade019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.355+0000 7fade7000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fade01142b0 con 0x7fade010e700 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.355+0000 7fade7000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fade0114130 con 0x7fade0105be0 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.355+0000 7fade7000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fade0114430 con 0x7fade0105290 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade0105be0 0x7fade01a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade0105290 0x7fade01a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade6600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade010e700 0x7fade019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade0105290 0x7fade01a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45784/0 (socket says 172.21.15.47:45784) 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 -- 172.21.15.47:0/3087808133 learned_addr learned my addr 172.21.15.47:0/3087808133 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 -- 172.21.15.47:0/3087808133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade0105be0 msgr2=0x7fade01a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:19.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade0105be0 0x7fade01a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 -- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade010e700 msgr2=0x7fade019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:19.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade010e700 0x7fade019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 -- 172.21.15.47:0/3087808133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade019b100 con 0x7fade0105290 2024-05-14T12:23:19.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.356+0000 7fade5c00700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade0105290 0x7fade01a0830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fadd400eb30 tx=0x7fadd400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:19.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.357+0000 7fadde000700 1 -- 172.21.15.47:0/3087808133 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd400cbd0 con 0x7fade0105290 2024-05-14T12:23:19.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.357+0000 7fadde000700 1 -- 172.21.15.47:0/3087808133 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd40044d0 con 0x7fade0105290 2024-05-14T12:23:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.357+0000 7fade7000700 1 -- 172.21.15.47:0/3087808133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade019b3f0 con 0x7fade0105290 2024-05-14T12:23:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.357+0000 7fadde000700 1 -- 172.21.15.47:0/3087808133 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4003e30 con 0x7fade0105290 2024-05-14T12:23:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.357+0000 7fade7000700 1 -- 172.21.15.47:0/3087808133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade0102eb0 con 0x7fade0105290 2024-05-14T12:23:19.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.358+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadbc005330 con 0x7fade0105290 2024-05-14T12:23:19.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.361+0000 7fadde000700 1 -- 172.21.15.47:0/3087808133 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fadd4004000 con 0x7fade0105290 2024-05-14T12:23:19.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.362+0000 7fadde000700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fadc80b2880 0x7fadc80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:19.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.362+0000 7fadde000700 1 -- 172.21.15.47:0/3087808133 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fadd40e27e0 con 0x7fade0105290 2024-05-14T12:23:19.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.362+0000 7fade5200700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fadc80b2880 0x7fadc80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:19.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.363+0000 7fade5200700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fadc80b2880 0x7fadc80b4d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fade0102540 tx=0x7fadcc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:19.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.364+0000 7fadde000700 1 -- 172.21.15.47:0/3087808133 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fadd4054df0 con 0x7fade0105290 2024-05-14T12:23:19.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.596+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadbc000bc0 con 0x7fadc80b2880 2024-05-14T12:23:19.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.608+0000 7fadde000700 1 -- 172.21.15.47:0/3087808133 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258883 (secure 0 0 0) 0x7fadcc067360 con 0x7fadc80b2880 2024-05-14T12:23:19.613 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:23:19.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.613+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fadc80b2880 msgr2=0x7fadc80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:19.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.613+0000 7fadd3400700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fadc80b2880 0x7fadc80b4d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fade0102540 tx=0x7fadcc00b260 comp rx=0 tx=0).stop 2024-05-14T12:23:19.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade0105290 msgr2=0x7fade01a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade0105290 0x7fade01a0830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fadd400eb30 tx=0x7fadd400ee40 comp rx=0 tx=0).stop 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 shutdown_connections 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fadc80b2880 0x7fadc80b4d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade010e700 0x7fade019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fade0105290 0x7fade01a0830 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 --2- 172.21.15.47:0/3087808133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade0105be0 0x7fade01a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 >> 172.21.15.47:0/3087808133 conn(0x7fade0078b00 msgr2=0x7fade00ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 shutdown_connections 2024-05-14T12:23:19.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:19.614+0000 7fadd3400700 1 -- 172.21.15.47:0/3087808133 wait complete. 2024-05-14T12:23:19.617 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-14T12:23:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:19 smithi047 ceph-mon[31254]: pgmap v394: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:19 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:20.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:19 smithi073 ceph-mon[35809]: pgmap v394: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:20.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:20.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:19 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:19 smithi066 ceph-mon[35981]: pgmap v394: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:19 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:20.524 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-05-14T12:23:18.306732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663061,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1233,"num_read_kb":726,"num_write":382,"num_write_kb":2301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2952484,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":815,"ondisk_log_size":815,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374664,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567160,"statfs":{"total":1151940427776,"available":1151556771840,"internally_reserved":0,"allocated":13344768,"data_stored":7309119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":531,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":53,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005068"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.249846+0000","last_change":"2024-05-14T12:20:59.669913+0000","last_active":"2024-05-14T12:23:08.249846+0000","last_peered":"2024-05-14T12:23:08.249846+0000","last_clean":"2024-05-14T12:23:08.249846+0000","last_became_active":"2024-05-14T12:20:59.668481+0000","last_became_peered":"2024-05-14T12:20:59.668481+0000","last_unstale":"2024-05-14T12:23:08.249846+0000","last_undegraded":"2024-05-14T12:23:08.249846+0000","last_fullsized":"2024-05-14T12:23:08.249846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:13.671516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.235645+0000","last_change":"2024-05-14T12:20:59.665032+0000","last_active":"2024-05-14T12:23:08.235645+0000","last_peered":"2024-05-14T12:23:08.235645+0000","last_clean":"2024-05-14T12:23:08.235645+0000","last_became_active":"2024-05-14T12:20:59.664471+0000","last_became_peered":"2024-05-14T12:20:59.664471+0000","last_unstale":"2024-05-14T12:23:08.235645+0000","last_undegraded":"2024-05-14T12:23:08.235645+0000","last_fullsized":"2024-05-14T12:23:08.235645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:58:02.354064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254928+0000","last_change":"2024-05-14T12:20:59.679975+0000","last_active":"2024-05-14T12:23:08.254928+0000","last_peered":"2024-05-14T12:23:08.254928+0000","last_clean":"2024-05-14T12:23:08.254928+0000","last_became_active":"2024-05-14T12:20:59.679586+0000","last_became_peered":"2024-05-14T12:20:59.679586+0000","last_unstale":"2024-05-14T12:23:08.254928+0000","last_undegraded":"2024-05-14T12:23:08.254928+0000","last_fullsized":"2024-05-14T12:23:08.254928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:45:37.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241040+0000","last_change":"2024-05-14T12:20:59.668125+0000","last_active":"2024-05-14T12:23:08.241040+0000","last_peered":"2024-05-14T12:23:08.241040+0000","last_clean":"2024-05-14T12:23:08.241040+0000","last_became_active":"2024-05-14T12:20:59.667664+0000","last_became_peered":"2024-05-14T12:20:59.667664+0000","last_unstale":"2024-05-14T12:23:08.241040+0000","last_undegraded":"2024-05-14T12:23:08.241040+0000","last_fullsized":"2024-05-14T12:23:08.241040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:29.995159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238828+0000","last_change":"2024-05-14T12:20:59.682787+0000","last_active":"2024-05-14T12:23:08.238828+0000","last_peered":"2024-05-14T12:23:08.238828+0000","last_clean":"2024-05-14T12:23:08.238828+0000","last_became_active":"2024-05-14T12:20:59.682462+0000","last_became_peered":"2024-05-14T12:20:59.682462+0000","last_unstale":"2024-05-14T12:23:08.238828+0000","last_undegraded":"2024-05-14T12:23:08.238828+0000","last_fullsized":"2024-05-14T12:23:08.238828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:27.287750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241933+0000","last_change":"2024-05-14T12:21:39.506661+0000","last_active":"2024-05-14T12:23:08.241933+0000","last_peered":"2024-05-14T12:23:08.241933+0000","last_clean":"2024-05-14T12:23:08.241933+0000","last_became_active":"2024-05-14T12:21:39.506116+0000","last_became_peered":"2024-05-14T12:21:39.506116+0000","last_unstale":"2024-05-14T12:23:08.241933+0000","last_undegraded":"2024-05-14T12:23:08.241933+0000","last_fullsized":"2024-05-14T12:23:08.241933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:18.551207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244260+0000","last_change":"2024-05-14T12:20:59.671683+0000","last_active":"2024-05-14T12:23:08.244260+0000","last_peered":"2024-05-14T12:23:08.244260+0000","last_clean":"2024-05-14T12:23:08.244260+0000","last_became_active":"2024-05-14T12:20:59.671307+0000","last_became_peered":"2024-05-14T12:20:59.671307+0000","last_unstale":"2024-05-14T12:23:08.244260+0000","last_undegraded":"2024-05-14T12:23:08.244260+0000","last_fullsized":"2024-05-14T12:23:08.244260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.744159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251050+0000","last_change":"2024-05-14T12:21:39.504953+0000","last_active":"2024-05-14T12:23:08.251050+0000","last_peered":"2024-05-14T12:23:08.251050+0000","last_clean":"2024-05-14T12:23:08.251050+0000","last_became_active":"2024-05-14T12:21:39.504267+0000","last_became_peered":"2024-05-14T12:21:39.504267+0000","last_unstale":"2024-05-14T12:23:08.251050+0000","last_undegraded":"2024-05-14T12:23:08.251050+0000","last_fullsized":"2024-05-14T12:23:08.251050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:04.329324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247121+0000","last_change":"2024-05-14T12:20:59.663319+0000","last_active":"2024-05-14T12:23:08.247121+0000","last_peered":"2024-05-14T12:23:08.247121+0000","last_clean":"2024-05-14T12:23:08.247121+0000","last_became_active":"2024-05-14T12:20:59.662618+0000","last_became_peered":"2024-05-14T12:20:59.662618+0000","last_unstale":"2024-05-14T12:23:08.247121+0000","last_undegraded":"2024-05-14T12:23:08.247121+0000","last_fullsized":"2024-05-14T12:23:08.247121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:18.032899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.242681+0000","last_change":"2024-05-14T12:20:59.671006+0000","last_active":"2024-05-14T12:23:08.242681+0000","last_peered":"2024-05-14T12:23:08.242681+0000","last_clean":"2024-05-14T12:23:08.242681+0000","last_became_active":"2024-05-14T12:20:59.670632+0000","last_became_peered":"2024-05-14T12:20:59.670632+0000","last_unstale":"2024-05-14T12:23:08.242681+0000","last_undegraded":"2024-05-14T12:23:08.242681+0000","last_fullsized":"2024-05-14T12:23:08.242681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:12:30.144637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243102+0000","last_change":"2024-05-14T12:20:59.675968+0000","last_active":"2024-05-14T12:23:08.243102+0000","last_peered":"2024-05-14T12:23:08.243102+0000","last_clean":"2024-05-14T12:23:08.243102+0000","last_became_active":"2024-05-14T12:20:59.675551+0000","last_became_peered":"2024-05-14T12:20:59.675551+0000","last_unstale":"2024-05-14T12:23:08.243102+0000","last_undegraded":"2024-05-14T12:23:08.243102+0000","last_fullsized":"2024-05-14T12:23:08.243102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:39.562658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240813+0000","last_change":"2024-05-14T12:20:59.671011+0000","last_active":"2024-05-14T12:23:08.240813+0000","last_peered":"2024-05-14T12:23:08.240813+0000","last_clean":"2024-05-14T12:23:08.240813+0000","last_became_active":"2024-05-14T12:20:59.670637+0000","last_became_peered":"2024-05-14T12:20:59.670637+0000","last_unstale":"2024-05-14T12:23:08.240813+0000","last_undegraded":"2024-05-14T12:23:08.240813+0000","last_fullsized":"2024-05-14T12:23:08.240813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:53.808936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.264725+0000","last_change":"2024-05-14T12:20:59.680039+0000","last_active":"2024-05-14T12:23:08.264725+0000","last_peered":"2024-05-14T12:23:08.264725+0000","last_clean":"2024-05-14T12:23:08.264725+0000","last_became_active":"2024-05-14T12:20:59.678120+0000","last_became_peered":"2024-05-14T12:20:59.678120+0000","last_unstale":"2024-05-14T12:23:08.264725+0000","last_undegraded":"2024-05-14T12:23:08.264725+0000","last_fullsized":"2024-05-14T12:23:08.264725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:19:28.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238076+0000","last_change":"2024-05-14T12:20:59.675301+0000","last_active":"2024-05-14T12:23:08.238076+0000","last_peered":"2024-05-14T12:23:08.238076+0000","last_clean":"2024-05-14T12:23:08.238076+0000","last_became_active":"2024-05-14T12:20:59.669861+0000","last_became_peered":"2024-05-14T12:20:59.669861+0000","last_unstale":"2024-05-14T12:23:08.238076+0000","last_undegraded":"2024-05-14T12:23:08.238076+0000","last_fullsized":"2024-05-14T12:23:08.238076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:19:17.931719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246752+0000","last_change":"2024-05-14T12:20:59.682378+0000","last_active":"2024-05-14T12:23:08.246752+0000","last_peered":"2024-05-14T12:23:08.246752+0000","last_clean":"2024-05-14T12:23:08.246752+0000","last_became_active":"2024-05-14T12:20:59.680598+0000","last_became_peered":"2024-05-14T12:20:59.680598+0000","last_unstale":"2024-05-14T12:23:08.246752+0000","last_undegraded":"2024-05-14T12:23:08.246752+0000","last_fullsized":"2024-05-14T12:23:08.246752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:22.189038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253368+0000","last_change":"2024-05-14T12:20:59.685447+0000","last_active":"2024-05-14T12:23:08.253368+0000","last_peered":"2024-05-14T12:23:08.253368+0000","last_clean":"2024-05-14T12:23:08.253368+0000","last_became_active":"2024-05-14T12:20:59.684963+0000","last_became_peered":"2024-05-14T12:20:59.684963+0000","last_unstale":"2024-05-14T12:23:08.253368+0000","last_undegraded":"2024-05-14T12:23:08.253368+0000","last_fullsized":"2024-05-14T12:23:08.253368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:47.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.249991+0000","last_change":"2024-05-14T12:20:59.681870+0000","last_active":"2024-05-14T12:23:08.249991+0000","last_peered":"2024-05-14T12:23:08.249991+0000","last_clean":"2024-05-14T12:23:08.249991+0000","last_became_active":"2024-05-14T12:20:59.681405+0000","last_became_peered":"2024-05-14T12:20:59.681405+0000","last_unstale":"2024-05-14T12:23:08.249991+0000","last_undegraded":"2024-05-14T12:23:08.249991+0000","last_fullsized":"2024-05-14T12:23:08.249991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:20.002496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.252517+0000","last_change":"2024-05-14T12:20:59.667486+0000","last_active":"2024-05-14T12:23:08.252517+0000","last_peered":"2024-05-14T12:23:08.252517+0000","last_clean":"2024-05-14T12:23:08.252517+0000","last_became_active":"2024-05-14T12:20:59.667032+0000","last_became_peered":"2024-05-14T12:20:59.667032+0000","last_unstale":"2024-05-14T12:23:08.252517+0000","last_undegraded":"2024-05-14T12:23:08.252517+0000","last_fullsized":"2024-05-14T12:23:08.252517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:25.325504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253867+0000","last_change":"2024-05-14T12:20:59.672065+0000","last_active":"2024-05-14T12:23:08.253867+0000","last_peered":"2024-05-14T12:23:08.253867+0000","last_clean":"2024-05-14T12:23:08.253867+0000","last_became_active":"2024-05-14T12:20:59.671692+0000","last_became_peered":"2024-05-14T12:20:59.671692+0000","last_unstale":"2024-05-14T12:23:08.253867+0000","last_undegraded":"2024-05-14T12:23:08.253867+0000","last_fullsized":"2024-05-14T12:23:08.253867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:11:47.952421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":154,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:12.654760+0000","last_change":"2024-05-14T12:20:55.611507+0000","last_active":"2024-05-14T12:23:12.654760+0000","last_peered":"2024-05-14T12:23:12.654760+0000","last_clean":"2024-05-14T12:23:12.654760+0000","last_became_active":"2024-05-14T12:20:55.606794+0000","last_became_peered":"2024-05-14T12:20:55.606794+0000","last_unstale":"2024-05-14T12:23:12.654760+0000","last_undegraded":"2024-05-14T12:23:12.654760+0000","last_fullsized":"2024-05-14T12:23:12.654760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:51.301124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246191+0000","last_change":"2024-05-14T12:20:59.673013+0000","last_active":"2024-05-14T12:23:08.246191+0000","last_peered":"2024-05-14T12:23:08.246191+0000","last_clean":"2024-05-14T12:23:08.246191+0000","last_became_active":"2024-05-14T12:20:59.672575+0000","last_became_peered":"2024-05-14T12:20:59.672575+0000","last_unstale":"2024-05-14T12:23:08.246191+0000","last_undegraded":"2024-05-14T12:23:08.246191+0000","last_fullsized":"2024-05-14T12:23:08.246191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:00:26.549099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703914+0000","last_change":"2024-05-14T12:20:55.963853+0000","last_active":"2024-05-14T12:21:39.703914+0000","last_peered":"2024-05-14T12:21:39.703914+0000","last_clean":"2024-05-14T12:21:39.703914+0000","last_became_active":"2024-05-14T12:20:55.962018+0000","last_became_peered":"2024-05-14T12:20:55.962018+0000","last_unstale":"2024-05-14T12:21:39.703914+0000","last_undegraded":"2024-05-14T12:21:39.703914+0000","last_fullsized":"2024-05-14T12:21:39.703914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:06:22.374595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253995+0000","last_change":"2024-05-14T12:20:59.671243+0000","last_active":"2024-05-14T12:23:08.253995+0000","last_peered":"2024-05-14T12:23:08.253995+0000","last_clean":"2024-05-14T12:23:08.253995+0000","last_became_active":"2024-05-14T12:20:59.665885+0000","last_became_peered":"2024-05-14T12:20:59.665885+0000","last_unstale":"2024-05-14T12:23:08.253995+0000","last_undegraded":"2024-05-14T12:23:08.253995+0000","last_fullsized":"2024-05-14T12:23:08.253995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:48.656774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.526944+0000","last_change":"2024-05-14T12:21:39.526944+0000","last_active":"2024-05-14T12:21:39.526944+0000","last_peered":"2024-05-14T12:21:39.526944+0000","last_clean":"2024-05-14T12:21:39.526944+0000","last_became_active":"2024-05-14T12:21:39.506478+0000","last_became_peered":"2024-05-14T12:21:39.506478+0000","last_unstale":"2024-05-14T12:21:39.526944+0000","last_undegraded":"2024-05-14T12:21:39.526944+0000","last_fullsized":"2024-05-14T12:21:39.526944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:41.812733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256609+0000","last_change":"2024-05-14T12:20:59.671282+0000","last_active":"2024-05-14T12:23:08.256609+0000","last_peered":"2024-05-14T12:23:08.256609+0000","last_clean":"2024-05-14T12:23:08.256609+0000","last_became_active":"2024-05-14T12:20:59.670645+0000","last_became_peered":"2024-05-14T12:20:59.670645+0000","last_unstale":"2024-05-14T12:23:08.256609+0000","last_undegraded":"2024-05-14T12:23:08.256609+0000","last_fullsized":"2024-05-14T12:23:08.256609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:51:57.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501842+0000","last_change":"2024-05-14T12:20:55.604757+0000","last_active":"2024-05-14T12:21:39.501842+0000","last_peered":"2024-05-14T12:21:39.501842+0000","last_clean":"2024-05-14T12:21:39.501842+0000","last_became_active":"2024-05-14T12:20:55.604281+0000","last_became_peered":"2024-05-14T12:20:55.604281+0000","last_unstale":"2024-05-14T12:21:39.501842+0000","last_undegraded":"2024-05-14T12:21:39.501842+0000","last_fullsized":"2024-05-14T12:21:39.501842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:52.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245572+0000","last_change":"2024-05-14T12:20:59.672498+0000","last_active":"2024-05-14T12:23:08.245572+0000","last_peered":"2024-05-14T12:23:08.245572+0000","last_clean":"2024-05-14T12:23:08.245572+0000","last_became_active":"2024-05-14T12:20:59.672116+0000","last_became_peered":"2024-05-14T12:20:59.672116+0000","last_unstale":"2024-05-14T12:23:08.245572+0000","last_undegraded":"2024-05-14T12:23:08.245572+0000","last_fullsized":"2024-05-14T12:23:08.245572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:47:34.614427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":115,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:15.713240+0000","last_change":"2024-05-14T12:21:39.515431+0000","last_active":"2024-05-14T12:23:15.713240+0000","last_peered":"2024-05-14T12:23:15.713240+0000","last_clean":"2024-05-14T12:23:15.713240+0000","last_became_active":"2024-05-14T12:21:39.503217+0000","last_became_peered":"2024-05-14T12:21:39.503217+0000","last_unstale":"2024-05-14T12:23:15.713240+0000","last_undegraded":"2024-05-14T12:23:15.713240+0000","last_fullsized":"2024-05-14T12:23:15.713240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:52:21.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255883+0000","last_change":"2024-05-14T12:20:59.664725+0000","last_active":"2024-05-14T12:23:08.255883+0000","last_peered":"2024-05-14T12:23:08.255883+0000","last_clean":"2024-05-14T12:23:08.255883+0000","last_became_active":"2024-05-14T12:20:59.664323+0000","last_became_peered":"2024-05-14T12:20:59.664323+0000","last_unstale":"2024-05-14T12:23:08.255883+0000","last_undegraded":"2024-05-14T12:23:08.255883+0000","last_fullsized":"2024-05-14T12:23:08.255883+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.729236+0000","last_change":"2024-05-14T12:21:39.729236+0000","last_active":"2024-05-14T12:21:39.729236+0000","last_peered":"2024-05-14T12:21:39.729236+0000","last_clean":"2024-05-14T12:21:39.729236+0000","last_became_active":"2024-05-14T12:21:39.722405+0000","last_became_peered":"2024-05-14T12:21:39.722405+0000","last_unstale":"2024-05-14T12:21:39.729236+0000","last_undegraded":"2024-05-14T12:21:39.729236+0000","last_fullsized":"2024-05-14T12:21:39.729236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:14:19.461411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243390+0000","last_change":"2024-05-14T12:20:59.671870+0000","last_active":"2024-05-14T12:23:08.243390+0000","last_peered":"2024-05-14T12:23:08.243390+0000","last_clean":"2024-05-14T12:23:08.243390+0000","last_became_active":"2024-05-14T12:20:59.671467+0000","last_became_peered":"2024-05-14T12:20:59.671467+0000","last_unstale":"2024-05-14T12:23:08.243390+0000","last_undegraded":"2024-05-14T12:23:08.243390+0000","last_fullsized":"2024-05-14T12:23:08.243390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:18.195518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498486+0000","last_change":"2024-05-14T12:20:55.613626+0000","last_active":"2024-05-14T12:21:39.498486+0000","last_peered":"2024-05-14T12:21:39.498486+0000","last_clean":"2024-05-14T12:21:39.498486+0000","last_became_active":"2024-05-14T12:20:55.613039+0000","last_became_peered":"2024-05-14T12:20:55.613039+0000","last_unstale":"2024-05-14T12:21:39.498486+0000","last_undegraded":"2024-05-14T12:21:39.498486+0000","last_fullsized":"2024-05-14T12:21:39.498486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:19.479433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259831+0000","last_change":"2024-05-14T12:20:59.683152+0000","last_active":"2024-05-14T12:23:08.259831+0000","last_peered":"2024-05-14T12:23:08.259831+0000","last_clean":"2024-05-14T12:23:08.259831+0000","last_became_active":"2024-05-14T12:20:59.682863+0000","last_became_peered":"2024-05-14T12:20:59.682863+0000","last_unstale":"2024-05-14T12:23:08.259831+0000","last_undegraded":"2024-05-14T12:23:08.259831+0000","last_fullsized":"2024-05-14T12:23:08.259831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:26.975487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496367+0000","last_change":"2024-05-14T12:20:55.604785+0000","last_active":"2024-05-14T12:21:39.496367+0000","last_peered":"2024-05-14T12:21:39.496367+0000","last_clean":"2024-05-14T12:21:39.496367+0000","last_became_active":"2024-05-14T12:20:55.604249+0000","last_became_peered":"2024-05-14T12:20:55.604249+0000","last_unstale":"2024-05-14T12:21:39.496367+0000","last_undegraded":"2024-05-14T12:21:39.496367+0000","last_fullsized":"2024-05-14T12:21:39.496367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:51.954691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254865+0000","last_change":"2024-05-14T12:20:59.677047+0000","last_active":"2024-05-14T12:23:08.254865+0000","last_peered":"2024-05-14T12:23:08.254865+0000","last_clean":"2024-05-14T12:23:08.254865+0000","last_became_active":"2024-05-14T12:20:59.673314+0000","last_became_peered":"2024-05-14T12:20:59.673314+0000","last_unstale":"2024-05-14T12:23:08.254865+0000","last_undegraded":"2024-05-14T12:23:08.254865+0000","last_fullsized":"2024-05-14T12:23:08.254865+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:54.069762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":259,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:15.624852+0000","last_change":"2024-05-14T12:20:55.608986+0000","last_active":"2024-05-14T12:23:15.624852+0000","last_peered":"2024-05-14T12:23:15.624852+0000","last_clean":"2024-05-14T12:23:15.624852+0000","last_became_active":"2024-05-14T12:20:55.608476+0000","last_became_peered":"2024-05-14T12:20:55.608476+0000","last_unstale":"2024-05-14T12:23:15.624852+0000","last_undegraded":"2024-05-14T12:23:15.624852+0000","last_fullsized":"2024-05-14T12:23:15.624852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:15:40.777724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251521+0000","last_change":"2024-05-14T12:20:59.673404+0000","last_active":"2024-05-14T12:23:08.251521+0000","last_peered":"2024-05-14T12:23:08.251521+0000","last_clean":"2024-05-14T12:23:08.251521+0000","last_became_active":"2024-05-14T12:20:59.673035+0000","last_became_peered":"2024-05-14T12:20:59.673035+0000","last_unstale":"2024-05-14T12:23:08.251521+0000","last_undegraded":"2024-05-14T12:23:08.251521+0000","last_fullsized":"2024-05-14T12:23:08.251521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:29:42.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498488+0000","last_change":"2024-05-14T12:20:55.605789+0000","last_active":"2024-05-14T12:21:39.498488+0000","last_peered":"2024-05-14T12:21:39.498488+0000","last_clean":"2024-05-14T12:21:39.498488+0000","last_became_active":"2024-05-14T12:20:55.605166+0000","last_became_peered":"2024-05-14T12:20:55.605166+0000","last_unstale":"2024-05-14T12:21:39.498488+0000","last_undegraded":"2024-05-14T12:21:39.498488+0000","last_fullsized":"2024-05-14T12:21:39.498488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:44.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244013+0000","last_change":"2024-05-14T12:20:59.678373+0000","last_active":"2024-05-14T12:23:08.244013+0000","last_peered":"2024-05-14T12:23:08.244013+0000","last_clean":"2024-05-14T12:23:08.244013+0000","last_became_active":"2024-05-14T12:20:59.673378+0000","last_became_peered":"2024-05-14T12:20:59.673378+0000","last_unstale":"2024-05-14T12:23:08.244013+0000","last_undegraded":"2024-05-14T12:23:08.244013+0000","last_fullsized":"2024-05-14T12:23:08.244013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:17:36.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496483+0000","last_change":"2024-05-14T12:20:55.966507+0000","last_active":"2024-05-14T12:21:39.496483+0000","last_peered":"2024-05-14T12:21:39.496483+0000","last_clean":"2024-05-14T12:21:39.496483+0000","last_became_active":"2024-05-14T12:20:55.966066+0000","last_became_peered":"2024-05-14T12:20:55.966066+0000","last_unstale":"2024-05-14T12:21:39.496483+0000","last_undegraded":"2024-05-14T12:21:39.496483+0000","last_fullsized":"2024-05-14T12:21:39.496483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:20.276346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250217+0000","last_change":"2024-05-14T12:20:59.669926+0000","last_active":"2024-05-14T12:23:08.250217+0000","last_peered":"2024-05-14T12:23:08.250217+0000","last_clean":"2024-05-14T12:23:08.250217+0000","last_became_active":"2024-05-14T12:20:59.669502+0000","last_became_peered":"2024-05-14T12:20:59.669502+0000","last_unstale":"2024-05-14T12:23:08.250217+0000","last_undegraded":"2024-05-14T12:23:08.250217+0000","last_fullsized":"2024-05-14T12:23:08.250217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:02.036442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":302,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:15.650421+0000","last_change":"2024-05-14T12:20:55.602307+0000","last_active":"2024-05-14T12:23:15.650421+0000","last_peered":"2024-05-14T12:23:15.650421+0000","last_clean":"2024-05-14T12:23:15.650421+0000","last_became_active":"2024-05-14T12:20:55.601879+0000","last_became_peered":"2024-05-14T12:20:55.601879+0000","last_unstale":"2024-05-14T12:23:15.650421+0000","last_undegraded":"2024-05-14T12:23:15.650421+0000","last_fullsized":"2024-05-14T12:23:15.650421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:10.839268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64973,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":182,"num_write":39,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244616+0000","last_change":"2024-05-14T12:20:59.676162+0000","last_active":"2024-05-14T12:23:08.244616+0000","last_peered":"2024-05-14T12:23:08.244616+0000","last_clean":"2024-05-14T12:23:08.244616+0000","last_became_active":"2024-05-14T12:20:59.675742+0000","last_became_peered":"2024-05-14T12:20:59.675742+0000","last_unstale":"2024-05-14T12:23:08.244616+0000","last_undegraded":"2024-05-14T12:23:08.244616+0000","last_fullsized":"2024-05-14T12:23:08.244616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:52:00.100743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501460+0000","last_change":"2024-05-14T12:20:55.616014+0000","last_active":"2024-05-14T12:21:39.501460+0000","last_peered":"2024-05-14T12:21:39.501460+0000","last_clean":"2024-05-14T12:21:39.501460+0000","last_became_active":"2024-05-14T12:20:55.615331+0000","last_became_peered":"2024-05-14T12:20:55.615331+0000","last_unstale":"2024-05-14T12:21:39.501460+0000","last_undegraded":"2024-05-14T12:21:39.501460+0000","last_fullsized":"2024-05-14T12:21:39.501460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:53.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261815+0000","last_change":"2024-05-14T12:20:59.690299+0000","last_active":"2024-05-14T12:23:08.261815+0000","last_peered":"2024-05-14T12:23:08.261815+0000","last_clean":"2024-05-14T12:23:08.261815+0000","last_became_active":"2024-05-14T12:20:59.689959+0000","last_became_peered":"2024-05-14T12:20:59.689959+0000","last_unstale":"2024-05-14T12:23:08.261815+0000","last_undegraded":"2024-05-14T12:23:08.261815+0000","last_fullsized":"2024-05-14T12:23:08.261815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:53.017238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496270+0000","last_change":"2024-05-14T12:20:55.615860+0000","last_active":"2024-05-14T12:21:39.496270+0000","last_peered":"2024-05-14T12:21:39.496270+0000","last_clean":"2024-05-14T12:21:39.496270+0000","last_became_active":"2024-05-14T12:20:55.615415+0000","last_became_peered":"2024-05-14T12:20:55.615415+0000","last_unstale":"2024-05-14T12:21:39.496270+0000","last_undegraded":"2024-05-14T12:21:39.496270+0000","last_fullsized":"2024-05-14T12:21:39.496270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:27:55.368122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257956+0000","last_change":"2024-05-14T12:20:59.684759+0000","last_active":"2024-05-14T12:23:08.257956+0000","last_peered":"2024-05-14T12:23:08.257956+0000","last_clean":"2024-05-14T12:23:08.257956+0000","last_became_active":"2024-05-14T12:20:59.684277+0000","last_became_peered":"2024-05-14T12:20:59.684277+0000","last_unstale":"2024-05-14T12:23:08.257956+0000","last_undegraded":"2024-05-14T12:23:08.257956+0000","last_fullsized":"2024-05-14T12:23:08.257956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:42:08.535580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:16.667263+0000","last_change":"2024-05-14T12:20:55.602130+0000","last_active":"2024-05-14T12:23:16.667263+0000","last_peered":"2024-05-14T12:23:16.667263+0000","last_clean":"2024-05-14T12:23:16.667263+0000","last_became_active":"2024-05-14T12:20:55.601635+0000","last_became_peered":"2024-05-14T12:20:55.601635+0000","last_unstale":"2024-05-14T12:23:16.667263+0000","last_undegraded":"2024-05-14T12:23:16.667263+0000","last_fullsized":"2024-05-14T12:23:16.667263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:24:34.599413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250869+0000","last_change":"2024-05-14T12:21:39.505509+0000","last_active":"2024-05-14T12:23:08.250869+0000","last_peered":"2024-05-14T12:23:08.250869+0000","last_clean":"2024-05-14T12:23:08.250869+0000","last_became_active":"2024-05-14T12:21:39.504817+0000","last_became_peered":"2024-05-14T12:21:39.504817+0000","last_unstale":"2024-05-14T12:23:08.250869+0000","last_undegraded":"2024-05-14T12:23:08.250869+0000","last_fullsized":"2024-05-14T12:23:08.250869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:05:08.309898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501589+0000","last_change":"2024-05-14T12:20:55.962404+0000","last_active":"2024-05-14T12:21:39.501589+0000","last_peered":"2024-05-14T12:21:39.501589+0000","last_clean":"2024-05-14T12:21:39.501589+0000","last_became_active":"2024-05-14T12:20:55.961886+0000","last_became_peered":"2024-05-14T12:20:55.961886+0000","last_unstale":"2024-05-14T12:21:39.501589+0000","last_undegraded":"2024-05-14T12:21:39.501589+0000","last_fullsized":"2024-05-14T12:21:39.501589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:30.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.229430+0000","last_change":"2024-05-14T12:20:59.674010+0000","last_active":"2024-05-14T12:23:08.229430+0000","last_peered":"2024-05-14T12:23:08.229430+0000","last_clean":"2024-05-14T12:23:08.229430+0000","last_became_active":"2024-05-14T12:20:59.673546+0000","last_became_peered":"2024-05-14T12:20:59.673546+0000","last_unstale":"2024-05-14T12:23:08.229430+0000","last_undegraded":"2024-05-14T12:23:08.229430+0000","last_fullsized":"2024-05-14T12:23:08.229430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:59.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.513347+0000","last_change":"2024-05-14T12:21:39.512745+0000","last_active":"2024-05-14T12:21:39.513347+0000","last_peered":"2024-05-14T12:21:39.513347+0000","last_clean":"2024-05-14T12:21:39.513347+0000","last_became_active":"2024-05-14T12:21:39.502690+0000","last_became_peered":"2024-05-14T12:21:39.502690+0000","last_unstale":"2024-05-14T12:21:39.513347+0000","last_undegraded":"2024-05-14T12:21:39.513347+0000","last_fullsized":"2024-05-14T12:21:39.513347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:55:22.829094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240989+0000","last_change":"2024-05-14T12:20:59.671773+0000","last_active":"2024-05-14T12:23:08.240989+0000","last_peered":"2024-05-14T12:23:08.240989+0000","last_clean":"2024-05-14T12:23:08.240989+0000","last_became_active":"2024-05-14T12:20:59.671380+0000","last_became_peered":"2024-05-14T12:20:59.671380+0000","last_unstale":"2024-05-14T12:23:08.240989+0000","last_undegraded":"2024-05-14T12:23:08.240989+0000","last_fullsized":"2024-05-14T12:23:08.240989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:23.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500635+0000","last_change":"2024-05-14T12:20:55.965843+0000","last_active":"2024-05-14T12:21:39.500635+0000","last_peered":"2024-05-14T12:21:39.500635+0000","last_clean":"2024-05-14T12:21:39.500635+0000","last_became_active":"2024-05-14T12:20:55.963827+0000","last_became_peered":"2024-05-14T12:20:55.963827+0000","last_unstale":"2024-05-14T12:21:39.500635+0000","last_undegraded":"2024-05-14T12:21:39.500635+0000","last_fullsized":"2024-05-14T12:21:39.500635+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:22.464989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259298+0000","last_change":"2024-05-14T12:20:59.674932+0000","last_active":"2024-05-14T12:23:08.259298+0000","last_peered":"2024-05-14T12:23:08.259298+0000","last_clean":"2024-05-14T12:23:08.259298+0000","last_became_active":"2024-05-14T12:20:59.674259+0000","last_became_peered":"2024-05-14T12:20:59.674259+0000","last_unstale":"2024-05-14T12:23:08.259298+0000","last_undegraded":"2024-05-14T12:23:08.259298+0000","last_fullsized":"2024-05-14T12:23:08.259298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:45.362069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:13.657179+0000","last_change":"2024-05-14T12:20:55.610031+0000","last_active":"2024-05-14T12:23:13.657179+0000","last_peered":"2024-05-14T12:23:13.657179+0000","last_clean":"2024-05-14T12:23:13.657179+0000","last_became_active":"2024-05-14T12:20:55.609730+0000","last_became_peered":"2024-05-14T12:20:55.609730+0000","last_unstale":"2024-05-14T12:23:13.657179+0000","last_undegraded":"2024-05-14T12:23:13.657179+0000","last_fullsized":"2024-05-14T12:23:13.657179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:35.763466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241082+0000","last_change":"2024-05-14T12:20:59.673504+0000","last_active":"2024-05-14T12:23:08.241082+0000","last_peered":"2024-05-14T12:23:08.241082+0000","last_clean":"2024-05-14T12:23:08.241082+0000","last_became_active":"2024-05-14T12:20:59.673100+0000","last_became_peered":"2024-05-14T12:20:59.673100+0000","last_unstale":"2024-05-14T12:23:08.241082+0000","last_undegraded":"2024-05-14T12:23:08.241082+0000","last_fullsized":"2024-05-14T12:23:08.241082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:02.262916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.233530+0000","last_change":"2024-05-14T12:20:59.674694+0000","last_active":"2024-05-14T12:23:08.233530+0000","last_peered":"2024-05-14T12:23:08.233530+0000","last_clean":"2024-05-14T12:23:08.233530+0000","last_became_active":"2024-05-14T12:20:59.673566+0000","last_became_peered":"2024-05-14T12:20:59.673566+0000","last_unstale":"2024-05-14T12:23:08.233530+0000","last_undegraded":"2024-05-14T12:23:08.233530+0000","last_fullsized":"2024-05-14T12:23:08.233530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:49:28.596919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:11.657682+0000","last_change":"2024-05-14T12:20:55.963207+0000","last_active":"2024-05-14T12:23:11.657682+0000","last_peered":"2024-05-14T12:23:11.657682+0000","last_clean":"2024-05-14T12:23:11.657682+0000","last_became_active":"2024-05-14T12:20:55.962084+0000","last_became_peered":"2024-05-14T12:20:55.962084+0000","last_unstale":"2024-05-14T12:23:11.657682+0000","last_undegraded":"2024-05-14T12:23:11.657682+0000","last_fullsized":"2024-05-14T12:23:11.657682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:17.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254789+0000","last_change":"2024-05-14T12:20:59.682629+0000","last_active":"2024-05-14T12:23:08.254789+0000","last_peered":"2024-05-14T12:23:08.254789+0000","last_clean":"2024-05-14T12:23:08.254789+0000","last_became_active":"2024-05-14T12:20:59.672656+0000","last_became_peered":"2024-05-14T12:20:59.672656+0000","last_unstale":"2024-05-14T12:23:08.254789+0000","last_undegraded":"2024-05-14T12:23:08.254789+0000","last_fullsized":"2024-05-14T12:23:08.254789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:23:29.651740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501096+0000","last_change":"2024-05-14T12:20:55.605223+0000","last_active":"2024-05-14T12:21:39.501096+0000","last_peered":"2024-05-14T12:21:39.501096+0000","last_clean":"2024-05-14T12:21:39.501096+0000","last_became_active":"2024-05-14T12:20:55.604743+0000","last_became_peered":"2024-05-14T12:20:55.604743+0000","last_unstale":"2024-05-14T12:21:39.501096+0000","last_undegraded":"2024-05-14T12:21:39.501096+0000","last_fullsized":"2024-05-14T12:21:39.501096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:15.258776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499375+0000","last_change":"2024-05-14T12:19:22.477995+0000","last_active":"2024-05-14T12:21:39.499375+0000","last_peered":"2024-05-14T12:21:39.499375+0000","last_clean":"2024-05-14T12:21:39.499375+0000","last_became_active":"2024-05-14T12:19:22.471890+0000","last_became_peered":"2024-05-14T12:19:22.471890+0000","last_unstale":"2024-05-14T12:21:39.499375+0000","last_undegraded":"2024-05-14T12:21:39.499375+0000","last_fullsized":"2024-05-14T12:21:39.499375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_clean_scrub_stamp":"2024-05-14T12:15:26.966159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:18.761547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239274+0000","last_change":"2024-05-14T12:20:59.674341+0000","last_active":"2024-05-14T12:23:08.239274+0000","last_peered":"2024-05-14T12:23:08.239274+0000","last_clean":"2024-05-14T12:23:08.239274+0000","last_became_active":"2024-05-14T12:20:59.672199+0000","last_became_peered":"2024-05-14T12:20:59.672199+0000","last_unstale":"2024-05-14T12:23:08.239274+0000","last_undegraded":"2024-05-14T12:23:08.239274+0000","last_fullsized":"2024-05-14T12:23:08.239274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.666708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499490+0000","last_change":"2024-05-14T12:20:55.605513+0000","last_active":"2024-05-14T12:21:39.499490+0000","last_peered":"2024-05-14T12:21:39.499490+0000","last_clean":"2024-05-14T12:21:39.499490+0000","last_became_active":"2024-05-14T12:20:55.605131+0000","last_became_peered":"2024-05-14T12:20:55.605131+0000","last_unstale":"2024-05-14T12:21:39.499490+0000","last_undegraded":"2024-05-14T12:21:39.499490+0000","last_fullsized":"2024-05-14T12:21:39.499490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:56.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502704+0000","last_change":"2024-05-14T12:20:55.966357+0000","last_active":"2024-05-14T12:21:39.502704+0000","last_peered":"2024-05-14T12:21:39.502704+0000","last_clean":"2024-05-14T12:21:39.502704+0000","last_became_active":"2024-05-14T12:20:55.965946+0000","last_became_peered":"2024-05-14T12:20:55.965946+0000","last_unstale":"2024-05-14T12:21:39.502704+0000","last_undegraded":"2024-05-14T12:21:39.502704+0000","last_fullsized":"2024-05-14T12:21:39.502704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:20.843819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253081+0000","last_change":"2024-05-14T12:20:59.675130+0000","last_active":"2024-05-14T12:23:08.253081+0000","last_peered":"2024-05-14T12:23:08.253081+0000","last_clean":"2024-05-14T12:23:08.253081+0000","last_became_active":"2024-05-14T12:20:59.674639+0000","last_became_peered":"2024-05-14T12:20:59.674639+0000","last_unstale":"2024-05-14T12:23:08.253081+0000","last_undegraded":"2024-05-14T12:23:08.253081+0000","last_fullsized":"2024-05-14T12:23:08.253081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:34:47.167894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.713889+0000","last_change":"2024-05-14T12:20:55.615975+0000","last_active":"2024-05-14T12:23:08.713889+0000","last_peered":"2024-05-14T12:23:08.713889+0000","last_clean":"2024-05-14T12:23:08.713889+0000","last_became_active":"2024-05-14T12:20:55.615542+0000","last_became_peered":"2024-05-14T12:20:55.615542+0000","last_unstale":"2024-05-14T12:23:08.713889+0000","last_undegraded":"2024-05-14T12:23:08.713889+0000","last_fullsized":"2024-05-14T12:23:08.713889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:52:46.621227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260341+0000","last_change":"2024-05-14T12:20:59.679047+0000","last_active":"2024-05-14T12:23:08.260341+0000","last_peered":"2024-05-14T12:23:08.260341+0000","last_clean":"2024-05-14T12:23:08.260341+0000","last_became_active":"2024-05-14T12:20:59.678620+0000","last_became_peered":"2024-05-14T12:20:59.678620+0000","last_unstale":"2024-05-14T12:23:08.260341+0000","last_undegraded":"2024-05-14T12:23:08.260341+0000","last_fullsized":"2024-05-14T12:23:08.260341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:30.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501411+0000","last_change":"2024-05-14T12:20:55.836121+0000","last_active":"2024-05-14T12:21:39.501411+0000","last_peered":"2024-05-14T12:21:39.501411+0000","last_clean":"2024-05-14T12:21:39.501411+0000","last_became_active":"2024-05-14T12:20:55.835758+0000","last_became_peered":"2024-05-14T12:20:55.835758+0000","last_unstale":"2024-05-14T12:21:39.501411+0000","last_undegraded":"2024-05-14T12:21:39.501411+0000","last_fullsized":"2024-05-14T12:21:39.501411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:29:12.627760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261142+0000","last_change":"2024-05-14T12:20:59.679664+0000","last_active":"2024-05-14T12:23:08.261142+0000","last_peered":"2024-05-14T12:23:08.261142+0000","last_clean":"2024-05-14T12:23:08.261142+0000","last_became_active":"2024-05-14T12:20:59.679242+0000","last_became_peered":"2024-05-14T12:20:59.679242+0000","last_unstale":"2024-05-14T12:23:08.261142+0000","last_undegraded":"2024-05-14T12:23:08.261142+0000","last_fullsized":"2024-05-14T12:23:08.261142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:38:17.910624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721087+0000","last_change":"2024-05-14T12:20:55.965927+0000","last_active":"2024-05-14T12:21:39.721087+0000","last_peered":"2024-05-14T12:21:39.721087+0000","last_clean":"2024-05-14T12:21:39.721087+0000","last_became_active":"2024-05-14T12:20:55.965570+0000","last_became_peered":"2024-05-14T12:20:55.965570+0000","last_unstale":"2024-05-14T12:21:39.721087+0000","last_undegraded":"2024-05-14T12:21:39.721087+0000","last_fullsized":"2024-05-14T12:21:39.721087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:16:23.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239485+0000","last_change":"2024-05-14T12:20:59.662521+0000","last_active":"2024-05-14T12:23:08.239485+0000","last_peered":"2024-05-14T12:23:08.239485+0000","last_clean":"2024-05-14T12:23:08.239485+0000","last_became_active":"2024-05-14T12:20:59.662140+0000","last_became_peered":"2024-05-14T12:20:59.662140+0000","last_unstale":"2024-05-14T12:23:08.239485+0000","last_undegraded":"2024-05-14T12:23:08.239485+0000","last_fullsized":"2024-05-14T12:23:08.239485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:44.471630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702986+0000","last_change":"2024-05-14T12:20:55.614124+0000","last_active":"2024-05-14T12:21:39.702986+0000","last_peered":"2024-05-14T12:21:39.702986+0000","last_clean":"2024-05-14T12:21:39.702986+0000","last_became_active":"2024-05-14T12:20:55.610826+0000","last_became_peered":"2024-05-14T12:20:55.610826+0000","last_unstale":"2024-05-14T12:21:39.702986+0000","last_undegraded":"2024-05-14T12:21:39.702986+0000","last_fullsized":"2024-05-14T12:21:39.702986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:01:30.296978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241601+0000","last_change":"2024-05-14T12:20:59.684356+0000","last_active":"2024-05-14T12:23:08.241601+0000","last_peered":"2024-05-14T12:23:08.241601+0000","last_clean":"2024-05-14T12:23:08.241601+0000","last_became_active":"2024-05-14T12:20:59.683942+0000","last_became_peered":"2024-05-14T12:20:59.683942+0000","last_unstale":"2024-05-14T12:23:08.241601+0000","last_undegraded":"2024-05-14T12:23:08.241601+0000","last_fullsized":"2024-05-14T12:23:08.241601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:50.421104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501801+0000","last_change":"2024-05-14T12:20:55.615921+0000","last_active":"2024-05-14T12:21:39.501801+0000","last_peered":"2024-05-14T12:21:39.501801+0000","last_clean":"2024-05-14T12:21:39.501801+0000","last_became_active":"2024-05-14T12:20:55.615448+0000","last_became_peered":"2024-05-14T12:20:55.615448+0000","last_unstale":"2024-05-14T12:21:39.501801+0000","last_undegraded":"2024-05-14T12:21:39.501801+0000","last_fullsized":"2024-05-14T12:21:39.501801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:41:00.260869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260052+0000","last_change":"2024-05-14T12:20:59.690629+0000","last_active":"2024-05-14T12:23:08.260052+0000","last_peered":"2024-05-14T12:23:08.260052+0000","last_clean":"2024-05-14T12:23:08.260052+0000","last_became_active":"2024-05-14T12:20:59.689696+0000","last_became_peered":"2024-05-14T12:20:59.689696+0000","last_unstale":"2024-05-14T12:23:08.260052+0000","last_undegraded":"2024-05-14T12:23:08.260052+0000","last_fullsized":"2024-05-14T12:23:08.260052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:27.678235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.531447+0000","last_change":"2024-05-14T12:21:39.530824+0000","last_active":"2024-05-14T12:21:39.531447+0000","last_peered":"2024-05-14T12:21:39.531447+0000","last_clean":"2024-05-14T12:21:39.531447+0000","last_became_active":"2024-05-14T12:21:39.507316+0000","last_became_peered":"2024-05-14T12:21:39.507316+0000","last_unstale":"2024-05-14T12:21:39.531447+0000","last_undegraded":"2024-05-14T12:21:39.531447+0000","last_fullsized":"2024-05-14T12:21:39.531447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:06:46.506545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257038+0000","last_change":"2024-05-14T12:20:59.679078+0000","last_active":"2024-05-14T12:23:08.257038+0000","last_peered":"2024-05-14T12:23:08.257038+0000","last_clean":"2024-05-14T12:23:08.257038+0000","last_became_active":"2024-05-14T12:20:59.678713+0000","last_became_peered":"2024-05-14T12:20:59.678713+0000","last_unstale":"2024-05-14T12:23:08.257038+0000","last_undegraded":"2024-05-14T12:23:08.257038+0000","last_fullsized":"2024-05-14T12:23:08.257038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:46:44.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":151,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:13.622828+0000","last_change":"2024-05-14T12:20:55.965829+0000","last_active":"2024-05-14T12:23:13.622828+0000","last_peered":"2024-05-14T12:23:13.622828+0000","last_clean":"2024-05-14T12:23:13.622828+0000","last_became_active":"2024-05-14T12:20:55.965316+0000","last_became_peered":"2024-05-14T12:20:55.965316+0000","last_unstale":"2024-05-14T12:23:13.622828+0000","last_undegraded":"2024-05-14T12:23:13.622828+0000","last_fullsized":"2024-05-14T12:23:13.622828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:46:36.879599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245162+0000","last_change":"2024-05-14T12:20:59.673582+0000","last_active":"2024-05-14T12:23:08.245162+0000","last_peered":"2024-05-14T12:23:08.245162+0000","last_clean":"2024-05-14T12:23:08.245162+0000","last_became_active":"2024-05-14T12:20:59.672475+0000","last_became_peered":"2024-05-14T12:20:59.672475+0000","last_unstale":"2024-05-14T12:23:08.245162+0000","last_undegraded":"2024-05-14T12:23:08.245162+0000","last_fullsized":"2024-05-14T12:23:08.245162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:06:04.861177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496398+0000","last_change":"2024-05-14T12:20:55.615870+0000","last_active":"2024-05-14T12:21:39.496398+0000","last_peered":"2024-05-14T12:21:39.496398+0000","last_clean":"2024-05-14T12:21:39.496398+0000","last_became_active":"2024-05-14T12:20:55.615444+0000","last_became_peered":"2024-05-14T12:20:55.615444+0000","last_unstale":"2024-05-14T12:21:39.496398+0000","last_undegraded":"2024-05-14T12:21:39.496398+0000","last_fullsized":"2024-05-14T12:21:39.496398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:03.081164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259667+0000","last_change":"2024-05-14T12:20:59.688252+0000","last_active":"2024-05-14T12:23:08.259667+0000","last_peered":"2024-05-14T12:23:08.259667+0000","last_clean":"2024-05-14T12:23:08.259667+0000","last_became_active":"2024-05-14T12:20:59.687861+0000","last_became_peered":"2024-05-14T12:20:59.687861+0000","last_unstale":"2024-05-14T12:23:08.259667+0000","last_undegraded":"2024-05-14T12:23:08.259667+0000","last_fullsized":"2024-05-14T12:23:08.259667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:29:00.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500452+0000","last_change":"2024-05-14T12:20:55.616119+0000","last_active":"2024-05-14T12:21:39.500452+0000","last_peered":"2024-05-14T12:21:39.500452+0000","last_clean":"2024-05-14T12:21:39.500452+0000","last_became_active":"2024-05-14T12:20:55.615700+0000","last_became_peered":"2024-05-14T12:20:55.615700+0000","last_unstale":"2024-05-14T12:21:39.500452+0000","last_undegraded":"2024-05-14T12:21:39.500452+0000","last_fullsized":"2024-05-14T12:21:39.500452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:39.342610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245535+0000","last_change":"2024-05-14T12:20:59.672495+0000","last_active":"2024-05-14T12:23:08.245535+0000","last_peered":"2024-05-14T12:23:08.245535+0000","last_clean":"2024-05-14T12:23:08.245535+0000","last_became_active":"2024-05-14T12:20:59.671983+0000","last_became_peered":"2024-05-14T12:20:59.671983+0000","last_unstale":"2024-05-14T12:23:08.245535+0000","last_undegraded":"2024-05-14T12:23:08.245535+0000","last_fullsized":"2024-05-14T12:23:08.245535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:41.336895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239937+0000","last_change":"2024-05-14T12:20:59.663818+0000","last_active":"2024-05-14T12:23:08.239937+0000","last_peered":"2024-05-14T12:23:08.239937+0000","last_clean":"2024-05-14T12:23:08.239937+0000","last_became_active":"2024-05-14T12:20:59.663431+0000","last_became_peered":"2024-05-14T12:20:59.663431+0000","last_unstale":"2024-05-14T12:23:08.239937+0000","last_undegraded":"2024-05-14T12:23:08.239937+0000","last_fullsized":"2024-05-14T12:23:08.239937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:40:10.435481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240311+0000","last_change":"2024-05-14T12:20:59.668412+0000","last_active":"2024-05-14T12:23:08.240311+0000","last_peered":"2024-05-14T12:23:08.240311+0000","last_clean":"2024-05-14T12:23:08.240311+0000","last_became_active":"2024-05-14T12:20:59.667963+0000","last_became_peered":"2024-05-14T12:20:59.667963+0000","last_unstale":"2024-05-14T12:23:08.240311+0000","last_undegraded":"2024-05-14T12:23:08.240311+0000","last_fullsized":"2024-05-14T12:23:08.240311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:50:19.463843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243037+0000","last_change":"2024-05-14T12:20:59.668796+0000","last_active":"2024-05-14T12:23:08.243037+0000","last_peered":"2024-05-14T12:23:08.243037+0000","last_clean":"2024-05-14T12:23:08.243037+0000","last_became_active":"2024-05-14T12:20:59.668414+0000","last_became_peered":"2024-05-14T12:20:59.668414+0000","last_unstale":"2024-05-14T12:23:08.243037+0000","last_undegraded":"2024-05-14T12:23:08.243037+0000","last_fullsized":"2024-05-14T12:23:08.243037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:28.669547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257458+0000","last_change":"2024-05-14T12:20:59.687417+0000","last_active":"2024-05-14T12:23:08.257458+0000","last_peered":"2024-05-14T12:23:08.257458+0000","last_clean":"2024-05-14T12:23:08.257458+0000","last_became_active":"2024-05-14T12:20:59.686373+0000","last_became_peered":"2024-05-14T12:20:59.686373+0000","last_unstale":"2024-05-14T12:23:08.257458+0000","last_undegraded":"2024-05-14T12:23:08.257458+0000","last_fullsized":"2024-05-14T12:23:08.257458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:55.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255534+0000","last_change":"2024-05-14T12:21:40.359831+0000","last_active":"2024-05-14T12:23:08.255534+0000","last_peered":"2024-05-14T12:23:08.255534+0000","last_clean":"2024-05-14T12:23:08.255534+0000","last_became_active":"2024-05-14T12:21:40.358347+0000","last_became_peered":"2024-05-14T12:21:40.358347+0000","last_unstale":"2024-05-14T12:23:08.255534+0000","last_undegraded":"2024-05-14T12:23:08.255534+0000","last_fullsized":"2024-05-14T12:23:08.255534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:03:58.165602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238787+0000","last_change":"2024-05-14T12:20:59.663332+0000","last_active":"2024-05-14T12:23:08.238787+0000","last_peered":"2024-05-14T12:23:08.238787+0000","last_clean":"2024-05-14T12:23:08.238787+0000","last_became_active":"2024-05-14T12:20:59.662714+0000","last_became_peered":"2024-05-14T12:20:59.662714+0000","last_unstale":"2024-05-14T12:23:08.238787+0000","last_undegraded":"2024-05-14T12:23:08.238787+0000","last_fullsized":"2024-05-14T12:23:08.238787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:59.140579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.234610+0000","last_change":"2024-05-14T12:20:59.665482+0000","last_active":"2024-05-14T12:23:08.234610+0000","last_peered":"2024-05-14T12:23:08.234610+0000","last_clean":"2024-05-14T12:23:08.234610+0000","last_became_active":"2024-05-14T12:20:59.665001+0000","last_became_peered":"2024-05-14T12:20:59.665001+0000","last_unstale":"2024-05-14T12:23:08.234610+0000","last_undegraded":"2024-05-14T12:23:08.234610+0000","last_fullsized":"2024-05-14T12:23:08.234610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:26.074054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246632+0000","last_change":"2024-05-14T12:20:59.679317+0000","last_active":"2024-05-14T12:23:08.246632+0000","last_peered":"2024-05-14T12:23:08.246632+0000","last_clean":"2024-05-14T12:23:08.246632+0000","last_became_active":"2024-05-14T12:20:59.675797+0000","last_became_peered":"2024-05-14T12:20:59.675797+0000","last_unstale":"2024-05-14T12:23:08.246632+0000","last_undegraded":"2024-05-14T12:23:08.246632+0000","last_fullsized":"2024-05-14T12:23:08.246632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:58.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250723+0000","last_change":"2024-05-14T12:20:59.669982+0000","last_active":"2024-05-14T12:23:08.250723+0000","last_peered":"2024-05-14T12:23:08.250723+0000","last_clean":"2024-05-14T12:23:08.250723+0000","last_became_active":"2024-05-14T12:20:59.669587+0000","last_became_peered":"2024-05-14T12:20:59.669587+0000","last_unstale":"2024-05-14T12:23:08.250723+0000","last_undegraded":"2024-05-14T12:23:08.250723+0000","last_fullsized":"2024-05-14T12:23:08.250723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:31.474906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260491+0000","last_change":"2024-05-14T12:20:59.672672+0000","last_active":"2024-05-14T12:23:08.260491+0000","last_peered":"2024-05-14T12:23:08.260491+0000","last_clean":"2024-05-14T12:23:08.260491+0000","last_became_active":"2024-05-14T12:20:59.672191+0000","last_became_peered":"2024-05-14T12:20:59.672191+0000","last_unstale":"2024-05-14T12:23:08.260491+0000","last_undegraded":"2024-05-14T12:23:08.260491+0000","last_fullsized":"2024-05-14T12:23:08.260491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:53:14.530296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260678+0000","last_change":"2024-05-14T12:20:59.684548+0000","last_active":"2024-05-14T12:23:08.260678+0000","last_peered":"2024-05-14T12:23:08.260678+0000","last_clean":"2024-05-14T12:23:08.260678+0000","last_became_active":"2024-05-14T12:20:59.684069+0000","last_became_peered":"2024-05-14T12:20:59.684069+0000","last_unstale":"2024-05-14T12:23:08.260678+0000","last_undegraded":"2024-05-14T12:23:08.260678+0000","last_fullsized":"2024-05-14T12:23:08.260678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:58.759384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.264099+0000","last_change":"2024-05-14T12:20:59.682386+0000","last_active":"2024-05-14T12:23:08.264099+0000","last_peered":"2024-05-14T12:23:08.264099+0000","last_clean":"2024-05-14T12:23:08.264099+0000","last_became_active":"2024-05-14T12:20:59.682037+0000","last_became_peered":"2024-05-14T12:20:59.682037+0000","last_unstale":"2024-05-14T12:23:08.264099+0000","last_undegraded":"2024-05-14T12:23:08.264099+0000","last_fullsized":"2024-05-14T12:23:08.264099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:24.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241032+0000","last_change":"2024-05-14T12:20:59.672679+0000","last_active":"2024-05-14T12:23:08.241032+0000","last_peered":"2024-05-14T12:23:08.241032+0000","last_clean":"2024-05-14T12:23:08.241032+0000","last_became_active":"2024-05-14T12:20:59.672324+0000","last_became_peered":"2024-05-14T12:20:59.672324+0000","last_unstale":"2024-05-14T12:23:08.241032+0000","last_undegraded":"2024-05-14T12:23:08.241032+0000","last_fullsized":"2024-05-14T12:23:08.241032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:45.513792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72459,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1157,"num_read_kb":662,"num_write":257,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":644,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":217377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579949,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776177,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1100522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939703,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":444450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135934,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":444806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1544192,"data_stored":1037487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561098,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":510585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":510805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1548288,"data_stored":1036011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T12:23:20.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T12:23:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:20 smithi047 ceph-mon[31254]: from='client.24847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:23:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:23:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:23:20.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:20 smithi073 ceph-mon[35809]: from='client.24847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:23:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:23:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:23:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:21.037 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:21.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:20 smithi066 ceph-mon[35981]: from='client.24847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:23:21.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:23:21.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:23:21.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:23:21.884 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:21 smithi047 ceph-mon[31254]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:21.903 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:21 smithi073 ceph-mon[35809]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:21 smithi066 ceph-mon[35981]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:23:23.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 -- 172.21.15.47:0/636692642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 msgr2=0x7fa808077020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 --2- 172.21.15.47:0/636692642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa808077020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009990 tx=0x7fa7f8009ca0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 -- 172.21.15.47:0/636692642 shutdown_connections 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 --2- 172.21.15.47:0/636692642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa808110be0 0x7fa808113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 --2- 172.21.15.47:0/636692642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa808077020 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 --2- 172.21.15.47:0/636692642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa808077560 0x7fa8081106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 -- 172.21.15.47:0/636692642 >> 172.21.15.47:0/636692642 conn(0x7fa8080ffea0 msgr2=0x7fa8081022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 -- 172.21.15.47:0/636692642 shutdown_connections 2024-05-14T12:23:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.248+0000 7fa80ee00700 1 -- 172.21.15.47:0/636692642 wait complete. 2024-05-14T12:23:23.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.250+0000 7fa80ee00700 1 Processor -- start 2024-05-14T12:23:23.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.250+0000 7fa80ee00700 1 -- start start 2024-05-14T12:23:23.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa80ee00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa80819d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:23.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa80ee00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa808077560 0x7fa80819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa80ee00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa808110be0 0x7fa8081a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa80ee00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8081166e0 con 0x7fa808076c10 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa80ee00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa808116560 con 0x7fa808077560 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa80ee00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa808116860 con 0x7fa808110be0 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa80819d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa80819d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35764/0 (socket says 172.21.15.47:35764) 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 -- 172.21.15.47:0/2308003238 learned_addr learned my addr 172.21.15.47:0/2308003238 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807400700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa808077560 0x7fa80819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa80ce00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa808110be0 0x7fa8081a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 -- 172.21.15.47:0/2308003238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa808110be0 msgr2=0x7fa8081a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa808110be0 0x7fa8081a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 -- 172.21.15.47:0/2308003238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa808077560 msgr2=0x7fa80819d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa808077560 0x7fa80819d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.251+0000 7fa807e00700 1 -- 172.21.15.47:0/2308003238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8081a1ef0 con 0x7fa808076c10 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.252+0000 7fa807e00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa80819d070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800b2e0 tx=0x7fa7f80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.252+0000 7fa804c00700 1 -- 172.21.15.47:0/2308003238 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8026070 con 0x7fa808076c10 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.252+0000 7fa804c00700 1 -- 172.21.15.47:0/2308003238 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7f8021410 con 0x7fa808076c10 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.252+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8081a2180 con 0x7fa808076c10 2024-05-14T12:23:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.252+0000 7fa804c00700 1 -- 172.21.15.47:0/2308003238 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8017650 con 0x7fa808076c10 2024-05-14T12:23:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.252+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8081a2660 con 0x7fa808076c10 2024-05-14T12:23:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.254+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8080512c0 con 0x7fa808076c10 2024-05-14T12:23:23.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.256+0000 7fa804c00700 1 -- 172.21.15.47:0/2308003238 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa7f8029070 con 0x7fa808076c10 2024-05-14T12:23:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.257+0000 7fa804c00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7ec0b2880 0x7fa7ec0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.258+0000 7fa804c00700 1 -- 172.21.15.47:0/2308003238 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa7f80e36d0 con 0x7fa808076c10 2024-05-14T12:23:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.258+0000 7fa807400700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7ec0b2880 0x7fa7ec0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:23.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.259+0000 7fa807400700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7ec0b2880 0x7fa7ec0b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa808103350 tx=0x7fa7f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:23.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.260+0000 7fa804c00700 1 -- 172.21.15.47:0/2308003238 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa7f8013070 con 0x7fa808076c10 2024-05-14T12:23:23.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.490+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa808063c00 con 0x7fa7ec0b2880 2024-05-14T12:23:23.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.513+0000 7fa804c00700 1 -- 172.21.15.47:0/2308003238 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258884 (secure 0 0 0) 0x7fa808063c00 con 0x7fa7ec0b2880 2024-05-14T12:23:23.519 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:23:23.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7ec0b2880 msgr2=0x7fa7ec0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7ec0b2880 0x7fa7ec0b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa808103350 tx=0x7fa7f4009260 comp rx=0 tx=0).stop 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 msgr2=0x7fa80819d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa80819d070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800b2e0 tx=0x7fa7f80047b0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 shutdown_connections 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7ec0b2880 0x7fa7ec0b4d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa808110be0 0x7fa8081a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa808076c10 0x7fa80819d070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 --2- 172.21.15.47:0/2308003238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa808077560 0x7fa80819d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 >> 172.21.15.47:0/2308003238 conn(0x7fa8080ffea0 msgr2=0x7fa808100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.519+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 shutdown_connections 2024-05-14T12:23:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:23.520+0000 7fa80ee00700 1 -- 172.21.15.47:0/2308003238 wait complete. 2024-05-14T12:23:23.522 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-14T12:23:23.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:23 smithi047 ceph-mon[31254]: pgmap v396: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-14T12:23:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:23 smithi073 ceph-mon[35809]: pgmap v396: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-14T12:23:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:23 smithi066 ceph-mon[35981]: pgmap v396: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-14T12:23:24.364 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2024-05-14T12:23:22.308794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663061,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1283,"num_read_kb":751,"num_write":382,"num_write_kb":2301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2952484,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":815,"ondisk_log_size":815,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374664,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567160,"statfs":{"total":1151940427776,"available":1151556771840,"internally_reserved":0,"allocated":13344768,"data_stored":7309119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":66,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005617"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.249846+0000","last_change":"2024-05-14T12:20:59.669913+0000","last_active":"2024-05-14T12:23:08.249846+0000","last_peered":"2024-05-14T12:23:08.249846+0000","last_clean":"2024-05-14T12:23:08.249846+0000","last_became_active":"2024-05-14T12:20:59.668481+0000","last_became_peered":"2024-05-14T12:20:59.668481+0000","last_unstale":"2024-05-14T12:23:08.249846+0000","last_undegraded":"2024-05-14T12:23:08.249846+0000","last_fullsized":"2024-05-14T12:23:08.249846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:13.671516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.235645+0000","last_change":"2024-05-14T12:20:59.665032+0000","last_active":"2024-05-14T12:23:08.235645+0000","last_peered":"2024-05-14T12:23:08.235645+0000","last_clean":"2024-05-14T12:23:08.235645+0000","last_became_active":"2024-05-14T12:20:59.664471+0000","last_became_peered":"2024-05-14T12:20:59.664471+0000","last_unstale":"2024-05-14T12:23:08.235645+0000","last_undegraded":"2024-05-14T12:23:08.235645+0000","last_fullsized":"2024-05-14T12:23:08.235645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:58:02.354064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254928+0000","last_change":"2024-05-14T12:20:59.679975+0000","last_active":"2024-05-14T12:23:08.254928+0000","last_peered":"2024-05-14T12:23:08.254928+0000","last_clean":"2024-05-14T12:23:08.254928+0000","last_became_active":"2024-05-14T12:20:59.679586+0000","last_became_peered":"2024-05-14T12:20:59.679586+0000","last_unstale":"2024-05-14T12:23:08.254928+0000","last_undegraded":"2024-05-14T12:23:08.254928+0000","last_fullsized":"2024-05-14T12:23:08.254928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:45:37.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241040+0000","last_change":"2024-05-14T12:20:59.668125+0000","last_active":"2024-05-14T12:23:08.241040+0000","last_peered":"2024-05-14T12:23:08.241040+0000","last_clean":"2024-05-14T12:23:08.241040+0000","last_became_active":"2024-05-14T12:20:59.667664+0000","last_became_peered":"2024-05-14T12:20:59.667664+0000","last_unstale":"2024-05-14T12:23:08.241040+0000","last_undegraded":"2024-05-14T12:23:08.241040+0000","last_fullsized":"2024-05-14T12:23:08.241040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:29.995159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238828+0000","last_change":"2024-05-14T12:20:59.682787+0000","last_active":"2024-05-14T12:23:08.238828+0000","last_peered":"2024-05-14T12:23:08.238828+0000","last_clean":"2024-05-14T12:23:08.238828+0000","last_became_active":"2024-05-14T12:20:59.682462+0000","last_became_peered":"2024-05-14T12:20:59.682462+0000","last_unstale":"2024-05-14T12:23:08.238828+0000","last_undegraded":"2024-05-14T12:23:08.238828+0000","last_fullsized":"2024-05-14T12:23:08.238828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:27.287750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241933+0000","last_change":"2024-05-14T12:21:39.506661+0000","last_active":"2024-05-14T12:23:08.241933+0000","last_peered":"2024-05-14T12:23:08.241933+0000","last_clean":"2024-05-14T12:23:08.241933+0000","last_became_active":"2024-05-14T12:21:39.506116+0000","last_became_peered":"2024-05-14T12:21:39.506116+0000","last_unstale":"2024-05-14T12:23:08.241933+0000","last_undegraded":"2024-05-14T12:23:08.241933+0000","last_fullsized":"2024-05-14T12:23:08.241933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:18.551207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244260+0000","last_change":"2024-05-14T12:20:59.671683+0000","last_active":"2024-05-14T12:23:08.244260+0000","last_peered":"2024-05-14T12:23:08.244260+0000","last_clean":"2024-05-14T12:23:08.244260+0000","last_became_active":"2024-05-14T12:20:59.671307+0000","last_became_peered":"2024-05-14T12:20:59.671307+0000","last_unstale":"2024-05-14T12:23:08.244260+0000","last_undegraded":"2024-05-14T12:23:08.244260+0000","last_fullsized":"2024-05-14T12:23:08.244260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.744159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251050+0000","last_change":"2024-05-14T12:21:39.504953+0000","last_active":"2024-05-14T12:23:08.251050+0000","last_peered":"2024-05-14T12:23:08.251050+0000","last_clean":"2024-05-14T12:23:08.251050+0000","last_became_active":"2024-05-14T12:21:39.504267+0000","last_became_peered":"2024-05-14T12:21:39.504267+0000","last_unstale":"2024-05-14T12:23:08.251050+0000","last_undegraded":"2024-05-14T12:23:08.251050+0000","last_fullsized":"2024-05-14T12:23:08.251050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:04.329324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247121+0000","last_change":"2024-05-14T12:20:59.663319+0000","last_active":"2024-05-14T12:23:08.247121+0000","last_peered":"2024-05-14T12:23:08.247121+0000","last_clean":"2024-05-14T12:23:08.247121+0000","last_became_active":"2024-05-14T12:20:59.662618+0000","last_became_peered":"2024-05-14T12:20:59.662618+0000","last_unstale":"2024-05-14T12:23:08.247121+0000","last_undegraded":"2024-05-14T12:23:08.247121+0000","last_fullsized":"2024-05-14T12:23:08.247121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:18.032899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.242681+0000","last_change":"2024-05-14T12:20:59.671006+0000","last_active":"2024-05-14T12:23:08.242681+0000","last_peered":"2024-05-14T12:23:08.242681+0000","last_clean":"2024-05-14T12:23:08.242681+0000","last_became_active":"2024-05-14T12:20:59.670632+0000","last_became_peered":"2024-05-14T12:20:59.670632+0000","last_unstale":"2024-05-14T12:23:08.242681+0000","last_undegraded":"2024-05-14T12:23:08.242681+0000","last_fullsized":"2024-05-14T12:23:08.242681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:12:30.144637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243102+0000","last_change":"2024-05-14T12:20:59.675968+0000","last_active":"2024-05-14T12:23:08.243102+0000","last_peered":"2024-05-14T12:23:08.243102+0000","last_clean":"2024-05-14T12:23:08.243102+0000","last_became_active":"2024-05-14T12:20:59.675551+0000","last_became_peered":"2024-05-14T12:20:59.675551+0000","last_unstale":"2024-05-14T12:23:08.243102+0000","last_undegraded":"2024-05-14T12:23:08.243102+0000","last_fullsized":"2024-05-14T12:23:08.243102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:39.562658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240813+0000","last_change":"2024-05-14T12:20:59.671011+0000","last_active":"2024-05-14T12:23:08.240813+0000","last_peered":"2024-05-14T12:23:08.240813+0000","last_clean":"2024-05-14T12:23:08.240813+0000","last_became_active":"2024-05-14T12:20:59.670637+0000","last_became_peered":"2024-05-14T12:20:59.670637+0000","last_unstale":"2024-05-14T12:23:08.240813+0000","last_undegraded":"2024-05-14T12:23:08.240813+0000","last_fullsized":"2024-05-14T12:23:08.240813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:53.808936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.264725+0000","last_change":"2024-05-14T12:20:59.680039+0000","last_active":"2024-05-14T12:23:08.264725+0000","last_peered":"2024-05-14T12:23:08.264725+0000","last_clean":"2024-05-14T12:23:08.264725+0000","last_became_active":"2024-05-14T12:20:59.678120+0000","last_became_peered":"2024-05-14T12:20:59.678120+0000","last_unstale":"2024-05-14T12:23:08.264725+0000","last_undegraded":"2024-05-14T12:23:08.264725+0000","last_fullsized":"2024-05-14T12:23:08.264725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:19:28.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238936+0000","last_change":"2024-05-14T12:20:59.675301+0000","last_active":"2024-05-14T12:23:08.238936+0000","last_peered":"2024-05-14T12:23:08.238936+0000","last_clean":"2024-05-14T12:23:08.238936+0000","last_became_active":"2024-05-14T12:20:59.669861+0000","last_became_peered":"2024-05-14T12:20:59.669861+0000","last_unstale":"2024-05-14T12:23:08.238936+0000","last_undegraded":"2024-05-14T12:23:08.238936+0000","last_fullsized":"2024-05-14T12:23:08.238936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:19:17.931719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246879+0000","last_change":"2024-05-14T12:20:59.682378+0000","last_active":"2024-05-14T12:23:08.246879+0000","last_peered":"2024-05-14T12:23:08.246879+0000","last_clean":"2024-05-14T12:23:08.246879+0000","last_became_active":"2024-05-14T12:20:59.680598+0000","last_became_peered":"2024-05-14T12:20:59.680598+0000","last_unstale":"2024-05-14T12:23:08.246879+0000","last_undegraded":"2024-05-14T12:23:08.246879+0000","last_fullsized":"2024-05-14T12:23:08.246879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:22.189038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254566+0000","last_change":"2024-05-14T12:20:59.685447+0000","last_active":"2024-05-14T12:23:08.254566+0000","last_peered":"2024-05-14T12:23:08.254566+0000","last_clean":"2024-05-14T12:23:08.254566+0000","last_became_active":"2024-05-14T12:20:59.684963+0000","last_became_peered":"2024-05-14T12:20:59.684963+0000","last_unstale":"2024-05-14T12:23:08.254566+0000","last_undegraded":"2024-05-14T12:23:08.254566+0000","last_fullsized":"2024-05-14T12:23:08.254566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:47.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250053+0000","last_change":"2024-05-14T12:20:59.681870+0000","last_active":"2024-05-14T12:23:08.250053+0000","last_peered":"2024-05-14T12:23:08.250053+0000","last_clean":"2024-05-14T12:23:08.250053+0000","last_became_active":"2024-05-14T12:20:59.681405+0000","last_became_peered":"2024-05-14T12:20:59.681405+0000","last_unstale":"2024-05-14T12:23:08.250053+0000","last_undegraded":"2024-05-14T12:23:08.250053+0000","last_fullsized":"2024-05-14T12:23:08.250053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:20.002496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253917+0000","last_change":"2024-05-14T12:20:59.667486+0000","last_active":"2024-05-14T12:23:08.253917+0000","last_peered":"2024-05-14T12:23:08.253917+0000","last_clean":"2024-05-14T12:23:08.253917+0000","last_became_active":"2024-05-14T12:20:59.667032+0000","last_became_peered":"2024-05-14T12:20:59.667032+0000","last_unstale":"2024-05-14T12:23:08.253917+0000","last_undegraded":"2024-05-14T12:23:08.253917+0000","last_fullsized":"2024-05-14T12:23:08.253917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:25.325504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253867+0000","last_change":"2024-05-14T12:20:59.672065+0000","last_active":"2024-05-14T12:23:08.253867+0000","last_peered":"2024-05-14T12:23:08.253867+0000","last_clean":"2024-05-14T12:23:08.253867+0000","last_became_active":"2024-05-14T12:20:59.671692+0000","last_became_peered":"2024-05-14T12:20:59.671692+0000","last_unstale":"2024-05-14T12:23:08.253867+0000","last_undegraded":"2024-05-14T12:23:08.253867+0000","last_fullsized":"2024-05-14T12:23:08.253867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:11:47.952421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:17.666132+0000","last_change":"2024-05-14T12:20:55.611507+0000","last_active":"2024-05-14T12:23:17.666132+0000","last_peered":"2024-05-14T12:23:17.666132+0000","last_clean":"2024-05-14T12:23:17.666132+0000","last_became_active":"2024-05-14T12:20:55.606794+0000","last_became_peered":"2024-05-14T12:20:55.606794+0000","last_unstale":"2024-05-14T12:23:17.666132+0000","last_undegraded":"2024-05-14T12:23:17.666132+0000","last_fullsized":"2024-05-14T12:23:17.666132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:51.301124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246191+0000","last_change":"2024-05-14T12:20:59.673013+0000","last_active":"2024-05-14T12:23:08.246191+0000","last_peered":"2024-05-14T12:23:08.246191+0000","last_clean":"2024-05-14T12:23:08.246191+0000","last_became_active":"2024-05-14T12:20:59.672575+0000","last_became_peered":"2024-05-14T12:20:59.672575+0000","last_unstale":"2024-05-14T12:23:08.246191+0000","last_undegraded":"2024-05-14T12:23:08.246191+0000","last_fullsized":"2024-05-14T12:23:08.246191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:00:26.549099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.703914+0000","last_change":"2024-05-14T12:20:55.963853+0000","last_active":"2024-05-14T12:21:39.703914+0000","last_peered":"2024-05-14T12:21:39.703914+0000","last_clean":"2024-05-14T12:21:39.703914+0000","last_became_active":"2024-05-14T12:20:55.962018+0000","last_became_peered":"2024-05-14T12:20:55.962018+0000","last_unstale":"2024-05-14T12:21:39.703914+0000","last_undegraded":"2024-05-14T12:21:39.703914+0000","last_fullsized":"2024-05-14T12:21:39.703914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:06:22.374595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253995+0000","last_change":"2024-05-14T12:20:59.671243+0000","last_active":"2024-05-14T12:23:08.253995+0000","last_peered":"2024-05-14T12:23:08.253995+0000","last_clean":"2024-05-14T12:23:08.253995+0000","last_became_active":"2024-05-14T12:20:59.665885+0000","last_became_peered":"2024-05-14T12:20:59.665885+0000","last_unstale":"2024-05-14T12:23:08.253995+0000","last_undegraded":"2024-05-14T12:23:08.253995+0000","last_fullsized":"2024-05-14T12:23:08.253995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:48.656774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.526944+0000","last_change":"2024-05-14T12:21:39.526944+0000","last_active":"2024-05-14T12:21:39.526944+0000","last_peered":"2024-05-14T12:21:39.526944+0000","last_clean":"2024-05-14T12:21:39.526944+0000","last_became_active":"2024-05-14T12:21:39.506478+0000","last_became_peered":"2024-05-14T12:21:39.506478+0000","last_unstale":"2024-05-14T12:21:39.526944+0000","last_undegraded":"2024-05-14T12:21:39.526944+0000","last_fullsized":"2024-05-14T12:21:39.526944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:41.812733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256609+0000","last_change":"2024-05-14T12:20:59.671282+0000","last_active":"2024-05-14T12:23:08.256609+0000","last_peered":"2024-05-14T12:23:08.256609+0000","last_clean":"2024-05-14T12:23:08.256609+0000","last_became_active":"2024-05-14T12:20:59.670645+0000","last_became_peered":"2024-05-14T12:20:59.670645+0000","last_unstale":"2024-05-14T12:23:08.256609+0000","last_undegraded":"2024-05-14T12:23:08.256609+0000","last_fullsized":"2024-05-14T12:23:08.256609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:51:57.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501842+0000","last_change":"2024-05-14T12:20:55.604757+0000","last_active":"2024-05-14T12:21:39.501842+0000","last_peered":"2024-05-14T12:21:39.501842+0000","last_clean":"2024-05-14T12:21:39.501842+0000","last_became_active":"2024-05-14T12:20:55.604281+0000","last_became_peered":"2024-05-14T12:20:55.604281+0000","last_unstale":"2024-05-14T12:21:39.501842+0000","last_undegraded":"2024-05-14T12:21:39.501842+0000","last_fullsized":"2024-05-14T12:21:39.501842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:52.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245572+0000","last_change":"2024-05-14T12:20:59.672498+0000","last_active":"2024-05-14T12:23:08.245572+0000","last_peered":"2024-05-14T12:23:08.245572+0000","last_clean":"2024-05-14T12:23:08.245572+0000","last_became_active":"2024-05-14T12:20:59.672116+0000","last_became_peered":"2024-05-14T12:20:59.672116+0000","last_unstale":"2024-05-14T12:23:08.245572+0000","last_undegraded":"2024-05-14T12:23:08.245572+0000","last_fullsized":"2024-05-14T12:23:08.245572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:47:34.614427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":120,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:20.723954+0000","last_change":"2024-05-14T12:21:39.515431+0000","last_active":"2024-05-14T12:23:20.723954+0000","last_peered":"2024-05-14T12:23:20.723954+0000","last_clean":"2024-05-14T12:23:20.723954+0000","last_became_active":"2024-05-14T12:21:39.503217+0000","last_became_peered":"2024-05-14T12:21:39.503217+0000","last_unstale":"2024-05-14T12:23:20.723954+0000","last_undegraded":"2024-05-14T12:23:20.723954+0000","last_fullsized":"2024-05-14T12:23:20.723954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:52:21.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255883+0000","last_change":"2024-05-14T12:20:59.664725+0000","last_active":"2024-05-14T12:23:08.255883+0000","last_peered":"2024-05-14T12:23:08.255883+0000","last_clean":"2024-05-14T12:23:08.255883+0000","last_became_active":"2024-05-14T12:20:59.664323+0000","last_became_peered":"2024-05-14T12:20:59.664323+0000","last_unstale":"2024-05-14T12:23:08.255883+0000","last_undegraded":"2024-05-14T12:23:08.255883+0000","last_fullsized":"2024-05-14T12:23:08.255883+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.729236+0000","last_change":"2024-05-14T12:21:39.729236+0000","last_active":"2024-05-14T12:21:39.729236+0000","last_peered":"2024-05-14T12:21:39.729236+0000","last_clean":"2024-05-14T12:21:39.729236+0000","last_became_active":"2024-05-14T12:21:39.722405+0000","last_became_peered":"2024-05-14T12:21:39.722405+0000","last_unstale":"2024-05-14T12:21:39.729236+0000","last_undegraded":"2024-05-14T12:21:39.729236+0000","last_fullsized":"2024-05-14T12:21:39.729236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:14:19.461411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243390+0000","last_change":"2024-05-14T12:20:59.671870+0000","last_active":"2024-05-14T12:23:08.243390+0000","last_peered":"2024-05-14T12:23:08.243390+0000","last_clean":"2024-05-14T12:23:08.243390+0000","last_became_active":"2024-05-14T12:20:59.671467+0000","last_became_peered":"2024-05-14T12:20:59.671467+0000","last_unstale":"2024-05-14T12:23:08.243390+0000","last_undegraded":"2024-05-14T12:23:08.243390+0000","last_fullsized":"2024-05-14T12:23:08.243390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:18.195518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498486+0000","last_change":"2024-05-14T12:20:55.613626+0000","last_active":"2024-05-14T12:21:39.498486+0000","last_peered":"2024-05-14T12:21:39.498486+0000","last_clean":"2024-05-14T12:21:39.498486+0000","last_became_active":"2024-05-14T12:20:55.613039+0000","last_became_peered":"2024-05-14T12:20:55.613039+0000","last_unstale":"2024-05-14T12:21:39.498486+0000","last_undegraded":"2024-05-14T12:21:39.498486+0000","last_fullsized":"2024-05-14T12:21:39.498486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:19.479433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259831+0000","last_change":"2024-05-14T12:20:59.683152+0000","last_active":"2024-05-14T12:23:08.259831+0000","last_peered":"2024-05-14T12:23:08.259831+0000","last_clean":"2024-05-14T12:23:08.259831+0000","last_became_active":"2024-05-14T12:20:59.682863+0000","last_became_peered":"2024-05-14T12:20:59.682863+0000","last_unstale":"2024-05-14T12:23:08.259831+0000","last_undegraded":"2024-05-14T12:23:08.259831+0000","last_fullsized":"2024-05-14T12:23:08.259831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:26.975487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496367+0000","last_change":"2024-05-14T12:20:55.604785+0000","last_active":"2024-05-14T12:21:39.496367+0000","last_peered":"2024-05-14T12:21:39.496367+0000","last_clean":"2024-05-14T12:21:39.496367+0000","last_became_active":"2024-05-14T12:20:55.604249+0000","last_became_peered":"2024-05-14T12:20:55.604249+0000","last_unstale":"2024-05-14T12:21:39.496367+0000","last_undegraded":"2024-05-14T12:21:39.496367+0000","last_fullsized":"2024-05-14T12:21:39.496367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:51.954691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254865+0000","last_change":"2024-05-14T12:20:59.677047+0000","last_active":"2024-05-14T12:23:08.254865+0000","last_peered":"2024-05-14T12:23:08.254865+0000","last_clean":"2024-05-14T12:23:08.254865+0000","last_became_active":"2024-05-14T12:20:59.673314+0000","last_became_peered":"2024-05-14T12:20:59.673314+0000","last_unstale":"2024-05-14T12:23:08.254865+0000","last_undegraded":"2024-05-14T12:23:08.254865+0000","last_fullsized":"2024-05-14T12:23:08.254865+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:54.069762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":270,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:20.722920+0000","last_change":"2024-05-14T12:20:55.608986+0000","last_active":"2024-05-14T12:23:20.722920+0000","last_peered":"2024-05-14T12:23:20.722920+0000","last_clean":"2024-05-14T12:23:20.722920+0000","last_became_active":"2024-05-14T12:20:55.608476+0000","last_became_peered":"2024-05-14T12:20:55.608476+0000","last_unstale":"2024-05-14T12:23:20.722920+0000","last_undegraded":"2024-05-14T12:23:20.722920+0000","last_fullsized":"2024-05-14T12:23:20.722920+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:15:40.777724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251521+0000","last_change":"2024-05-14T12:20:59.673404+0000","last_active":"2024-05-14T12:23:08.251521+0000","last_peered":"2024-05-14T12:23:08.251521+0000","last_clean":"2024-05-14T12:23:08.251521+0000","last_became_active":"2024-05-14T12:20:59.673035+0000","last_became_peered":"2024-05-14T12:20:59.673035+0000","last_unstale":"2024-05-14T12:23:08.251521+0000","last_undegraded":"2024-05-14T12:23:08.251521+0000","last_fullsized":"2024-05-14T12:23:08.251521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:29:42.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498557+0000","last_change":"2024-05-14T12:20:55.605789+0000","last_active":"2024-05-14T12:21:39.498557+0000","last_peered":"2024-05-14T12:21:39.498557+0000","last_clean":"2024-05-14T12:21:39.498557+0000","last_became_active":"2024-05-14T12:20:55.605166+0000","last_became_peered":"2024-05-14T12:20:55.605166+0000","last_unstale":"2024-05-14T12:21:39.498557+0000","last_undegraded":"2024-05-14T12:21:39.498557+0000","last_fullsized":"2024-05-14T12:21:39.498557+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:44.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244013+0000","last_change":"2024-05-14T12:20:59.678373+0000","last_active":"2024-05-14T12:23:08.244013+0000","last_peered":"2024-05-14T12:23:08.244013+0000","last_clean":"2024-05-14T12:23:08.244013+0000","last_became_active":"2024-05-14T12:20:59.673378+0000","last_became_peered":"2024-05-14T12:20:59.673378+0000","last_unstale":"2024-05-14T12:23:08.244013+0000","last_undegraded":"2024-05-14T12:23:08.244013+0000","last_fullsized":"2024-05-14T12:23:08.244013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:17:36.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496483+0000","last_change":"2024-05-14T12:20:55.966507+0000","last_active":"2024-05-14T12:21:39.496483+0000","last_peered":"2024-05-14T12:21:39.496483+0000","last_clean":"2024-05-14T12:21:39.496483+0000","last_became_active":"2024-05-14T12:20:55.966066+0000","last_became_peered":"2024-05-14T12:20:55.966066+0000","last_unstale":"2024-05-14T12:21:39.496483+0000","last_undegraded":"2024-05-14T12:21:39.496483+0000","last_fullsized":"2024-05-14T12:21:39.496483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:20.276346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250342+0000","last_change":"2024-05-14T12:20:59.669926+0000","last_active":"2024-05-14T12:23:08.250342+0000","last_peered":"2024-05-14T12:23:08.250342+0000","last_clean":"2024-05-14T12:23:08.250342+0000","last_became_active":"2024-05-14T12:20:59.669502+0000","last_became_peered":"2024-05-14T12:20:59.669502+0000","last_unstale":"2024-05-14T12:23:08.250342+0000","last_undegraded":"2024-05-14T12:23:08.250342+0000","last_fullsized":"2024-05-14T12:23:08.250342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:02.036442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:20.657443+0000","last_change":"2024-05-14T12:20:55.602307+0000","last_active":"2024-05-14T12:23:20.657443+0000","last_peered":"2024-05-14T12:23:20.657443+0000","last_clean":"2024-05-14T12:23:20.657443+0000","last_became_active":"2024-05-14T12:20:55.601879+0000","last_became_peered":"2024-05-14T12:20:55.601879+0000","last_unstale":"2024-05-14T12:23:20.657443+0000","last_undegraded":"2024-05-14T12:23:20.657443+0000","last_fullsized":"2024-05-14T12:23:20.657443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:10.839268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64973,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":248,"num_read_kb":187,"num_write":39,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244616+0000","last_change":"2024-05-14T12:20:59.676162+0000","last_active":"2024-05-14T12:23:08.244616+0000","last_peered":"2024-05-14T12:23:08.244616+0000","last_clean":"2024-05-14T12:23:08.244616+0000","last_became_active":"2024-05-14T12:20:59.675742+0000","last_became_peered":"2024-05-14T12:20:59.675742+0000","last_unstale":"2024-05-14T12:23:08.244616+0000","last_undegraded":"2024-05-14T12:23:08.244616+0000","last_fullsized":"2024-05-14T12:23:08.244616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:52:00.100743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501460+0000","last_change":"2024-05-14T12:20:55.616014+0000","last_active":"2024-05-14T12:21:39.501460+0000","last_peered":"2024-05-14T12:21:39.501460+0000","last_clean":"2024-05-14T12:21:39.501460+0000","last_became_active":"2024-05-14T12:20:55.615331+0000","last_became_peered":"2024-05-14T12:20:55.615331+0000","last_unstale":"2024-05-14T12:21:39.501460+0000","last_undegraded":"2024-05-14T12:21:39.501460+0000","last_fullsized":"2024-05-14T12:21:39.501460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:53.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261815+0000","last_change":"2024-05-14T12:20:59.690299+0000","last_active":"2024-05-14T12:23:08.261815+0000","last_peered":"2024-05-14T12:23:08.261815+0000","last_clean":"2024-05-14T12:23:08.261815+0000","last_became_active":"2024-05-14T12:20:59.689959+0000","last_became_peered":"2024-05-14T12:20:59.689959+0000","last_unstale":"2024-05-14T12:23:08.261815+0000","last_undegraded":"2024-05-14T12:23:08.261815+0000","last_fullsized":"2024-05-14T12:23:08.261815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:53.017238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496270+0000","last_change":"2024-05-14T12:20:55.615860+0000","last_active":"2024-05-14T12:21:39.496270+0000","last_peered":"2024-05-14T12:21:39.496270+0000","last_clean":"2024-05-14T12:21:39.496270+0000","last_became_active":"2024-05-14T12:20:55.615415+0000","last_became_peered":"2024-05-14T12:20:55.615415+0000","last_unstale":"2024-05-14T12:21:39.496270+0000","last_undegraded":"2024-05-14T12:21:39.496270+0000","last_fullsized":"2024-05-14T12:21:39.496270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:27:55.368122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.258058+0000","last_change":"2024-05-14T12:20:59.684759+0000","last_active":"2024-05-14T12:23:08.258058+0000","last_peered":"2024-05-14T12:23:08.258058+0000","last_clean":"2024-05-14T12:23:08.258058+0000","last_became_active":"2024-05-14T12:20:59.684277+0000","last_became_peered":"2024-05-14T12:20:59.684277+0000","last_unstale":"2024-05-14T12:23:08.258058+0000","last_undegraded":"2024-05-14T12:23:08.258058+0000","last_fullsized":"2024-05-14T12:23:08.258058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:42:08.535580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":154,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:20.673610+0000","last_change":"2024-05-14T12:20:55.602130+0000","last_active":"2024-05-14T12:23:20.673610+0000","last_peered":"2024-05-14T12:23:20.673610+0000","last_clean":"2024-05-14T12:23:20.673610+0000","last_became_active":"2024-05-14T12:20:55.601635+0000","last_became_peered":"2024-05-14T12:20:55.601635+0000","last_unstale":"2024-05-14T12:23:20.673610+0000","last_undegraded":"2024-05-14T12:23:20.673610+0000","last_fullsized":"2024-05-14T12:23:20.673610+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:24:34.599413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251007+0000","last_change":"2024-05-14T12:21:39.505509+0000","last_active":"2024-05-14T12:23:08.251007+0000","last_peered":"2024-05-14T12:23:08.251007+0000","last_clean":"2024-05-14T12:23:08.251007+0000","last_became_active":"2024-05-14T12:21:39.504817+0000","last_became_peered":"2024-05-14T12:21:39.504817+0000","last_unstale":"2024-05-14T12:23:08.251007+0000","last_undegraded":"2024-05-14T12:23:08.251007+0000","last_fullsized":"2024-05-14T12:23:08.251007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:05:08.309898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501589+0000","last_change":"2024-05-14T12:20:55.962404+0000","last_active":"2024-05-14T12:21:39.501589+0000","last_peered":"2024-05-14T12:21:39.501589+0000","last_clean":"2024-05-14T12:21:39.501589+0000","last_became_active":"2024-05-14T12:20:55.961886+0000","last_became_peered":"2024-05-14T12:20:55.961886+0000","last_unstale":"2024-05-14T12:21:39.501589+0000","last_undegraded":"2024-05-14T12:21:39.501589+0000","last_fullsized":"2024-05-14T12:21:39.501589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:30.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.229430+0000","last_change":"2024-05-14T12:20:59.674010+0000","last_active":"2024-05-14T12:23:08.229430+0000","last_peered":"2024-05-14T12:23:08.229430+0000","last_clean":"2024-05-14T12:23:08.229430+0000","last_became_active":"2024-05-14T12:20:59.673546+0000","last_became_peered":"2024-05-14T12:20:59.673546+0000","last_unstale":"2024-05-14T12:23:08.229430+0000","last_undegraded":"2024-05-14T12:23:08.229430+0000","last_fullsized":"2024-05-14T12:23:08.229430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:59.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.513347+0000","last_change":"2024-05-14T12:21:39.512745+0000","last_active":"2024-05-14T12:21:39.513347+0000","last_peered":"2024-05-14T12:21:39.513347+0000","last_clean":"2024-05-14T12:21:39.513347+0000","last_became_active":"2024-05-14T12:21:39.502690+0000","last_became_peered":"2024-05-14T12:21:39.502690+0000","last_unstale":"2024-05-14T12:21:39.513347+0000","last_undegraded":"2024-05-14T12:21:39.513347+0000","last_fullsized":"2024-05-14T12:21:39.513347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:55:22.829094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240989+0000","last_change":"2024-05-14T12:20:59.671773+0000","last_active":"2024-05-14T12:23:08.240989+0000","last_peered":"2024-05-14T12:23:08.240989+0000","last_clean":"2024-05-14T12:23:08.240989+0000","last_became_active":"2024-05-14T12:20:59.671380+0000","last_became_peered":"2024-05-14T12:20:59.671380+0000","last_unstale":"2024-05-14T12:23:08.240989+0000","last_undegraded":"2024-05-14T12:23:08.240989+0000","last_fullsized":"2024-05-14T12:23:08.240989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:23.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500635+0000","last_change":"2024-05-14T12:20:55.965843+0000","last_active":"2024-05-14T12:21:39.500635+0000","last_peered":"2024-05-14T12:21:39.500635+0000","last_clean":"2024-05-14T12:21:39.500635+0000","last_became_active":"2024-05-14T12:20:55.963827+0000","last_became_peered":"2024-05-14T12:20:55.963827+0000","last_unstale":"2024-05-14T12:21:39.500635+0000","last_undegraded":"2024-05-14T12:21:39.500635+0000","last_fullsized":"2024-05-14T12:21:39.500635+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:22.464989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259298+0000","last_change":"2024-05-14T12:20:59.674932+0000","last_active":"2024-05-14T12:23:08.259298+0000","last_peered":"2024-05-14T12:23:08.259298+0000","last_clean":"2024-05-14T12:23:08.259298+0000","last_became_active":"2024-05-14T12:20:59.674259+0000","last_became_peered":"2024-05-14T12:20:59.674259+0000","last_unstale":"2024-05-14T12:23:08.259298+0000","last_undegraded":"2024-05-14T12:23:08.259298+0000","last_fullsized":"2024-05-14T12:23:08.259298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:45.362069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":155,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:18.668948+0000","last_change":"2024-05-14T12:20:55.610031+0000","last_active":"2024-05-14T12:23:18.668948+0000","last_peered":"2024-05-14T12:23:18.668948+0000","last_clean":"2024-05-14T12:23:18.668948+0000","last_became_active":"2024-05-14T12:20:55.609730+0000","last_became_peered":"2024-05-14T12:20:55.609730+0000","last_unstale":"2024-05-14T12:23:18.668948+0000","last_undegraded":"2024-05-14T12:23:18.668948+0000","last_fullsized":"2024-05-14T12:23:18.668948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:35.763466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241082+0000","last_change":"2024-05-14T12:20:59.673504+0000","last_active":"2024-05-14T12:23:08.241082+0000","last_peered":"2024-05-14T12:23:08.241082+0000","last_clean":"2024-05-14T12:23:08.241082+0000","last_became_active":"2024-05-14T12:20:59.673100+0000","last_became_peered":"2024-05-14T12:20:59.673100+0000","last_unstale":"2024-05-14T12:23:08.241082+0000","last_undegraded":"2024-05-14T12:23:08.241082+0000","last_fullsized":"2024-05-14T12:23:08.241082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:02.262916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.233530+0000","last_change":"2024-05-14T12:20:59.674694+0000","last_active":"2024-05-14T12:23:08.233530+0000","last_peered":"2024-05-14T12:23:08.233530+0000","last_clean":"2024-05-14T12:23:08.233530+0000","last_became_active":"2024-05-14T12:20:59.673566+0000","last_became_peered":"2024-05-14T12:20:59.673566+0000","last_unstale":"2024-05-14T12:23:08.233530+0000","last_undegraded":"2024-05-14T12:23:08.233530+0000","last_fullsized":"2024-05-14T12:23:08.233530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:49:28.596919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:16.666622+0000","last_change":"2024-05-14T12:20:55.963207+0000","last_active":"2024-05-14T12:23:16.666622+0000","last_peered":"2024-05-14T12:23:16.666622+0000","last_clean":"2024-05-14T12:23:16.666622+0000","last_became_active":"2024-05-14T12:20:55.962084+0000","last_became_peered":"2024-05-14T12:20:55.962084+0000","last_unstale":"2024-05-14T12:23:16.666622+0000","last_undegraded":"2024-05-14T12:23:16.666622+0000","last_fullsized":"2024-05-14T12:23:16.666622+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:17.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254789+0000","last_change":"2024-05-14T12:20:59.682629+0000","last_active":"2024-05-14T12:23:08.254789+0000","last_peered":"2024-05-14T12:23:08.254789+0000","last_clean":"2024-05-14T12:23:08.254789+0000","last_became_active":"2024-05-14T12:20:59.672656+0000","last_became_peered":"2024-05-14T12:20:59.672656+0000","last_unstale":"2024-05-14T12:23:08.254789+0000","last_undegraded":"2024-05-14T12:23:08.254789+0000","last_fullsized":"2024-05-14T12:23:08.254789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:23:29.651740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501096+0000","last_change":"2024-05-14T12:20:55.605223+0000","last_active":"2024-05-14T12:21:39.501096+0000","last_peered":"2024-05-14T12:21:39.501096+0000","last_clean":"2024-05-14T12:21:39.501096+0000","last_became_active":"2024-05-14T12:20:55.604743+0000","last_became_peered":"2024-05-14T12:20:55.604743+0000","last_unstale":"2024-05-14T12:21:39.501096+0000","last_undegraded":"2024-05-14T12:21:39.501096+0000","last_fullsized":"2024-05-14T12:21:39.501096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:15.258776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499375+0000","last_change":"2024-05-14T12:19:22.477995+0000","last_active":"2024-05-14T12:21:39.499375+0000","last_peered":"2024-05-14T12:21:39.499375+0000","last_clean":"2024-05-14T12:21:39.499375+0000","last_became_active":"2024-05-14T12:19:22.471890+0000","last_became_peered":"2024-05-14T12:19:22.471890+0000","last_unstale":"2024-05-14T12:21:39.499375+0000","last_undegraded":"2024-05-14T12:21:39.499375+0000","last_fullsized":"2024-05-14T12:21:39.499375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_clean_scrub_stamp":"2024-05-14T12:15:26.966159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:18.761547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239274+0000","last_change":"2024-05-14T12:20:59.674341+0000","last_active":"2024-05-14T12:23:08.239274+0000","last_peered":"2024-05-14T12:23:08.239274+0000","last_clean":"2024-05-14T12:23:08.239274+0000","last_became_active":"2024-05-14T12:20:59.672199+0000","last_became_peered":"2024-05-14T12:20:59.672199+0000","last_unstale":"2024-05-14T12:23:08.239274+0000","last_undegraded":"2024-05-14T12:23:08.239274+0000","last_fullsized":"2024-05-14T12:23:08.239274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.666708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.499490+0000","last_change":"2024-05-14T12:20:55.605513+0000","last_active":"2024-05-14T12:21:39.499490+0000","last_peered":"2024-05-14T12:21:39.499490+0000","last_clean":"2024-05-14T12:21:39.499490+0000","last_became_active":"2024-05-14T12:20:55.605131+0000","last_became_peered":"2024-05-14T12:20:55.605131+0000","last_unstale":"2024-05-14T12:21:39.499490+0000","last_undegraded":"2024-05-14T12:21:39.499490+0000","last_fullsized":"2024-05-14T12:21:39.499490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:56.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.502704+0000","last_change":"2024-05-14T12:20:55.966357+0000","last_active":"2024-05-14T12:21:39.502704+0000","last_peered":"2024-05-14T12:21:39.502704+0000","last_clean":"2024-05-14T12:21:39.502704+0000","last_became_active":"2024-05-14T12:20:55.965946+0000","last_became_peered":"2024-05-14T12:20:55.965946+0000","last_unstale":"2024-05-14T12:21:39.502704+0000","last_undegraded":"2024-05-14T12:21:39.502704+0000","last_fullsized":"2024-05-14T12:21:39.502704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:20.843819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253081+0000","last_change":"2024-05-14T12:20:59.675130+0000","last_active":"2024-05-14T12:23:08.253081+0000","last_peered":"2024-05-14T12:23:08.253081+0000","last_clean":"2024-05-14T12:23:08.253081+0000","last_became_active":"2024-05-14T12:20:59.674639+0000","last_became_peered":"2024-05-14T12:20:59.674639+0000","last_unstale":"2024-05-14T12:23:08.253081+0000","last_undegraded":"2024-05-14T12:23:08.253081+0000","last_fullsized":"2024-05-14T12:23:08.253081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:34:47.167894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.713889+0000","last_change":"2024-05-14T12:20:55.615975+0000","last_active":"2024-05-14T12:23:08.713889+0000","last_peered":"2024-05-14T12:23:08.713889+0000","last_clean":"2024-05-14T12:23:08.713889+0000","last_became_active":"2024-05-14T12:20:55.615542+0000","last_became_peered":"2024-05-14T12:20:55.615542+0000","last_unstale":"2024-05-14T12:23:08.713889+0000","last_undegraded":"2024-05-14T12:23:08.713889+0000","last_fullsized":"2024-05-14T12:23:08.713889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:52:46.621227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260341+0000","last_change":"2024-05-14T12:20:59.679047+0000","last_active":"2024-05-14T12:23:08.260341+0000","last_peered":"2024-05-14T12:23:08.260341+0000","last_clean":"2024-05-14T12:23:08.260341+0000","last_became_active":"2024-05-14T12:20:59.678620+0000","last_became_peered":"2024-05-14T12:20:59.678620+0000","last_unstale":"2024-05-14T12:23:08.260341+0000","last_undegraded":"2024-05-14T12:23:08.260341+0000","last_fullsized":"2024-05-14T12:23:08.260341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:30.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501411+0000","last_change":"2024-05-14T12:20:55.836121+0000","last_active":"2024-05-14T12:21:39.501411+0000","last_peered":"2024-05-14T12:21:39.501411+0000","last_clean":"2024-05-14T12:21:39.501411+0000","last_became_active":"2024-05-14T12:20:55.835758+0000","last_became_peered":"2024-05-14T12:20:55.835758+0000","last_unstale":"2024-05-14T12:21:39.501411+0000","last_undegraded":"2024-05-14T12:21:39.501411+0000","last_fullsized":"2024-05-14T12:21:39.501411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:29:12.627760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261142+0000","last_change":"2024-05-14T12:20:59.679664+0000","last_active":"2024-05-14T12:23:08.261142+0000","last_peered":"2024-05-14T12:23:08.261142+0000","last_clean":"2024-05-14T12:23:08.261142+0000","last_became_active":"2024-05-14T12:20:59.679242+0000","last_became_peered":"2024-05-14T12:20:59.679242+0000","last_unstale":"2024-05-14T12:23:08.261142+0000","last_undegraded":"2024-05-14T12:23:08.261142+0000","last_fullsized":"2024-05-14T12:23:08.261142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:38:17.910624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721087+0000","last_change":"2024-05-14T12:20:55.965927+0000","last_active":"2024-05-14T12:21:39.721087+0000","last_peered":"2024-05-14T12:21:39.721087+0000","last_clean":"2024-05-14T12:21:39.721087+0000","last_became_active":"2024-05-14T12:20:55.965570+0000","last_became_peered":"2024-05-14T12:20:55.965570+0000","last_unstale":"2024-05-14T12:21:39.721087+0000","last_undegraded":"2024-05-14T12:21:39.721087+0000","last_fullsized":"2024-05-14T12:21:39.721087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:16:23.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239485+0000","last_change":"2024-05-14T12:20:59.662521+0000","last_active":"2024-05-14T12:23:08.239485+0000","last_peered":"2024-05-14T12:23:08.239485+0000","last_clean":"2024-05-14T12:23:08.239485+0000","last_became_active":"2024-05-14T12:20:59.662140+0000","last_became_peered":"2024-05-14T12:20:59.662140+0000","last_unstale":"2024-05-14T12:23:08.239485+0000","last_undegraded":"2024-05-14T12:23:08.239485+0000","last_fullsized":"2024-05-14T12:23:08.239485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:44.471630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702986+0000","last_change":"2024-05-14T12:20:55.614124+0000","last_active":"2024-05-14T12:21:39.702986+0000","last_peered":"2024-05-14T12:21:39.702986+0000","last_clean":"2024-05-14T12:21:39.702986+0000","last_became_active":"2024-05-14T12:20:55.610826+0000","last_became_peered":"2024-05-14T12:20:55.610826+0000","last_unstale":"2024-05-14T12:21:39.702986+0000","last_undegraded":"2024-05-14T12:21:39.702986+0000","last_fullsized":"2024-05-14T12:21:39.702986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:01:30.296978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241601+0000","last_change":"2024-05-14T12:20:59.684356+0000","last_active":"2024-05-14T12:23:08.241601+0000","last_peered":"2024-05-14T12:23:08.241601+0000","last_clean":"2024-05-14T12:23:08.241601+0000","last_became_active":"2024-05-14T12:20:59.683942+0000","last_became_peered":"2024-05-14T12:20:59.683942+0000","last_unstale":"2024-05-14T12:23:08.241601+0000","last_undegraded":"2024-05-14T12:23:08.241601+0000","last_fullsized":"2024-05-14T12:23:08.241601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:50.421104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501801+0000","last_change":"2024-05-14T12:20:55.615921+0000","last_active":"2024-05-14T12:21:39.501801+0000","last_peered":"2024-05-14T12:21:39.501801+0000","last_clean":"2024-05-14T12:21:39.501801+0000","last_became_active":"2024-05-14T12:20:55.615448+0000","last_became_peered":"2024-05-14T12:20:55.615448+0000","last_unstale":"2024-05-14T12:21:39.501801+0000","last_undegraded":"2024-05-14T12:21:39.501801+0000","last_fullsized":"2024-05-14T12:21:39.501801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:41:00.260869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260052+0000","last_change":"2024-05-14T12:20:59.690629+0000","last_active":"2024-05-14T12:23:08.260052+0000","last_peered":"2024-05-14T12:23:08.260052+0000","last_clean":"2024-05-14T12:23:08.260052+0000","last_became_active":"2024-05-14T12:20:59.689696+0000","last_became_peered":"2024-05-14T12:20:59.689696+0000","last_unstale":"2024-05-14T12:23:08.260052+0000","last_undegraded":"2024-05-14T12:23:08.260052+0000","last_fullsized":"2024-05-14T12:23:08.260052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:27.678235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.531447+0000","last_change":"2024-05-14T12:21:39.530824+0000","last_active":"2024-05-14T12:21:39.531447+0000","last_peered":"2024-05-14T12:21:39.531447+0000","last_clean":"2024-05-14T12:21:39.531447+0000","last_became_active":"2024-05-14T12:21:39.507316+0000","last_became_peered":"2024-05-14T12:21:39.507316+0000","last_unstale":"2024-05-14T12:21:39.531447+0000","last_undegraded":"2024-05-14T12:21:39.531447+0000","last_fullsized":"2024-05-14T12:21:39.531447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:06:46.506545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257038+0000","last_change":"2024-05-14T12:20:59.679078+0000","last_active":"2024-05-14T12:23:08.257038+0000","last_peered":"2024-05-14T12:23:08.257038+0000","last_clean":"2024-05-14T12:23:08.257038+0000","last_became_active":"2024-05-14T12:20:59.678713+0000","last_became_peered":"2024-05-14T12:20:59.678713+0000","last_unstale":"2024-05-14T12:23:08.257038+0000","last_undegraded":"2024-05-14T12:23:08.257038+0000","last_fullsized":"2024-05-14T12:23:08.257038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:46:44.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:18.629455+0000","last_change":"2024-05-14T12:20:55.965829+0000","last_active":"2024-05-14T12:23:18.629455+0000","last_peered":"2024-05-14T12:23:18.629455+0000","last_clean":"2024-05-14T12:23:18.629455+0000","last_became_active":"2024-05-14T12:20:55.965316+0000","last_became_peered":"2024-05-14T12:20:55.965316+0000","last_unstale":"2024-05-14T12:23:18.629455+0000","last_undegraded":"2024-05-14T12:23:18.629455+0000","last_fullsized":"2024-05-14T12:23:18.629455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:46:36.879599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245162+0000","last_change":"2024-05-14T12:20:59.673582+0000","last_active":"2024-05-14T12:23:08.245162+0000","last_peered":"2024-05-14T12:23:08.245162+0000","last_clean":"2024-05-14T12:23:08.245162+0000","last_became_active":"2024-05-14T12:20:59.672475+0000","last_became_peered":"2024-05-14T12:20:59.672475+0000","last_unstale":"2024-05-14T12:23:08.245162+0000","last_undegraded":"2024-05-14T12:23:08.245162+0000","last_fullsized":"2024-05-14T12:23:08.245162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:06:04.861177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496398+0000","last_change":"2024-05-14T12:20:55.615870+0000","last_active":"2024-05-14T12:21:39.496398+0000","last_peered":"2024-05-14T12:21:39.496398+0000","last_clean":"2024-05-14T12:21:39.496398+0000","last_became_active":"2024-05-14T12:20:55.615444+0000","last_became_peered":"2024-05-14T12:20:55.615444+0000","last_unstale":"2024-05-14T12:21:39.496398+0000","last_undegraded":"2024-05-14T12:21:39.496398+0000","last_fullsized":"2024-05-14T12:21:39.496398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:03.081164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259667+0000","last_change":"2024-05-14T12:20:59.688252+0000","last_active":"2024-05-14T12:23:08.259667+0000","last_peered":"2024-05-14T12:23:08.259667+0000","last_clean":"2024-05-14T12:23:08.259667+0000","last_became_active":"2024-05-14T12:20:59.687861+0000","last_became_peered":"2024-05-14T12:20:59.687861+0000","last_unstale":"2024-05-14T12:23:08.259667+0000","last_undegraded":"2024-05-14T12:23:08.259667+0000","last_fullsized":"2024-05-14T12:23:08.259667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:29:00.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500452+0000","last_change":"2024-05-14T12:20:55.616119+0000","last_active":"2024-05-14T12:21:39.500452+0000","last_peered":"2024-05-14T12:21:39.500452+0000","last_clean":"2024-05-14T12:21:39.500452+0000","last_became_active":"2024-05-14T12:20:55.615700+0000","last_became_peered":"2024-05-14T12:20:55.615700+0000","last_unstale":"2024-05-14T12:21:39.500452+0000","last_undegraded":"2024-05-14T12:21:39.500452+0000","last_fullsized":"2024-05-14T12:21:39.500452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:39.342610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245535+0000","last_change":"2024-05-14T12:20:59.672495+0000","last_active":"2024-05-14T12:23:08.245535+0000","last_peered":"2024-05-14T12:23:08.245535+0000","last_clean":"2024-05-14T12:23:08.245535+0000","last_became_active":"2024-05-14T12:20:59.671983+0000","last_became_peered":"2024-05-14T12:20:59.671983+0000","last_unstale":"2024-05-14T12:23:08.245535+0000","last_undegraded":"2024-05-14T12:23:08.245535+0000","last_fullsized":"2024-05-14T12:23:08.245535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:41.336895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239937+0000","last_change":"2024-05-14T12:20:59.663818+0000","last_active":"2024-05-14T12:23:08.239937+0000","last_peered":"2024-05-14T12:23:08.239937+0000","last_clean":"2024-05-14T12:23:08.239937+0000","last_became_active":"2024-05-14T12:20:59.663431+0000","last_became_peered":"2024-05-14T12:20:59.663431+0000","last_unstale":"2024-05-14T12:23:08.239937+0000","last_undegraded":"2024-05-14T12:23:08.239937+0000","last_fullsized":"2024-05-14T12:23:08.239937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:40:10.435481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240311+0000","last_change":"2024-05-14T12:20:59.668412+0000","last_active":"2024-05-14T12:23:08.240311+0000","last_peered":"2024-05-14T12:23:08.240311+0000","last_clean":"2024-05-14T12:23:08.240311+0000","last_became_active":"2024-05-14T12:20:59.667963+0000","last_became_peered":"2024-05-14T12:20:59.667963+0000","last_unstale":"2024-05-14T12:23:08.240311+0000","last_undegraded":"2024-05-14T12:23:08.240311+0000","last_fullsized":"2024-05-14T12:23:08.240311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:50:19.463843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243037+0000","last_change":"2024-05-14T12:20:59.668796+0000","last_active":"2024-05-14T12:23:08.243037+0000","last_peered":"2024-05-14T12:23:08.243037+0000","last_clean":"2024-05-14T12:23:08.243037+0000","last_became_active":"2024-05-14T12:20:59.668414+0000","last_became_peered":"2024-05-14T12:20:59.668414+0000","last_unstale":"2024-05-14T12:23:08.243037+0000","last_undegraded":"2024-05-14T12:23:08.243037+0000","last_fullsized":"2024-05-14T12:23:08.243037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:28.669547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257458+0000","last_change":"2024-05-14T12:20:59.687417+0000","last_active":"2024-05-14T12:23:08.257458+0000","last_peered":"2024-05-14T12:23:08.257458+0000","last_clean":"2024-05-14T12:23:08.257458+0000","last_became_active":"2024-05-14T12:20:59.686373+0000","last_became_peered":"2024-05-14T12:20:59.686373+0000","last_unstale":"2024-05-14T12:23:08.257458+0000","last_undegraded":"2024-05-14T12:23:08.257458+0000","last_fullsized":"2024-05-14T12:23:08.257458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:55.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255534+0000","last_change":"2024-05-14T12:21:40.359831+0000","last_active":"2024-05-14T12:23:08.255534+0000","last_peered":"2024-05-14T12:23:08.255534+0000","last_clean":"2024-05-14T12:23:08.255534+0000","last_became_active":"2024-05-14T12:21:40.358347+0000","last_became_peered":"2024-05-14T12:21:40.358347+0000","last_unstale":"2024-05-14T12:23:08.255534+0000","last_undegraded":"2024-05-14T12:23:08.255534+0000","last_fullsized":"2024-05-14T12:23:08.255534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:03:58.165602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238787+0000","last_change":"2024-05-14T12:20:59.663332+0000","last_active":"2024-05-14T12:23:08.238787+0000","last_peered":"2024-05-14T12:23:08.238787+0000","last_clean":"2024-05-14T12:23:08.238787+0000","last_became_active":"2024-05-14T12:20:59.662714+0000","last_became_peered":"2024-05-14T12:20:59.662714+0000","last_unstale":"2024-05-14T12:23:08.238787+0000","last_undegraded":"2024-05-14T12:23:08.238787+0000","last_fullsized":"2024-05-14T12:23:08.238787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:59.140579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.234610+0000","last_change":"2024-05-14T12:20:59.665482+0000","last_active":"2024-05-14T12:23:08.234610+0000","last_peered":"2024-05-14T12:23:08.234610+0000","last_clean":"2024-05-14T12:23:08.234610+0000","last_became_active":"2024-05-14T12:20:59.665001+0000","last_became_peered":"2024-05-14T12:20:59.665001+0000","last_unstale":"2024-05-14T12:23:08.234610+0000","last_undegraded":"2024-05-14T12:23:08.234610+0000","last_fullsized":"2024-05-14T12:23:08.234610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:26.074054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246632+0000","last_change":"2024-05-14T12:20:59.679317+0000","last_active":"2024-05-14T12:23:08.246632+0000","last_peered":"2024-05-14T12:23:08.246632+0000","last_clean":"2024-05-14T12:23:08.246632+0000","last_became_active":"2024-05-14T12:20:59.675797+0000","last_became_peered":"2024-05-14T12:20:59.675797+0000","last_unstale":"2024-05-14T12:23:08.246632+0000","last_undegraded":"2024-05-14T12:23:08.246632+0000","last_fullsized":"2024-05-14T12:23:08.246632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:58.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250723+0000","last_change":"2024-05-14T12:20:59.669982+0000","last_active":"2024-05-14T12:23:08.250723+0000","last_peered":"2024-05-14T12:23:08.250723+0000","last_clean":"2024-05-14T12:23:08.250723+0000","last_became_active":"2024-05-14T12:20:59.669587+0000","last_became_peered":"2024-05-14T12:20:59.669587+0000","last_unstale":"2024-05-14T12:23:08.250723+0000","last_undegraded":"2024-05-14T12:23:08.250723+0000","last_fullsized":"2024-05-14T12:23:08.250723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:31.474906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260491+0000","last_change":"2024-05-14T12:20:59.672672+0000","last_active":"2024-05-14T12:23:08.260491+0000","last_peered":"2024-05-14T12:23:08.260491+0000","last_clean":"2024-05-14T12:23:08.260491+0000","last_became_active":"2024-05-14T12:20:59.672191+0000","last_became_peered":"2024-05-14T12:20:59.672191+0000","last_unstale":"2024-05-14T12:23:08.260491+0000","last_undegraded":"2024-05-14T12:23:08.260491+0000","last_fullsized":"2024-05-14T12:23:08.260491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:53:14.530296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260678+0000","last_change":"2024-05-14T12:20:59.684548+0000","last_active":"2024-05-14T12:23:08.260678+0000","last_peered":"2024-05-14T12:23:08.260678+0000","last_clean":"2024-05-14T12:23:08.260678+0000","last_became_active":"2024-05-14T12:20:59.684069+0000","last_became_peered":"2024-05-14T12:20:59.684069+0000","last_unstale":"2024-05-14T12:23:08.260678+0000","last_undegraded":"2024-05-14T12:23:08.260678+0000","last_fullsized":"2024-05-14T12:23:08.260678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:58.759384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.264740+0000","last_change":"2024-05-14T12:20:59.682386+0000","last_active":"2024-05-14T12:23:08.264740+0000","last_peered":"2024-05-14T12:23:08.264740+0000","last_clean":"2024-05-14T12:23:08.264740+0000","last_became_active":"2024-05-14T12:20:59.682037+0000","last_became_peered":"2024-05-14T12:20:59.682037+0000","last_unstale":"2024-05-14T12:23:08.264740+0000","last_undegraded":"2024-05-14T12:23:08.264740+0000","last_fullsized":"2024-05-14T12:23:08.264740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:24.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241032+0000","last_change":"2024-05-14T12:20:59.672679+0000","last_active":"2024-05-14T12:23:08.241032+0000","last_peered":"2024-05-14T12:23:08.241032+0000","last_clean":"2024-05-14T12:23:08.241032+0000","last_became_active":"2024-05-14T12:20:59.672324+0000","last_became_peered":"2024-05-14T12:20:59.672324+0000","last_unstale":"2024-05-14T12:23:08.241032+0000","last_undegraded":"2024-05-14T12:23:08.241032+0000","last_fullsized":"2024-05-14T12:23:08.241032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:45.513792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72459,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1207,"num_read_kb":687,"num_write":257,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":644,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":217377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776178,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1100522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939704,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":444450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135935,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":444806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1544192,"data_stored":1037487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":510585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":510805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149787,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1548288,"data_stored":1036011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T12:23:24.368 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-14T12:23:24.368 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-14T12:23:24.369 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-14T12:23:24.369 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph health --format=json 2024-05-14T12:23:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:24.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:24 smithi047 ceph-mon[31254]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:23:25.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:24 smithi073 ceph-mon[35809]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:23:25.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:24 smithi066 ceph-mon[35981]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:23:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:25 smithi047 ceph-mon[31254]: pgmap v397: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:25 smithi073 ceph-mon[35809]: pgmap v397: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:25 smithi066 ceph-mon[35981]: pgmap v397: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.076+0000 7f1d0f200700 1 -- 172.21.15.47:0/3655498167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10108d30 msgr2=0x7f1d10109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.076+0000 7f1d0f200700 1 --2- 172.21.15.47:0/3655498167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10108d30 0x7f1d10109140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80099c0 tx=0x7f1cf8009cd0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.077+0000 7f1d0f200700 1 -- 172.21.15.47:0/3655498167 shutdown_connections 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.077+0000 7f1d0f200700 1 --2- 172.21.15.47:0/3655498167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10109680 0x7f1d10110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.077+0000 7f1d0f200700 1 --2- 172.21.15.47:0/3655498167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d10104400 0x7f1d10104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.077+0000 7f1d0f200700 1 --2- 172.21.15.47:0/3655498167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10108d30 0x7f1d10109140 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.077+0000 7f1d0f200700 1 -- 172.21.15.47:0/3655498167 >> 172.21.15.47:0/3655498167 conn(0x7f1d10079d10 msgr2=0x7f1d1007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:27.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.077+0000 7f1d0f200700 1 -- 172.21.15.47:0/3655498167 shutdown_connections 2024-05-14T12:23:27.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.077+0000 7f1d0f200700 1 -- 172.21.15.47:0/3655498167 wait complete. 2024-05-14T12:23:27.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.078+0000 7f1d0f200700 1 Processor -- start 2024-05-14T12:23:27.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.078+0000 7f1d0f200700 1 -- start start 2024-05-14T12:23:27.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0f200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d10104400 0x7f1d10075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:27.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0f200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10108d30 0x7f1d10076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:27.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10109680 0x7f1d10076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:27.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101142e0 con 0x7f1d10109680 2024-05-14T12:23:27.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0f200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10114160 con 0x7f1d10104400 2024-05-14T12:23:27.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0f200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10114460 con 0x7f1d10108d30 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d05400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10108d30 0x7f1d10076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d05400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10108d30 0x7f1d10076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45842/0 (socket says 172.21.15.47:45842) 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d05400700 1 -- 172.21.15.47:0/2560067902 learned_addr learned my addr 172.21.15.47:0/2560067902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0de00700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d10104400 0x7f1d10075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.079+0000 7f1d0e800700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10109680 0x7f1d10076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.080+0000 7f1d05400700 1 -- 172.21.15.47:0/2560067902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d10104400 msgr2=0x7f1d10075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.080+0000 7f1d05400700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d10104400 0x7f1d10075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.080+0000 7f1d05400700 1 -- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10109680 msgr2=0x7f1d10076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.080+0000 7f1d05400700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10109680 0x7f1d10076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.080+0000 7f1d05400700 1 -- 172.21.15.47:0/2560067902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d101a8ff0 con 0x7f1d10108d30 2024-05-14T12:23:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.080+0000 7f1d05400700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10108d30 0x7f1d10076000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005f50 tx=0x7f1cf8005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.080+0000 7f1d07400700 1 -- 172.21.15.47:0/2560067902 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8026070 con 0x7f1d10108d30 2024-05-14T12:23:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.081+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d101a9280 con 0x7f1d10108d30 2024-05-14T12:23:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.081+0000 7f1d07400700 1 -- 172.21.15.47:0/2560067902 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf8003c70 con 0x7f1d10108d30 2024-05-14T12:23:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.081+0000 7f1d07400700 1 -- 172.21.15.47:0/2560067902 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800f960 con 0x7f1d10108d30 2024-05-14T12:23:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.081+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d101a9730 con 0x7f1d10108d30 2024-05-14T12:23:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.082+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d100512c0 con 0x7f1d10108d30 2024-05-14T12:23:27.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.085+0000 7f1d07400700 1 -- 172.21.15.47:0/2560067902 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1cf8029070 con 0x7f1d10108d30 2024-05-14T12:23:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.086+0000 7f1d07400700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cf40b2880 0x7f1cf40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.086+0000 7f1d07400700 1 -- 172.21.15.47:0/2560067902 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1cf80e29f0 con 0x7f1d10108d30 2024-05-14T12:23:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.086+0000 7f1d0de00700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cf40b2880 0x7f1cf40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.087+0000 7f1d0de00700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cf40b2880 0x7f1cf40b4d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009c60 tx=0x7f1d00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:27.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.091+0000 7f1d07400700 1 -- 172.21.15.47:0/2560067902 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1cf805edf0 con 0x7f1d10108d30 2024-05-14T12:23:27.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.379+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1d1002e5f0 con 0x7f1d10108d30 2024-05-14T12:23:27.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.379+0000 7f1d07400700 1 -- 172.21.15.47:0/2560067902 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1cf8013070 con 0x7f1d10108d30 2024-05-14T12:23:27.381 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:23:27.381 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cf40b2880 msgr2=0x7f1cf40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cf40b2880 0x7f1cf40b4d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009c60 tx=0x7f1d00009260 comp rx=0 tx=0).stop 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10108d30 msgr2=0x7f1d10076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10108d30 0x7f1d10076000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005f50 tx=0x7f1cf8005280 comp rx=0 tx=0).stop 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 shutdown_connections 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cf40b2880 0x7f1cf40b4d90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d10109680 0x7f1d10076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d10104400 0x7f1d10075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 --2- 172.21.15.47:0/2560067902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d10108d30 0x7f1d10076000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:27.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 >> 172.21.15.47:0/2560067902 conn(0x7f1d10079d10 msgr2=0x7f1d10101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:27.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.383+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 shutdown_connections 2024-05-14T12:23:27.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:27.384+0000 7f1d0f200700 1 -- 172.21.15.47:0/2560067902 wait complete. 2024-05-14T12:23:27.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:27 smithi047 ceph-mon[31254]: pgmap v398: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:27.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:27 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2560067902' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T12:23:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:27 smithi073 ceph-mon[35809]: pgmap v398: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:27 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2560067902' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T12:23:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:27 smithi066 ceph-mon[35981]: pgmap v398: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:27 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2560067902' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T12:23:28.161 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-14T12:23:28.162 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:23:28.645 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:29.871 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:29 smithi047 ceph-mon[31254]: pgmap v399: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:30.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:29 smithi073 ceph-mon[35809]: pgmap v399: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:30.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:29 smithi066 ceph-mon[35981]: pgmap v399: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.809+0000 7fc9b2e00700 1 -- 172.21.15.47:0/3367484215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 msgr2=0x7fc9ac117820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.809+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/3367484215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 0x7fc9ac117820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400b0a0 tx=0x7fc9a400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.810+0000 7fc9b2e00700 1 -- 172.21.15.47:0/3367484215 shutdown_connections 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.810+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/3367484215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 0x7fc9ac117820 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.810+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/3367484215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9ac110980 0x7fc9ac110d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.810+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/3367484215 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 0x7fc9ac10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.810+0000 7fc9b2e00700 1 -- 172.21.15.47:0/3367484215 >> 172.21.15.47:0/3367484215 conn(0x7fc9ac076d30 msgr2=0x7fc9ac077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.810+0000 7fc9b2e00700 1 -- 172.21.15.47:0/3367484215 shutdown_connections 2024-05-14T12:23:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.810+0000 7fc9b2e00700 1 -- 172.21.15.47:0/3367484215 wait complete. 2024-05-14T12:23:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.811+0000 7fc9b2e00700 1 Processor -- start 2024-05-14T12:23:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.811+0000 7fc9b2e00700 1 -- start start 2024-05-14T12:23:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.811+0000 7fc9b2e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 0x7fc9ac1a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9b2e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 0x7fc9ac1a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9b2e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9ac110980 0x7fc9ac1a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9b2e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac11ab00 con 0x7fc9ac10a950 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9b2e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac11a980 con 0x7fc9ac110980 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9b2e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac11ac80 con 0x7fc9ac10b2a0 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 0x7fc9ac1a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 0x7fc9ac1a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59572/0 (socket says 172.21.15.47:59572) 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 -- 172.21.15.47:0/1611800087 learned_addr learned my addr 172.21.15.47:0/1611800087 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9b0e00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9ac110980 0x7fc9ac1a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9ab400700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 0x7fc9ac1a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 -- 172.21.15.47:0/1611800087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 msgr2=0x7fc9ac1a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 0x7fc9ac1a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 -- 172.21.15.47:0/1611800087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9ac110980 msgr2=0x7fc9ac1a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9ac110980 0x7fc9ac1a5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.812+0000 7fc9abe00700 1 -- 172.21.15.47:0/1611800087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac1a62e0 con 0x7fc9ac10a950 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.813+0000 7fc9abe00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 0x7fc9ac1a1410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d980 tx=0x7fc99c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.813+0000 7fc9a8c00700 1 -- 172.21.15.47:0/1611800087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c017070 con 0x7fc9ac10a950 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.813+0000 7fc9a8c00700 1 -- 172.21.15.47:0/1611800087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc99c009de0 con 0x7fc9ac10a950 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.813+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac1a65d0 con 0x7fc9ac10a950 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.813+0000 7fc9a8c00700 1 -- 172.21.15.47:0/1611800087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00f3c0 con 0x7fc9ac10a950 2024-05-14T12:23:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.814+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac1adef0 con 0x7fc9ac10a950 2024-05-14T12:23:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.815+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ac0512c0 con 0x7fc9ac10a950 2024-05-14T12:23:30.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.818+0000 7fc9a8c00700 1 -- 172.21.15.47:0/1611800087 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc99c009930 con 0x7fc9ac10a950 2024-05-14T12:23:30.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.819+0000 7fc9a8c00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc9900b2900 0x7fc9900b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:30.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.819+0000 7fc9a8c00700 1 -- 172.21.15.47:0/1611800087 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc99c0e1c30 con 0x7fc9ac10a950 2024-05-14T12:23:30.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.820+0000 7fc9ab400700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc9900b2900 0x7fc9900b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:30.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.820+0000 7fc9ab400700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc9900b2900 0x7fc9900b4e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac10fc50 tx=0x7fc994009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:30.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:30.824+0000 7fc9a8c00700 1 -- 172.21.15.47:0/1611800087 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc99c0a9910 con 0x7fc9ac10a950 2024-05-14T12:23:31.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.110+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9ac1a2770 con 0x7fc9ac10a950 2024-05-14T12:23:31.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.112+0000 7fc9a8c00700 1 -- 172.21.15.47:0/1611800087 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11919 (secure 0 0 0) 0x7fc99c0a9210 con 0x7fc9ac10a950 2024-05-14T12:23:31.206 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:23:31.207 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:21:26.159710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:23:31.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc9900b2900 msgr2=0x7fc9900b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:31.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc9900b2900 0x7fc9900b4e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac10fc50 tx=0x7fc994009260 comp rx=0 tx=0).stop 2024-05-14T12:23:31.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 msgr2=0x7fc9ac1a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:31.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 0x7fc9ac1a1410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00d980 tx=0x7fc99c00dc90 comp rx=0 tx=0).stop 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 shutdown_connections 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc9900b2900 0x7fc9900b4e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9ac110980 0x7fc9ac1a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9ac10a950 0x7fc9ac1a1410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 --2- 172.21.15.47:0/1611800087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9ac10b2a0 0x7fc9ac1a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.115+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 >> 172.21.15.47:0/1611800087 conn(0x7fc9ac076d30 msgr2=0x7fc9ac108860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.116+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 shutdown_connections 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:31.116+0000 7fc9b2e00700 1 -- 172.21.15.47:0/1611800087 wait complete. 2024-05-14T12:23:31.208 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-05-14T12:23:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:31 smithi047 ceph-mon[31254]: pgmap v400: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:31 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1611800087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:31.999 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:23:32.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:31 smithi073 ceph-mon[35809]: pgmap v400: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:32.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:31 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1611800087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:31 smithi066 ceph-mon[35981]: pgmap v400: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:31 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1611800087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:32.485 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:33.905 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:33 smithi047 ceph-mon[31254]: pgmap v401: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:33 smithi073 ceph-mon[35809]: pgmap v401: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:33 smithi066 ceph-mon[35981]: pgmap v401: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 -- 172.21.15.47:0/3061320828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb410a990 msgr2=0x7f5bb410ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 --2- 172.21.15.47:0/3061320828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb410a990 0x7f5bb410ada0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40098f0 tx=0x7f5ba4009c00 comp rx=0 tx=0).stop 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 -- 172.21.15.47:0/3061320828 shutdown_connections 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 --2- 172.21.15.47:0/3061320828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bb410b2e0 0x7f5bb4117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 --2- 172.21.15.47:0/3061320828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb4110970 0x7f5bb4110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 --2- 172.21.15.47:0/3061320828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb410a990 0x7f5bb410ada0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 -- 172.21.15.47:0/3061320828 >> 172.21.15.47:0/3061320828 conn(0x7f5bb4077c80 msgr2=0x7f5bb40780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 -- 172.21.15.47:0/3061320828 shutdown_connections 2024-05-14T12:23:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.878+0000 7f5bbc800700 1 -- 172.21.15.47:0/3061320828 wait complete. 2024-05-14T12:23:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.880+0000 7f5bbc800700 1 Processor -- start 2024-05-14T12:23:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.880+0000 7f5bbc800700 1 -- start start 2024-05-14T12:23:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.880+0000 7f5bbc800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bb410a990 0x7f5bb41a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.880+0000 7f5bbc800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb410b2e0 0x7f5bb41a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bbc800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4110970 0x7f5bb41a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bbc800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb411aa90 con 0x7f5bb410a990 2024-05-14T12:23:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bbc800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb411a910 con 0x7f5bb410b2e0 2024-05-14T12:23:34.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bbc800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb411ac10 con 0x7f5bb4110970 2024-05-14T12:23:34.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bb410a990 0x7f5bb41a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb410b2e0 0x7f5bb41a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb410b2e0 0x7f5bb41a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:45498/0 (socket says 172.21.15.47:45498) 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 -- 172.21.15.47:0/1156341175 learned_addr learned my addr 172.21.15.47:0/1156341175 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bba800700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4110970 0x7f5bb41a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 -- 172.21.15.47:0/1156341175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4110970 msgr2=0x7f5bb41a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4110970 0x7f5bb41a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 -- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bb410a990 msgr2=0x7f5bb41a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bb410a990 0x7f5bb41a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.881+0000 7f5bb9400700 1 -- 172.21.15.47:0/1156341175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb41a6370 con 0x7f5bb410b2e0 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.882+0000 7f5bb9400700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb410b2e0 0x7f5bb41a1a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009230 tx=0x7f5ba400f990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.882+0000 7f5baea00700 1 -- 172.21.15.47:0/1156341175 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40050c0 con 0x7f5bb410b2e0 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.882+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41a6600 con 0x7f5bb410b2e0 2024-05-14T12:23:34.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.882+0000 7f5baea00700 1 -- 172.21.15.47:0/1156341175 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ba400b560 con 0x7f5bb410b2e0 2024-05-14T12:23:34.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.882+0000 7f5baea00700 1 -- 172.21.15.47:0/1156341175 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4003a40 con 0x7f5bb410b2e0 2024-05-14T12:23:34.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.882+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a6ae0 con 0x7f5bb410b2e0 2024-05-14T12:23:34.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.883+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb40512c0 con 0x7f5bb410b2e0 2024-05-14T12:23:34.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.886+0000 7f5baea00700 1 -- 172.21.15.47:0/1156341175 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5ba400ba10 con 0x7f5bb410b2e0 2024-05-14T12:23:34.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.887+0000 7f5baea00700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5b9c0b2880 0x7f5b9c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:34.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.887+0000 7f5baea00700 1 -- 172.21.15.47:0/1156341175 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5ba40e34e0 con 0x7f5bb410b2e0 2024-05-14T12:23:34.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.887+0000 7f5bb9e00700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5b9c0b2880 0x7f5b9c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:34.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.888+0000 7f5bb9e00700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5b9c0b2880 0x7f5b9c0b4d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5bb407d0f0 tx=0x7f5ba8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:34.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:34.890+0000 7f5baea00700 1 -- 172.21.15.47:0/1156341175 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5ba4013030 con 0x7f5bb410b2e0 2024-05-14T12:23:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.176+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bb4112ef0 con 0x7f5bb410b2e0 2024-05-14T12:23:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.177+0000 7f5baea00700 1 -- 172.21.15.47:0/1156341175 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11919 (secure 0 0 0) 0x7f5ba40ab250 con 0x7f5bb410b2e0 2024-05-14T12:23:35.178 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:23:35.178 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:21:26.159710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:23:35.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5b9c0b2880 msgr2=0x7f5b9c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:35.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5b9c0b2880 0x7f5b9c0b4d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5bb407d0f0 tx=0x7f5ba8009260 comp rx=0 tx=0).stop 2024-05-14T12:23:35.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb410b2e0 msgr2=0x7f5bb41a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:35.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb410b2e0 0x7f5bb41a1a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009230 tx=0x7f5ba400f990 comp rx=0 tx=0).stop 2024-05-14T12:23:35.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 shutdown_connections 2024-05-14T12:23:35.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5b9c0b2880 0x7f5b9c0b4d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:35.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4110970 0x7f5bb41a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:35.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bb410a990 0x7f5bb41a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:35.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 --2- 172.21.15.47:0/1156341175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bb410b2e0 0x7f5bb41a1a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:35.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.180+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 >> 172.21.15.47:0/1156341175 conn(0x7f5bb4077c80 msgr2=0x7f5bb407b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:35.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.181+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 shutdown_connections 2024-05-14T12:23:35.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:35.181+0000 7f5bbc800700 1 -- 172.21.15.47:0/1156341175 wait complete. 2024-05-14T12:23:35.183 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-05-14T12:23:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:35 smithi047 ceph-mon[31254]: pgmap v402: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:35 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1156341175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:35 smithi073 ceph-mon[35809]: pgmap v402: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:35 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1156341175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:35 smithi066 ceph-mon[35981]: pgmap v402: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:35 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1156341175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:36.095 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:23:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:37.791 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:37 smithi047 ceph-mon[31254]: pgmap v403: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:38.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:37 smithi073 ceph-mon[35809]: pgmap v403: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:37 smithi066 ceph-mon[35981]: pgmap v403: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:38.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:38 smithi047 ceph-mon[31254]: pgmap v404: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:38.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 -- 172.21.15.47:0/2098655279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b810e8f0 msgr2=0x7f08b8110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:38.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 --2- 172.21.15.47:0/2098655279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b810e8f0 0x7f08b8110dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08b000b0a0 tx=0x7f08b000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:23:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 -- 172.21.15.47:0/2098655279 shutdown_connections 2024-05-14T12:23:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 --2- 172.21.15.47:0/2098655279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b810e8f0 0x7f08b8110dd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 --2- 172.21.15.47:0/2098655279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b81054c0 0x7f08b81058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 --2- 172.21.15.47:0/2098655279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b8105e10 0x7f08b810e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 -- 172.21.15.47:0/2098655279 >> 172.21.15.47:0/2098655279 conn(0x7f08b80fedc0 msgr2=0x7f08b81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.985+0000 7f08bfc00700 1 -- 172.21.15.47:0/2098655279 shutdown_connections 2024-05-14T12:23:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.986+0000 7f08bfc00700 1 -- 172.21.15.47:0/2098655279 wait complete. 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 Processor -- start 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 -- start start 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b81054c0 0x7f08b819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b8105e10 0x7f08b819d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b810e8f0 0x7f08b81a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08b81144c0 con 0x7f08b8105e10 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8114340 con 0x7f08b81054c0 2024-05-14T12:23:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.987+0000 7f08bfc00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8114640 con 0x7f08b810e8f0 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08b7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b8105e10 0x7f08b819d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b81054c0 0x7f08b819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b81054c0 0x7f08b819cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57840/0 (socket says 172.21.15.47:57840) 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08b7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b8105e10 0x7f08b819d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47126/0 (socket says 172.21.15.47:47126) 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 -- 172.21.15.47:0/1618970111 learned_addr learned my addr 172.21.15.47:0/1618970111 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bdc00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b810e8f0 0x7f08b81a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 -- 172.21.15.47:0/1618970111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b810e8f0 msgr2=0x7f08b81a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b810e8f0 0x7f08b81a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 -- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b8105e10 msgr2=0x7f08b819d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:38.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b8105e10 0x7f08b819d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.988+0000 7f08bd200700 1 -- 172.21.15.47:0/1618970111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b81a1e80 con 0x7f08b81054c0 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.989+0000 7f08bd200700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b81054c0 0x7f08b819cfb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9c0 tx=0x7f08ac00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.989+0000 7f08b5600700 1 -- 172.21.15.47:0/1618970111 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00cbd0 con 0x7f08b81054c0 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.989+0000 7f08b5600700 1 -- 172.21.15.47:0/1618970111 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08ac00ee60 con 0x7f08b81054c0 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.989+0000 7f08b5600700 1 -- 172.21.15.47:0/1618970111 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0055c0 con 0x7f08b81054c0 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.989+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b81a2170 con 0x7f08b81054c0 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.989+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b81a9a90 con 0x7f08b81054c0 2024-05-14T12:23:38.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.990+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b80512c0 con 0x7f08b81054c0 2024-05-14T12:23:38.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.993+0000 7f08b5600700 1 -- 172.21.15.47:0/1618970111 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f08ac004750 con 0x7f08b81054c0 2024-05-14T12:23:38.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.994+0000 7f08b5600700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08a00b2900 0x7f08a00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:38.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.994+0000 7f08b5600700 1 -- 172.21.15.47:0/1618970111 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f08ac0e2650 con 0x7f08b81054c0 2024-05-14T12:23:38.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.995+0000 7f08b7e00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08a00b2900 0x7f08a00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.995+0000 7f08b7e00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08a00b2900 0x7f08a00b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f08b81107f0 tx=0x7f08a4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:38.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:38.996+0000 7f08b5600700 1 -- 172.21.15.47:0/1618970111 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f08ac054df0 con 0x7f08b81054c0 2024-05-14T12:23:39.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:38 smithi073 ceph-mon[35809]: pgmap v404: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:39.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:38 smithi066 ceph-mon[35981]: pgmap v404: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:39.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.237+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08b819e310 con 0x7f08b81054c0 2024-05-14T12:23:39.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.239+0000 7f08b5600700 1 -- 172.21.15.47:0/1618970111 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7f08b819e310 con 0x7f08b81054c0 2024-05-14T12:23:39.241 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:23:39.241 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:23:39.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.242+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08a00b2900 msgr2=0x7f08a00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.242+0000 7f08bfc00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08a00b2900 0x7f08a00b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f08b81107f0 tx=0x7f08a4009260 comp rx=0 tx=0).stop 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.242+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b81054c0 msgr2=0x7f08b819cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.242+0000 7f08bfc00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b81054c0 0x7f08b819cfb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9c0 tx=0x7f08ac00ecd0 comp rx=0 tx=0).stop 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 shutdown_connections 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f08a00b2900 0x7f08a00b4e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b810e8f0 0x7f08b81a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08b81054c0 0x7f08b819cfb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 --2- 172.21.15.47:0/1618970111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b8105e10 0x7f08b819d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 >> 172.21.15.47:0/1618970111 conn(0x7f08b80fedc0 msgr2=0x7f08b8103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 shutdown_connections 2024-05-14T12:23:39.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:39.243+0000 7f08bfc00700 1 -- 172.21.15.47:0/1618970111 wait complete. 2024-05-14T12:23:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:39 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1618970111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:23:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:39 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1618970111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:23:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:39 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1618970111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:23:40.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:23:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:40.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:40 smithi047 ceph-mon[31254]: pgmap v405: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:41.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:40 smithi073 ceph-mon[35809]: pgmap v405: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:41.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:40 smithi066 ceph-mon[35981]: pgmap v405: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:43.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 -- 172.21.15.47:0/3160828123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8110ba0 msgr2=0x7f19c8113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:43.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 --2- 172.21.15.47:0/3160828123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8110ba0 0x7f19c8113000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f19c000b0a0 tx=0x7f19c000b3b0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 -- 172.21.15.47:0/3160828123 shutdown_connections 2024-05-14T12:23:43.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 --2- 172.21.15.47:0/3160828123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8110ba0 0x7f19c8113000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 --2- 172.21.15.47:0/3160828123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19c8075d30 0x7f19c8076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 --2- 172.21.15.47:0/3160828123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8076680 0x7f19c8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 -- 172.21.15.47:0/3160828123 >> 172.21.15.47:0/3160828123 conn(0x7f19c8100040 msgr2=0x7f19c8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:43.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 -- 172.21.15.47:0/3160828123 shutdown_connections 2024-05-14T12:23:43.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.005+0000 7f19ce800700 1 -- 172.21.15.47:0/3160828123 wait complete. 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.006+0000 7f19ce800700 1 Processor -- start 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.006+0000 7f19ce800700 1 -- start start 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19ce800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19c8075d30 0x7f19c81042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19ce800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8076680 0x7f19c8104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19ce800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8110ba0 0x7f19c8104d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19ce800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19c81166d0 con 0x7f19c8076680 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19ce800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8116550 con 0x7f19c8075d30 2024-05-14T12:23:43.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19ce800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8116850 con 0x7f19c8110ba0 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19c6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8076680 0x7f19c8104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19c7e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8110ba0 0x7f19c8104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19c7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19c8075d30 0x7f19c81042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19c7e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8110ba0 0x7f19c8104d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:48336/0 (socket says 172.21.15.47:48336) 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19c7e00700 1 -- 172.21.15.47:0/4280578869 learned_addr learned my addr 172.21.15.47:0/4280578869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.007+0000 7f19c6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8076680 0x7f19c8104800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47144/0 (socket says 172.21.15.47:47144) 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.008+0000 7f19c7e00700 1 -- 172.21.15.47:0/4280578869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19c8075d30 msgr2=0x7f19c81042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:43.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.008+0000 7f19c7e00700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19c8075d30 0x7f19c81042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.008+0000 7f19c7e00700 1 -- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8076680 msgr2=0x7f19c8104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.008+0000 7f19c7e00700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8076680 0x7f19c8104800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.008+0000 7f19c7e00700 1 -- 172.21.15.47:0/4280578869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c81ad5e0 con 0x7f19c8110ba0 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.008+0000 7f19c7e00700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8110ba0 0x7f19c8104d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19c000b070 tx=0x7f19c0004c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.008+0000 7f19bfe00700 1 -- 172.21.15.47:0/4280578869 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0021070 con 0x7f19c8110ba0 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.009+0000 7f19bfe00700 1 -- 172.21.15.47:0/4280578869 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19c0007e30 con 0x7f19c8110ba0 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.009+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c81ad810 con 0x7f19c8110ba0 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.009+0000 7f19bfe00700 1 -- 172.21.15.47:0/4280578869 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c00045e0 con 0x7f19c8110ba0 2024-05-14T12:23:43.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.009+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c81adda0 con 0x7f19c8110ba0 2024-05-14T12:23:43.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.010+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c80772a0 con 0x7f19c8110ba0 2024-05-14T12:23:43.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.013+0000 7f19bfe00700 1 -- 172.21.15.47:0/4280578869 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f19c0003c90 con 0x7f19c8110ba0 2024-05-14T12:23:43.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.014+0000 7f19bfe00700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19ac0b2900 0x7f19ac0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:43.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.015+0000 7f19bfe00700 1 -- 172.21.15.47:0/4280578869 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f19c000f020 con 0x7f19c8110ba0 2024-05-14T12:23:43.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.015+0000 7f19c7400700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19ac0b2900 0x7f19ac0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:43.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.015+0000 7f19c7400700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19ac0b2900 0x7f19ac0b4e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009c60 tx=0x7f19b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:43.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.019+0000 7f19bfe00700 1 -- 172.21.15.47:0/4280578869 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f19c002a020 con 0x7f19c8110ba0 2024-05-14T12:23:43.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.313+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19c802e5f0 con 0x7f19c8110ba0 2024-05-14T12:23:43.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.314+0000 7f19bfe00700 1 -- 172.21.15.47:0/4280578869 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11919 (secure 0 0 0) 0x7f19c00ab300 con 0x7f19c8110ba0 2024-05-14T12:23:43.314 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:23:43.314 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:21:26.159710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:23:43.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19ac0b2900 msgr2=0x7f19ac0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:43.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19ac0b2900 0x7f19ac0b4e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009c60 tx=0x7f19b8009260 comp rx=0 tx=0).stop 2024-05-14T12:23:43.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8110ba0 msgr2=0x7f19c8104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:43.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8110ba0 0x7f19c8104d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19c000b070 tx=0x7f19c0004c60 comp rx=0 tx=0).stop 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 shutdown_connections 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19ac0b2900 0x7f19ac0b4e10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19c8110ba0 0x7f19c8104d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19c8075d30 0x7f19c81042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 --2- 172.21.15.47:0/4280578869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c8076680 0x7f19c8104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.317+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 >> 172.21.15.47:0/4280578869 conn(0x7f19c8100040 msgr2=0x7f19c8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.318+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 shutdown_connections 2024-05-14T12:23:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:43.318+0000 7f19ce800700 1 -- 172.21.15.47:0/4280578869 wait complete. 2024-05-14T12:23:43.319 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-05-14T12:23:43.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:43 smithi047 ceph-mon[31254]: pgmap v406: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:43.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:43 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/4280578869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:43 smithi073 ceph-mon[35809]: pgmap v406: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:43.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:43 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/4280578869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:43 smithi066 ceph-mon[35981]: pgmap v406: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:43 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/4280578869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:23:44.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-14T12:21:02.642705+0000', 'modified': '2024-05-14T12:21:26.159710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24535, 'mds_1': 24521, 'mds_2': 24517, 'mds_3': 24502, 'mds_4': 24490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6833/3730098623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 3730098623}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 3730098623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6833/1120434141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 1120434141}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 1120434141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/2635749889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 2635749889}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 2635749889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'd', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.47:6837/1559121259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6836', 'nonce': 1559121259}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 1559121259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6837/2588925145', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 2588925145}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 2588925145}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.73:6835/263909949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 263909949}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 263909949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.73:6837/3629841248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3629841248}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3629841248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.73:6839/2008561705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 2008561705}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 2008561705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.66:6839/2700854370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2700854370}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2700854370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24535': {'gid': 24535, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.47:6841/3387131427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6840', 'nonce': 3387131427}, {'type': 'v1', 'addr': '172.21.15.47:6841', 'nonce': 3387131427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24535, 'qdb_cluster': [24490, 24502, 24517, 24521, 24535]} 2024-05-14T12:23:44.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-14T12:23:44.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.f status 2024-05-14T12:23:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:45.649 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:45 smithi047 ceph-mon[31254]: pgmap v407: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:45.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:45 smithi073 ceph-mon[35809]: pgmap v407: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:45 smithi066 ceph-mon[35981]: pgmap v407: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.979+0000 7f0fe8a00700 1 -- 172.21.15.47:0/2220627696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe41109b0 msgr2=0x7f0fe4112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.979+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/2220627696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe41109b0 0x7f0fe4112e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009f90 tx=0x7f0fdc00b330 comp rx=0 tx=0).stop 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.979+0000 7f0fe8a00700 1 -- 172.21.15.47:0/2220627696 shutdown_connections 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.979+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/2220627696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe41109b0 0x7f0fe4112e10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.979+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/2220627696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fe4075d30 0x7f0fe4076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.979+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/2220627696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe4076680 0x7f0fe4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.979+0000 7f0fe8a00700 1 -- 172.21.15.47:0/2220627696 >> 172.21.15.47:0/2220627696 conn(0x7f0fe4079d10 msgr2=0x7f0fe407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.980+0000 7f0fe8a00700 1 -- 172.21.15.47:0/2220627696 shutdown_connections 2024-05-14T12:23:46.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.980+0000 7f0fe8a00700 1 -- 172.21.15.47:0/2220627696 wait complete. 2024-05-14T12:23:46.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.981+0000 7f0fe8a00700 1 Processor -- start 2024-05-14T12:23:46.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.981+0000 7f0fe8a00700 1 -- start start 2024-05-14T12:23:46.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe8a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fe4075d30 0x7f0fe419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe8a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe4076680 0x7f0fe419d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe8a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe41109b0 0x7f0fe41a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe8a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe41164e0 con 0x7f0fe4075d30 2024-05-14T12:23:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe8a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe4116360 con 0x7f0fe4076680 2024-05-14T12:23:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe8a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe4116660 con 0x7f0fe41109b0 2024-05-14T12:23:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe2a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe4076680 0x7f0fe419d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe2a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe4076680 0x7f0fe419d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57878/0 (socket says 172.21.15.47:57878) 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.982+0000 7f0fe2a00700 1 -- 172.21.15.47:0/810061910 learned_addr learned my addr 172.21.15.47:0/810061910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe3400700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fe4075d30 0x7f0fe419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe3e00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe41109b0 0x7f0fe41a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe2a00700 1 -- 172.21.15.47:0/810061910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe41109b0 msgr2=0x7f0fe41a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe41109b0 0x7f0fe41a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe2a00700 1 -- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fe4075d30 msgr2=0x7f0fe419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fe4075d30 0x7f0fe419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe2a00700 1 -- 172.21.15.47:0/810061910 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe41a1d10 con 0x7f0fe4076680 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe3e00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe41109b0 0x7f0fe41a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe3400700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fe4075d30 0x7f0fe419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.983+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe4076680 0x7f0fe419d430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000e9c0 tx=0x7f0fd000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.984+0000 7f0fdbe00700 1 -- 172.21.15.47:0/810061910 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000cbd0 con 0x7f0fe4076680 2024-05-14T12:23:46.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.984+0000 7f0fdbe00700 1 -- 172.21.15.47:0/810061910 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fd000cd70 con 0x7f0fe4076680 2024-05-14T12:23:46.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.984+0000 7f0fdbe00700 1 -- 172.21.15.47:0/810061910 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00056a0 con 0x7f0fe4076680 2024-05-14T12:23:46.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.984+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe41a2000 con 0x7f0fe4076680 2024-05-14T12:23:46.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.984+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe41a9920 con 0x7f0fe4076680 2024-05-14T12:23:46.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.989+0000 7f0fdbe00700 1 -- 172.21.15.47:0/810061910 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0fd0004750 con 0x7f0fe4076680 2024-05-14T12:23:46.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.989+0000 7f0ff8bfeb80 1 Processor -- start 2024-05-14T12:23:46.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.989+0000 7f0ff8bfeb80 1 -- start start 2024-05-14T12:23:46.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b45adf0 0x559d5b5d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b5d9640 0x559d5b5e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559d5b4fa9d0 con 0x559d5b45adf0 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559d5b498710 con 0x559d5b5d9230 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559d5b4f6990 con 0x559d5b5d9640 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b45adf0 0x559d5b5d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b45adf0 0x559d5b5d8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47178/0 (socket says 172.21.15.47:47178) 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3e00700 1 -- 172.21.15.47:0/2396121874 learned_addr learned my addr 172.21.15.47:0/2396121874 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b5d9640 0x559d5b5e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3400700 1 -- 172.21.15.47:0/2396121874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b5d9640 msgr2=0x559d5b5e4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3400700 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b5d9640 0x559d5b5e4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3400700 1 -- 172.21.15.47:0/2396121874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b45adf0 msgr2=0x559d5b5d8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:46.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3400700 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b45adf0 0x559d5b5d8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3400700 1 -- 172.21.15.47:0/2396121874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5b447880 con 0x559d5b5d9230 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.990+0000 7f0fe3e00700 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b45adf0 0x559d5b5d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.991+0000 7f0fdbe00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0fc80b2900 0x7f0fc80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.991+0000 7f0fe3400700 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e2890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009cc0 tx=0x7f0fd40113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9800ec176916acc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.991+0000 7f0fdbe00700 1 -- 172.21.15.47:0/810061910 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0fd00e23c0 con 0x7f0fe4076680 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.991+0000 7f0fd8c00700 1 -- 172.21.15.47:0/2396121874 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4011c30 con 0x559d5b5d9230 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.991+0000 7f0fd8c00700 1 -- 172.21.15.47:0/2396121874 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fd4011dd0 con 0x559d5b5d9230 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.991+0000 7f0fe3e00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0fc80b2900 0x7f0fc80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.991+0000 7f0fd8c00700 1 -- 172.21.15.47:0/2396121874 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400f7b0 con 0x559d5b5d9230 2024-05-14T12:23:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2396121874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 msgr2=0x559d5b5e2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e2890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009cc0 tx=0x7f0fd40113e0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0fe3e00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0fc80b2900 0x7f0fc80b4e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009da0 tx=0x7f0fdc009720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2396121874 shutdown_connections 2024-05-14T12:23:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b5d9640 0x559d5b5e4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b45adf0 0x559d5b5d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2396121874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e2890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2396121874 >> 172.21.15.47:0/2396121874 conn(0x559d5b499a30 msgr2=0x559d5b5d3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.992+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2396121874 shutdown_connections 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.993+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2396121874 wait complete. 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.993+0000 7f0ff8bfeb80 1 -- start start 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.993+0000 7f0ff8bfeb80 1 Processor -- start 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5e22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5e57f0 con 0x559d5b5d9640 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559d5b460ad0 con 0x559d5b5d9230 2024-05-14T12:23:46.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5e5970 con 0x559d5b45adf0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0ff8bfeb80 10 client.0 _ll_register_callbacks cb 0x559d5b48e330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0fe3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5e22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0fe3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0fe3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5e22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:48362/0 (socket says 172.21.15.47:48362) 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0fe3400700 1 -- 172.21.15.47:0/2241677220 learned_addr learned my addr 172.21.15.47:0/2241677220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.994+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fe3400700 1 -- 172.21.15.47:0/2241677220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 msgr2=0x559d5b5e27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fe3400700 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fe3400700 1 -- 172.21.15.47:0/2241677220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 msgr2=0x559d5b5e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fe3400700 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fe3400700 1 -- 172.21.15.47:0/2241677220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d5b4c03d0 con 0x559d5b45adf0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fe3400700 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5e22b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4000c00 tx=0x7f0fd4005420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b1ca96f41080aa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fcd600700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.995+0000 7f0fcd600700 1 -- 172.21.15.47:0/2241677220 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4029020 con 0x559d5b45adf0 2024-05-14T12:23:46.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fd4011dd0 con 0x559d5b45adf0 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0fcd600700 1 -- 172.21.15.47:0/2241677220 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0fd4004750 con 0x559d5b45adf0 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0fcd600700 1 -- 172.21.15.47:0/2241677220 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0fd4004020 con 0x559d5b45adf0 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0ff8bfeb80 10 client.24892 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d5b5f0360 con 0x559d5b45adf0 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0fcd600700 1 -- 172.21.15.47:0/2241677220 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fd4011dd0 con 0x559d5b45adf0 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0fcd600700 1 -- 172.21.15.47:0/2241677220 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0fd40038e0 con 0x559d5b45adf0 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0ff8bfeb80 10 client.24892 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0ff8bfeb80 10 client.24892 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.996+0000 7f0ff8bfeb80 20 client.24892 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.997+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b5f2600 0x559d5b5f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.997+0000 7f0ff8bfeb80 4 client.24892 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.997+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d5b5a5020 con 0x559d5b5f2600 2024-05-14T12:23:47.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.997+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b5f2600 0x559d5b5f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.997+0000 7f0fcd600700 10 client.24892 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:23:47.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.997+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b5f2600 0x559d5b5f3a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b20a2c40abbc352 server_cookie=1420ca4298fd659 in_seq=0 out_seq=0 2024-05-14T12:23:47.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.998+0000 7f0fcd600700 1 -- 172.21.15.47:0/2241677220 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559d5b5a5020 con 0x559d5b5f2600 2024-05-14T12:23:47.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.998+0000 7f0fcd600700 10 client.24892 handle_command_reply: tid=0 2024-05-14T12:23:47.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.998+0000 7f0ff8bfeb80 1 client.24892 shutdown 2024-05-14T12:23:47.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 msgr2=0x559d5b5e22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:47.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5e22b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4000c00 tx=0x7f0fd4005420 comp rx=0 tx=0).stop 2024-05-14T12:23:47.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 shutdown_connections 2024-05-14T12:23:47.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b5f2600 0x559d5b5f3a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5e22b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/2241677220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5e27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0fcd600700 0 client.24892 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 >> 172.21.15.47:0/2241677220 conn(0x559d5b499a30 msgr2=0x559d5b5d76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 shutdown_connections 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/2241677220 wait complete. 2024-05-14T12:23:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:46.999+0000 7f0ff8bfeb80 20 client.24892 trim_cache size 0 max 16384 2024-05-14T12:23:47.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.023+0000 7f0ff8bfeb80 1 Processor -- start 2024-05-14T12:23:47.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0ff8bfeb80 1 -- start start 2024-05-14T12:23:47.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5eec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9230 0x559d5b5d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9640 0x559d5b5e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5f1db0 con 0x559d5b5d9230 2024-05-14T12:23:47.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5f2480 con 0x559d5b5d9640 2024-05-14T12:23:47.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5f2b50 con 0x559d5b45adf0 2024-05-14T12:23:47.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0fe3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.024+0000 7f0fe3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5eec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:48368/0 (socket says 172.21.15.47:48368) 2024-05-14T12:23:47.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3400700 1 -- 172.21.15.47:0/1736348799 learned_addr learned my addr 172.21.15.47:0/1736348799 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:47.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3e00700 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9640 0x559d5b5e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9230 0x559d5b5d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3400700 1 -- 172.21.15.47:0/1736348799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9640 msgr2=0x559d5b5e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:47.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3400700 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9640 0x559d5b5e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3400700 1 -- 172.21.15.47:0/1736348799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9230 msgr2=0x559d5b5d8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:47.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3400700 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9230 0x559d5b5d8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3400700 1 -- 172.21.15.47:0/1736348799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5b5cb5f0 con 0x559d5b45adf0 2024-05-14T12:23:47.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.025+0000 7f0fe3400700 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5eec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40092a0 tx=0x7f0fd4009350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8770d617642e3fc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:47.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.026+0000 7f0fcfe00700 1 -- 172.21.15.47:0/1736348799 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4029040 con 0x559d5b45adf0 2024-05-14T12:23:47.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.026+0000 7f0fcfe00700 1 -- 172.21.15.47:0/1736348799 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fd4012450 con 0x559d5b45adf0 2024-05-14T12:23:47.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.026+0000 7f0fcfe00700 1 -- 172.21.15.47:0/1736348799 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4012e20 con 0x559d5b45adf0 2024-05-14T12:23:47.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.026+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/1736348799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 msgr2=0x559d5b5eec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.026+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5eec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40092a0 tx=0x7f0fd4009350 comp rx=0 tx=0).stop 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/1736348799 shutdown_connections 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9640 0x559d5b5e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5eec40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/1736348799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9230 0x559d5b5d8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/1736348799 >> 172.21.15.47:0/1736348799 conn(0x559d5b499a30 msgr2=0x559d5b5e0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/1736348799 shutdown_connections 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/1736348799 wait complete. 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 -- start start 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.027+0000 7f0ff8bfeb80 1 Processor -- start 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5fd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0ff8bfeb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5f38f0 con 0x559d5b5d9640 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5f3220 con 0x559d5b5d9230 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0ff8bfeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559d5b5f3fc0 con 0x559d5b45adf0 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0ff8bfeb80 10 client.0 _ll_register_callbacks cb 0x559d5b48e330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0fe2a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0fe2a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5fd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57924/0 (socket says 172.21.15.47:57924) 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0fe2a00700 1 -- 172.21.15.47:0/3102121793 learned_addr learned my addr 172.21.15.47:0/3102121793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0fe3400700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.028+0000 7f0fe3e00700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fe2a00700 1 -- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 msgr2=0x559d5b5fcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5fcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fe2a00700 1 -- 172.21.15.47:0/3102121793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 msgr2=0x559d5b5f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fe2a00700 1 -- 172.21.15.47:0/3102121793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d5b5f69d0 con 0x559d5b5d9230 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fe3400700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fe2a00700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5fd480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00a6c10 tx=0x7f0fd0091040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c181233d058623 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fcd600700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fcd600700 1 -- 172.21.15.47:0/3102121793 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00a5860 con 0x559d5b5d9230 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fcd600700 1 -- 172.21.15.47:0/3102121793 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0fd00a9c00 con 0x559d5b5d9230 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fd4012450 con 0x559d5b5d9230 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.029+0000 7f0fcd600700 1 -- 172.21.15.47:0/3102121793 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0fd00b2140 con 0x559d5b5d9230 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 10 client.24875 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d5b5fb3e0 con 0x559d5b5d9230 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0fcd600700 1 -- 172.21.15.47:0/3102121793 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fd4012450 con 0x559d5b5d9230 2024-05-14T12:23:47.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0fcd600700 1 -- 172.21.15.47:0/3102121793 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0fd00b2370 con 0x559d5b5d9230 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 10 client.24875 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 10 client.24875 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 20 client.24875 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b668090 0x559d5b669500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 4 client.24875 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.030+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "status"}) -- 0x559d5b5083b0 con 0x559d5b668090 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.031+0000 7f0fe3400700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b668090 0x559d5b669500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.031+0000 7f0fe3400700 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b668090 0x559d5b669500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bcc432b276aacdea server_cookie=38bc16d5260e97b6 in_seq=0 out_seq=0 2024-05-14T12:23:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.031+0000 7f0fcd600700 10 client.24875 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:23:47.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0fcd600700 1 -- 172.21.15.47:0/3102121793 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x559d5b5083b0 con 0x559d5b668090 2024-05-14T12:23:47.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0fcd600700 10 client.24875 handle_command_reply: tid=0 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 client.24875 shutdown 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 msgr2=0x559d5b5fd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5fd480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00a6c10 tx=0x7f0fd0091040 comp rx=0 tx=0).stop 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 shutdown_connections 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x559d5b668090 0x559d5b669500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559d5b5d9640 0x559d5b5f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d5b45adf0 0x559d5b5fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 --2- 172.21.15.47:0/3102121793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559d5b5d9230 0x559d5b5fd480 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0fcd600700 0 client.24875 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 >> 172.21.15.47:0/3102121793 conn(0x559d5b499a30 msgr2=0x559d5b5d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 shutdown_connections 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 1 -- 172.21.15.47:0/3102121793 wait complete. 2024-05-14T12:23:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.032+0000 7f0ff8bfeb80 20 client.24875 trim_cache size 0 max 16384 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 4, 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24490, 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 145.616568194, 2024-05-14T12:23:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:23:47.038 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:23:47.038 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:23:47.038 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 208.00271551 2024-05-14T12:23:47.038 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0fc80b2900 msgr2=0x7f0fc80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0fc80b2900 0x7f0fc80b4e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009da0 tx=0x7f0fdc009720 comp rx=0 tx=0).stop 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe4076680 msgr2=0x7f0fe419d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe4076680 0x7f0fe419d430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000e9c0 tx=0x7f0fd000ed80 comp rx=0 tx=0).stop 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 shutdown_connections 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0fc80b2900 0x7f0fc80b4e10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe41109b0 0x7f0fe41a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fe4075d30 0x7f0fe419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 --2- 172.21.15.47:0/810061910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fe4076680 0x7f0fe419d430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 >> 172.21.15.47:0/810061910 conn(0x7f0fe4079d10 msgr2=0x7f0fe4100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 shutdown_connections 2024-05-14T12:23:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:47.033+0000 7f0fe8a00700 1 -- 172.21.15.47:0/810061910 wait complete. 2024-05-14T12:23:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:47 smithi047 ceph-mon[31254]: pgmap v408: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:47.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:47 smithi073 ceph-mon[35809]: pgmap v408: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:47 smithi066 ceph-mon[35981]: pgmap v408: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:47.927 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-14T12:23:48.399 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:49.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:49 smithi047 ceph-mon[31254]: pgmap v409: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:49.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:49 smithi073 ceph-mon[35809]: pgmap v409: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:49 smithi066 ceph-mon[35981]: pgmap v409: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.665+0000 7faf57600700 1 -- 172.21.15.47:0/2856594208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf501045d0 msgr2=0x7faf501049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.665+0000 7faf57600700 1 --2- 172.21.15.47:0/2856594208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf501045d0 0x7faf501049e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf440099c0 tx=0x7faf44009cd0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.665+0000 7faf57600700 1 -- 172.21.15.47:0/2856594208 shutdown_connections 2024-05-14T12:23:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.665+0000 7faf57600700 1 --2- 172.21.15.47:0/2856594208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf50109850 0x7faf501111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.665+0000 7faf57600700 1 --2- 172.21.15.47:0/2856594208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf501045d0 0x7faf501049e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.665+0000 7faf57600700 1 --2- 172.21.15.47:0/2856594208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf50108f00 0x7faf50109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.665+0000 7faf57600700 1 -- 172.21.15.47:0/2856594208 >> 172.21.15.47:0/2856594208 conn(0x7faf500ffea0 msgr2=0x7faf501022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:50.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.666+0000 7faf57600700 1 -- 172.21.15.47:0/2856594208 shutdown_connections 2024-05-14T12:23:50.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.666+0000 7faf57600700 1 -- 172.21.15.47:0/2856594208 wait complete. 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.667+0000 7faf57600700 1 Processor -- start 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.667+0000 7faf57600700 1 -- start start 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf57600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf501045d0 0x7faf5019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf57600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf50108f00 0x7faf5019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf57600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf50109850 0x7faf5019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf57600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faf501144d0 con 0x7faf50108f00 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf57600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faf50114350 con 0x7faf50109850 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf57600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faf50114650 con 0x7faf501045d0 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf4fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf50108f00 0x7faf5019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf54c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf501045d0 0x7faf5019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf54c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf501045d0 0x7faf5019ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:48904/0 (socket says 172.21.15.47:48904) 2024-05-14T12:23:50.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf54c00700 1 -- 172.21.15.47:0/1298470022 learned_addr learned my addr 172.21.15.47:0/1298470022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf55600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf50109850 0x7faf5019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf54c00700 1 -- 172.21.15.47:0/1298470022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf50109850 msgr2=0x7faf5019f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.668+0000 7faf54c00700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf50109850 0x7faf5019f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf54c00700 1 -- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf50108f00 msgr2=0x7faf5019b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf54c00700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf50108f00 0x7faf5019b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf54c00700 1 -- 172.21.15.47:0/1298470022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5019fd10 con 0x7faf501045d0 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf54c00700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf501045d0 0x7faf5019ae40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf44006010 tx=0x7faf44005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf4d600700 1 -- 172.21.15.47:0/1298470022 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44026070 con 0x7faf501045d0 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5019ffa0 con 0x7faf501045d0 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf4d600700 1 -- 172.21.15.47:0/1298470022 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf44003c70 con 0x7faf501045d0 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf4d600700 1 -- 172.21.15.47:0/1298470022 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4400fad0 con 0x7faf501045d0 2024-05-14T12:23:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.669+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf50076b00 con 0x7faf501045d0 2024-05-14T12:23:50.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.673+0000 7faf4d600700 1 -- 172.21.15.47:0/1298470022 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7faf44029070 con 0x7faf501045d0 2024-05-14T12:23:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 Processor -- start 2024-05-14T12:23:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 -- start start 2024-05-14T12:23:50.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf4d600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faf380b2880 0x7faf380b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf4d600700 1 -- 172.21.15.47:0/1298470022 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faf440e2b00 con 0x7faf501045d0 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf55600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faf380b2880 0x7faf380b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b5d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555a58a7f9d0 con 0x555a589dfdf0 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a58a1d710 con 0x555a58b637e0 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.675+0000 7faf660e6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555a58a7b990 con 0x555a58b5d9a0 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf54c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b5d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b5d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:49106/0 (socket says 172.21.15.47:49106) 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 -- 172.21.15.47:0/3931609811 learned_addr learned my addr 172.21.15.47:0/3931609811 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf55600700 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 -- 172.21.15.47:0/3931609811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 msgr2=0x555a58b5ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf55600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faf380b2880 0x7faf380b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faf48009fd0 tx=0x7faf4800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 -- 172.21.15.47:0/3931609811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 msgr2=0x555a58b632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf4fe00700 1 -- 172.21.15.47:0/3931609811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a589cc880 con 0x555a58b637e0 2024-05-14T12:23:50.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.676+0000 7faf54c00700 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:50.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.677+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b5d460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009cf0 tx=0x7faf3c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e194cfbc5b6ac60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.677+0000 7faf42000700 1 -- 172.21.15.47:0/3931609811 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c011d80 con 0x555a58b637e0 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.677+0000 7faf42000700 1 -- 172.21.15.47:0/3931609811 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf3c004500 con 0x555a58b637e0 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.677+0000 7faf42000700 1 -- 172.21.15.47:0/3931609811 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c005280 con 0x555a58b637e0 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.678+0000 7faf660e6b80 1 -- 172.21.15.47:0/3931609811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 msgr2=0x555a58b5d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.678+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b5d460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009cf0 tx=0x7faf3c011440 comp rx=0 tx=0).stop 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.678+0000 7faf660e6b80 1 -- 172.21.15.47:0/3931609811 shutdown_connections 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.678+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.678+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.678+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3931609811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b5d460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.678+0000 7faf660e6b80 1 -- 172.21.15.47:0/3931609811 >> 172.21.15.47:0/3931609811 conn(0x555a58a24f20 msgr2=0x555a58b58280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.679+0000 7faf660e6b80 1 -- 172.21.15.47:0/3931609811 shutdown_connections 2024-05-14T12:23:50.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.679+0000 7faf660e6b80 1 -- 172.21.15.47:0/3931609811 wait complete. 2024-05-14T12:23:50.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.679+0000 7faf660e6b80 1 -- start start 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 1 Processor -- start 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b66f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b5d9a0 0x555a58b67450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b67990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555a58b6a2c0 con 0x555a589dfdf0 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a589e5ad0 con 0x555a58b5d9a0 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555a58b6a440 con 0x555a58b637e0 2024-05-14T12:23:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.680+0000 7faf660e6b80 10 client.0 _ll_register_callbacks cb 0x555a58a26c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf54c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b66f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf54c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b66f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41724/0 (socket says 172.21.15.47:41724) 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf54c00700 1 -- 172.21.15.47:0/1495875778 learned_addr learned my addr 172.21.15.47:0/1495875778 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf4fe00700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b5d9a0 0x555a58b67450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf55600700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b67990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf4fe00700 1 -- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 msgr2=0x555a58b67990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf4fe00700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b67990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf4fe00700 1 -- 172.21.15.47:0/1495875778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 msgr2=0x555a58b66f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf4fe00700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b66f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf4fe00700 1 -- 172.21.15.47:0/1495875778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a58a453d0 con 0x555a58b5d9a0 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.681+0000 7faf54c00700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b66f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf4fe00700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b5d9a0 0x555a58b67450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x555a58b59a60 tx=0x7faf3c005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd63e09edad42103 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:50.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf36a00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf36a00700 1 -- 172.21.15.47:0/1495875778 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c026020 con 0x555a58b5d9a0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf36a00700 1 -- 172.21.15.47:0/1495875778 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faf3c004050 con 0x555a58b5d9a0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf3c004500 con 0x555a58b5d9a0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf36a00700 1 -- 172.21.15.47:0/1495875778 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf3c004250 con 0x555a58b5d9a0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf660e6b80 10 client.24887 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.682+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a58b74dd0 con 0x555a58b5d9a0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf36a00700 1 -- 172.21.15.47:0/1495875778 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf3c004500 con 0x555a58b5d9a0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf36a00700 1 -- 172.21.15.47:0/1495875778 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7faf3c018070 con 0x555a58b5d9a0 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf660e6b80 10 client.24887 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf660e6b80 10 client.24887 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T12:23:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf660e6b80 20 client.24887 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf660e6b80 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58b77170 0x555a58b785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf660e6b80 4 client.24887 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:23:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a58b2a170 con 0x555a58b77170 2024-05-14T12:23:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.683+0000 7faf54c00700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58b77170 0x555a58b785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.684+0000 7faf54c00700 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58b77170 0x555a58b785e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f0316906b70c852 server_cookie=9adf7f41a2bbf97c in_seq=0 out_seq=0 2024-05-14T12:23:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.684+0000 7faf36a00700 10 client.24887 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:23:50.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.685+0000 7faf36a00700 1 -- 172.21.15.47:0/1495875778 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555a58b2a170 con 0x555a58b77170 2024-05-14T12:23:50.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.685+0000 7faf36a00700 10 client.24887 handle_command_reply: tid=0 2024-05-14T12:23:50.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.685+0000 7faf660e6b80 1 client.24887 shutdown 2024-05-14T12:23:50.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.685+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b5d9a0 msgr2=0x555a58b67450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.685+0000 7faf660e6b80 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b5d9a0 0x555a58b67450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x555a58b59a60 tx=0x7faf3c005e50 comp rx=0 tx=0).stop 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.685+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 shutdown_connections 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.685+0000 7faf660e6b80 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58b77170 0x555a58b785e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf660e6b80 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b67990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf660e6b80 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b66f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf660e6b80 1 --2- 172.21.15.47:0/1495875778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b5d9a0 0x555a58b67450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf36a00700 0 client.24887 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 >> 172.21.15.47:0/1495875778 conn(0x555a58a24f20 msgr2=0x555a58b5c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 shutdown_connections 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf660e6b80 1 -- 172.21.15.47:0/1495875778 wait complete. 2024-05-14T12:23:50.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.686+0000 7faf660e6b80 20 client.24887 trim_cache size 0 max 16384 2024-05-14T12:23:50.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.709+0000 7faf660e6b80 1 Processor -- start 2024-05-14T12:23:50.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.709+0000 7faf660e6b80 1 -- start start 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.709+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b5d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.709+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b57c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf660e6b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555a58b76920 con 0x555a589dfdf0 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf660e6b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a58b76ff0 con 0x555a58b637e0 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf660e6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555a58b776c0 con 0x555a58b5d9a0 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf54c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b5d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf4fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf54c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b5d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41732/0 (socket says 172.21.15.47:41732) 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf54c00700 1 -- 172.21.15.47:0/3069112702 learned_addr learned my addr 172.21.15.47:0/3069112702 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf55600700 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b57c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf4fe00700 1 -- 172.21.15.47:0/3069112702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 msgr2=0x555a58b57c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b57c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf4fe00700 1 -- 172.21.15.47:0/3069112702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 msgr2=0x555a58b5d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b5d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf4fe00700 1 -- 172.21.15.47:0/3069112702 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a58b50390 con 0x555a58b5d9a0 2024-05-14T12:23:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.710+0000 7faf54c00700 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b5d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:50.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.711+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf3c005250 tx=0x7faf3c011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3caa006f875df041 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:50.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.711+0000 7faf41600700 1 -- 172.21.15.47:0/3069112702 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c026040 con 0x555a58b5d9a0 2024-05-14T12:23:50.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.711+0000 7faf41600700 1 -- 172.21.15.47:0/3069112702 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf3c004000 con 0x555a58b5d9a0 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.711+0000 7faf41600700 1 -- 172.21.15.47:0/3069112702 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0052d0 con 0x555a58b5d9a0 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 -- 172.21.15.47:0/3069112702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 msgr2=0x555a58b5ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf3c005250 tx=0x7faf3c011440 comp rx=0 tx=0).stop 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 -- 172.21.15.47:0/3069112702 shutdown_connections 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a58b637e0 0x555a58b57c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a589dfdf0 0x555a58b5d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3069112702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b5d9a0 0x555a58b5ddb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 -- 172.21.15.47:0/3069112702 >> 172.21.15.47:0/3069112702 conn(0x555a58a24f20 msgr2=0x555a58b51880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 -- 172.21.15.47:0/3069112702 shutdown_connections 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.712+0000 7faf660e6b80 1 -- 172.21.15.47:0/3069112702 wait complete. 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.713+0000 7faf660e6b80 1 -- start start 2024-05-14T12:23:50.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.713+0000 7faf660e6b80 1 Processor -- start 2024-05-14T12:23:50.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.713+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a589dfdf0 0x555a58b820b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a58b5d9a0 0x555a58b5c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf660e6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b5caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf660e6b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555a58b78460 con 0x555a58b5d9a0 2024-05-14T12:23:50.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf660e6b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a58b77d90 con 0x555a589dfdf0 2024-05-14T12:23:50.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf660e6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555a58b78b30 con 0x555a58b637e0 2024-05-14T12:23:50.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf660e6b80 10 client.0 _ll_register_callbacks cb 0x555a58a26c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a58b5d9a0 0x555a58b5c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf54c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a589dfdf0 0x555a58b820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a58b5d9a0 0x555a58b5c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41740/0 (socket says 172.21.15.47:41740) 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 -- 172.21.15.47:0/3679711454 learned_addr learned my addr 172.21.15.47:0/3679711454 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf55600700 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b5caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 -- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 msgr2=0x555a58b5caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b5caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 -- 172.21.15.47:0/3679711454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a589dfdf0 msgr2=0x555a58b820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a589dfdf0 0x555a58b820b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf4fe00700 1 -- 172.21.15.47:0/3679711454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a58b5d270 con 0x555a58b5d9a0 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.714+0000 7faf54c00700 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a589dfdf0 0x555a58b820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf4fe00700 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a58b5d9a0 0x555a58b5c450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf3c004720 tx=0x7faf3c005580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71b949eab096e0a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:50.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf36a00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:23:50.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf36a00700 1 -- 172.21.15.47:0/3679711454 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c03b070 con 0x555a58b5d9a0 2024-05-14T12:23:50.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf3c004000 con 0x555a58b5d9a0 2024-05-14T12:23:50.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf36a00700 1 -- 172.21.15.47:0/3679711454 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faf3c003680 con 0x555a58b5d9a0 2024-05-14T12:23:50.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf36a00700 1 -- 172.21.15.47:0/3679711454 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf3c047050 con 0x555a58b5d9a0 2024-05-14T12:23:50.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf660e6b80 10 client.14787 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:50.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.715+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a58be2640 con 0x555a58b5d9a0 2024-05-14T12:23:50.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf36a00700 1 -- 172.21.15.47:0/3679711454 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf3c004000 con 0x555a58b5d9a0 2024-05-14T12:23:50.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf36a00700 1 -- 172.21.15.47:0/3679711454 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7faf3c018040 con 0x555a58b5d9a0 2024-05-14T12:23:50.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf660e6b80 10 client.14787 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf660e6b80 10 client.14787 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf660e6b80 20 client.14787 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58be47c0 0x555a58be5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf660e6b80 4 client.14787 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.716+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "status"}) -- 0x555a58b6a470 con 0x555a58be47c0 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.717+0000 7faf54c00700 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58be47c0 0x555a58be5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.717+0000 7faf54c00700 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58be47c0 0x555a58be5c30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eac91f7d4943d419 server_cookie=8e49b2fb57e6ccb2 in_seq=0 out_seq=0 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.717+0000 7faf36a00700 10 client.14787 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf36a00700 1 -- 172.21.15.47:0/3679711454 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555a58b6a470 con 0x555a58be47c0 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf36a00700 10 client.14787 handle_command_reply: tid=0 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 client.14787 shutdown 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a58b5d9a0 msgr2=0x555a58b5c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a58b5d9a0 0x555a58b5c450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf3c004720 tx=0x7faf3c005580 comp rx=0 tx=0).stop 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 shutdown_connections 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x555a58be47c0 0x555a58be5c30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a58b637e0 0x555a58b5caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a589dfdf0 0x555a58b820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 --2- 172.21.15.47:0/3679711454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a58b5d9a0 0x555a58b5c450 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 >> 172.21.15.47:0/3679711454 conn(0x555a58a24f20 msgr2=0x555a58b57be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf36a00700 0 client.14787 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 shutdown_connections 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 1 -- 172.21.15.47:0/3679711454 wait complete. 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.718+0000 7faf660e6b80 20 client.14787 trim_cache size 0 max 16384 2024-05-14T12:23:50.720 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 3, 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24502, 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 150.30873474399999, 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 208.750953727 2024-05-14T12:23:50.721 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:23:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faf380b2880 msgr2=0x7faf380b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faf380b2880 0x7faf380b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faf48009fd0 tx=0x7faf4800b040 comp rx=0 tx=0).stop 2024-05-14T12:23:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf501045d0 msgr2=0x7faf5019ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf501045d0 0x7faf5019ae40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf44006010 tx=0x7faf44005280 comp rx=0 tx=0).stop 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 shutdown_connections 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faf380b2880 0x7faf380b4d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf50109850 0x7faf5019f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf501045d0 0x7faf5019ae40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 --2- 172.21.15.47:0/1298470022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf50108f00 0x7faf5019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 >> 172.21.15.47:0/1298470022 conn(0x7faf500ffea0 msgr2=0x7faf501022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 shutdown_connections 2024-05-14T12:23:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:50.719+0000 7faf57600700 1 -- 172.21.15.47:0/1298470022 wait complete. 2024-05-14T12:23:51.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:51 smithi047 ceph-mon[31254]: pgmap v410: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:51.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:51 smithi073 ceph-mon[35809]: pgmap v410: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:51.780 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-14T12:23:51.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:51 smithi066 ceph-mon[35981]: pgmap v410: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:52.252 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:53.626 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:53 smithi047 ceph-mon[31254]: pgmap v411: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:53.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:53 smithi073 ceph-mon[35809]: pgmap v411: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:53 smithi066 ceph-mon[35981]: pgmap v411: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:54.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 -- 172.21.15.47:0/3392344088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 msgr2=0x7f00b8109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 --2- 172.21.15.47:0/3392344088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 0x7f00b8109140 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00a40099c0 tx=0x7f00a4009cd0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 -- 172.21.15.47:0/3392344088 shutdown_connections 2024-05-14T12:23:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 --2- 172.21.15.47:0/3392344088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b8109680 0x7f00b8110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 --2- 172.21.15.47:0/3392344088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 0x7f00b8104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 --2- 172.21.15.47:0/3392344088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 0x7f00b8109140 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 -- 172.21.15.47:0/3392344088 >> 172.21.15.47:0/3392344088 conn(0x7f00b8079d10 msgr2=0x7f00b807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 -- 172.21.15.47:0/3392344088 shutdown_connections 2024-05-14T12:23:54.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.535+0000 7f00b7200700 1 -- 172.21.15.47:0/3392344088 wait complete. 2024-05-14T12:23:54.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 Processor -- start 2024-05-14T12:23:54.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 -- start start 2024-05-14T12:23:54.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 0x7f00b819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 0x7f00b819d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b8109680 0x7f00b81a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8114290 con 0x7f00b8108d30 2024-05-14T12:23:54.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8114110 con 0x7f00b8104400 2024-05-14T12:23:54.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.537+0000 7f00b7200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8114410 con 0x7f00b8109680 2024-05-14T12:23:54.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 0x7f00b819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 0x7f00b819d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 0x7f00b819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:49148/0 (socket says 172.21.15.47:49148) 2024-05-14T12:23:54.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 -- 172.21.15.47:0/1110169514 learned_addr learned my addr 172.21.15.47:0/1110169514 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:54.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 0x7f00b819d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41764/0 (socket says 172.21.15.47:41764) 2024-05-14T12:23:54.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b6800700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b8109680 0x7f00b81a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 -- 172.21.15.47:0/1110169514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b8109680 msgr2=0x7f00b81a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b8109680 0x7f00b81a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 -- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 msgr2=0x7f00b819d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 0x7f00b819d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b5e00700 1 -- 172.21.15.47:0/1110169514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b81a1cb0 con 0x7f00b8104400 2024-05-14T12:23:54.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.538+0000 7f00b6800700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b8109680 0x7f00b81a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:54.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.539+0000 7f00b5e00700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 0x7f00b819cde0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00a800eb30 tx=0x7f00a800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:54.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.539+0000 7f00aea00700 1 -- 172.21.15.47:0/1110169514 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a800cbd0 con 0x7f00b8104400 2024-05-14T12:23:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.539+0000 7f00aea00700 1 -- 172.21.15.47:0/1110169514 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a80044d0 con 0x7f00b8104400 2024-05-14T12:23:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.539+0000 7f00aea00700 1 -- 172.21.15.47:0/1110169514 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8003e30 con 0x7f00b8104400 2024-05-14T12:23:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.539+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b81a1fa0 con 0x7f00b8104400 2024-05-14T12:23:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.539+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b81a98c0 con 0x7f00b8104400 2024-05-14T12:23:54.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.544+0000 7f00cb6f8b80 1 Processor -- start 2024-05-14T12:23:54.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.544+0000 7f00aea00700 1 -- 172.21.15.47:0/1110169514 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f00a8003fd0 con 0x7f00b8104400 2024-05-14T12:23:54.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.544+0000 7f00cb6f8b80 1 -- start start 2024-05-14T12:23:54.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.544+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.544+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.544+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd62000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575afc839d0 con 0x5575afbe3df0 2024-05-14T12:23:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575afc21710 con 0x5575afd61bf0 2024-05-14T12:23:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5575afc7f990 con 0x5575afd67a30 2024-05-14T12:23:54.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41772/0 (socket says 172.21.15.47:41772) 2024-05-14T12:23:54.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 -- 172.21.15.47:0/1788838535 learned_addr learned my addr 172.21.15.47:0/1788838535 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:54.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b5e00700 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b5400700 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd62000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 -- 172.21.15.47:0/1788838535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 msgr2=0x5575afd616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 -- 172.21.15.47:0/1788838535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 msgr2=0x5575afd62000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd62000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.545+0000 7f00b6800700 1 -- 172.21.15.47:0/1788838535 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575afbd0880 con 0x5575afbe3df0 2024-05-14T12:23:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.546+0000 7f00aea00700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f009c0b2900 0x7f009c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.546+0000 7f00b6800700 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd674f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00b0003eb0 tx=0x7f00b0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e463b5910b0e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:54.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.546+0000 7f00aea00700 1 -- 172.21.15.47:0/1110169514 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f00a80e2840 con 0x7f00b8104400 2024-05-14T12:23:54.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.546+0000 7f00b5e00700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f009c0b2900 0x7f009c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.546+0000 7f00a3400700 1 -- 172.21.15.47:0/1788838535 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0019020 con 0x5575afbe3df0 2024-05-14T12:23:54.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.546+0000 7f00a3400700 1 -- 172.21.15.47:0/1788838535 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00b00092d0 con 0x5575afbe3df0 2024-05-14T12:23:54.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.546+0000 7f00a3400700 1 -- 172.21.15.47:0/1788838535 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b000e870 con 0x5575afbe3df0 2024-05-14T12:23:54.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.547+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1788838535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 msgr2=0x5575afd674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.547+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd674f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00b0003eb0 tx=0x7f00b0009920 comp rx=0 tx=0).stop 2024-05-14T12:23:54.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.547+0000 7f00b5e00700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f009c0b2900 0x7f009c0b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f00a80e0340 tx=0x7f00a80e8530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:54.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.547+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1788838535 shutdown_connections 2024-05-14T12:23:54.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd62000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd674f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1788838535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1788838535 >> 172.21.15.47:0/1788838535 conn(0x5575afc28f20 msgr2=0x5575afd5c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:54.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1788838535 shutdown_connections 2024-05-14T12:23:54.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1788838535 wait complete. 2024-05-14T12:23:54.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 -- start start 2024-05-14T12:23:54.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.548+0000 7f00cb6f8b80 1 Processor -- start 2024-05-14T12:23:54.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afbe3df0 0x5575afd6b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd6b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd67a30 0x5575afd6bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575afd6e440 con 0x5575afd67a30 2024-05-14T12:23:54.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575afbe9ad0 con 0x5575afd61bf0 2024-05-14T12:23:54.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5575afd6e5c0 con 0x5575afbe3df0 2024-05-14T12:23:54.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00cb6f8b80 10 client.0 _ll_register_callbacks cb 0x5575afc2ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:54.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00b6800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afbe3df0 0x5575afd6b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00b6800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afbe3df0 0x5575afd6b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:48982/0 (socket says 172.21.15.47:48982) 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00b6800700 1 -- 172.21.15.47:0/80558568 learned_addr learned my addr 172.21.15.47:0/80558568 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00b5400700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd6b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.549+0000 7f00b6800700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd67a30 0x5575afd6bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f00b5400700 1 -- 172.21.15.47:0/80558568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afbe3df0 msgr2=0x5575afd6b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f00b5400700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afbe3df0 0x5575afd6b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f00b5400700 1 -- 172.21.15.47:0/80558568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd67a30 msgr2=0x5575afd6bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f00b5400700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd67a30 0x5575afd6bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f00b5400700 1 -- 172.21.15.47:0/80558568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575afc493d0 con 0x5575afd61bf0 2024-05-14T12:23:54.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f00b6800700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd67a30 0x5575afd6bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f00b5400700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd6b6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00a40098e0 tx=0x7f00a4005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=417d4efe8da65ad7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.550+0000 7f0097e00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.551+0000 7f0097e00700 1 -- 172.21.15.47:0/80558568 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4003bd0 con 0x5575afd61bf0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.551+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00b00092d0 con 0x5575afd61bf0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.551+0000 7f0097e00700 1 -- 172.21.15.47:0/80558568 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f00a4003d70 con 0x5575afd61bf0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.551+0000 7f0097e00700 1 -- 172.21.15.47:0/80558568 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00a4009e60 con 0x5575afd61bf0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.551+0000 7f00cb6f8b80 10 client.24905 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.551+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575afd79070 con 0x5575afd61bf0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f0097e00700 1 -- 172.21.15.47:0/80558568 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00b00092d0 con 0x5575afd61bf0 2024-05-14T12:23:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f0097e00700 1 -- 172.21.15.47:0/80558568 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f00a4024590 con 0x5575afd61bf0 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f00cb6f8b80 10 client.24905 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f00cb6f8b80 10 client.24905 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f00cb6f8b80 20 client.24905 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afd7b6c0 0x5575afd7cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f00cb6f8b80 4 client.24905 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575afd2e170 con 0x5575afd7b6c0 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.552+0000 7f00b6800700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afd7b6c0 0x5575afd7cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.553+0000 7f00b6800700 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afd7b6c0 0x5575afd7cb30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8cbf40620d3d1e3e server_cookie=1ab5dd1948b652ec in_seq=0 out_seq=0 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.553+0000 7f0097e00700 10 client.24905 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f0097e00700 1 -- 172.21.15.47:0/80558568 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5575afd2e170 con 0x5575afd7b6c0 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f0097e00700 10 client.24905 handle_command_reply: tid=0 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 client.24905 shutdown 2024-05-14T12:23:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 msgr2=0x5575afd6b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd6b6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00a40098e0 tx=0x7f00a4005790 comp rx=0 tx=0).stop 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 shutdown_connections 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afd7b6c0 0x5575afd7cb30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd67a30 0x5575afd6bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afbe3df0 0x5575afd6b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f0097e00700 0 client.24905 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/80558568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd6b6b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 >> 172.21.15.47:0/80558568 conn(0x5575afc28f20 msgr2=0x5575afd606a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.554+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 shutdown_connections 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.555+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/80558568 wait complete. 2024-05-14T12:23:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.555+0000 7f00cb6f8b80 20 client.24905 trim_cache size 0 max 16384 2024-05-14T12:23:54.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.577+0000 7f00cb6f8b80 1 Processor -- start 2024-05-14T12:23:54.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.577+0000 7f00cb6f8b80 1 -- start start 2024-05-14T12:23:54.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afbe3df0 0x5575afd68e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd61bf0 0x5575afd778c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd6ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575afd7ae70 con 0x5575afd61bf0 2024-05-14T12:23:54.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575afd7b540 con 0x5575afbe3df0 2024-05-14T12:23:54.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5575afd7bc10 con 0x5575afd67a30 2024-05-14T12:23:54.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00b6800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afbe3df0 0x5575afd68e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00b5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd61bf0 0x5575afd778c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00b6800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afbe3df0 0x5575afd68e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:49176/0 (socket says 172.21.15.47:49176) 2024-05-14T12:23:54.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00b6800700 1 -- 172.21.15.47:0/4093836781 learned_addr learned my addr 172.21.15.47:0/4093836781 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:54.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.578+0000 7f00b6800700 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd6ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.579+0000 7f00b5400700 1 -- 172.21.15.47:0/4093836781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 msgr2=0x5575afd6ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.579+0000 7f00b5400700 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd6ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.579+0000 7f00b5400700 1 -- 172.21.15.47:0/4093836781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afbe3df0 msgr2=0x5575afd68e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.579+0000 7f00b5400700 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afbe3df0 0x5575afd68e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.579+0000 7f00b5400700 1 -- 172.21.15.47:0/4093836781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575afd58bf0 con 0x5575afd61bf0 2024-05-14T12:23:54.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.579+0000 7f00b6800700 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afbe3df0 0x5575afd68e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:54.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.579+0000 7f00b5400700 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd61bf0 0x5575afd778c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00a4024bc0 tx=0x7f00a4003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6503475ce078a618 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:54.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.580+0000 7f00a2a00700 1 -- 172.21.15.47:0/4093836781 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4024670 con 0x5575afd61bf0 2024-05-14T12:23:54.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.580+0000 7f00a2a00700 1 -- 172.21.15.47:0/4093836781 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a4029070 con 0x5575afd61bf0 2024-05-14T12:23:54.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.580+0000 7f00a2a00700 1 -- 172.21.15.47:0/4093836781 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a400bd20 con 0x5575afd61bf0 2024-05-14T12:23:54.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/4093836781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd61bf0 msgr2=0x5575afd778c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd61bf0 0x5575afd778c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00a4024bc0 tx=0x7f00a4003680 comp rx=0 tx=0).stop 2024-05-14T12:23:54.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/4093836781 shutdown_connections 2024-05-14T12:23:54.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd6ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afbe3df0 0x5575afd68e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/4093836781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afd61bf0 0x5575afd778c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/4093836781 >> 172.21.15.47:0/4093836781 conn(0x5575afc28f20 msgr2=0x5575afd5be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:54.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/4093836781 shutdown_connections 2024-05-14T12:23:54.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/4093836781 wait complete. 2024-05-14T12:23:54.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.581+0000 7f00cb6f8b80 1 -- start start 2024-05-14T12:23:54.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 1 Processor -- start 2024-05-14T12:23:54.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd85fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd864f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd80f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575afd7c9b0 con 0x5575afbe3df0 2024-05-14T12:23:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575afd7c2e0 con 0x5575afd61bf0 2024-05-14T12:23:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5575afd7d080 con 0x5575afd67a30 2024-05-14T12:23:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00cb6f8b80 10 client.0 _ll_register_callbacks cb 0x5575afc2ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:54.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.582+0000 7f00b6800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd85fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd85fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41814/0 (socket says 172.21.15.47:41814) 2024-05-14T12:23:54.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 -- 172.21.15.47:0/1405671326 learned_addr learned my addr 172.21.15.47:0/1405671326 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:54.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b5400700 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd864f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd80f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 -- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 msgr2=0x5575afd80f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd80f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 -- 172.21.15.47:0/1405671326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 msgr2=0x5575afd864f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd864f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 -- 172.21.15.47:0/1405671326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575afd5dcf0 con 0x5575afbe3df0 2024-05-14T12:23:54.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f00b6800700 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd85fb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00b0007e50 tx=0x7f00b0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dd6484486f944d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.583+0000 7f0097e00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f0097e00700 1 -- 172.21.15.47:0/1405671326 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0035060 con 0x5575afbe3df0 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f0097e00700 1 -- 172.21.15.47:0/1405671326 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f00b002fc70 con 0x5575afbe3df0 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a4029070 con 0x5575afbe3df0 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f0097e00700 1 -- 172.21.15.47:0/1405671326 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00b0019040 con 0x5575afbe3df0 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f00cb6f8b80 10 client.14805 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575afde6fd0 con 0x5575afbe3df0 2024-05-14T12:23:54.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f0097e00700 1 -- 172.21.15.47:0/1405671326 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a4029070 con 0x5575afbe3df0 2024-05-14T12:23:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f0097e00700 1 -- 172.21.15.47:0/1405671326 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f00b000e930 con 0x5575afbe3df0 2024-05-14T12:23:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f00cb6f8b80 10 client.14805 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.584+0000 7f00cb6f8b80 10 client.14805 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T12:23:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.585+0000 7f00cb6f8b80 20 client.14805 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.585+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afde9150 0x5575afdea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.585+0000 7f00cb6f8b80 4 client.14805 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:23:54.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.585+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "status"}) -- 0x5575afc913b0 con 0x5575afde9150 2024-05-14T12:23:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.585+0000 7f00b5400700 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afde9150 0x5575afdea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.585+0000 7f00b5400700 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afde9150 0x5575afdea5c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd511aeffa3e0ce1 server_cookie=767a9cedfdc0e892 in_seq=0 out_seq=0 2024-05-14T12:23:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.585+0000 7f0097e00700 10 client.14805 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:23:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f0097e00700 1 -- 172.21.15.47:0/1405671326 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5575afc913b0 con 0x5575afde9150 2024-05-14T12:23:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f0097e00700 10 client.14805 handle_command_reply: tid=0 2024-05-14T12:23:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 client.14805 shutdown 2024-05-14T12:23:54.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 msgr2=0x5575afd85fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd85fb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00b0007e50 tx=0x7f00b0009920 comp rx=0 tx=0).stop 2024-05-14T12:23:54.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 shutdown_connections 2024-05-14T12:23:54.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5575afde9150 0x5575afdea5c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575afd67a30 0x5575afd80f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f0097e00700 0 client.14805 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:23:54.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575afbe3df0 0x5575afd85fb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 --2- 172.21.15.47:0/1405671326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575afd61bf0 0x5575afd864f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 >> 172.21.15.47:0/1405671326 conn(0x5575afc28f20 msgr2=0x5575afd64e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:54.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 shutdown_connections 2024-05-14T12:23:54.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 1 -- 172.21.15.47:0/1405671326 wait complete. 2024-05-14T12:23:54.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.586+0000 7f00cb6f8b80 20 client.14805 trim_cache size 0 max 16384 2024-05-14T12:23:54.602 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:23:54.602 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:23:54.602 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 2, 2024-05-14T12:23:54.602 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24517, 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 155.20190989100001, 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 206.94010657800001 2024-05-14T12:23:54.603 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:23:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f009c0b2900 msgr2=0x7f009c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f009c0b2900 0x7f009c0b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f00a80e0340 tx=0x7f00a80e8530 comp rx=0 tx=0).stop 2024-05-14T12:23:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 msgr2=0x7f00b819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 0x7f00b819cde0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00a800eb30 tx=0x7f00a800ee40 comp rx=0 tx=0).stop 2024-05-14T12:23:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 shutdown_connections 2024-05-14T12:23:54.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f009c0b2900 0x7f009c0b4e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00b8109680 0x7f00b81a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b8104400 0x7f00b819cde0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 --2- 172.21.15.47:0/1110169514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00b8108d30 0x7f00b819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:54.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 >> 172.21.15.47:0/1110169514 conn(0x7f00b8079d10 msgr2=0x7f00b8110dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:54.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 shutdown_connections 2024-05-14T12:23:54.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:54.587+0000 7f00b7200700 1 -- 172.21.15.47:0/1110169514 wait complete. 2024-05-14T12:23:55.451 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-14T12:23:55.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:55 smithi047 ceph-mon[31254]: pgmap v412: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:55.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:55 smithi073 ceph-mon[35809]: pgmap v412: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:55.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:55 smithi066 ceph-mon[35981]: pgmap v412: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:23:55.919 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:57.667 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:57 smithi047 ceph-mon[31254]: pgmap v413: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:57.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:57 smithi073 ceph-mon[35809]: pgmap v413: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:57 smithi066 ceph-mon[35981]: pgmap v413: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:23:58.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 -- 172.21.15.47:0/937642564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106570 msgr2=0x7f1be8106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 --2- 172.21.15.47:0/937642564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106570 0x7f1be8106980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009990 tx=0x7f1bd4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 -- 172.21.15.47:0/937642564 shutdown_connections 2024-05-14T12:23:58.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 --2- 172.21.15.47:0/937642564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be8106ec0 0x7f1be8113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 --2- 172.21.15.47:0/937642564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be810c5b0 0x7f1be810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 --2- 172.21.15.47:0/937642564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106570 0x7f1be8106980 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 -- 172.21.15.47:0/937642564 >> 172.21.15.47:0/937642564 conn(0x7f1be8102050 msgr2=0x7f1be81044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:58.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 -- 172.21.15.47:0/937642564 shutdown_connections 2024-05-14T12:23:58.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.280+0000 7f1beea00700 1 -- 172.21.15.47:0/937642564 wait complete. 2024-05-14T12:23:58.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 Processor -- start 2024-05-14T12:23:58.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 -- start start 2024-05-14T12:23:58.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be8106570 0x7f1be819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106ec0 0x7f1be819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be810c5b0 0x7f1be81a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8116690 con 0x7f1be8106570 2024-05-14T12:23:58.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8116510 con 0x7f1be810c5b0 2024-05-14T12:23:58.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1beea00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8116810 con 0x7f1be8106ec0 2024-05-14T12:23:58.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.282+0000 7f1be7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be8106570 0x7f1be819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be8106570 0x7f1be819d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36160/0 (socket says 172.21.15.47:36160) 2024-05-14T12:23:58.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 -- 172.21.15.47:0/780263530 learned_addr learned my addr 172.21.15.47:0/780263530 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:58.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7400700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106ec0 0x7f1be819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1beca00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be810c5b0 0x7f1be81a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 -- 172.21.15.47:0/780263530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106ec0 msgr2=0x7f1be819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106ec0 0x7f1be819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 -- 172.21.15.47:0/780263530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be810c5b0 msgr2=0x7f1be81a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be810c5b0 0x7f1be81a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 -- 172.21.15.47:0/780263530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be81a1f30 con 0x7f1be8106570 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1beca00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be810c5b0 0x7f1be81a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.283+0000 7f1be7e00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be8106570 0x7f1be819d060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e970 tx=0x7f1bd800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.284+0000 7f1be4c00700 1 -- 172.21.15.47:0/780263530 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8004a30 con 0x7f1be8106570 2024-05-14T12:23:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.284+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be81a2220 con 0x7f1be8106570 2024-05-14T12:23:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.284+0000 7f1be4c00700 1 -- 172.21.15.47:0/780263530 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd800cc70 con 0x7f1be8106570 2024-05-14T12:23:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.284+0000 7f1be4c00700 1 -- 172.21.15.47:0/780263530 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8005580 con 0x7f1be8106570 2024-05-14T12:23:58.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.284+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be81a9b40 con 0x7f1be8106570 2024-05-14T12:23:58.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.288+0000 7f1be4c00700 1 -- 172.21.15.47:0/780263530 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1bd800c7c0 con 0x7f1be8106570 2024-05-14T12:23:58.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.290+0000 7f1bfd5ffb80 1 Processor -- start 2024-05-14T12:23:58.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.290+0000 7f1bfd5ffb80 1 -- start start 2024-05-14T12:23:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e482660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1be4c00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1bcc0b2880 0x7f1bcc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e482ba0 0x56375e47c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e47cc00 0x56375e47d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56375e39e9d0 con 0x56375e47cc00 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56375e33c710 con 0x56375e2fedf0 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56375e39a990 con 0x56375e482ba0 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1be4c00700 1 -- 172.21.15.47:0/780263530 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1bd80e2420 con 0x7f1be8106570 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1beca00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e482660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1be7400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e482ba0 0x56375e47c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1beca00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e482660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35266/0 (socket says 172.21.15.47:35266) 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1beca00700 1 -- 172.21.15.47:0/4278053501 learned_addr learned my addr 172.21.15.47:0/4278053501 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.291+0000 7f1beca00700 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e47cc00 0x56375e47d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1be7400700 1 -- 172.21.15.47:0/4278053501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 msgr2=0x56375e482660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1be7400700 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e482660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1be7400700 1 -- 172.21.15.47:0/4278053501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e47cc00 msgr2=0x56375e47d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1be7400700 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e47cc00 0x56375e47d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1be7400700 1 -- 172.21.15.47:0/4278053501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375e2eb880 con 0x56375e482ba0 2024-05-14T12:23:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1be7e00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1bcc0b2880 0x7f1bcc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1beca00700 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e47cc00 0x56375e47d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:23:58.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1be7400700 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e482ba0 0x56375e47c6c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4000c00 tx=0x7f1bd40096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e207746526cf507 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1bdd600700 1 -- 172.21.15.47:0/4278053501 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4027070 con 0x56375e482ba0 2024-05-14T12:23:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1bdd600700 1 -- 172.21.15.47:0/4278053501 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd40056b0 con 0x56375e482ba0 2024-05-14T12:23:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.292+0000 7f1bdd600700 1 -- 172.21.15.47:0/4278053501 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4003b10 con 0x56375e482ba0 2024-05-14T12:23:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/4278053501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e482ba0 msgr2=0x56375e47c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e482ba0 0x56375e47c6c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4000c00 tx=0x7f1bd40096a0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1be7e00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1bcc0b2880 0x7f1bcc0b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8000c00 tx=0x7f1bd8004750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:58.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/4278053501 shutdown_connections 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e47cc00 0x56375e47d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e482660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/4278053501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e482ba0 0x56375e47c6c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.293+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/4278053501 >> 172.21.15.47:0/4278053501 conn(0x56375e33da30 msgr2=0x56375e477740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.294+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/4278053501 shutdown_connections 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.294+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/4278053501 wait complete. 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.294+0000 7f1bfd5ffb80 1 -- start start 2024-05-14T12:23:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.294+0000 7f1bfd5ffb80 1 Processor -- start 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e4863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e486910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e486e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56375e489610 con 0x56375e2fedf0 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56375e304ad0 con 0x56375e482ba0 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56375e489790 con 0x56375e47cc00 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1bfd5ffb80 10 client.0 _ll_register_callbacks cb 0x56375e332330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1be7400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e486910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1beca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e4863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1be7400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e486910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59504/0 (socket says 172.21.15.47:59504) 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.295+0000 7f1be7400700 1 -- 172.21.15.47:0/3702001828 learned_addr learned my addr 172.21.15.47:0/3702001828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:58.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1beca00700 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e486e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1be7400700 1 -- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 msgr2=0x56375e486e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1be7400700 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e486e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1be7400700 1 -- 172.21.15.47:0/3702001828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 msgr2=0x56375e4863d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1be7400700 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e4863d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1be7400700 1 -- 172.21.15.47:0/3702001828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375e3643d0 con 0x56375e47cc00 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1be7400700 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e486910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4005a30 tx=0x7f1bd40039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d4012227dcda799 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.296+0000 7f1bd2000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bd2000700 1 -- 172.21.15.47:0/3702001828 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4031060 con 0x56375e47cc00 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd40056b0 con 0x56375e47cc00 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bd2000700 1 -- 172.21.15.47:0/3702001828 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1bd400b720 con 0x56375e47cc00 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bd2000700 1 -- 172.21.15.47:0/3702001828 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1bd4027070 con 0x56375e47cc00 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bfd5ffb80 10 client.24946 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:58.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56375e489610 con 0x56375e47cc00 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bd2000700 1 -- 172.21.15.47:0/3702001828 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd40056b0 con 0x56375e47cc00 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.297+0000 7f1bd2000700 1 -- 172.21.15.47:0/3702001828 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1bd40228e0 con 0x56375e47cc00 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.298+0000 7f1bfd5ffb80 10 client.24946 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.298+0000 7f1bfd5ffb80 10 client.24946 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.298+0000 7f1bfd5ffb80 20 client.24946 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.298+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e496320 0x56375e497790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.298+0000 7f1bfd5ffb80 4 client.24946 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.298+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56375e449020 con 0x56375e496320 2024-05-14T12:23:58.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.298+0000 7f1beca00700 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e496320 0x56375e497790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.299+0000 7f1beca00700 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e496320 0x56375e497790 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f8156daead5e055 server_cookie=9a10b4f615709aaf in_seq=0 out_seq=0 2024-05-14T12:23:58.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.299+0000 7f1bd2000700 10 client.24946 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:23:58.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bd2000700 1 -- 172.21.15.47:0/3702001828 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56375e449020 con 0x56375e496320 2024-05-14T12:23:58.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bd2000700 10 client.24946 handle_command_reply: tid=0 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 client.24946 shutdown 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 msgr2=0x56375e486910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e486910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4005a30 tx=0x7f1bd40039c0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 shutdown_connections 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e496320 0x56375e497790 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e486e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e4863d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/3702001828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e486910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 >> 172.21.15.47:0/3702001828 conn(0x56375e33da30 msgr2=0x56375e47b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bd2000700 0 client.24946 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 shutdown_connections 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.300+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/3702001828 wait complete. 2024-05-14T12:23:58.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.301+0000 7f1bfd5ffb80 20 client.24946 trim_cache size 0 max 16384 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 Processor -- start 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 -- start start 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e47c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e471af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e481530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56375e495ad0 con 0x56375e2fedf0 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56375e4961a0 con 0x56375e482ba0 2024-05-14T12:23:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.324+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56375e496870 con 0x56375e47cc00 2024-05-14T12:23:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e47c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e47c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36192/0 (socket says 172.21.15.47:36192) 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 -- 172.21.15.47:0/1432997586 learned_addr learned my addr 172.21.15.47:0/1432997586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e481530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1be7400700 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e471af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 -- 172.21.15.47:0/1432997586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 msgr2=0x56375e471af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e471af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 -- 172.21.15.47:0/1432997586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 msgr2=0x56375e481530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e481530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 -- 172.21.15.47:0/1432997586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375e472090 con 0x56375e2fedf0 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.325+0000 7f1beca00700 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e47c6c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x56375e47d9e0 tx=0x7f1be001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57e18b85d1c0421 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.326+0000 7f1bdcc00700 1 -- 172.21.15.47:0/1432997586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0004bb0 con 0x56375e2fedf0 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.326+0000 7f1bdcc00700 1 -- 172.21.15.47:0/1432997586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be0004d50 con 0x56375e2fedf0 2024-05-14T12:23:58.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.326+0000 7f1bdcc00700 1 -- 172.21.15.47:0/1432997586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be00259c0 con 0x56375e2fedf0 2024-05-14T12:23:58.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/1432997586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 msgr2=0x56375e47c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e47c6c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x56375e47d9e0 tx=0x7f1be001d040 comp rx=0 tx=0).stop 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/1432997586 shutdown_connections 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e482ba0 0x56375e481530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e2fedf0 0x56375e47c6c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/1432997586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e471af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/1432997586 >> 172.21.15.47:0/1432997586 conn(0x56375e33da30 msgr2=0x56375e4713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/1432997586 shutdown_connections 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/1432997586 wait complete. 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.327+0000 7f1bfd5ffb80 1 -- start start 2024-05-14T12:23:58.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 1 Processor -- start 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e4a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e47b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e482ba0 0x56375e47bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56375e497610 con 0x56375e482ba0 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56375e496f40 con 0x56375e2fedf0 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56375e497ce0 con 0x56375e47cc00 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.328+0000 7f1bfd5ffb80 10 client.0 _ll_register_callbacks cb 0x56375e332330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e482ba0 0x56375e47bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e482ba0 0x56375e47bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36202/0 (socket says 172.21.15.47:36202) 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 -- 172.21.15.47:0/2353127389 learned_addr learned my addr 172.21.15.47:0/2353127389 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1be7400700 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e47b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e4a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 -- 172.21.15.47:0/2353127389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 msgr2=0x56375e47b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e47b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 -- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 msgr2=0x56375e4a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e4a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 -- 172.21.15.47:0/2353127389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375e47c340 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1beca00700 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e482ba0 0x56375e47bbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1be0003fd0 tx=0x7f1be000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896a204c8736d41c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.329+0000 7f1bd2000700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.330+0000 7f1bd2000700 1 -- 172.21.15.47:0/2353127389 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be003a060 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.330+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be0004d50 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.330+0000 7f1bd2000700 1 -- 172.21.15.47:0/2353127389 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1be0025840 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.330+0000 7f1bd2000700 1 -- 172.21.15.47:0/2353127389 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1be000eab0 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.330+0000 7f1bfd5ffb80 10 client.14823 fetch_fsmap learned FSMap version 28 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.330+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56375e501790 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.330+0000 7f1bd2000700 1 -- 172.21.15.47:0/2353127389 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be0004d50 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1bd2000700 1 -- 172.21.15.47:0/2353127389 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1be0031070 con 0x56375e482ba0 2024-05-14T12:23:58.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1bfd5ffb80 10 client.14823 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:23:58.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1bfd5ffb80 10 client.14823 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T12:23:58.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1bfd5ffb80 20 client.14823 populate_metadata read hostname 'smithi047' 2024-05-14T12:23:58.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e503930 0x56375e504da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:23:58.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1bfd5ffb80 4 client.14823 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:23:58.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "status"}) -- 0x56375e3ac3b0 con 0x56375e503930 2024-05-14T12:23:58.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.331+0000 7f1be7400700 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e503930 0x56375e504da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:23:58.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1be7400700 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e503930 0x56375e504da0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59672e37a47b667e server_cookie=34852526508029cd in_seq=0 out_seq=0 2024-05-14T12:23:58.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bd2000700 10 client.14823 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:23:58.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bd2000700 1 -- 172.21.15.47:0/2353127389 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56375e3ac3b0 con 0x56375e503930 2024-05-14T12:23:58.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bd2000700 10 client.14823 handle_command_reply: tid=0 2024-05-14T12:23:58.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 client.14823 shutdown 2024-05-14T12:23:58.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e482ba0 msgr2=0x56375e47bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e482ba0 0x56375e47bbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1be0003fd0 tx=0x7f1be000b040 comp rx=0 tx=0).stop 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 shutdown_connections 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56375e482ba0 0x56375e47bbf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x56375e503930 0x56375e504da0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375e2fedf0 0x56375e4a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 --2- 172.21.15.47:0/2353127389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56375e47cc00 0x56375e47b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bd2000700 0 client.14823 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.332+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 >> 172.21.15.47:0/2353127389 conn(0x56375e33da30 msgr2=0x56375e4848b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.333+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 shutdown_connections 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.333+0000 7f1bfd5ffb80 1 -- 172.21.15.47:0/2353127389 wait complete. 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.333+0000 7f1bfd5ffb80 20 client.14823 trim_cache size 0 max 16384 2024-05-14T12:23:58.335 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 1, 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24521, 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 159.96258674399999, 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 198.51624631600001 2024-05-14T12:23:58.336 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.333+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1bcc0b2880 msgr2=0x7f1bcc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.333+0000 7f1beea00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1bcc0b2880 0x7f1bcc0b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8000c00 tx=0x7f1bd8004750 comp rx=0 tx=0).stop 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be8106570 msgr2=0x7f1be819d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be8106570 0x7f1be819d060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e970 tx=0x7f1bd800ec80 comp rx=0 tx=0).stop 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 shutdown_connections 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1bcc0b2880 0x7f1bcc0b4d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be810c5b0 0x7f1be81a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1be8106570 0x7f1be819d060 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 --2- 172.21.15.47:0/780263530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be8106ec0 0x7f1be819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:23:58.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 >> 172.21.15.47:0/780263530 conn(0x7f1be8102050 msgr2=0x7f1be8103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:23:58.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 shutdown_connections 2024-05-14T12:23:58.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:23:58.334+0000 7f1beea00700 1 -- 172.21.15.47:0/780263530 wait complete. 2024-05-14T12:23:59.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.a status 2024-05-14T12:23:59.723 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:23:59.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:23:59 smithi047 ceph-mon[31254]: pgmap v414: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:59.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:23:59 smithi073 ceph-mon[35809]: pgmap v414: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:23:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:23:59 smithi066 ceph-mon[35981]: pgmap v414: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:01.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:01 smithi047 ceph-mon[31254]: pgmap v415: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:01.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:01 smithi073 ceph-mon[35809]: pgmap v415: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:01 smithi066 ceph-mon[35981]: pgmap v415: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 -- 172.21.15.47:0/4292389335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0076680 msgr2=0x7f3cb0110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 --2- 172.21.15.47:0/4292389335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0076680 0x7f3cb0110660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3c980098f0 tx=0x7f3c98009c00 comp rx=0 tx=0).stop 2024-05-14T12:24:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 -- 172.21.15.47:0/4292389335 shutdown_connections 2024-05-14T12:24:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 --2- 172.21.15.47:0/4292389335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb0110ba0 0x7f3cb0113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 --2- 172.21.15.47:0/4292389335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cb0075d30 0x7f3cb0076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 --2- 172.21.15.47:0/4292389335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0076680 0x7f3cb0110660 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 -- 172.21.15.47:0/4292389335 >> 172.21.15.47:0/4292389335 conn(0x7f3cb0100040 msgr2=0x7f3cb0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 -- 172.21.15.47:0/4292389335 shutdown_connections 2024-05-14T12:24:02.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.057+0000 7f3cb6600700 1 -- 172.21.15.47:0/4292389335 wait complete. 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.058+0000 7f3cb6600700 1 Processor -- start 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.058+0000 7f3cb6600700 1 -- start start 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cb6600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cb0075d30 0x7f3cb019d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cb6600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb0076680 0x7f3cb019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cb6600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0110ba0 0x7f3cb01a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cb6600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01166a0 con 0x7f3cb0075d30 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cb6600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0116520 con 0x7f3cb0076680 2024-05-14T12:24:02.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cb6600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0116820 con 0x7f3cb0110ba0 2024-05-14T12:24:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3caf400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cb0075d30 0x7f3cb019d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cafe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0110ba0 0x7f3cb01a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3ca6a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb0076680 0x7f3cb019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cafe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0110ba0 0x7f3cb01a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59554/0 (socket says 172.21.15.47:59554) 2024-05-14T12:24:02.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.059+0000 7f3cafe00700 1 -- 172.21.15.47:0/2941009478 learned_addr learned my addr 172.21.15.47:0/2941009478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cafe00700 1 -- 172.21.15.47:0/2941009478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb0076680 msgr2=0x7f3cb019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cafe00700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb0076680 0x7f3cb019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cafe00700 1 -- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cb0075d30 msgr2=0x7f3cb019d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cafe00700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cb0075d30 0x7f3cb019d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cafe00700 1 -- 172.21.15.47:0/2941009478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb01a1f80 con 0x7f3cb0110ba0 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb0076680 0x7f3cb019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cafe00700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0110ba0 0x7f3cb01a18e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80094f0 tx=0x7f3ca800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cacc00700 1 -- 172.21.15.47:0/2941009478 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8004db0 con 0x7f3cb0110ba0 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cacc00700 1 -- 172.21.15.47:0/2941009478 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca8009e20 con 0x7f3cb0110ba0 2024-05-14T12:24:02.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.060+0000 7f3cacc00700 1 -- 172.21.15.47:0/2941009478 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8015400 con 0x7f3cb0110ba0 2024-05-14T12:24:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.061+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb01a2270 con 0x7f3cb0110ba0 2024-05-14T12:24:02.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.061+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb01a9b90 con 0x7f3cb0110ba0 2024-05-14T12:24:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.066+0000 7f3cacc00700 1 -- 172.21.15.47:0/2941009478 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3ca8005260 con 0x7f3cb0110ba0 2024-05-14T12:24:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.067+0000 7f3cc5148b80 1 Processor -- start 2024-05-14T12:24:02.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.067+0000 7f3cc5148b80 1 -- start start 2024-05-14T12:24:02.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.067+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556a9eb1df0 0x5556aa0352a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa02f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa02fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5556a9f519d0 con 0x5556a9eb1df0 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5556a9eef710 con 0x5556aa0357e0 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5556a9f4d990 con 0x5556aa02f9a0 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3ca6a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556a9eb1df0 0x5556aa0352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3caf400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa02f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3caf400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa02f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35312/0 (socket says 172.21.15.47:35312) 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3caf400700 1 -- 172.21.15.47:0/2493259386 learned_addr learned my addr 172.21.15.47:0/2493259386 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:02.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa02fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3cacc00700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3c940b2880 0x7f3c940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3caf400700 1 -- 172.21.15.47:0/2493259386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 msgr2=0x5556aa02fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3caf400700 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa02fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3caf400700 1 -- 172.21.15.47:0/2493259386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556a9eb1df0 msgr2=0x5556aa0352a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.068+0000 7f3caf400700 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556a9eb1df0 0x5556aa0352a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.069+0000 7f3caf400700 1 -- 172.21.15.47:0/2493259386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a9e9e880 con 0x5556aa0357e0 2024-05-14T12:24:02.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.069+0000 7f3cafe00700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3c940b2880 0x7f3c940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.069+0000 7f3cacc00700 1 -- 172.21.15.47:0/2941009478 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3ca80e1bb0 con 0x7f3cb0110ba0 2024-05-14T12:24:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.069+0000 7f3caf400700 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa02f460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009e70 tx=0x7f3ca0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a92cd926da212d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.069+0000 7f3ca4c00700 1 -- 172.21.15.47:0/2493259386 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca001e070 con 0x5556aa0357e0 2024-05-14T12:24:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.069+0000 7f3ca4c00700 1 -- 172.21.15.47:0/2493259386 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca000eb20 con 0x5556aa0357e0 2024-05-14T12:24:02.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.069+0000 7f3ca4c00700 1 -- 172.21.15.47:0/2493259386 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0019b10 con 0x5556aa0357e0 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.070+0000 7f3cc5148b80 1 -- 172.21.15.47:0/2493259386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 msgr2=0x5556aa02f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.070+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa02f460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009e70 tx=0x7f3ca0011720 comp rx=0 tx=0).stop 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.070+0000 7f3cc5148b80 1 -- 172.21.15.47:0/2493259386 shutdown_connections 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.070+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa02fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.070+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556a9eb1df0 0x5556aa0352a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.070+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/2493259386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa02f460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.071+0000 7f3cafe00700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3c940b2880 0x7f3c940b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80a9120 tx=0x7f3ca8004f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.071+0000 7f3cc5148b80 1 -- 172.21.15.47:0/2493259386 >> 172.21.15.47:0/2493259386 conn(0x5556a9ef6f20 msgr2=0x5556aa02a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.071+0000 7f3cc5148b80 1 -- 172.21.15.47:0/2493259386 shutdown_connections 2024-05-14T12:24:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.071+0000 7f3cc5148b80 1 -- 172.21.15.47:0/2493259386 wait complete. 2024-05-14T12:24:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.071+0000 7f3cc5148b80 1 -- start start 2024-05-14T12:24:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.072+0000 7f3cc5148b80 1 Processor -- start 2024-05-14T12:24:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.072+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa038fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.072+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa02f9a0 0x5556aa039510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.072+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa039a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.072+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5556aa03c2c0 con 0x5556aa02f9a0 2024-05-14T12:24:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.072+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5556a9eb7ad0 con 0x5556aa0357e0 2024-05-14T12:24:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.072+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5556aa03c440 con 0x5556a9eb1df0 2024-05-14T12:24:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3cc5148b80 10 client.0 _ll_register_callbacks cb 0x5556a9ef8c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3ca6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa038fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3ca6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa038fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59572/0 (socket says 172.21.15.47:59572) 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3ca6a00700 1 -- 172.21.15.47:0/3022593449 learned_addr learned my addr 172.21.15.47:0/3022593449 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3caf400700 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa02f9a0 0x5556aa039510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa039a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3caf400700 1 -- 172.21.15.47:0/3022593449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 msgr2=0x5556aa038fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3caf400700 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa038fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3caf400700 1 -- 172.21.15.47:0/3022593449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 msgr2=0x5556aa039a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3caf400700 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa039a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.073+0000 7f3caf400700 1 -- 172.21.15.47:0/3022593449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a9f173d0 con 0x5556aa02f9a0 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3caf400700 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa02f9a0 0x5556aa039510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0000c00 tx=0x7f3ca000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2879ad41f70954f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3c9d600700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3c9d600700 1 -- 172.21.15.47:0/3022593449 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0026070 con 0x5556aa02f9a0 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca000eb20 con 0x5556aa02f9a0 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3c9d600700 1 -- 172.21.15.47:0/3022593449 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3ca000e880 con 0x5556aa02f9a0 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3c9d600700 1 -- 172.21.15.47:0/3022593449 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ca001e040 con 0x5556aa02f9a0 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3cc5148b80 10 client.14835 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:02.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.074+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556aa046e20 con 0x5556aa02f9a0 2024-05-14T12:24:02.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3c9d600700 1 -- 172.21.15.47:0/3022593449 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca000eb20 con 0x5556aa02f9a0 2024-05-14T12:24:02.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3c9d600700 1 -- 172.21.15.47:0/3022593449 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3ca0029030 con 0x5556aa02f9a0 2024-05-14T12:24:02.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3cc5148b80 10 client.14835 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:02.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3cc5148b80 10 client.14835 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T12:24:02.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3cc5148b80 20 client.14835 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:02.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0491b0 0x5556aa04a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3cc5148b80 4 client.14835 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:24:02.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.075+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556a9ffc170 con 0x5556aa0491b0 2024-05-14T12:24:02.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.076+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0491b0 0x5556aa04a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.076+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0491b0 0x5556aa04a620 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f654d2a31c521aed server_cookie=1a966282a3e1dfcb in_seq=0 out_seq=0 2024-05-14T12:24:02.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.076+0000 7f3c9d600700 10 client.14835 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.077+0000 7f3c9d600700 1 -- 172.21.15.47:0/3022593449 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5556a9ffc170 con 0x5556aa0491b0 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.077+0000 7f3c9d600700 10 client.14835 handle_command_reply: tid=0 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.077+0000 7f3cc5148b80 1 client.14835 shutdown 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa02f9a0 msgr2=0x5556aa039510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa02f9a0 0x5556aa039510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0000c00 tx=0x7f3ca000eda0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 shutdown_connections 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0491b0 0x5556aa04a620 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa0357e0 0x5556aa039a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa038fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3c9d600700 0 client.14835 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:02.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3022593449 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa02f9a0 0x5556aa039510 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 >> 172.21.15.47:0/3022593449 conn(0x5556a9ef6f20 msgr2=0x5556aa02e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 shutdown_connections 2024-05-14T12:24:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3022593449 wait complete. 2024-05-14T12:24:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.078+0000 7f3cc5148b80 20 client.14835 trim_cache size 0 max 16384 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.102+0000 7f3cc5148b80 1 Processor -- start 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.102+0000 7f3cc5148b80 1 -- start start 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa02f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa02f9a0 0x5556aa0456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa024760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5556aa048960 con 0x5556aa0357e0 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5556aa049030 con 0x5556aa02f9a0 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5556aa049700 con 0x5556a9eb1df0 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3caf400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa02f9a0 0x5556aa0456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3ca6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa02f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3caf400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa02f9a0 0x5556aa0456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35330/0 (socket says 172.21.15.47:35330) 2024-05-14T12:24:02.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3caf400700 1 -- 172.21.15.47:0/3879550720 learned_addr learned my addr 172.21.15.47:0/3879550720 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:02.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.103+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa024760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3caf400700 1 -- 172.21.15.47:0/3879550720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 msgr2=0x5556aa02f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3caf400700 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa02f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3caf400700 1 -- 172.21.15.47:0/3879550720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 msgr2=0x5556aa024760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3caf400700 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa024760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3caf400700 1 -- 172.21.15.47:0/3879550720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556aa02b220 con 0x5556aa02f9a0 2024-05-14T12:24:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3caf400700 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa02f9a0 0x5556aa0456a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009890 tx=0x7f3ca0011ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77800ecf12d5b7c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3c9fe00700 1 -- 172.21.15.47:0/3879550720 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0026030 con 0x5556aa02f9a0 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3c9fe00700 1 -- 172.21.15.47:0/3879550720 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca0019940 con 0x5556aa02f9a0 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.104+0000 7f3c9fe00700 1 -- 172.21.15.47:0/3879550720 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00038e0 con 0x5556aa02f9a0 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3879550720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa02f9a0 msgr2=0x5556aa0456a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa02f9a0 0x5556aa0456a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009890 tx=0x7f3ca0011ba0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3879550720 shutdown_connections 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa024760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556a9eb1df0 0x5556aa02f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/3879550720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556aa02f9a0 0x5556aa0456a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3879550720 >> 172.21.15.47:0/3879550720 conn(0x5556a9ef6f20 msgr2=0x5556aa024050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3879550720 shutdown_connections 2024-05-14T12:24:02.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.105+0000 7f3cc5148b80 1 -- 172.21.15.47:0/3879550720 wait complete. 2024-05-14T12:24:02.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.106+0000 7f3cc5148b80 1 -- start start 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.106+0000 7f3cc5148b80 1 Processor -- start 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.106+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556a9eb1df0 0x5556aa053aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa053fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3cc5148b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa04ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5556aa04a4a0 con 0x5556aa0357e0 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5556aa049dd0 con 0x5556a9eb1df0 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3cc5148b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5556aa04ab70 con 0x5556aa02f9a0 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3cc5148b80 10 client.0 _ll_register_callbacks cb 0x5556a9ef8c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:02.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3ca6a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556a9eb1df0 0x5556aa053aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3ca6a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556a9eb1df0 0x5556aa053aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35342/0 (socket says 172.21.15.47:35342) 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3ca6a00700 1 -- 172.21.15.47:0/1482427877 learned_addr learned my addr 172.21.15.47:0/1482427877 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa04ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3caf400700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa053fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3caf400700 1 -- 172.21.15.47:0/1482427877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556a9eb1df0 msgr2=0x5556aa053aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3caf400700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556a9eb1df0 0x5556aa053aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3caf400700 1 -- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 msgr2=0x5556aa04ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3caf400700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa04ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3caf400700 1 -- 172.21.15.47:0/1482427877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556aa03c3f0 con 0x5556aa02f9a0 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.107+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556a9eb1df0 0x5556aa053aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3caf400700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa053fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005a60 tx=0x7f3ca000e930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b90567bcbfa87e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:02.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3c9d600700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3c9d600700 1 -- 172.21.15.47:0/1482427877 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0026040 con 0x5556aa02f9a0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca0019940 con 0x5556aa02f9a0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3c9d600700 1 -- 172.21.15.47:0/1482427877 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3ca00052e0 con 0x5556aa02f9a0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3c9d600700 1 -- 172.21.15.47:0/1482427877 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ca0003680 con 0x5556aa02f9a0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3cc5148b80 10 client.24970 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.108+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556aa0b4c70 con 0x5556aa02f9a0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3c9d600700 1 -- 172.21.15.47:0/1482427877 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca0019940 con 0x5556aa02f9a0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3c9d600700 1 -- 172.21.15.47:0/1482427877 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3ca003f050 con 0x5556aa02f9a0 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3cc5148b80 10 client.24970 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3cc5148b80 10 client.24970 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3cc5148b80 20 client.24970 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0b6e70 0x5556aa0b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3cc5148b80 4 client.24970 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:24:02.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.109+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "status"}) -- 0x5556a9f5f3b0 con 0x5556aa0b6e70 2024-05-14T12:24:02.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.110+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0b6e70 0x5556aa0b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:02.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.110+0000 7f3ca6a00700 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0b6e70 0x5556aa0b82e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6771ab7d119e3b7c server_cookie=e3c14c3b3fe5f5cf in_seq=0 out_seq=0 2024-05-14T12:24:02.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.110+0000 7f3c9d600700 10 client.24970 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.110+0000 7f3c9d600700 1 -- 172.21.15.47:0/1482427877 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5556a9f5f3b0 con 0x5556aa0b6e70 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.110+0000 7f3c9d600700 10 client.24970 handle_command_reply: tid=0 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.110+0000 7f3cc5148b80 1 client.24970 shutdown 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 msgr2=0x5556aa053fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa053fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005a60 tx=0x7f3ca000e930 comp rx=0 tx=0).stop 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 shutdown_connections 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5556aa0b6e70 0x5556aa0b82e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5556aa0357e0 0x5556aa04ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5556a9eb1df0 0x5556aa053aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 --2- 172.21.15.47:0/1482427877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5556aa02f9a0 0x5556aa053fe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 >> 172.21.15.47:0/1482427877 conn(0x5556a9ef6f20 msgr2=0x5556aa032c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3c9d600700 0 client.24970 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 shutdown_connections 2024-05-14T12:24:02.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 1 -- 172.21.15.47:0/1482427877 wait complete. 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.111+0000 7f3cc5148b80 20 client.24970 trim_cache size 0 max 16384 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24535, 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:24:02.114 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:24:02.115 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 179.43499222099999, 2024-05-14T12:24:02.115 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:24:02.115 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:24:02.115 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:24:02.115 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 205.10443846999999 2024-05-14T12:24:02.115 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:24:02.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3c940b2880 msgr2=0x7f3c940b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3c940b2880 0x7f3c940b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80a9120 tx=0x7f3ca8004f50 comp rx=0 tx=0).stop 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0110ba0 msgr2=0x7f3cb01a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0110ba0 0x7f3cb01a18e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80094f0 tx=0x7f3ca800d3b0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 shutdown_connections 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3c940b2880 0x7f3c940b4d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb0110ba0 0x7f3cb01a18e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cb0075d30 0x7f3cb019d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 --2- 172.21.15.47:0/2941009478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb0076680 0x7f3cb019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 >> 172.21.15.47:0/2941009478 conn(0x7f3cb0100040 msgr2=0x7f3cb0100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 shutdown_connections 2024-05-14T12:24:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:02.112+0000 7f3cb6600700 1 -- 172.21.15.47:0/2941009478 wait complete. 2024-05-14T12:24:02.928 INFO:tasks.cephadm:Setup complete, yielding 2024-05-14T12:24:02.928 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-14T12:24:02.941 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T12:24:02.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- bash -c 'ceph orch status' 2024-05-14T12:24:03.404 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:03.711 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:03 smithi047 ceph-mon[31254]: pgmap v416: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:03.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:03 smithi073 ceph-mon[35809]: pgmap v416: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:03 smithi066 ceph-mon[35981]: pgmap v416: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:05.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.674+0000 7fe6f1400700 1 -- 172.21.15.47:0/714847425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec107680 msgr2=0x7fe6ec107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:05.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.674+0000 7fe6f1400700 1 --2- 172.21.15.47:0/714847425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec107680 0x7fe6ec107a90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009990 tx=0x7fe6d8009ca0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:05 smithi047 ceph-mon[31254]: pgmap v417: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:05.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.675+0000 7fe6f1400700 1 -- 172.21.15.47:0/714847425 shutdown_connections 2024-05-14T12:24:05.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.675+0000 7fe6f1400700 1 --2- 172.21.15.47:0/714847425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec108020 0x7fe6ec10e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.675+0000 7fe6f1400700 1 --2- 172.21.15.47:0/714847425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ec106550 0x7fe6ec106960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.675+0000 7fe6f1400700 1 --2- 172.21.15.47:0/714847425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec107680 0x7fe6ec107a90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.675+0000 7fe6f1400700 1 -- 172.21.15.47:0/714847425 >> 172.21.15.47:0/714847425 conn(0x7fe6ec101bd0 msgr2=0x7fe6ec104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.675+0000 7fe6f1400700 1 -- 172.21.15.47:0/714847425 shutdown_connections 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.675+0000 7fe6f1400700 1 -- 172.21.15.47:0/714847425 wait complete. 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.676+0000 7fe6f1400700 1 Processor -- start 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.676+0000 7fe6f1400700 1 -- start start 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6f1400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec106550 0x7fe6ec19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6f1400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ec107680 0x7fe6ec19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6f1400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec108020 0x7fe6ec1a4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6f1400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec112000 con 0x7fe6ec108020 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6f1400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec111e80 con 0x7fe6ec107680 2024-05-14T12:24:05.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6f1400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec112180 con 0x7fe6ec106550 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6ea800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec106550 0x7fe6ec19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6ea800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec106550 0x7fe6ec19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59616/0 (socket says 172.21.15.47:59616) 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6ea800700 1 -- 172.21.15.47:0/1992893228 learned_addr learned my addr 172.21.15.47:0/1992893228 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6e9e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ec107680 0x7fe6ec19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.677+0000 7fe6eb200700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec108020 0x7fe6ec1a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6ea800700 1 -- 172.21.15.47:0/1992893228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ec107680 msgr2=0x7fe6ec19d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6ea800700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ec107680 0x7fe6ec19d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6ea800700 1 -- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec108020 msgr2=0x7fe6ec1a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6ea800700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec108020 0x7fe6ec1a4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6ea800700 1 -- 172.21.15.47:0/1992893228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec1a46a0 con 0x7fe6ec106550 2024-05-14T12:24:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6eb200700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec108020 0x7fe6ec1a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:24:05.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6ea800700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec106550 0x7fe6ec19cb40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00e940 tx=0x7fe6dc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:05.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6e3400700 1 -- 172.21.15.47:0/1992893228 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00cbd0 con 0x7fe6ec106550 2024-05-14T12:24:05.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6e3400700 1 -- 172.21.15.47:0/1992893228 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6dc00ee90 con 0x7fe6ec106550 2024-05-14T12:24:05.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec1a4990 con 0x7fe6ec106550 2024-05-14T12:24:05.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.678+0000 7fe6e3400700 1 -- 172.21.15.47:0/1992893228 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc003dc0 con 0x7fe6ec106550 2024-05-14T12:24:05.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.679+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1a4ed0 con 0x7fe6ec106550 2024-05-14T12:24:05.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.680+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec0512c0 con 0x7fe6ec106550 2024-05-14T12:24:05.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.683+0000 7fe6e3400700 1 -- 172.21.15.47:0/1992893228 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe6dc046910 con 0x7fe6ec106550 2024-05-14T12:24:05.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.684+0000 7fe6e3400700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6d00b2880 0x7fe6d00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:05.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.684+0000 7fe6e3400700 1 -- 172.21.15.47:0/1992893228 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe6dc0e24a0 con 0x7fe6ec106550 2024-05-14T12:24:05.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.685+0000 7fe6e9e00700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6d00b2880 0x7fe6d00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:05.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.685+0000 7fe6e9e00700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6d00b2880 0x7fe6d00b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec19dbf0 tx=0x7fe6d800b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:05.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.687+0000 7fe6e3400700 1 -- 172.21.15.47:0/1992893228 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe6dc0aa180 con 0x7fe6ec106550 2024-05-14T12:24:05.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:05 smithi073 ceph-mon[35809]: pgmap v417: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:05.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:05 smithi066 ceph-mon[35981]: pgmap v417: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:05.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.948+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe6ec063c00 con 0x7fe6d00b2880 2024-05-14T12:24:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.950+0000 7fe6e3400700 1 -- 172.21.15.47:0/1992893228 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe6ec063c00 con 0x7fe6d00b2880 2024-05-14T12:24:05.951 INFO:teuthology.orchestra.run.smithi047.stdout:Backend: cephadm 2024-05-14T12:24:05.951 INFO:teuthology.orchestra.run.smithi047.stdout:Available: Yes 2024-05-14T12:24:05.951 INFO:teuthology.orchestra.run.smithi047.stdout:Paused: No 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6d00b2880 msgr2=0x7fe6d00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6d00b2880 0x7fe6d00b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec19dbf0 tx=0x7fe6d800b720 comp rx=0 tx=0).stop 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec106550 msgr2=0x7fe6ec19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec106550 0x7fe6ec19cb40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00e940 tx=0x7fe6dc00ec50 comp rx=0 tx=0).stop 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 shutdown_connections 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6d00b2880 0x7fe6d00b4d90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6ec108020 0x7fe6ec1a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6ec106550 0x7fe6ec19cb40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 --2- 172.21.15.47:0/1992893228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ec107680 0x7fe6ec19d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 >> 172.21.15.47:0/1992893228 conn(0x7fe6ec101bd0 msgr2=0x7fe6ec10a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 shutdown_connections 2024-05-14T12:24:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:05.954+0000 7fe6f1400700 1 -- 172.21.15.47:0/1992893228 wait complete. 2024-05-14T12:24:06.795 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-14T12:24:07.276 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:07.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:07 smithi047 ceph-mon[31254]: from='client.24976 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:07.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:07 smithi047 ceph-mon[31254]: pgmap v418: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:07 smithi073 ceph-mon[35809]: from='client.24976 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:07.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:07 smithi073 ceph-mon[35809]: pgmap v418: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:07.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:07 smithi066 ceph-mon[35981]: from='client.24976 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:07.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:07 smithi066 ceph-mon[35981]: pgmap v418: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 -- 172.21.15.47:0/2843643932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004109f10 msgr2=0x7fc00410c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 --2- 172.21.15.47:0/2843643932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004109f10 0x7fc00410c330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009f90 tx=0x7fbffc00b330 comp rx=0 tx=0).stop 2024-05-14T12:24:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 -- 172.21.15.47:0/2843643932 shutdown_connections 2024-05-14T12:24:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 --2- 172.21.15.47:0/2843643932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004109f10 0x7fc00410c330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 --2- 172.21.15.47:0/2843643932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc004104c50 0x7fc004107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 --2- 172.21.15.47:0/2843643932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0041075b0 0x7fc0041099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 -- 172.21.15.47:0/2843643932 >> 172.21.15.47:0/2843643932 conn(0x7fc0040fe690 msgr2=0x7fc004100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 -- 172.21.15.47:0/2843643932 shutdown_connections 2024-05-14T12:24:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.562+0000 7fc00a800700 1 -- 172.21.15.47:0/2843643932 wait complete. 2024-05-14T12:24:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.564+0000 7fc00a800700 1 Processor -- start 2024-05-14T12:24:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.564+0000 7fc00a800700 1 -- start start 2024-05-14T12:24:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.564+0000 7fc00a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004104c50 0x7fc00419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.564+0000 7fc00a800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0041075b0 0x7fc00419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc00a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc004109f10 0x7fc0041a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc00a800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc00410fbb0 con 0x7fc004104c50 2024-05-14T12:24:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc00a800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc00410fa30 con 0x7fc0041075b0 2024-05-14T12:24:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc00a800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc00410fd30 con 0x7fc004109f10 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004104c50 0x7fc00419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004104c50 0x7fc00419c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48026/0 (socket says 172.21.15.47:48026) 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009400700 1 -- 172.21.15.47:0/2485871034 learned_addr learned my addr 172.21.15.47:0/2485871034 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc008a00700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0041075b0 0x7fc00419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009e00700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc004109f10 0x7fc0041a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009400700 1 -- 172.21.15.47:0/2485871034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc004109f10 msgr2=0x7fc0041a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009400700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc004109f10 0x7fc0041a3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009400700 1 -- 172.21.15.47:0/2485871034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0041075b0 msgr2=0x7fc00419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.565+0000 7fc009400700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0041075b0 0x7fc00419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc009400700 1 -- 172.21.15.47:0/2485871034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0041a4410 con 0x7fc004104c50 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc009e00700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc004109f10 0x7fc0041a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:24:09.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc008a00700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0041075b0 0x7fc00419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc009400700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004104c50 0x7fc00419c8b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e9f0 tx=0x7fbff800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc002000700 1 -- 172.21.15.47:0/2485871034 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff800c9c0 con 0x7fc004104c50 2024-05-14T12:24:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0041a4700 con 0x7fc004104c50 2024-05-14T12:24:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc002000700 1 -- 172.21.15.47:0/2485871034 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbff800cb60 con 0x7fc004104c50 2024-05-14T12:24:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc002000700 1 -- 172.21.15.47:0/2485871034 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8018680 con 0x7fc004104c50 2024-05-14T12:24:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.566+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0041a4c40 con 0x7fc004104c50 2024-05-14T12:24:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.568+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0040512c0 con 0x7fc004104c50 2024-05-14T12:24:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.570+0000 7fc002000700 1 -- 172.21.15.47:0/2485871034 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbff8018a30 con 0x7fc004104c50 2024-05-14T12:24:09.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.573+0000 7fc002000700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfec0b2880 0x7fbfec0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.573+0000 7fc002000700 1 -- 172.21.15.47:0/2485871034 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbff80e26c0 con 0x7fc004104c50 2024-05-14T12:24:09.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.573+0000 7fc008a00700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfec0b2880 0x7fbfec0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:09.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.574+0000 7fc008a00700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfec0b2880 0x7fbfec0b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc00419d960 tx=0x7fbff0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:09.577 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:09 smithi047 ceph-mon[31254]: pgmap v419: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.579+0000 7fc002000700 1 -- 172.21.15.47:0/2485871034 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbff80aa3a0 con 0x7fc004104c50 2024-05-14T12:24:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:09 smithi073 ceph-mon[35809]: pgmap v419: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:09.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:09 smithi066 ceph-mon[35981]: pgmap v419: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:09.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.828+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc004063c00 con 0x7fbfec0b2880 2024-05-14T12:24:09.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.868+0000 7fc002000700 1 -- 172.21.15.47:0/2485871034 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fc004063c00 con 0x7fbfec0b2880 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.a smithi047 running (3m) 51s ago 3m 92.6M - 19.0.0-3588-ge2b755a6 bc14c6192b1a ce3db125857d 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.b smithi066 running (3m) 72s ago 3m 89.4M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 35a40c749e63 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.c smithi073 running (3m) 72s ago 3m 89.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a d3538bf0807a 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.d smithi047 running (3m) 51s ago 3m 85.2M - 19.0.0-3588-ge2b755a6 bc14c6192b1a c41f7e11b3e6 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.e smithi066 running (3m) 72s ago 3m 88.9M - 19.0.0-3588-ge2b755a6 bc14c6192b1a a07a0bc8a3aa 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.f smithi073 running (3m) 72s ago 3m 89.3M - 19.0.0-3588-ge2b755a6 bc14c6192b1a ded613d13e8d 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.g smithi047 running (3m) 51s ago 3m 80.2M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 3ab1902ab70f 2024-05-14T12:24:09.870 INFO:teuthology.orchestra.run.smithi047.stdout:mds.h smithi066 running (3m) 72s ago 3m 87.6M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 8fd6117631c4 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mds.i smithi073 running (3m) 72s ago 3m 86.0M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 4575e4da0fbf 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mds.j smithi047 running (4m) 51s ago 4m 80.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 71dacb13a5b0 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mds.k smithi066 running (4m) 72s ago 4m 89.1M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 4fcc12ac5f10 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mds.l smithi073 running (4m) 72s ago 4m 85.8M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 3152981b0c91 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.x smithi047 *:9283,8765 running (12m) 51s ago 12m 598M - 19.0.0-3588-ge2b755a6 bc14c6192b1a d74a48a5c6e7 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.y smithi066 *:8443,8765 running (10m) 72s ago 10m 538M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 9856deffc4cc 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.z smithi073 *:8443,8765 running (10m) 72s ago 10m 535M - 19.0.0-3588-ge2b755a6 bc14c6192b1a ebff4ec15e40 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mon.a smithi047 running (12m) 51s ago 12m 117M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a cfed7abc41f9 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mon.b smithi066 running (10m) 72s ago 10m 109M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a 334e228c20bc 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:mon.c smithi073 running (10m) 72s ago 10m 109M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a fbe503225835 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (9m) 51s ago 9m 116M 4273M 19.0.0-3588-ge2b755a6 bc14c6192b1a f0dd86e9f1e2 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi066 running (9m) 72s ago 9m 115M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a c3affc1f20ec 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi073 running (8m) 72s ago 8m 120M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 120cb12a5816 2024-05-14T12:24:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi047 running (8m) 51s ago 8m 112M 4273M 19.0.0-3588-ge2b755a6 bc14c6192b1a f598532d06df 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi066 running (7m) 72s ago 7m 119M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 49b2cea31001 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi073 running (7m) 72s ago 7m 122M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 4567af15bc5a 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 smithi047 running (6m) 51s ago 6m 116M 4273M 19.0.0-3588-ge2b755a6 bc14c6192b1a 2ad03bce2189 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 smithi066 running (6m) 72s ago 6m 125M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 69599756b036 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 smithi073 running (5m) 72s ago 5m 121M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 0a89bb4bd6fd 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 smithi047 running (5m) 51s ago 5m 111M 4273M 19.0.0-3588-ge2b755a6 bc14c6192b1a b3afe11e4142 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 smithi066 running (4m) 72s ago 4m 117M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 30490efb5ad4 2024-05-14T12:24:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 smithi073 running (4m) 72s ago 4m 113M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 9c39db316a2c 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.871+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfec0b2880 msgr2=0x7fbfec0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.871+0000 7fc00a800700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfec0b2880 0x7fbfec0b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc00419d960 tx=0x7fbff0009260 comp rx=0 tx=0).stop 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004104c50 msgr2=0x7fc00419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004104c50 0x7fc00419c8b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e9f0 tx=0x7fbff800ed00 comp rx=0 tx=0).stop 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 shutdown_connections 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfec0b2880 0x7fbfec0b4d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc004109f10 0x7fc0041a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc004104c50 0x7fc00419c8b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 --2- 172.21.15.47:0/2485871034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0041075b0 0x7fc00419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 >> 172.21.15.47:0/2485871034 conn(0x7fc0040fe690 msgr2=0x7fc004104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 shutdown_connections 2024-05-14T12:24:09.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:09.872+0000 7fc00a800700 1 -- 172.21.15.47:0/2485871034 wait complete. 2024-05-14T12:24:10.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-14T12:24:11.141 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:11.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:11 smithi047 ceph-mon[31254]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:11.625 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:11 smithi047 ceph-mon[31254]: pgmap v420: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:11 smithi073 ceph-mon[35809]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:11 smithi073 ceph-mon[35809]: pgmap v420: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:11 smithi066 ceph-mon[35981]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:11 smithi066 ceph-mon[35981]: pgmap v420: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:13.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.330+0000 7f5afa600700 1 -- 172.21.15.47:0/3907273397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af41074c0 msgr2=0x7f5af41078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:13.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.330+0000 7f5afa600700 1 --2- 172.21.15.47:0/3907273397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af41074c0 0x7f5af41078d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009990 tx=0x7f5ae0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.331+0000 7f5afa600700 1 -- 172.21.15.47:0/3907273397 shutdown_connections 2024-05-14T12:24:13.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.331+0000 7f5afa600700 1 --2- 172.21.15.47:0/3907273397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af4107e60 0x7f5af410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.331+0000 7f5afa600700 1 --2- 172.21.15.47:0/3907273397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af4106390 0x7f5af41067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.331+0000 7f5afa600700 1 --2- 172.21.15.47:0/3907273397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af41074c0 0x7f5af41078d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.331+0000 7f5afa600700 1 -- 172.21.15.47:0/3907273397 >> 172.21.15.47:0/3907273397 conn(0x7f5af4101a10 msgr2=0x7f5af4103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:13.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.331+0000 7f5afa600700 1 -- 172.21.15.47:0/3907273397 shutdown_connections 2024-05-14T12:24:13.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.331+0000 7f5afa600700 1 -- 172.21.15.47:0/3907273397 wait complete. 2024-05-14T12:24:13.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.333+0000 7f5afa600700 1 Processor -- start 2024-05-14T12:24:13.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.333+0000 7f5afa600700 1 -- start start 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5afa600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af4106390 0x7f5af419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5afa600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af41074c0 0x7f5af419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5afa600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af4107e60 0x7f5af41a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5afa600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5af4111e00 con 0x7f5af4106390 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5afa600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5af4111c80 con 0x7f5af41074c0 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5afa600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5af4111f80 con 0x7f5af4107e60 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5af3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af41074c0 0x7f5af419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5af9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af4106390 0x7f5af419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5af3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af41074c0 0x7f5af419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56466/0 (socket says 172.21.15.47:56466) 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5af3e00700 1 -- 172.21.15.47:0/1669563334 learned_addr learned my addr 172.21.15.47:0/1669563334 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5af9c00700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af4107e60 0x7f5af41a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.334+0000 7f5af3e00700 1 -- 172.21.15.47:0/1669563334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af4107e60 msgr2=0x7f5af41a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5af3e00700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af4107e60 0x7f5af41a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5af3e00700 1 -- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af4106390 msgr2=0x7f5af419c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:13.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5af3e00700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af4106390 0x7f5af419c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5af3e00700 1 -- 172.21.15.47:0/1669563334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af41a4470 con 0x7f5af41074c0 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5af3e00700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af41074c0 0x7f5af419ce50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00057c0 tx=0x7f5ae00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5af1600700 1 -- 172.21.15.47:0/1669563334 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0026070 con 0x7f5af41074c0 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5af1600700 1 -- 172.21.15.47:0/1669563334 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ae0021410 con 0x7f5af41074c0 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.335+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af41a4700 con 0x7f5af41074c0 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.336+0000 7f5af1600700 1 -- 172.21.15.47:0/1669563334 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0017650 con 0x7f5af41074c0 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.336+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af41a4b50 con 0x7f5af41074c0 2024-05-14T12:24:13.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.337+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af40512c0 con 0x7f5af41074c0 2024-05-14T12:24:13.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.339+0000 7f5af1600700 1 -- 172.21.15.47:0/1669563334 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5ae0029070 con 0x7f5af41074c0 2024-05-14T12:24:13.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.341+0000 7f5af1600700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5adc0b2880 0x7f5adc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.341+0000 7f5af1600700 1 -- 172.21.15.47:0/1669563334 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5ae00e3340 con 0x7f5af41074c0 2024-05-14T12:24:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.341+0000 7f5af9200700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5adc0b2880 0x7f5adc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.342+0000 7f5af9200700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5adc0b2880 0x7f5adc0b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5af41073c0 tx=0x7f5ae8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:13.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.343+0000 7f5af1600700 1 -- 172.21.15.47:0/1669563334 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5ae005edf0 con 0x7f5af41074c0 2024-05-14T12:24:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.592+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f5af4063c00 con 0x7f5adc0b2880 2024-05-14T12:24:13.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:13 smithi047 ceph-mon[31254]: pgmap v421: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.600+0000 7f5af1600700 1 -- 172.21.15.47:0/1669563334 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f5af4063c00 con 0x7f5adc0b2880 2024-05-14T12:24:13.601 INFO:teuthology.orchestra.run.smithi047.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-14T12:24:13.601 INFO:teuthology.orchestra.run.smithi047.stdout:mds.all 12/12 76s ago 4m smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-05-14T12:24:13.601 INFO:teuthology.orchestra.run.smithi047.stdout:mgr 3/3 76s ago 10m smithi047=x;smithi066=y;smithi073=z;count:3 2024-05-14T12:24:13.601 INFO:teuthology.orchestra.run.smithi047.stdout:mon 3/3 76s ago 10m smithi047:172.21.15.47=a;smithi066:172.21.15.66=b;smithi073:172.21.15.73=c;count:3 2024-05-14T12:24:13.601 INFO:teuthology.orchestra.run.smithi047.stdout:osd 12 76s ago - 2024-05-14T12:24:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5adc0b2880 msgr2=0x7f5adc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5adc0b2880 0x7f5adc0b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5af41073c0 tx=0x7f5ae8009260 comp rx=0 tx=0).stop 2024-05-14T12:24:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af41074c0 msgr2=0x7f5af419ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af41074c0 0x7f5af419ce50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00057c0 tx=0x7f5ae00057f0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 shutdown_connections 2024-05-14T12:24:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5adc0b2880 0x7f5adc0b4d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af4107e60 0x7f5af41a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5af4106390 0x7f5af419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 --2- 172.21.15.47:0/1669563334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5af41074c0 0x7f5af419ce50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:13.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 >> 172.21.15.47:0/1669563334 conn(0x7f5af4101a10 msgr2=0x7f5af410a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:13.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.603+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 shutdown_connections 2024-05-14T12:24:13.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:13.604+0000 7f5afa600700 1 -- 172.21.15.47:0/1669563334 wait complete. 2024-05-14T12:24:13.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:13 smithi073 ceph-mon[35809]: pgmap v421: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:13.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:13 smithi066 ceph-mon[35981]: pgmap v421: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:14.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-14T12:24:14.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:14 smithi047 ceph-mon[31254]: from='client.24965 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:14.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:14 smithi073 ceph-mon[35809]: from='client.24965 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:14.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:14 smithi066 ceph-mon[35981]: from='client.24965 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:14.892 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:15 smithi047 ceph-mon[31254]: pgmap v422: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:15.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:15 smithi073 ceph-mon[35809]: pgmap v422: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:15 smithi066 ceph-mon[35981]: pgmap v422: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:17.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.292+0000 7efec3e00700 1 -- 172.21.15.47:0/3013051438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105c20 msgr2=0x7efec410c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:17.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.292+0000 7efec3e00700 1 --2- 172.21.15.47:0/3013051438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105c20 0x7efec410c4d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efebc009990 tx=0x7efebc009ca0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.293+0000 7efec3e00700 1 -- 172.21.15.47:0/3013051438 shutdown_connections 2024-05-14T12:24:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.293+0000 7efec3e00700 1 --2- 172.21.15.47:0/3013051438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105c20 0x7efec410c4d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.293+0000 7efec3e00700 1 --2- 172.21.15.47:0/3013051438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efec4104150 0x7efec4104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.293+0000 7efec3e00700 1 --2- 172.21.15.47:0/3013051438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efec4105280 0x7efec4105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.293+0000 7efec3e00700 1 -- 172.21.15.47:0/3013051438 >> 172.21.15.47:0/3013051438 conn(0x7efec40ff7b0 msgr2=0x7efec4101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.293+0000 7efec3e00700 1 -- 172.21.15.47:0/3013051438 shutdown_connections 2024-05-14T12:24:17.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.293+0000 7efec3e00700 1 -- 172.21.15.47:0/3013051438 wait complete. 2024-05-14T12:24:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.294+0000 7efec3e00700 1 Processor -- start 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.294+0000 7efec3e00700 1 -- start start 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec3e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efec4104150 0x7efec419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105280 0x7efec419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efec4105c20 0x7efec41a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec3e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efec410fbd0 con 0x7efec4105280 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec3e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efec410fa50 con 0x7efec4105c20 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec3e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efec410fd50 con 0x7efec4104150 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec2000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105280 0x7efec419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec2a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efec4104150 0x7efec419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec2a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efec4104150 0x7efec419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55038/0 (socket says 172.21.15.47:55038) 2024-05-14T12:24:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec2a00700 1 -- 172.21.15.47:0/715932864 learned_addr learned my addr 172.21.15.47:0/715932864 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.295+0000 7efec3400700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efec4105c20 0x7efec41a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.296+0000 7efec2000700 1 -- 172.21.15.47:0/715932864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efec4104150 msgr2=0x7efec419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.296+0000 7efec2000700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efec4104150 0x7efec419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.296+0000 7efec2000700 1 -- 172.21.15.47:0/715932864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efec4105c20 msgr2=0x7efec41a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.296+0000 7efec2000700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efec4105c20 0x7efec41a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.296+0000 7efec2000700 1 -- 172.21.15.47:0/715932864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec41a2210 con 0x7efec4105280 2024-05-14T12:24:17.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.296+0000 7efec2000700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105280 0x7efec419abf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efeb000e9f0 tx=0x7efeb000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.296+0000 7efebb400700 1 -- 172.21.15.47:0/715932864 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0004220 con 0x7efec4105280 2024-05-14T12:24:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.297+0000 7efebb400700 1 -- 172.21.15.47:0/715932864 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb00043c0 con 0x7efec4105280 2024-05-14T12:24:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.297+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec41a2500 con 0x7efec4105280 2024-05-14T12:24:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.297+0000 7efebb400700 1 -- 172.21.15.47:0/715932864 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0005020 con 0x7efec4105280 2024-05-14T12:24:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.297+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec41a29f0 con 0x7efec4105280 2024-05-14T12:24:17.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.298+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec40512c0 con 0x7efec4105280 2024-05-14T12:24:17.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.301+0000 7efebb400700 1 -- 172.21.15.47:0/715932864 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efeb0004750 con 0x7efec4105280 2024-05-14T12:24:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.302+0000 7efebb400700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efea80b2880 0x7efea80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.303+0000 7efebb400700 1 -- 172.21.15.47:0/715932864 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efeb00e2270 con 0x7efec4105280 2024-05-14T12:24:17.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.303+0000 7efec2a00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efea80b2880 0x7efea80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:17.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.303+0000 7efec2a00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efea80b2880 0x7efea80b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009fd0 tx=0x7efeb400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:17.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.305+0000 7efebb400700 1 -- 172.21.15.47:0/715932864 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efeb00a9fe0 con 0x7efec4105280 2024-05-14T12:24:17.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.552+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7efec4063c00 con 0x7efea80b2880 2024-05-14T12:24:17.553 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:17 smithi047 ceph-mon[31254]: pgmap v423: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.554+0000 7efebb400700 1 -- 172.21.15.47:0/715932864 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7efec4063c00 con 0x7efea80b2880 2024-05-14T12:24:17.555 INFO:teuthology.orchestra.run.smithi047.stdout:HOST ADDR LABELS STATUS 2024-05-14T12:24:17.555 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 172.21.15.47 2024-05-14T12:24:17.555 INFO:teuthology.orchestra.run.smithi047.stdout:smithi066 172.21.15.66 2024-05-14T12:24:17.555 INFO:teuthology.orchestra.run.smithi047.stdout:smithi073 172.21.15.73 2024-05-14T12:24:17.555 INFO:teuthology.orchestra.run.smithi047.stdout:3 hosts in cluster 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efea80b2880 msgr2=0x7efea80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efea80b2880 0x7efea80b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009fd0 tx=0x7efeb400b040 comp rx=0 tx=0).stop 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105280 msgr2=0x7efec419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105280 0x7efec419abf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efeb000e9f0 tx=0x7efeb000ed00 comp rx=0 tx=0).stop 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 shutdown_connections 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efea80b2880 0x7efea80b4d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efec4105c20 0x7efec41a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efec4104150 0x7efec419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 --2- 172.21.15.47:0/715932864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efec4105280 0x7efec419abf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 >> 172.21.15.47:0/715932864 conn(0x7efec40ff7b0 msgr2=0x7efec41084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:17.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 shutdown_connections 2024-05-14T12:24:17.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:17.558+0000 7efec3e00700 1 -- 172.21.15.47:0/715932864 wait complete. 2024-05-14T12:24:17.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:17 smithi073 ceph-mon[35809]: pgmap v423: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:17 smithi066 ceph-mon[35981]: pgmap v423: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:18.412 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-14T12:24:18.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:18 smithi047 ceph-mon[31254]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:18.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:18 smithi073 ceph-mon[35809]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:18.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:18 smithi066 ceph-mon[35981]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:18.875 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:19.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:19 smithi047 ceph-mon[31254]: pgmap v424: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:19.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:19 smithi073 ceph-mon[35809]: pgmap v424: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:19 smithi066 ceph-mon[35981]: pgmap v424: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:20.653 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:20 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:24:20.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:20 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:24:20.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:20 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.231+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2227164207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 msgr2=0x7fbfbc107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.231+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2227164207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 0x7fbfbc107ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009990 tx=0x7fbfa4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.232+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2227164207 shutdown_connections 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.232+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2227164207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfbc108040 0x7fbfbc10e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.232+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2227164207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfbc106570 0x7fbfbc106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.232+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2227164207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 0x7fbfbc107ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.232+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2227164207 >> 172.21.15.47:0/2227164207 conn(0x7fbfbc101bd0 msgr2=0x7fbfbc104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.232+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2227164207 shutdown_connections 2024-05-14T12:24:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.232+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2227164207 wait complete. 2024-05-14T12:24:21.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.233+0000 7fbfc0e00700 1 Processor -- start 2024-05-14T12:24:21.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.233+0000 7fbfc0e00700 1 -- start start 2024-05-14T12:24:21.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfc0e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfbc106570 0x7fbfbc19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:21.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfc0e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 0x7fbfbc19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:21.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfc0e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfbc108040 0x7fbfbc1a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:21.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfc0e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc111fe0 con 0x7fbfbc106570 2024-05-14T12:24:21.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfc0e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc111e60 con 0x7fbfbc1076a0 2024-05-14T12:24:21.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfc0e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc112160 con 0x7fbfbc108040 2024-05-14T12:24:21.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfb3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 0x7fbfbc19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:21.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfb3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 0x7fbfbc19d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:48464/0 (socket says 172.21.15.47:48464) 2024-05-14T12:24:21.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfb3e00700 1 -- 172.21.15.47:0/2028652024 learned_addr learned my addr 172.21.15.47:0/2028652024 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:21.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfba800700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfbc108040 0x7fbfbc1a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.234+0000 7fbfb9e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfbc106570 0x7fbfbc19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.235+0000 7fbfb9e00700 1 -- 172.21.15.47:0/2028652024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfbc108040 msgr2=0x7fbfbc1a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.235+0000 7fbfb9e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfbc108040 0x7fbfbc1a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.235+0000 7fbfb9e00700 1 -- 172.21.15.47:0/2028652024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 msgr2=0x7fbfbc19d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.235+0000 7fbfb9e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 0x7fbfbc19d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.235+0000 7fbfb9e00700 1 -- 172.21.15.47:0/2028652024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc1a4650 con 0x7fbfbc106570 2024-05-14T12:24:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.236+0000 7fbfb9e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfbc106570 0x7fbfbc19caf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc106270 tx=0x7fbfac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.236+0000 7fbfb2a00700 1 -- 172.21.15.47:0/2028652024 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac004220 con 0x7fbfbc106570 2024-05-14T12:24:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.236+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc1a4940 con 0x7fbfbc106570 2024-05-14T12:24:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.236+0000 7fbfb2a00700 1 -- 172.21.15.47:0/2028652024 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfac004d20 con 0x7fbfbc106570 2024-05-14T12:24:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.236+0000 7fbfb2a00700 1 -- 172.21.15.47:0/2028652024 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac010700 con 0x7fbfbc106570 2024-05-14T12:24:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.236+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc1a4ed0 con 0x7fbfbc106570 2024-05-14T12:24:21.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.238+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc0512c0 con 0x7fbfbc106570 2024-05-14T12:24:21.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.240+0000 7fbfb2a00700 1 -- 172.21.15.47:0/2028652024 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbfac004750 con 0x7fbfbc106570 2024-05-14T12:24:21.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.242+0000 7fbfb2a00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfa00b2900 0x7fbfa00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:21.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.242+0000 7fbfb2a00700 1 -- 172.21.15.47:0/2028652024 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbfac0e2070 con 0x7fbfbc106570 2024-05-14T12:24:21.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.242+0000 7fbfb3e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfa00b2900 0x7fbfa00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:21.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.243+0000 7fbfb3e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfa00b2900 0x7fbfa00b4e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400b2e0 tx=0x7fbfa4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:21.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.244+0000 7fbfb2a00700 1 -- 172.21.15.47:0/2028652024 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbfac0a9de0 con 0x7fbfbc106570 2024-05-14T12:24:21.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.496+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fbfbc063c00 con 0x7fbfa00b2900 2024-05-14T12:24:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.499+0000 7fbfb2a00700 1 -- 172.21.15.47:0/2028652024 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fbfbc063c00 con 0x7fbfa00b2900 2024-05-14T12:24:21.500 INFO:teuthology.orchestra.run.smithi047.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-14T12:24:21.500 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130022480DGN 447G No 5m ago Has a FileSystem, LVM detected 2024-05-14T12:24:21.500 INFO:teuthology.orchestra.run.smithi047.stdout:smithi066 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53430091400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-14T12:24:21.500 INFO:teuthology.orchestra.run.smithi047.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.501+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfa00b2900 msgr2=0x7fbfa00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.501+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfa00b2900 0x7fbfa00b4e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400b2e0 tx=0x7fbfa4005fb0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.501+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfbc106570 msgr2=0x7fbfbc19caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.501+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfbc106570 0x7fbfbc19caf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc106270 tx=0x7fbfac00eca0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 shutdown_connections 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbfa00b2900 0x7fbfa00b4e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfbc108040 0x7fbfbc1a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfbc106570 0x7fbfbc19caf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 --2- 172.21.15.47:0/2028652024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc1076a0 0x7fbfbc19d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 >> 172.21.15.47:0/2028652024 conn(0x7fbfbc101bd0 msgr2=0x7fbfbc10a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 shutdown_connections 2024-05-14T12:24:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:21.502+0000 7fbfc0e00700 1 -- 172.21.15.47:0/2028652024 wait complete. 2024-05-14T12:24:21.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: pgmap v425: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:21.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:21.889 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:21.889 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:21.889 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:21.889 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:24:21.889 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:24:21.889 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:21 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: pgmap v425: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:24:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:21 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: pgmap v425: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:24:22.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:24:22.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:21 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:24:22.299 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-14T12:24:22.308 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T12:24:22.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-14T12:24:22.813 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:22.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:22 smithi047 ceph-mon[31254]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:23.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:22 smithi073 ceph-mon[35809]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:23.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:22 smithi066 ceph-mon[35981]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T12:24:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:23 smithi047 ceph-mon[31254]: pgmap v426: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:23 smithi073 ceph-mon[35809]: pgmap v426: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:23 smithi066 ceph-mon[35981]: pgmap v426: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 -- 172.21.15.47:0/4190963329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c1075d0 msgr2=0x7f6f9c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 --2- 172.21.15.47:0/4190963329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c1075d0 0x7f6f9c1099f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009990 tx=0x7f6f88009ca0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 -- 172.21.15.47:0/4190963329 shutdown_connections 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 --2- 172.21.15.47:0/4190963329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f9c109f30 0x7f6f9c10c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 --2- 172.21.15.47:0/4190963329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f9c104c70 0x7f6f9c107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 --2- 172.21.15.47:0/4190963329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c1075d0 0x7f6f9c1099f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 -- 172.21.15.47:0/4190963329 >> 172.21.15.47:0/4190963329 conn(0x7f6f9c0fe6b0 msgr2=0x7f6f9c100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 -- 172.21.15.47:0/4190963329 shutdown_connections 2024-05-14T12:24:25.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.070+0000 7f6f9b200700 1 -- 172.21.15.47:0/4190963329 wait complete. 2024-05-14T12:24:25.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.071+0000 7f6f9b200700 1 Processor -- start 2024-05-14T12:24:25.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.071+0000 7f6f9b200700 1 -- start start 2024-05-14T12:24:25.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.071+0000 7f6f9b200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c104c70 0x7f6f9c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f9b200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f9c1075d0 0x7f6f9c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f9b200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f9c109f30 0x7f6f9c1a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f9b200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c10fbd0 con 0x7f6f9c104c70 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f9b200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c10fa50 con 0x7f6f9c109f30 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f9b200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c10fd50 con 0x7f6f9c1075d0 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f99e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c104c70 0x7f6f9c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f99e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c104c70 0x7f6f9c19c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47612/0 (socket says 172.21.15.47:47612) 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f99e00700 1 -- 172.21.15.47:0/1923134972 learned_addr learned my addr 172.21.15.47:0/1923134972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f99400700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f9c1075d0 0x7f6f9c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:25.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f9a800700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f9c109f30 0x7f6f9c1a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:25.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f99e00700 1 -- 172.21.15.47:0/1923134972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f9c1075d0 msgr2=0x7f6f9c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:25.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f99e00700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f9c1075d0 0x7f6f9c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.072+0000 7f6f99e00700 1 -- 172.21.15.47:0/1923134972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f9c109f30 msgr2=0x7f6f9c1a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.073+0000 7f6f99e00700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f9c109f30 0x7f6f9c1a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.073+0000 7f6f99e00700 1 -- 172.21.15.47:0/1923134972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c1a4470 con 0x7f6f9c104c70 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.073+0000 7f6f99e00700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c104c70 0x7f6f9c19c910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00e970 tx=0x7f6f8c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.073+0000 7f6f92a00700 1 -- 172.21.15.47:0/1923134972 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c004a30 con 0x7f6f9c104c70 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.073+0000 7f6f92a00700 1 -- 172.21.15.47:0/1923134972 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f8c00cc90 con 0x7f6f9c104c70 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.073+0000 7f6f92a00700 1 -- 172.21.15.47:0/1923134972 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c005610 con 0x7f6f9c104c70 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.073+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c1a4760 con 0x7f6f9c104c70 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.074+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c1a4c50 con 0x7f6f9c104c70 2024-05-14T12:24:25.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.075+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c0512c0 con 0x7f6f9c104c70 2024-05-14T12:24:25.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.077+0000 7f6f92a00700 1 -- 172.21.15.47:0/1923134972 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6f8c00c7e0 con 0x7f6f9c104c70 2024-05-14T12:24:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.079+0000 7f6f92a00700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6f800b2900 0x7f6f800b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.079+0000 7f6f92a00700 1 -- 172.21.15.47:0/1923134972 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6f8c0e2560 con 0x7f6f9c104c70 2024-05-14T12:24:25.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.079+0000 7f6f99400700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6f800b2900 0x7f6f800b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.080+0000 7f6f99400700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6f800b2900 0x7f6f800b4e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800b760 tx=0x7f6f8800b680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.081+0000 7f6f92a00700 1 -- 172.21.15.47:0/1923134972 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6f8c054df0 con 0x7f6f9c104c70 2024-05-14T12:24:25.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.368+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6f9c1a4f10 con 0x7f6f9c104c70 2024-05-14T12:24:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.369+0000 7f6f92a00700 1 -- 172.21.15.47:0/1923134972 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3082 (secure 0 0 0) 0x7f6f8c0aa240 con 0x7f6f9c104c70 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:e28 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 28 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-05-14T12:21:02.642705+0000 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-05-14T12:21:26.159710+0000 2024-05-14T12:24:25.372 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 300 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 0 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 5 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:in 0,1,2,3,4 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=24535,1=24521,2=24517,3=24502,4=24490} 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-05-14T12:24:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 0 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:qdb_cluster leader: 24535 members: 24490,24502,24517,24521,24535 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a{0:24535} state up:active seq 8 addr [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.h{0:24485} state up:standby-replay seq 1 addr [v2:172.21.15.66:6836/2588925145,v1:172.21.15.66:6837/2588925145] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b{1:24521} state up:active seq 11 addr [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d{1:24472} state up:standby-replay seq 1 addr [v2:172.21.15.47:6836/1559121259,v1:172.21.15.47:6837/1559121259] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.i{2:24517} state up:active seq 14 addr [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.e{2:24470} state up:standby-replay seq 1 addr [v2:172.21.15.66:6834/2635749889,v1:172.21.15.66:6835/2635749889] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.374 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c{3:24502} state up:active seq 16 addr [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.l{3:24451} state up:standby-replay seq 1 addr [v2:172.21.15.73:6832/1120434141,v1:172.21.15.73:6833/1120434141] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.f{4:24490} state up:active seq 17 addr [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.k{4:24440} state up:standby-replay seq 1 addr [v2:172.21.15.66:6832/3730098623,v1:172.21.15.66:6833/3730098623] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout:Standby daemons: 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.j{-1:14367} state up:standby seq 1 addr [v2:172.21.15.47:6834/683389749,v1:172.21.15.47:6835/683389749] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.375 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.g{-1:14400} state up:standby seq 1 addr [v2:172.21.15.47:6838/1063467558,v1:172.21.15.47:6839/1063467558] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T12:24:25.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.373+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6f800b2900 msgr2=0x7f6f800b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:25.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.373+0000 7f6f9b200700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6f800b2900 0x7f6f800b4e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800b760 tx=0x7f6f8800b680 comp rx=0 tx=0).stop 2024-05-14T12:24:25.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.373+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c104c70 msgr2=0x7f6f9c19c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:25.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.373+0000 7f6f9b200700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c104c70 0x7f6f9c19c910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00e970 tx=0x7f6f8c00ec80 comp rx=0 tx=0).stop 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 shutdown_connections 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6f800b2900 0x7f6f800b4e10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f9c109f30 0x7f6f9c1a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f9c104c70 0x7f6f9c19c910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 --2- 172.21.15.47:0/1923134972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f9c1075d0 0x7f6f9c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 >> 172.21.15.47:0/1923134972 conn(0x7f6f9c0fe6b0 msgr2=0x7f6f9c102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 shutdown_connections 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:25.374+0000 7f6f9b200700 1 -- 172.21.15.47:0/1923134972 wait complete. 2024-05-14T12:24:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-05-14T12:24:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:25 smithi047 ceph-mon[31254]: pgmap v427: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:25 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1923134972' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T12:24:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:25 smithi073 ceph-mon[35809]: pgmap v427: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:25 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1923134972' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T12:24:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:25 smithi066 ceph-mon[35981]: pgmap v427: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:25 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1923134972' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T12:24:26.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-14T12:24:26.692 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:27.982 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:27 smithi047 ceph-mon[31254]: pgmap v428: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:28.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:27 smithi073 ceph-mon[35809]: pgmap v428: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:27 smithi066 ceph-mon[35981]: pgmap v428: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.902+0000 7f879b200700 1 -- 172.21.15.47:0/3043247737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c1107c0 msgr2=0x7f879c112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.902+0000 7f879b200700 1 --2- 172.21.15.47:0/3043247737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c1107c0 0x7f879c112be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f879400b0d0 tx=0x7f879400b3e0 comp rx=0 tx=0).stop 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.902+0000 7f879b200700 1 -- 172.21.15.47:0/3043247737 shutdown_connections 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.902+0000 7f879b200700 1 --2- 172.21.15.47:0/3043247737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c1107c0 0x7f879c112be0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.902+0000 7f879b200700 1 --2- 172.21.15.47:0/3043247737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f879c0776e0 0x7f879c075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.902+0000 7f879b200700 1 --2- 172.21.15.47:0/3043247737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879c0760f0 0x7f879c076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.902+0000 7f879b200700 1 -- 172.21.15.47:0/3043247737 >> 172.21.15.47:0/3043247737 conn(0x7f879c0ff7b0 msgr2=0x7f879c101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.903+0000 7f879b200700 1 -- 172.21.15.47:0/3043247737 shutdown_connections 2024-05-14T12:24:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.903+0000 7f879b200700 1 -- 172.21.15.47:0/3043247737 wait complete. 2024-05-14T12:24:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.904+0000 7f879b200700 1 Processor -- start 2024-05-14T12:24:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.905+0000 7f879b200700 1 -- start start 2024-05-14T12:24:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.905+0000 7f879b200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c0760f0 0x7f879c1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.905+0000 7f879b200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879c0776e0 0x7f879c1a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.905+0000 7f879b200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f879c1107c0 0x7f879c1a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.905+0000 7f879b200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f879c1161e0 con 0x7f879c0776e0 2024-05-14T12:24:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.905+0000 7f879b200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f879c116060 con 0x7f879c1107c0 2024-05-14T12:24:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.905+0000 7f879b200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f879c116360 con 0x7f879c0760f0 2024-05-14T12:24:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f8799e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c0760f0 0x7f879c1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f8799e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c0760f0 0x7f879c1a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49546/0 (socket says 172.21.15.47:49546) 2024-05-14T12:24:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f8799400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879c0776e0 0x7f879c1a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f8799e00700 1 -- 172.21.15.47:0/3748444705 learned_addr learned my addr 172.21.15.47:0/3748444705 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f879a800700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f879c1107c0 0x7f879c1a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f879a800700 1 -- 172.21.15.47:0/3748444705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c0760f0 msgr2=0x7f879c1a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f879a800700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c0760f0 0x7f879c1a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f879a800700 1 -- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879c0776e0 msgr2=0x7f879c1a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f879a800700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879c0776e0 0x7f879c1a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.906+0000 7f879a800700 1 -- 172.21.15.47:0/3748444705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c1a88b0 con 0x7f879c1107c0 2024-05-14T12:24:28.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.907+0000 7f879a800700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f879c1107c0 0x7f879c1a81e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f879400b0d0 tx=0x7f8794007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.907+0000 7f8792a00700 1 -- 172.21.15.47:0/3748444705 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879401f070 con 0x7f879c1107c0 2024-05-14T12:24:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.907+0000 7f8792a00700 1 -- 172.21.15.47:0/3748444705 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8794004c50 con 0x7f879c1107c0 2024-05-14T12:24:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.907+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c1a8b40 con 0x7f879c1107c0 2024-05-14T12:24:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.907+0000 7f8792a00700 1 -- 172.21.15.47:0/3748444705 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879401b430 con 0x7f879c1107c0 2024-05-14T12:24:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.907+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c1a8ff0 con 0x7f879c1107c0 2024-05-14T12:24:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.909+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c02e5f0 con 0x7f879c1107c0 2024-05-14T12:24:28.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.911+0000 7f8792a00700 1 -- 172.21.15.47:0/3748444705 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8794022070 con 0x7f879c1107c0 2024-05-14T12:24:28.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.913+0000 7f8792a00700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f87800b2900 0x7f87800b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:28.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.913+0000 7f8792a00700 1 -- 172.21.15.47:0/3748444705 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f879400f020 con 0x7f879c1107c0 2024-05-14T12:24:28.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.913+0000 7f8799e00700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f87800b2900 0x7f87800b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:28.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.914+0000 7f8799e00700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f87800b2900 0x7f87800b4e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f879c1a2140 tx=0x7f878c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:28.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:28.915+0000 7f8792a00700 1 -- 172.21.15.47:0/3748444705 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8794029020 con 0x7f879c1107c0 2024-05-14T12:24:29.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.154+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f879c02e820 con 0x7f879c1107c0 2024-05-14T12:24:29.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.155+0000 7f8792a00700 1 -- 172.21.15.47:0/3748444705 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5287 (secure 0 0 0) 0x7f87940ab460 con 0x7f879c1107c0 2024-05-14T12:24:29.157 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 84 2024-05-14T12:24:29.157 INFO:teuthology.orchestra.run.smithi047.stdout:fsid e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:24:29.157 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-05-14T12:11:28.507275+0000 2024-05-14T12:24:29.157 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-05-14T12:21:39.488185+0000 2024-05-14T12:24:29.157 INFO:teuthology.orchestra.run.smithi047.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:crush_version 26 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:full_ratio 0.95 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:backfillfull_ratio 0.9 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:nearfull_ratio 0.85 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:require_min_compat_client luminous 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:min_compat_client luminous 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:require_osd_release squid 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:stretch_mode_enabled false 2024-05-14T12:24:29.158 INFO:teuthology.orchestra.run.smithi047.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:max_osd 12 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6802/2686634727,v1:172.21.15.47:6803/2686634727] [v2:172.21.15.47:6804/2686634727,v1:172.21.15.47:6805/2686634727] exists,up 93dfcb55-8853-4f03-845b-ba543a595731 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6800/3104926440,v1:172.21.15.66:6801/3104926440] [v2:172.21.15.66:6802/3104926440,v1:172.21.15.66:6803/3104926440] exists,up a5f87079-8c21-4289-bb99-2969ef95c1cb 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6800/4201489932,v1:172.21.15.73:6801/4201489932] [v2:172.21.15.73:6802/4201489932,v1:172.21.15.73:6803/4201489932] exists,up 1131b486-8220-4f69-85d2-b249ded3392f 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 up in weight 1 up_from 26 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6810/2176301728,v1:172.21.15.47:6811/2176301728] [v2:172.21.15.47:6812/2176301728,v1:172.21.15.47:6813/2176301728] exists,up 0cdbf6ec-880b-4a04-9411-baf21e5daf0b 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6808/1977323226,v1:172.21.15.66:6809/1977323226] [v2:172.21.15.66:6810/1977323226,v1:172.21.15.66:6811/1977323226] exists,up c6a73cfc-0b02-4d92-b2c0-7d5289970c22 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 up in weight 1 up_from 38 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6808/3780521249,v1:172.21.15.73:6809/3780521249] [v2:172.21.15.73:6810/3780521249,v1:172.21.15.73:6811/3780521249] exists,up 73764d93-e78d-4398-a314-f5d3fafdbb3b 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 up in weight 1 up_from 44 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6818/1409128354,v1:172.21.15.47:6819/1409128354] [v2:172.21.15.47:6820/1409128354,v1:172.21.15.47:6821/1409128354] exists,up 589bf07a-e38e-486f-b8b7-4beeb4f937dd 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 up in weight 1 up_from 50 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6816/1666910569,v1:172.21.15.66:6817/1666910569] [v2:172.21.15.66:6818/1666910569,v1:172.21.15.66:6819/1666910569] exists,up 3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41 2024-05-14T12:24:29.159 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 up in weight 1 up_from 57 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6816/1194835774,v1:172.21.15.73:6817/1194835774] [v2:172.21.15.73:6818/1194835774,v1:172.21.15.73:6819/1194835774] exists,up 8df95850-ff70-4fb9-a2c4-bcd51a5e3762 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 up in weight 1 up_from 63 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6826/3151826793,v1:172.21.15.47:6827/3151826793] [v2:172.21.15.47:6828/3151826793,v1:172.21.15.47:6829/3151826793] exists,up be5d9c5f-765b-43b6-a77c-8976ed5a443e 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 up in weight 1 up_from 68 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6824/609811860,v1:172.21.15.66:6825/609811860] [v2:172.21.15.66:6826/609811860,v1:172.21.15.66:6827/609811860] exists,up 248e33b6-d8dd-49ac-9ec5-f9b0741b49b2 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 up in weight 1 up_from 74 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6824/4073821208,v1:172.21.15.73:6825/4073821208] [v2:172.21.15.73:6826/4073821208,v1:172.21.15.73:6827/4073821208] exists,up f80cffd5-cb0c-46c4-9cc3-704730531566 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.b [2,4] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.f [8,11] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.1a [8,1] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.1b [5,11] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.1d [2,4] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.10 [5,9] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.24 [4,9] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.38 [3,9] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.3a [4,8] 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/3791767528 expires 2024-05-15T12:12:38.074846+0000 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/545134280 expires 2024-05-15T12:12:38.074846+0000 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3930862505 expires 2024-05-15T12:12:38.074846+0000 2024-05-14T12:24:29.160 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/3184141127 expires 2024-05-15T12:12:02.805930+0000 2024-05-14T12:24:29.161 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/3184141127 expires 2024-05-15T12:12:02.805930+0000 2024-05-14T12:24:29.161 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/3791767528 expires 2024-05-15T12:12:38.074846+0000 2024-05-14T12:24:29.161 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2164606567 expires 2024-05-15T12:12:02.805930+0000 2024-05-14T12:24:29.161 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2624675860 expires 2024-05-15T12:12:02.805930+0000 2024-05-14T12:24:29.161 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2731663046 expires 2024-05-15T12:12:02.805930+0000 2024-05-14T12:24:29.161 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3380467049 expires 2024-05-15T12:12:38.074846+0000 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f87800b2900 msgr2=0x7f87800b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f87800b2900 0x7f87800b4e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f879c1a2140 tx=0x7f878c009260 comp rx=0 tx=0).stop 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f879c1107c0 msgr2=0x7f879c1a81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f879c1107c0 0x7f879c1a81e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f879400b0d0 tx=0x7f8794007a00 comp rx=0 tx=0).stop 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 shutdown_connections 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f87800b2900 0x7f87800b4e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f879c1107c0 0x7f879c1a81e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f879c0760f0 0x7f879c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 --2- 172.21.15.47:0/3748444705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f879c0776e0 0x7f879c1a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:29.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 >> 172.21.15.47:0/3748444705 conn(0x7f879c0ff7b0 msgr2=0x7f879c103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 shutdown_connections 2024-05-14T12:24:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:29.159+0000 7f879b200700 1 -- 172.21.15.47:0/3748444705 wait complete. 2024-05-14T12:24:29.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:29 smithi047 ceph-mon[31254]: pgmap v429: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:29.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:29 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3748444705' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T12:24:29.984 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-14T12:24:29.995 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:24:30.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:29 smithi073 ceph-mon[35809]: pgmap v429: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:30.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:29 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3748444705' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T12:24:30.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:29 smithi066 ceph-mon[35981]: pgmap v429: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:30.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:29 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3748444705' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T12:24:30.473 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:31.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:31 smithi047 ceph-mon[31254]: pgmap v430: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:31 smithi073 ceph-mon[35809]: pgmap v430: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:31 smithi066 ceph-mon[35981]: pgmap v430: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.697+0000 7f558cc00700 1 -- 172.21.15.47:0/1149102801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 msgr2=0x7f5588110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.697+0000 7f558cc00700 1 --2- 172.21.15.47:0/1149102801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 0x7f5588110470 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5570009f90 tx=0x7f557000b330 comp rx=0 tx=0).stop 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.697+0000 7f558cc00700 1 -- 172.21.15.47:0/1149102801 shutdown_connections 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.697+0000 7f558cc00700 1 --2- 172.21.15.47:0/1149102801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55881109b0 0x7f5588112e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.697+0000 7f558cc00700 1 --2- 172.21.15.47:0/1149102801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5588075d30 0x7f5588076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.697+0000 7f558cc00700 1 --2- 172.21.15.47:0/1149102801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 0x7f5588110470 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.697+0000 7f558cc00700 1 -- 172.21.15.47:0/1149102801 >> 172.21.15.47:0/1149102801 conn(0x7f5588079d10 msgr2=0x7f558807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.698+0000 7f558cc00700 1 -- 172.21.15.47:0/1149102801 shutdown_connections 2024-05-14T12:24:32.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.698+0000 7f558cc00700 1 -- 172.21.15.47:0/1149102801 wait complete. 2024-05-14T12:24:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.699+0000 7f558cc00700 1 Processor -- start 2024-05-14T12:24:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.699+0000 7f558cc00700 1 -- start start 2024-05-14T12:24:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f558cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5588075d30 0x7f558819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f558cc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 0x7f558819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f558cc00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55881109b0 0x7f55881a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:32.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f558cc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5588116500 con 0x7f5588075d30 2024-05-14T12:24:32.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f558cc00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5588116380 con 0x7f5588076680 2024-05-14T12:24:32.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f558cc00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5588116680 con 0x7f55881109b0 2024-05-14T12:24:32.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f5587400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5588075d30 0x7f558819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:32.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f5587400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5588075d30 0x7f558819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41356/0 (socket says 172.21.15.47:41356) 2024-05-14T12:24:32.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f5587400700 1 -- 172.21.15.47:0/1302117346 learned_addr learned my addr 172.21.15.47:0/1302117346 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:32.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f557ea00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 0x7f558819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:32.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f5587e00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55881109b0 0x7f55881a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:32.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f557ea00700 1 -- 172.21.15.47:0/1302117346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55881109b0 msgr2=0x7f55881a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:32.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f557ea00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55881109b0 0x7f55881a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f557ea00700 1 -- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5588075d30 msgr2=0x7f558819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f557ea00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5588075d30 0x7f558819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.700+0000 7f557ea00700 1 -- 172.21.15.47:0/1302117346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55881a1d40 con 0x7f5588076680 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.701+0000 7f557ea00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 0x7f558819d410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5570000f80 tx=0x7f557000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.701+0000 7f5584c00700 1 -- 172.21.15.47:0/1302117346 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570021070 con 0x7f5588076680 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.701+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55881a1fd0 con 0x7f5588076680 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.701+0000 7f5584c00700 1 -- 172.21.15.47:0/1302117346 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5570007ac0 con 0x7f5588076680 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.701+0000 7f5584c00700 1 -- 172.21.15.47:0/1302117346 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570005040 con 0x7f5588076680 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.701+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55881a9950 con 0x7f5588076680 2024-05-14T12:24:32.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.703+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55880512c0 con 0x7f5588076680 2024-05-14T12:24:32.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.705+0000 7f5584c00700 1 -- 172.21.15.47:0/1302117346 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5570024070 con 0x7f5588076680 2024-05-14T12:24:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.706+0000 7f5584c00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f556c0b2880 0x7f556c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.707+0000 7f5584c00700 1 -- 172.21.15.47:0/1302117346 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f557000f020 con 0x7f5588076680 2024-05-14T12:24:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.707+0000 7f5587400700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f556c0b2880 0x7f556c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.707+0000 7f5587400700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f556c0b2880 0x7f556c0b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5578005950 tx=0x7f5578009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:32.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:32.711+0000 7f5584c00700 1 -- 172.21.15.47:0/1302117346 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f557002b020 con 0x7f5588076680 2024-05-14T12:24:33.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.006+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f558819e1d0 con 0x7f5588076680 2024-05-14T12:24:33.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.008+0000 7f5584c00700 1 -- 172.21.15.47:0/1302117346 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11919 (secure 0 0 0) 0x7f55700ab2c0 con 0x7f5588076680 2024-05-14T12:24:33.008 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:24:33.008 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:21:26.159710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:24:33.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.011+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f556c0b2880 msgr2=0x7f556c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.011+0000 7f558cc00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f556c0b2880 0x7f556c0b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5578005950 tx=0x7f5578009310 comp rx=0 tx=0).stop 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.011+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 msgr2=0x7f558819d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.011+0000 7f558cc00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 0x7f558819d410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5570000f80 tx=0x7f557000ccb0 comp rx=0 tx=0).stop 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 shutdown_connections 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f556c0b2880 0x7f556c0b4d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55881109b0 0x7f55881a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5588075d30 0x7f558819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 --2- 172.21.15.47:0/1302117346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5588076680 0x7f558819d410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 >> 172.21.15.47:0/1302117346 conn(0x7f5588079d10 msgr2=0x7f5588100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 shutdown_connections 2024-05-14T12:24:33.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:33.012+0000 7f558cc00700 1 -- 172.21.15.47:0/1302117346 wait complete. 2024-05-14T12:24:33.013 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-05-14T12:24:33.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:24:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:33 smithi047 ceph-mon[31254]: pgmap v431: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:33 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1302117346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:24:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:33 smithi073 ceph-mon[35809]: pgmap v431: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:33 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1302117346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:24:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:33 smithi066 ceph-mon[35981]: pgmap v431: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:33 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1302117346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:24:34.288 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:35.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:35 smithi047 ceph-mon[31254]: pgmap v432: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:35 smithi073 ceph-mon[35809]: pgmap v432: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:35 smithi066 ceph-mon[35981]: pgmap v432: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.478+0000 7f338ca00700 1 -- 172.21.15.47:0/2820410838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3388109850 msgr2=0x7f33881111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.478+0000 7f338ca00700 1 --2- 172.21.15.47:0/2820410838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3388109850 0x7f33881111b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f338000b0d0 tx=0x7f338000b3e0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.478+0000 7f338ca00700 1 -- 172.21.15.47:0/2820410838 shutdown_connections 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.478+0000 7f338ca00700 1 --2- 172.21.15.47:0/2820410838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3388109850 0x7f33881111b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.478+0000 7f338ca00700 1 --2- 172.21.15.47:0/2820410838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33881045d0 0x7f33881049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.478+0000 7f338ca00700 1 --2- 172.21.15.47:0/2820410838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3388108f00 0x7f3388109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.478+0000 7f338ca00700 1 -- 172.21.15.47:0/2820410838 >> 172.21.15.47:0/2820410838 conn(0x7f33880ffea0 msgr2=0x7f33881022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:36.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.479+0000 7f338ca00700 1 -- 172.21.15.47:0/2820410838 shutdown_connections 2024-05-14T12:24:36.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.479+0000 7f338ca00700 1 -- 172.21.15.47:0/2820410838 wait complete. 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.480+0000 7f338ca00700 1 Processor -- start 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.480+0000 7f338ca00700 1 -- start start 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.480+0000 7f338ca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33881045d0 0x7f338819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.480+0000 7f338ca00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3388108f00 0x7f338819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f338ca00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3388109850 0x7f33881a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f338ca00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3388114480 con 0x7f33881045d0 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f338ca00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3388114300 con 0x7f3388109850 2024-05-14T12:24:36.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f338ca00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3388114600 con 0x7f3388108f00 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3385e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33881045d0 0x7f338819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3385e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33881045d0 0x7f338819cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41372/0 (socket says 172.21.15.47:41372) 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3385e00700 1 -- 172.21.15.47:0/3559873172 learned_addr learned my addr 172.21.15.47:0/3559873172 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3386800700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3388109850 0x7f33881a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3385400700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3388108f00 0x7f338819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3386800700 1 -- 172.21.15.47:0/3559873172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3388108f00 msgr2=0x7f338819d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3386800700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3388108f00 0x7f338819d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3386800700 1 -- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33881045d0 msgr2=0x7f338819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3386800700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33881045d0 0x7f338819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.481+0000 7f3386800700 1 -- 172.21.15.47:0/3559873172 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33881a1e60 con 0x7f3388109850 2024-05-14T12:24:36.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.482+0000 7f3386800700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3388109850 0x7f33881a17c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f338000b0d0 tx=0x7f3380007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:36.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.482+0000 7f337ea00700 1 -- 172.21.15.47:0/3559873172 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338001f070 con 0x7f3388109850 2024-05-14T12:24:36.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.482+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33881a20f0 con 0x7f3388109850 2024-05-14T12:24:36.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.482+0000 7f337ea00700 1 -- 172.21.15.47:0/3559873172 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3380004c50 con 0x7f3388109850 2024-05-14T12:24:36.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.482+0000 7f337ea00700 1 -- 172.21.15.47:0/3559873172 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338001b690 con 0x7f3388109850 2024-05-14T12:24:36.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.482+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33881a25d0 con 0x7f3388109850 2024-05-14T12:24:36.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.484+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33880512c0 con 0x7f3388109850 2024-05-14T12:24:36.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.486+0000 7f337ea00700 1 -- 172.21.15.47:0/3559873172 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3380022070 con 0x7f3388109850 2024-05-14T12:24:36.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.487+0000 7f337ea00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f336c0b2880 0x7f336c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:36.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.488+0000 7f337ea00700 1 -- 172.21.15.47:0/3559873172 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f338000f020 con 0x7f3388109850 2024-05-14T12:24:36.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.488+0000 7f3385e00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f336c0b2880 0x7f336c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:36.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.488+0000 7f3385e00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f336c0b2880 0x7f336c0b4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3378009d20 tx=0x7f3378009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:36.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.493+0000 7f337ea00700 1 -- 172.21.15.47:0/3559873172 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3380029020 con 0x7f3388109850 2024-05-14T12:24:36.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.781+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33881a9a70 con 0x7f3388109850 2024-05-14T12:24:36.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.782+0000 7f337ea00700 1 -- 172.21.15.47:0/3559873172 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11919 (secure 0 0 0) 0x7f33800aafa0 con 0x7f3388109850 2024-05-14T12:24:36.782 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:24:36.782 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:21:26.159710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:24:36.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.785+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f336c0b2880 msgr2=0x7f336c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:36.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.785+0000 7f338ca00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f336c0b2880 0x7f336c0b4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3378009d20 tx=0x7f3378009260 comp rx=0 tx=0).stop 2024-05-14T12:24:36.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.785+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3388109850 msgr2=0x7f33881a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.785+0000 7f338ca00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3388109850 0x7f33881a17c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f338000b0d0 tx=0x7f3380007a00 comp rx=0 tx=0).stop 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.785+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 shutdown_connections 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.786+0000 7f338ca00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f336c0b2880 0x7f336c0b4d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.786+0000 7f338ca00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3388109850 0x7f33881a17c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.786+0000 7f338ca00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33881045d0 0x7f338819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.786+0000 7f338ca00700 1 --2- 172.21.15.47:0/3559873172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3388108f00 0x7f338819d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.786+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 >> 172.21.15.47:0/3559873172 conn(0x7f33880ffea0 msgr2=0x7f338810a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.786+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 shutdown_connections 2024-05-14T12:24:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:36.786+0000 7f338ca00700 1 -- 172.21.15.47:0/3559873172 wait complete. 2024-05-14T12:24:36.787 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-05-14T12:24:37.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:24:37.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:37 smithi047 ceph-mon[31254]: pgmap v433: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:37.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:37 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3559873172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:24:38.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:37 smithi073 ceph-mon[35809]: pgmap v433: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:38.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:37 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3559873172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:24:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:37 smithi066 ceph-mon[35981]: pgmap v433: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:37 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3559873172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:24:38.130 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:39.948 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:39 smithi047 ceph-mon[31254]: pgmap v434: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:39 smithi073 ceph-mon[35809]: pgmap v434: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:39 smithi066 ceph-mon[35981]: pgmap v434: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 -- 172.21.15.47:0/851260310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe6810af50 msgr2=0x7fbe6810b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/851260310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe6810af50 0x7fbe6810b360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbe540099c0 tx=0x7fbe54009cd0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 -- 172.21.15.47:0/851260310 shutdown_connections 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/851260310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe6810b8a0 0x7fbe68113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/851260310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe68106620 0x7fbe68106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/851260310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe6810af50 0x7fbe6810b360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 -- 172.21.15.47:0/851260310 >> 172.21.15.47:0/851260310 conn(0x7fbe68102030 msgr2=0x7fbe68104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 -- 172.21.15.47:0/851260310 shutdown_connections 2024-05-14T12:24:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.366+0000 7fbe6ea00700 1 -- 172.21.15.47:0/851260310 wait complete. 2024-05-14T12:24:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.367+0000 7fbe6ea00700 1 Processor -- start 2024-05-14T12:24:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6ea00700 1 -- start start 2024-05-14T12:24:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106620 0x7fbe6819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe6810af50 0x7fbe6819d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe6810b8a0 0x7fbe681a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6ea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68116500 con 0x7fbe68106620 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6ea00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68116380 con 0x7fbe6810b8a0 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6ea00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68116680 con 0x7fbe6810af50 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106620 0x7fbe6819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106620 0x7fbe6819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33788/0 (socket says 172.21.15.47:33788) 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.368+0000 7fbe6d600700 1 -- 172.21.15.47:0/2787827253 learned_addr learned my addr 172.21.15.47:0/2787827253 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6cc00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe6810af50 0x7fbe6819d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6e000700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe6810b8a0 0x7fbe681a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6cc00700 1 -- 172.21.15.47:0/2787827253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe6810b8a0 msgr2=0x7fbe681a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6cc00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe6810b8a0 0x7fbe681a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6cc00700 1 -- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106620 msgr2=0x7fbe6819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6cc00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106620 0x7fbe6819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6cc00700 1 -- 172.21.15.47:0/2787827253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe681a1d80 con 0x7fbe6810af50 2024-05-14T12:24:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.369+0000 7fbe6cc00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe6810af50 0x7fbe6819d450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe540098e0 tx=0x7fbe54005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.370+0000 7fbe66000700 1 -- 172.21.15.47:0/2787827253 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54026070 con 0x7fbe6810af50 2024-05-14T12:24:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.370+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe681a2010 con 0x7fbe6810af50 2024-05-14T12:24:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.370+0000 7fbe66000700 1 -- 172.21.15.47:0/2787827253 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe540056c0 con 0x7fbe6810af50 2024-05-14T12:24:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.370+0000 7fbe66000700 1 -- 172.21.15.47:0/2787827253 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400f960 con 0x7fbe6810af50 2024-05-14T12:24:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.370+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe681a24f0 con 0x7fbe6810af50 2024-05-14T12:24:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.371+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe680512c0 con 0x7fbe6810af50 2024-05-14T12:24:40.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.374+0000 7fbe66000700 1 -- 172.21.15.47:0/2787827253 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbe54029070 con 0x7fbe6810af50 2024-05-14T12:24:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.375+0000 7fbe66000700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe500b2880 0x7fbe500b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.376+0000 7fbe66000700 1 -- 172.21.15.47:0/2787827253 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbe540e2e80 con 0x7fbe6810af50 2024-05-14T12:24:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.376+0000 7fbe6d600700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe500b2880 0x7fbe500b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.376+0000 7fbe6d600700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe500b2880 0x7fbe500b4d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009d20 tx=0x7fbe5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.378+0000 7fbe66000700 1 -- 172.21.15.47:0/2787827253 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbe54030080 con 0x7fbe6810af50 2024-05-14T12:24:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.622+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe6802e5f0 con 0x7fbe6810af50 2024-05-14T12:24:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.624+0000 7fbe66000700 1 -- 172.21.15.47:0/2787827253 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7fbe54013070 con 0x7fbe6810af50 2024-05-14T12:24:40.625 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:24:40.625 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:24:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe500b2880 msgr2=0x7fbe500b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe500b2880 0x7fbe500b4d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009d20 tx=0x7fbe5c009260 comp rx=0 tx=0).stop 2024-05-14T12:24:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe6810af50 msgr2=0x7fbe6819d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe6810af50 0x7fbe6819d450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe540098e0 tx=0x7fbe54005280 comp rx=0 tx=0).stop 2024-05-14T12:24:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 shutdown_connections 2024-05-14T12:24:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe500b2880 0x7fbe500b4d90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe6810b8a0 0x7fbe681a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe68106620 0x7fbe6819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 --2- 172.21.15.47:0/2787827253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe6810af50 0x7fbe6819d450 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 >> 172.21.15.47:0/2787827253 conn(0x7fbe68102030 msgr2=0x7fbe6810a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.628+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 shutdown_connections 2024-05-14T12:24:40.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:40.629+0000 7fbe6ea00700 1 -- 172.21.15.47:0/2787827253 wait complete. 2024-05-14T12:24:40.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:40 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2787827253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:24:41.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:40 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2787827253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:24:41.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:40 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2787827253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:24:41.432 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-14T12:21:02.642705+0000', 'modified': '2024-05-14T12:21:26.159710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24535, 'mds_1': 24521, 'mds_2': 24517, 'mds_3': 24502, 'mds_4': 24490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6833/3730098623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 3730098623}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 3730098623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6833/1120434141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 1120434141}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 1120434141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/2635749889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 2635749889}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 2635749889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'd', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.47:6837/1559121259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6836', 'nonce': 1559121259}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 1559121259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6837/2588925145', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 2588925145}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 2588925145}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.73:6835/263909949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 263909949}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 263909949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.73:6837/3629841248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3629841248}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3629841248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.73:6839/2008561705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 2008561705}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 2008561705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.66:6839/2700854370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2700854370}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2700854370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24535': {'gid': 24535, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.47:6841/3387131427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6840', 'nonce': 3387131427}, {'type': 'v1', 'addr': '172.21.15.47:6841', 'nonce': 3387131427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24535, 'qdb_cluster': [24490, 24502, 24517, 24521, 24535]} 2024-05-14T12:24:41.432 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-14T12:24:41.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.f status 2024-05-14T12:24:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:41.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:41 smithi047 ceph-mon[31254]: pgmap v435: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:42.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:41 smithi073 ceph-mon[35809]: pgmap v435: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:42.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:41 smithi066 ceph-mon[35981]: pgmap v435: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:43.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:43 smithi047 ceph-mon[31254]: pgmap v436: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:44.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:43 smithi073 ceph-mon[35809]: pgmap v436: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:43 smithi066 ceph-mon[35981]: pgmap v436: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:24:44.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 -- 172.21.15.47:0/2978784488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 msgr2=0x7fd300110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 --2- 172.21.15.47:0/2978784488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 0x7fd300110be0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009f90 tx=0x7fd2f800b330 comp rx=0 tx=0).stop 2024-05-14T12:24:44.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 -- 172.21.15.47:0/2978784488 shutdown_connections 2024-05-14T12:24:44.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 --2- 172.21.15.47:0/2978784488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 0x7fd300110be0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 --2- 172.21.15.47:0/2978784488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd300105290 0x7fd3001056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 --2- 172.21.15.47:0/2978784488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105be0 0x7fd30010e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 -- 172.21.15.47:0/2978784488 >> 172.21.15.47:0/2978784488 conn(0x7fd300078ac0 msgr2=0x7fd300078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.107+0000 7fd306a00700 1 -- 172.21.15.47:0/2978784488 shutdown_connections 2024-05-14T12:24:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.108+0000 7fd306a00700 1 -- 172.21.15.47:0/2978784488 wait complete. 2024-05-14T12:24:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.109+0000 7fd306a00700 1 Processor -- start 2024-05-14T12:24:44.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.109+0000 7fd306a00700 1 -- start start 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd306a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105290 0x7fd30019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd306a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd300105be0 0x7fd30019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd306a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 0x7fd3001a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd306a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd3001142b0 con 0x7fd300105290 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd306a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd300114130 con 0x7fd300105be0 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd306a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd300114430 con 0x7fd30010e700 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd305600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105290 0x7fd30019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd305600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105290 0x7fd30019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33806/0 (socket says 172.21.15.47:33806) 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd305600700 1 -- 172.21.15.47:0/3158362731 learned_addr learned my addr 172.21.15.47:0/3158362731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd304c00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd300105be0 0x7fd30019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.110+0000 7fd306000700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 0x7fd3001a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd305600700 1 -- 172.21.15.47:0/3158362731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 msgr2=0x7fd3001a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd305600700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 0x7fd3001a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd305600700 1 -- 172.21.15.47:0/3158362731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd300105be0 msgr2=0x7fd30019d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd305600700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd300105be0 0x7fd30019d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd305600700 1 -- 172.21.15.47:0/3158362731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3001a1cb0 con 0x7fd300105290 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd305600700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105290 0x7fd30019cde0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400e9a0 tx=0x7fd2f400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd2fe000700 1 -- 172.21.15.47:0/3158362731 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400c9c0 con 0x7fd300105290 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd2fe000700 1 -- 172.21.15.47:0/3158362731 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f400cb60 con 0x7fd300105290 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3001a1fa0 con 0x7fd300105290 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.111+0000 7fd2fe000700 1 -- 172.21.15.47:0/3158362731 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4018680 con 0x7fd300105290 2024-05-14T12:24:44.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.112+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001a98c0 con 0x7fd300105290 2024-05-14T12:24:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.116+0000 7fd2fe000700 1 -- 172.21.15.47:0/3158362731 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd2f4010430 con 0x7fd300105290 2024-05-14T12:24:44.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 Processor -- start 2024-05-14T12:24:44.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 -- start start 2024-05-14T12:24:44.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbdd05df0 0x55cbbde894f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde84000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbbdda59d0 con 0x55cbbde83bf0 2024-05-14T12:24:44.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cbbdd43710 con 0x55cbbdd05df0 2024-05-14T12:24:44.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cbbdda1990 con 0x55cbbde89a30 2024-05-14T12:24:44.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.118+0000 7fd2fe000700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2e80b2880 0x7fd2e80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd305600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd306000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbdd05df0 0x55cbbde894f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd305600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde836b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49808/0 (socket says 172.21.15.47:49808) 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd305600700 1 -- 172.21.15.47:0/606322757 learned_addr learned my addr 172.21.15.47:0/606322757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd306000700 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde84000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd304c00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2e80b2880 0x7fd2e80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd2fe000700 1 -- 172.21.15.47:0/3158362731 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd2f40e24e0 con 0x7fd300105290 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd306000700 1 -- 172.21.15.47:0/606322757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 msgr2=0x55cbbde836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd306000700 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde836b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd306000700 1 -- 172.21.15.47:0/606322757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 msgr2=0x55cbbde84000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd306000700 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde84000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.119+0000 7fd306000700 1 -- 172.21.15.47:0/606322757 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbbdcf2880 con 0x55cbbdd05df0 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.120+0000 7fd306000700 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbdd05df0 0x55cbbde894f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009790 tx=0x7fd2f8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442028cd262dfebc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.120+0000 7fd304c00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2e80b2880 0x7fd2e80b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd300104530 tx=0x7fd2ec009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.120+0000 7fd2f2a00700 1 -- 172.21.15.47:0/606322757 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8003c00 con 0x55cbbdd05df0 2024-05-14T12:24:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.120+0000 7fd2f2a00700 1 -- 172.21.15.47:0/606322757 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f8007500 con 0x55cbbdd05df0 2024-05-14T12:24:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.120+0000 7fd2f2a00700 1 -- 172.21.15.47:0/606322757 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f801e6c0 con 0x55cbbdd05df0 2024-05-14T12:24:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 -- 172.21.15.47:0/606322757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbdd05df0 msgr2=0x55cbbde894f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbdd05df0 0x55cbbde894f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009790 tx=0x7fd2f8009920 comp rx=0 tx=0).stop 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 -- 172.21.15.47:0/606322757 shutdown_connections 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde84000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbdd05df0 0x55cbbde894f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/606322757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 -- 172.21.15.47:0/606322757 >> 172.21.15.47:0/606322757 conn(0x55cbbdd4af20 msgr2=0x55cbbde7e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 -- 172.21.15.47:0/606322757 shutdown_connections 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.121+0000 7fd316bf5b80 1 -- 172.21.15.47:0/606322757 wait complete. 2024-05-14T12:24:44.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.122+0000 7fd316bf5b80 1 -- start start 2024-05-14T12:24:44.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.122+0000 7fd316bf5b80 1 Processor -- start 2024-05-14T12:24:44.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde8d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde83bf0 0x55cbbde8d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde8dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde90440 con 0x55cbbdd05df0 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cbbdd0bad0 con 0x55cbbde83bf0 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde905c0 con 0x55cbbde89a30 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd316bf5b80 10 client.0 _ll_register_callbacks cb 0x55cbbdd4cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd306000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde8dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd305600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde8d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd306000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde8dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49824/0 (socket says 172.21.15.47:49824) 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.123+0000 7fd306000700 1 -- 172.21.15.47:0/766045940 learned_addr learned my addr 172.21.15.47:0/766045940 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd304c00700 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde83bf0 0x55cbbde8d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd306000700 1 -- 172.21.15.47:0/766045940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde83bf0 msgr2=0x55cbbde8d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd306000700 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde83bf0 0x55cbbde8d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd306000700 1 -- 172.21.15.47:0/766045940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 msgr2=0x55cbbde8d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd306000700 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde8d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd306000700 1 -- 172.21.15.47:0/766045940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbbdd6b3d0 con 0x55cbbde89a30 2024-05-14T12:24:44.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd306000700 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde8dc30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8007f20 tx=0x7fd2f800bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4d69867761553 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:44.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd2e7400700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:24:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.124+0000 7fd2e7400700 1 -- 172.21.15.47:0/766045940 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8007ac0 con 0x55cbbde89a30 2024-05-14T12:24:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2f8007500 con 0x55cbbde89a30 2024-05-14T12:24:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd2e7400700 1 -- 172.21.15.47:0/766045940 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd2f8004040 con 0x55cbbde89a30 2024-05-14T12:24:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd2e7400700 1 -- 172.21.15.47:0/766045940 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2f8007c60 con 0x55cbbde89a30 2024-05-14T12:24:44.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd316bf5b80 10 client.25042 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cbbde90440 con 0x55cbbde89a30 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd2e7400700 1 -- 172.21.15.47:0/766045940 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f8007500 con 0x55cbbde89a30 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd2e7400700 1 -- 172.21.15.47:0/766045940 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd2f8033050 con 0x55cbbde89a30 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.125+0000 7fd316bf5b80 10 client.25042 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd316bf5b80 10 client.25042 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd316bf5b80 20 client.25042 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbde9d170 0x55cbbde9e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd316bf5b80 4 client.25042 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbbde50170 con 0x55cbbde9d170 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd305600700 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbde9d170 0x55cbbde9e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd305600700 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbde9d170 0x55cbbde9e5e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b3df8e2ae461df20 server_cookie=64fb74765d49bbef in_seq=0 out_seq=0 2024-05-14T12:24:44.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.126+0000 7fd2e7400700 10 client.25042 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:24:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.127+0000 7fd2e7400700 1 -- 172.21.15.47:0/766045940 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cbbde50170 con 0x55cbbde9d170 2024-05-14T12:24:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.127+0000 7fd2e7400700 10 client.25042 handle_command_reply: tid=0 2024-05-14T12:24:44.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.127+0000 7fd316bf5b80 1 client.25042 shutdown 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 msgr2=0x55cbbde8dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde8dc30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8007f20 tx=0x7fd2f800bc20 comp rx=0 tx=0).stop 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 shutdown_connections 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbde9d170 0x55cbbde9e5e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde89a30 0x55cbbde8dc30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde8d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/766045940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde83bf0 0x55cbbde8d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd2e7400700 0 client.25042 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 >> 172.21.15.47:0/766045940 conn(0x55cbbdd4af20 msgr2=0x55cbbde826a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 shutdown_connections 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 1 -- 172.21.15.47:0/766045940 wait complete. 2024-05-14T12:24:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.128+0000 7fd316bf5b80 20 client.25042 trim_cache size 0 max 16384 2024-05-14T12:24:44.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.151+0000 7fd316bf5b80 1 Processor -- start 2024-05-14T12:24:44.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.151+0000 7fd316bf5b80 1 -- start start 2024-05-14T12:24:44.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde83bf0 0x55cbbde99860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde87540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde9c920 con 0x55cbbdd05df0 2024-05-14T12:24:44.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde9cff0 con 0x55cbbde89a30 2024-05-14T12:24:44.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde9d6c0 con 0x55cbbde83bf0 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd304c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde83bf0 0x55cbbde99860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd306000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde87540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd304c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde83bf0 0x55cbbde99860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49826/0 (socket says 172.21.15.47:49826) 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd304c00700 1 -- 172.21.15.47:0/3547301754 learned_addr learned my addr 172.21.15.47:0/3547301754 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd305600700 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.152+0000 7fd306000700 1 -- 172.21.15.47:0/3547301754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde83bf0 msgr2=0x55cbbde99860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd306000700 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde83bf0 0x55cbbde99860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd306000700 1 -- 172.21.15.47:0/3547301754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 msgr2=0x55cbbde836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd306000700 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde836b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd306000700 1 -- 172.21.15.47:0/3547301754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbbde7abf0 con 0x55cbbde89a30 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd305600700 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd304c00700 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde83bf0 0x55cbbde99860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd306000700 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde87540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800b370 tx=0x7fd2f8009b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2de4c50854f50055 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd2f2000700 1 -- 172.21.15.47:0/3547301754 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800b680 con 0x55cbbde89a30 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd2f2000700 1 -- 172.21.15.47:0/3547301754 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f80078c0 con 0x55cbbde89a30 2024-05-14T12:24:44.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.153+0000 7fd2f2000700 1 -- 172.21.15.47:0/3547301754 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8020450 con 0x55cbbde89a30 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 -- 172.21.15.47:0/3547301754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 msgr2=0x55cbbde87540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde87540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800b370 tx=0x7fd2f8009b40 comp rx=0 tx=0).stop 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 -- 172.21.15.47:0/3547301754 shutdown_connections 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde87540 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbdd05df0 0x55cbbde836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/3547301754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbde83bf0 0x55cbbde99860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 -- 172.21.15.47:0/3547301754 >> 172.21.15.47:0/3547301754 conn(0x55cbbdd4af20 msgr2=0x55cbbde86e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 -- 172.21.15.47:0/3547301754 shutdown_connections 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.154+0000 7fd316bf5b80 1 -- 172.21.15.47:0/3547301754 wait complete. 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.155+0000 7fd316bf5b80 1 -- start start 2024-05-14T12:24:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.155+0000 7fd316bf5b80 1 Processor -- start 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbdd05df0 0x55cbbde989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde98f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd316bf5b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde99450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde9e460 con 0x55cbbde83bf0 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde9dd90 con 0x55cbbde89a30 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd316bf5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cbbde9eb30 con 0x55cbbdd05df0 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd316bf5b80 10 client.0 _ll_register_callbacks cb 0x55cbbdd4cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd304c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde98f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd304c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde98f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:33834/0 (socket says 172.21.15.47:33834) 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd304c00700 1 -- 172.21.15.47:0/1046598783 learned_addr learned my addr 172.21.15.47:0/1046598783 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd305600700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbdd05df0 0x55cbbde989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.156+0000 7fd306000700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde99450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd305600700 1 -- 172.21.15.47:0/1046598783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 msgr2=0x55cbbde99450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd305600700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde99450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd305600700 1 -- 172.21.15.47:0/1046598783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 msgr2=0x55cbbde98f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd305600700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde98f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd305600700 1 -- 172.21.15.47:0/1046598783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbbdea5e80 con 0x55cbbdd05df0 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd304c00700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde98f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd305600700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbdd05df0 0x55cbbde989d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40a6d30 tx=0x7fd2f4014ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f5c92312fc6ab7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:44.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd2e7400700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd2e7400700 1 -- 172.21.15.47:0/1046598783 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40a95d0 con 0x55cbbdd05df0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd2e7400700 1 -- 172.21.15.47:0/1046598783 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd2f400cd10 con 0x55cbbdd05df0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.157+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2f80078c0 con 0x55cbbdd05df0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd2e7400700 1 -- 172.21.15.47:0/1046598783 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2f40aa1c0 con 0x55cbbdd05df0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 10 client.25048 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cbbdf088e0 con 0x55cbbdd05df0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd2e7400700 1 -- 172.21.15.47:0/1046598783 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2f80078c0 con 0x55cbbdd05df0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd2e7400700 1 -- 172.21.15.47:0/1046598783 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd2f401dca0 con 0x55cbbdd05df0 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 10 client.25048 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 10 client.25048 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 20 client.25048 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:44.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbdf0ad70 0x55cbbdf0c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 4 client.25048 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.158+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "status"}) -- 0x55cbbddb33b0 con 0x55cbbdf0ad70 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.159+0000 7fd304c00700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbdf0ad70 0x55cbbdf0c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.159+0000 7fd304c00700 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbdf0ad70 0x55cbbdf0c1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=30a2c3e5594bc607 server_cookie=cad097935ddfabaa in_seq=0 out_seq=0 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.159+0000 7fd2e7400700 10 client.25048 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.159+0000 7fd2e7400700 1 -- 172.21.15.47:0/1046598783 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55cbbddb33b0 con 0x55cbbdf0ad70 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.159+0000 7fd2e7400700 10 client.25048 handle_command_reply: tid=0 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.159+0000 7fd316bf5b80 1 client.25048 shutdown 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbdd05df0 msgr2=0x55cbbde989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbdd05df0 0x55cbbde989d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40a6d30 tx=0x7fd2f4014ed0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 shutdown_connections 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x55cbbdf0ad70 0x55cbbdf0c1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbbde89a30 0x55cbbde99450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cbbdd05df0 0x55cbbde989d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 --2- 172.21.15.47:0/1046598783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbbde83bf0 0x55cbbde98f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd2e7400700 0 client.25048 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 >> 172.21.15.47:0/1046598783 conn(0x55cbbdd4af20 msgr2=0x55cbbde78250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 shutdown_connections 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 1 -- 172.21.15.47:0/1046598783 wait complete. 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.160+0000 7fd316bf5b80 20 client.25048 trim_cache size 0 max 16384 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:24:44.163 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 4, 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24490, 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 202.744313632, 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 265.130448758 2024-05-14T12:24:44.164 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2e80b2880 msgr2=0x7fd2e80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2e80b2880 0x7fd2e80b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd300104530 tx=0x7fd2ec009310 comp rx=0 tx=0).stop 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105290 msgr2=0x7fd30019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105290 0x7fd30019cde0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400e9a0 tx=0x7fd2f400ecb0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 shutdown_connections 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2e80b2880 0x7fd2e80b4d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd30010e700 0x7fd3001a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd300105290 0x7fd30019cde0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 --2- 172.21.15.47:0/3158362731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd300105be0 0x7fd30019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 >> 172.21.15.47:0/3158362731 conn(0x7fd300078ac0 msgr2=0x7fd300101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:44.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 shutdown_connections 2024-05-14T12:24:44.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:44.161+0000 7fd306a00700 1 -- 172.21.15.47:0/3158362731 wait complete. 2024-05-14T12:24:44.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:44 smithi047 ceph-mon[31254]: pgmap v437: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:45.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:44 smithi073 ceph-mon[35809]: pgmap v437: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:45.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-14T12:24:45.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:44 smithi066 ceph-mon[35981]: pgmap v437: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:24:45.530 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:47.669 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:47 smithi047 ceph-mon[31254]: pgmap v438: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:47.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:47 smithi073 ceph-mon[35809]: pgmap v438: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:47 smithi066 ceph-mon[35981]: pgmap v438: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 -- 172.21.15.47:0/2149958262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 msgr2=0x7f6bc0113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 --2- 172.21.15.47:0/2149958262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 0x7f6bc0113350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800b0a0 tx=0x7f6bb800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 -- 172.21.15.47:0/2149958262 shutdown_connections 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 --2- 172.21.15.47:0/2149958262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 0x7f6bc0113350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 --2- 172.21.15.47:0/2149958262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc010c5b0 0x7f6bc010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 --2- 172.21.15.47:0/2149958262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bc0106570 0x7f6bc0106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 -- 172.21.15.47:0/2149958262 >> 172.21.15.47:0/2149958262 conn(0x7f6bc0102050 msgr2=0x7f6bc01044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.031+0000 7f6bc5600700 1 -- 172.21.15.47:0/2149958262 shutdown_connections 2024-05-14T12:24:48.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.032+0000 7f6bc5600700 1 -- 172.21.15.47:0/2149958262 wait complete. 2024-05-14T12:24:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 Processor -- start 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 -- start start 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc0106570 0x7f6bc019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 0x7f6bc019d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bc010c5b0 0x7f6bc01a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0116730 con 0x7f6bc0106ec0 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01165b0 con 0x7f6bc0106570 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.033+0000 7f6bc5600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01168b0 con 0x7f6bc010c5b0 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbe000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 0x7f6bc019d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc0106570 0x7f6bc019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc0106570 0x7f6bc019cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56652/0 (socket says 172.21.15.47:56652) 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 -- 172.21.15.47:0/4241594616 learned_addr learned my addr 172.21.15.47:0/4241594616 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbe000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 0x7f6bc019d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59838/0 (socket says 172.21.15.47:59838) 2024-05-14T12:24:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbf400700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bc010c5b0 0x7f6bc01a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 -- 172.21.15.47:0/4241594616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bc010c5b0 msgr2=0x7f6bc01a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bc010c5b0 0x7f6bc01a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 -- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 msgr2=0x7f6bc019d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 0x7f6bc019d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.034+0000 7f6bbea00700 1 -- 172.21.15.47:0/4241594616 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc01a1eb0 con 0x7f6bc0106570 2024-05-14T12:24:48.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.035+0000 7f6bbea00700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc0106570 0x7f6bc019cfe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000e970 tx=0x7f6bb000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:48.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.035+0000 7f6bb7400700 1 -- 172.21.15.47:0/4241594616 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0004a30 con 0x7f6bc0106570 2024-05-14T12:24:48.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.035+0000 7f6bb7400700 1 -- 172.21.15.47:0/4241594616 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb000cc90 con 0x7f6bc0106570 2024-05-14T12:24:48.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.035+0000 7f6bb7400700 1 -- 172.21.15.47:0/4241594616 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005610 con 0x7f6bc0106570 2024-05-14T12:24:48.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.035+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc01a21a0 con 0x7f6bc0106570 2024-05-14T12:24:48.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.035+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc01a9ac0 con 0x7f6bc0106570 2024-05-14T12:24:48.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.039+0000 7f6bb7400700 1 -- 172.21.15.47:0/4241594616 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6bb000c7e0 con 0x7f6bc0106570 2024-05-14T12:24:48.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.040+0000 7f6bd41d1b80 1 Processor -- start 2024-05-14T12:24:48.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bd41d1b80 1 -- start start 2024-05-14T12:24:48.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bb7400700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6ba40b2900 0x7f6ba40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bb7400700 1 -- 172.21.15.47:0/4241594616 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6bb00e2310 con 0x7f6bc0106570 2024-05-14T12:24:48.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e5f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bbf400700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6ba40b2900 0x7f6ba40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5f47e0 0x556c9e5ee460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e5eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c9e5109d0 con 0x556c9e470df0 2024-05-14T12:24:48.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c9e4ae710 con 0x556c9e5ee9a0 2024-05-14T12:24:48.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556c9e50c990 con 0x556c9e5f47e0 2024-05-14T12:24:48.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e5f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.041+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e5f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59846/0 (socket says 172.21.15.47:59846) 2024-05-14T12:24:48.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbea00700 1 -- 172.21.15.47:0/2012520379 learned_addr learned my addr 172.21.15.47:0/2012520379 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:48.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbe000700 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5f47e0 0x556c9e5ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbf400700 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e5eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbea00700 1 -- 172.21.15.47:0/2012520379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5f47e0 msgr2=0x556c9e5ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbea00700 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5f47e0 0x556c9e5ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbea00700 1 -- 172.21.15.47:0/2012520379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 msgr2=0x556c9e5eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbea00700 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e5eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbea00700 1 -- 172.21.15.47:0/2012520379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9e45d880 con 0x556c9e470df0 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbe000700 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5f47e0 0x556c9e5ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbf400700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6ba40b2900 0x7f6ba40b4e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800b780 tx=0x7f6bb8009410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.042+0000 7f6bbea00700 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e5f42a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0005060 tx=0x7f6bb0005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2b7b8922cc3598 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.043+0000 7f6babe00700 1 -- 172.21.15.47:0/2012520379 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00c3070 con 0x556c9e470df0 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.043+0000 7f6babe00700 1 -- 172.21.15.47:0/2012520379 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb00b20a0 con 0x556c9e470df0 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.043+0000 7f6babe00700 1 -- 172.21.15.47:0/2012520379 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb008fe60 con 0x556c9e470df0 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/2012520379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 msgr2=0x556c9e5f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e5f42a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0005060 tx=0x7f6bb0005910 comp rx=0 tx=0).stop 2024-05-14T12:24:48.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/2012520379 shutdown_connections 2024-05-14T12:24:48.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e5eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e5f42a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/2012520379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5f47e0 0x556c9e5ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/2012520379 >> 172.21.15.47:0/2012520379 conn(0x556c9e4b5f20 msgr2=0x556c9e5e9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/2012520379 shutdown_connections 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.044+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/2012520379 wait complete. 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.045+0000 7f6bd41d1b80 1 -- start start 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.045+0000 7f6bd41d1b80 1 Processor -- start 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5ee9a0 0x556c9e5f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e5f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c9e5fb2c0 con 0x556c9e5ee9a0 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c9e476ad0 con 0x556c9e5f47e0 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556c9e5fb440 con 0x556c9e470df0 2024-05-14T12:24:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bd41d1b80 10 client.0 _ll_register_callbacks cb 0x556c9e4b7c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:48.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bbe000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5ee9a0 0x556c9e5f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5f7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51802/0 (socket says 172.21.15.47:51802) 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bbe000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5ee9a0 0x556c9e5f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59856/0 (socket says 172.21.15.47:59856) 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bbea00700 1 -- 172.21.15.47:0/1774146016 learned_addr learned my addr 172.21.15.47:0/1774146016 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.046+0000 7f6bbf400700 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e5f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bbea00700 1 -- 172.21.15.47:0/1774146016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 msgr2=0x556c9e5f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bbea00700 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e5f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bbea00700 1 -- 172.21.15.47:0/1774146016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5ee9a0 msgr2=0x556c9e5f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bbea00700 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5ee9a0 0x556c9e5f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bbea00700 1 -- 172.21.15.47:0/1774146016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9e4d63d0 con 0x556c9e470df0 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bbf400700 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e5f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bbea00700 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5f7f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0004e90 tx=0x7f6bb00a50f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be00e1775fbe09a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6ba8c00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6ba8c00700 1 -- 172.21.15.47:0/1774146016 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00c3070 con 0x556c9e470df0 2024-05-14T12:24:48.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6ba8c00700 1 -- 172.21.15.47:0/1774146016 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6bb00a9b50 con 0x556c9e470df0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb00b20a0 con 0x556c9e470df0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6ba8c00700 1 -- 172.21.15.47:0/1774146016 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bb000cad0 con 0x556c9e470df0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bd41d1b80 10 client.25060 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.047+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c9e5fb2c0 con 0x556c9e470df0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6ba8c00700 1 -- 172.21.15.47:0/1774146016 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb00b20a0 con 0x556c9e470df0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6ba8c00700 1 -- 172.21.15.47:0/1774146016 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f6bb00b22c0 con 0x556c9e470df0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6bd41d1b80 10 client.25060 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6bd41d1b80 10 client.25060 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6bd41d1b80 20 client.25060 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e607ef0 0x556c9e609360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6bd41d1b80 4 client.25060 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c9e5bb170 con 0x556c9e607ef0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.048+0000 7f6bbe000700 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e607ef0 0x556c9e609360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.049+0000 7f6bbe000700 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e607ef0 0x556c9e609360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=297f3cf61afa2ef9 server_cookie=208881e841efe9bb in_seq=0 out_seq=0 2024-05-14T12:24:48.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.049+0000 7f6ba8c00700 10 client.25060 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:24:48.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6ba8c00700 1 -- 172.21.15.47:0/1774146016 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556c9e5bb170 con 0x556c9e607ef0 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6ba8c00700 10 client.25060 handle_command_reply: tid=0 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 client.25060 shutdown 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 msgr2=0x556c9e5f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5f7f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0004e90 tx=0x7f6bb00a50f0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 shutdown_connections 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e5f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e607ef0 0x556c9e609360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5f7f80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1774146016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5ee9a0 0x556c9e5f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6ba8c00700 0 client.25060 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 >> 172.21.15.47:0/1774146016 conn(0x556c9e4b5f20 msgr2=0x556c9e5ed450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 shutdown_connections 2024-05-14T12:24:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.050+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1774146016 wait complete. 2024-05-14T12:24:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.051+0000 7f6bd41d1b80 20 client.25060 trim_cache size 0 max 16384 2024-05-14T12:24:48.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.074+0000 7f6bd41d1b80 1 Processor -- start 2024-05-14T12:24:48.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.074+0000 7f6bd41d1b80 1 -- start start 2024-05-14T12:24:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5ee460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e604700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5f47e0 0x556c9e5e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c9e6076a0 con 0x556c9e5f47e0 2024-05-14T12:24:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c9e607d70 con 0x556c9e5ee9a0 2024-05-14T12:24:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556c9e608440 con 0x556c9e470df0 2024-05-14T12:24:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bbf400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5f47e0 0x556c9e5e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bbf400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5f47e0 0x556c9e5e8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59870/0 (socket says 172.21.15.47:59870) 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bbf400700 1 -- 172.21.15.47:0/1137101047 learned_addr learned my addr 172.21.15.47:0/1137101047 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bbea00700 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.075+0000 7f6bbe000700 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e604700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bbf400700 1 -- 172.21.15.47:0/1137101047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 msgr2=0x556c9e5ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bbf400700 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bbf400700 1 -- 172.21.15.47:0/1137101047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 msgr2=0x556c9e604700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bbf400700 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e604700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bbf400700 1 -- 172.21.15.47:0/1137101047 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9e607b90 con 0x556c9e5f47e0 2024-05-14T12:24:48.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bbf400700 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5f47e0 0x556c9e5e8be0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8015000 tx=0x7f6bb8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f538eb4b03b032 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:48.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bab400700 1 -- 172.21.15.47:0/1137101047 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb802d070 con 0x556c9e5f47e0 2024-05-14T12:24:48.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bab400700 1 -- 172.21.15.47:0/1137101047 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb8023040 con 0x556c9e5f47e0 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.076+0000 7f6bab400700 1 -- 172.21.15.47:0/1137101047 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8025070 con 0x556c9e5f47e0 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.077+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1137101047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5f47e0 msgr2=0x556c9e5e8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.077+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5f47e0 0x556c9e5e8be0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8015000 tx=0x7f6bb8021000 comp rx=0 tx=0).stop 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.077+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1137101047 shutdown_connections 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.077+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e5f47e0 0x556c9e5e8be0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.077+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e470df0 0x556c9e5ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.077+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/1137101047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5ee9a0 0x556c9e604700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.077+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1137101047 >> 172.21.15.47:0/1137101047 conn(0x556c9e4b5f20 msgr2=0x556c9e5e3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.078+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1137101047 shutdown_connections 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.078+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/1137101047 wait complete. 2024-05-14T12:24:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.078+0000 7f6bd41d1b80 1 -- start start 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.078+0000 7f6bd41d1b80 1 Processor -- start 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e603810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5ee9a0 0x556c9e603d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bd41d1b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e604290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556c9e6091e0 con 0x556c9e470df0 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c9e608b10 con 0x556c9e5f47e0 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bd41d1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556c9e6098b0 con 0x556c9e5ee9a0 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bd41d1b80 10 client.0 _ll_register_callbacks cb 0x556c9e4b7c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e603810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e603810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59886/0 (socket says 172.21.15.47:59886) 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bbea00700 1 -- 172.21.15.47:0/3549070613 learned_addr learned my addr 172.21.15.47:0/3549070613 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bbf400700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e604290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.079+0000 7f6bbe000700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5ee9a0 0x556c9e603d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bbea00700 1 -- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5ee9a0 msgr2=0x556c9e603d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bbea00700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5ee9a0 0x556c9e603d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bbea00700 1 -- 172.21.15.47:0/3549070613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 msgr2=0x556c9e604290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bbea00700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e604290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bbea00700 1 -- 172.21.15.47:0/3549070613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9e610b50 con 0x556c9e470df0 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bbf400700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e604290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bbea00700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e603810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00a5970 tx=0x7f6bb00050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7525730286af46a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6ba8c00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3549070613 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00c3070 con 0x556c9e470df0 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3549070613 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6bb00a8d60 con 0x556c9e470df0 2024-05-14T12:24:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.080+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb8023040 con 0x556c9e470df0 2024-05-14T12:24:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3549070613 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bb00caba0 con 0x556c9e470df0 2024-05-14T12:24:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 10 client.14937 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c9e6735c0 con 0x556c9e470df0 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3549070613 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb8023040 con 0x556c9e470df0 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3549070613 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f6bb00a85c0 con 0x556c9e470df0 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 10 client.14937 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 10 client.14937 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 20 client.14937 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e675740 0x556c9e676bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 4 client.14937 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.081+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "status"}) -- 0x556c9e51e3b0 con 0x556c9e675740 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.082+0000 7f6bbe000700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e675740 0x556c9e676bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.082+0000 7f6bbe000700 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e675740 0x556c9e676bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d23a17a47eeccdd server_cookie=ed1daf34bb404808 in_seq=0 out_seq=0 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.082+0000 7f6ba8c00700 10 client.14937 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3549070613 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556c9e51e3b0 con 0x556c9e675740 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6ba8c00700 10 client.14937 handle_command_reply: tid=0 2024-05-14T12:24:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 client.14937 shutdown 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 msgr2=0x556c9e603810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e603810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00a5970 tx=0x7f6bb00050b0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 shutdown_connections 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c9e5f47e0 0x556c9e604290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556c9e470df0 0x556c9e603810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x556c9e675740 0x556c9e676bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 --2- 172.21.15.47:0/3549070613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556c9e5ee9a0 0x556c9e603d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 >> 172.21.15.47:0/3549070613 conn(0x556c9e4b5f20 msgr2=0x556c9e5f30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6ba8c00700 0 client.14937 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 shutdown_connections 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 1 -- 172.21.15.47:0/3549070613 wait complete. 2024-05-14T12:24:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.083+0000 7f6bd41d1b80 20 client.14937 trim_cache size 0 max 16384 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 3, 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24502, 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 207.67376347999999, 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 266.11596854499999 2024-05-14T12:24:48.086 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:24:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6ba40b2900 msgr2=0x7f6ba40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6ba40b2900 0x7f6ba40b4e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800b780 tx=0x7f6bb8009410 comp rx=0 tx=0).stop 2024-05-14T12:24:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc0106570 msgr2=0x7f6bc019cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc0106570 0x7f6bc019cfe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000e970 tx=0x7f6bb000ec80 comp rx=0 tx=0).stop 2024-05-14T12:24:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 shutdown_connections 2024-05-14T12:24:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6ba40b2900 0x7f6ba40b4e10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bc010c5b0 0x7f6bc01a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bc0106570 0x7f6bc019cfe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 --2- 172.21.15.47:0/4241594616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bc0106ec0 0x7f6bc019d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 >> 172.21.15.47:0/4241594616 conn(0x7f6bc0102050 msgr2=0x7f6bc01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.084+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 shutdown_connections 2024-05-14T12:24:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:48.085+0000 7f6bc5600700 1 -- 172.21.15.47:0/4241594616 wait complete. 2024-05-14T12:24:48.967 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-14T12:24:49.429 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:49.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:49 smithi047 ceph-mon[31254]: pgmap v439: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T12:24:49.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:49 smithi073 ceph-mon[35809]: pgmap v439: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T12:24:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:49 smithi066 ceph-mon[35981]: pgmap v439: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T12:24:51.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:51 smithi047 ceph-mon[31254]: pgmap v440: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:24:51.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:51 smithi073 ceph-mon[35809]: pgmap v440: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:24:51.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.776+0000 7f1987800700 1 -- 172.21.15.47:0/2334008974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980108740 msgr2=0x7f19801100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.776+0000 7f1987800700 1 --2- 172.21.15.47:0/2334008974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980108740 0x7f19801100a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f197800b0d0 tx=0x7f197800b3e0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.777+0000 7f1987800700 1 -- 172.21.15.47:0/2334008974 shutdown_connections 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.777+0000 7f1987800700 1 --2- 172.21.15.47:0/2334008974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1980108740 0x7f19801100a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.777+0000 7f1987800700 1 --2- 172.21.15.47:0/2334008974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19801034c0 0x7f19801038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.777+0000 7f1987800700 1 --2- 172.21.15.47:0/2334008974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1980107df0 0x7f1980108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.777+0000 7f1987800700 1 -- 172.21.15.47:0/2334008974 >> 172.21.15.47:0/2334008974 conn(0x7f19800fedc0 msgr2=0x7f19801011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.777+0000 7f1987800700 1 -- 172.21.15.47:0/2334008974 shutdown_connections 2024-05-14T12:24:51.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.777+0000 7f1987800700 1 -- 172.21.15.47:0/2334008974 wait complete. 2024-05-14T12:24:51.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.778+0000 7f1987800700 1 Processor -- start 2024-05-14T12:24:51.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.778+0000 7f1987800700 1 -- start start 2024-05-14T12:24:51.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1987800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19801034c0 0x7f198019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1987800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1980107df0 0x7f198019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1987800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1980108740 0x7f19801a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1987800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19801133c0 con 0x7f1980107df0 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1987800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1980113240 con 0x7f1980108740 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1987800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1980113540 con 0x7f19801034c0 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1984e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19801034c0 0x7f198019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1984e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19801034c0 0x7f198019d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51828/0 (socket says 172.21.15.47:51828) 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1984e00700 1 -- 172.21.15.47:0/3304017341 learned_addr learned my addr 172.21.15.47:0/3304017341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f197fe00700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1980107df0 0x7f198019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.779+0000 7f1985800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1980108740 0x7f19801a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f1984e00700 1 -- 172.21.15.47:0/3304017341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1980108740 msgr2=0x7f19801a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f1984e00700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1980108740 0x7f19801a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f1984e00700 1 -- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1980107df0 msgr2=0x7f198019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f1984e00700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1980107df0 0x7f198019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f1984e00700 1 -- 172.21.15.47:0/3304017341 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19801a1f50 con 0x7f19801034c0 2024-05-14T12:24:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f1984e00700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19801034c0 0x7f198019d080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f197400eb30 tx=0x7f197400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:51.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f197d600700 1 -- 172.21.15.47:0/3304017341 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197400cbd0 con 0x7f19801034c0 2024-05-14T12:24:51.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f197d600700 1 -- 172.21.15.47:0/3304017341 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19740044d0 con 0x7f19801034c0 2024-05-14T12:24:51.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.780+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19801a2240 con 0x7f19801034c0 2024-05-14T12:24:51.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.781+0000 7f197d600700 1 -- 172.21.15.47:0/3304017341 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974003e30 con 0x7f19801034c0 2024-05-14T12:24:51.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.781+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19801a9b60 con 0x7f19801034c0 2024-05-14T12:24:51.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.785+0000 7f197d600700 1 -- 172.21.15.47:0/3304017341 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1974004000 con 0x7f19801034c0 2024-05-14T12:24:51.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 Processor -- start 2024-05-14T12:24:51.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 -- start start 2024-05-14T12:24:51.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d92892a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d9283460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d9283db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5600d91a59d0 con 0x5600d9105df0 2024-05-14T12:24:51.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5600d9143710 con 0x5600d92839a0 2024-05-14T12:24:51.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f1996258b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5600d91a1990 con 0x5600d92897e0 2024-05-14T12:24:51.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.786+0000 7f197d600700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19680b2980 0x7f19680b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d9283460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1985800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d92892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d9283460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51836/0 (socket says 172.21.15.47:51836) 2024-05-14T12:24:51.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 -- 172.21.15.47:0/1381872309 learned_addr learned my addr 172.21.15.47:0/1381872309 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:51.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f197fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d9283db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f197d600700 1 -- 172.21.15.47:0/3304017341 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f19740e2540 con 0x7f19801034c0 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1985800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19680b2980 0x7f19680b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 -- 172.21.15.47:0/1381872309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 msgr2=0x5600d9283db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d9283db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 -- 172.21.15.47:0/1381872309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 msgr2=0x5600d92892a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d92892a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1984e00700 1 -- 172.21.15.47:0/1381872309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600d90f2880 con 0x5600d92897e0 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.787+0000 7f1985800700 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d92892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.788+0000 7f1984e00700 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d9283460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f197400c5b0 tx=0x7f19740764a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f61b2e910e5be0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.788+0000 7f1972000700 1 -- 172.21.15.47:0/1381872309 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740a59e0 con 0x5600d92897e0 2024-05-14T12:24:51.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.788+0000 7f1972000700 1 -- 172.21.15.47:0/1381872309 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19740a9630 con 0x5600d92897e0 2024-05-14T12:24:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.788+0000 7f1972000700 1 -- 172.21.15.47:0/1381872309 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740b1490 con 0x5600d92897e0 2024-05-14T12:24:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 -- 172.21.15.47:0/1381872309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 msgr2=0x5600d9283460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1985800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19680b2980 0x7f19680b4e90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1978009fd0 tx=0x7f197800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d9283460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f197400c5b0 tx=0x7f19740764a0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 -- 172.21.15.47:0/1381872309 shutdown_connections 2024-05-14T12:24:51.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d9283db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d92892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 --2- 172.21.15.47:0/1381872309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d9283460 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 -- 172.21.15.47:0/1381872309 >> 172.21.15.47:0/1381872309 conn(0x5600d914af20 msgr2=0x5600d927e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:51.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 -- 172.21.15.47:0/1381872309 shutdown_connections 2024-05-14T12:24:51.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.789+0000 7f1996258b80 1 -- 172.21.15.47:0/1381872309 wait complete. 2024-05-14T12:24:51.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.790+0000 7f1996258b80 1 -- start start 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.790+0000 7f1996258b80 1 Processor -- start 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1996258b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d928cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1996258b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92839a0 0x5600d928d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1996258b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d928d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1996258b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5600d92902c0 con 0x5600d9105df0 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1996258b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5600d910bad0 con 0x5600d92897e0 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1996258b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5600d9290440 con 0x5600d92839a0 2024-05-14T12:24:51.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1996258b80 10 client.0 _ll_register_callbacks cb 0x5600d914cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:51.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1984e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d928cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1984e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d928cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59928/0 (socket says 172.21.15.47:59928) 2024-05-14T12:24:51.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1984e00700 1 -- 172.21.15.47:0/3117008794 learned_addr learned my addr 172.21.15.47:0/3117008794 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:51.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f197fe00700 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92839a0 0x5600d928d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.791+0000 7f1985800700 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d928d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1984e00700 1 -- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92839a0 msgr2=0x5600d928d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1984e00700 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92839a0 0x5600d928d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1984e00700 1 -- 172.21.15.47:0/3117008794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 msgr2=0x5600d928d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1984e00700 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d928d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1984e00700 1 -- 172.21.15.47:0/3117008794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600d916b3d0 con 0x5600d9105df0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1984e00700 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d928cf60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1974003840 tx=0x7f19740aa2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c67ad974409982 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1966a00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.792+0000 7f1966a00700 1 -- 172.21.15.47:0/3117008794 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740c2070 con 0x5600d9105df0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.793+0000 7f1966a00700 1 -- 172.21.15.47:0/3117008794 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f197401e2e0 con 0x5600d9105df0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.793+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19740a9630 con 0x5600d9105df0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.793+0000 7f1966a00700 1 -- 172.21.15.47:0/3117008794 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19740b22e0 con 0x5600d9105df0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.793+0000 7f1996258b80 10 client.14949 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.793+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5600d929adc0 con 0x5600d9105df0 2024-05-14T12:24:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.793+0000 7f1966a00700 1 -- 172.21.15.47:0/3117008794 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19740a9630 con 0x5600d9105df0 2024-05-14T12:24:51.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.793+0000 7f1966a00700 1 -- 172.21.15.47:0/3117008794 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f19740a9d80 con 0x5600d9105df0 2024-05-14T12:24:51.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.794+0000 7f1996258b80 10 client.14949 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:51.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.794+0000 7f1996258b80 10 client.14949 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T12:24:51.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.794+0000 7f1996258b80 20 client.14949 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.794+0000 7f1996258b80 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d929c110 0x5600d929e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.794+0000 7f1996258b80 4 client.14949 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:24:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.794+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600d9250170 con 0x5600d929c110 2024-05-14T12:24:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.794+0000 7f197fe00700 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d929c110 0x5600d929e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.795+0000 7f197fe00700 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d929c110 0x5600d929e2e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fca2594a9aa305f5 server_cookie=88d216d70e6cf709 in_seq=0 out_seq=0 2024-05-14T12:24:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.795+0000 7f1966a00700 10 client.14949 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1966a00700 1 -- 172.21.15.47:0/3117008794 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5600d9250170 con 0x5600d929c110 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1966a00700 10 client.14949 handle_command_reply: tid=0 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 client.14949 shutdown 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 msgr2=0x5600d928cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d928cf60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1974003840 tx=0x7f19740aa2a0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 shutdown_connections 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d929c110 0x5600d929e2e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d928d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d928cf60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 --2- 172.21.15.47:0/3117008794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92839a0 0x5600d928d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 >> 172.21.15.47:0/3117008794 conn(0x5600d914af20 msgr2=0x5600d9282450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1966a00700 0 client.14949 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:24:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 shutdown_connections 2024-05-14T12:24:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.796+0000 7f1996258b80 1 -- 172.21.15.47:0/3117008794 wait complete. 2024-05-14T12:24:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.797+0000 7f1996258b80 20 client.14949 trim_cache size 0 max 16384 2024-05-14T12:24:51.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 Processor -- start 2024-05-14T12:24:51.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 -- start start 2024-05-14T12:24:51.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d9283460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d92996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d929c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5600d929c620 con 0x5600d9105df0 2024-05-14T12:24:51.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5600d929ccf0 con 0x5600d92839a0 2024-05-14T12:24:51.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.820+0000 7f1996258b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5600d929d3c0 con 0x5600d92897e0 2024-05-14T12:24:51.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f1984e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d9283460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f1984e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d9283460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59936/0 (socket says 172.21.15.47:59936) 2024-05-14T12:24:51.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f1984e00700 1 -- 172.21.15.47:0/4235296979 learned_addr learned my addr 172.21.15.47:0/4235296979 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:51.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f197fe00700 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d92996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f1985800700 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d929c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f197fe00700 1 -- 172.21.15.47:0/4235296979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 msgr2=0x5600d929c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f197fe00700 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d929c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f197fe00700 1 -- 172.21.15.47:0/4235296979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 msgr2=0x5600d9283460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f197fe00700 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d9283460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f197fe00700 1 -- 172.21.15.47:0/4235296979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600d92903f0 con 0x5600d92839a0 2024-05-14T12:24:51.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.821+0000 7f197fe00700 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d92996a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5600d929e9b0 tx=0x7f196c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c185ed5d794b365 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:51.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.822+0000 7f1971600700 1 -- 172.21.15.47:0/4235296979 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c026070 con 0x5600d92839a0 2024-05-14T12:24:51.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.822+0000 7f1971600700 1 -- 172.21.15.47:0/4235296979 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f196c01d8c0 con 0x5600d92839a0 2024-05-14T12:24:51.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.822+0000 7f1971600700 1 -- 172.21.15.47:0/4235296979 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c0204d0 con 0x5600d92839a0 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 -- 172.21.15.47:0/4235296979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 msgr2=0x5600d92996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d92996a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5600d929e9b0 tx=0x7f196c009260 comp rx=0 tx=0).stop 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 -- 172.21.15.47:0/4235296979 shutdown_connections 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d92897e0 0x5600d929c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d9105df0 0x5600d9283460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 --2- 172.21.15.47:0/4235296979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92839a0 0x5600d92996a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 -- 172.21.15.47:0/4235296979 >> 172.21.15.47:0/4235296979 conn(0x5600d914af20 msgr2=0x5600d928b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 -- 172.21.15.47:0/4235296979 shutdown_connections 2024-05-14T12:24:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.823+0000 7f1996258b80 1 -- 172.21.15.47:0/4235296979 wait complete. 2024-05-14T12:24:51.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.824+0000 7f1996258b80 1 -- start start 2024-05-14T12:24:51.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.824+0000 7f1996258b80 1 Processor -- start 2024-05-14T12:24:51.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.824+0000 7f1996258b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d9105df0 0x5600d92825d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.824+0000 7f1996258b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d92839a0 0x5600d9282b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1996258b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d9283050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1996258b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5600d929e160 con 0x5600d92839a0 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1996258b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5600d929da90 con 0x5600d92897e0 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1996258b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5600d929e830 con 0x5600d9105df0 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1996258b80 10 client.0 _ll_register_callbacks cb 0x5600d914cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f197fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d92839a0 0x5600d9282b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f197fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d92839a0 0x5600d9282b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59940/0 (socket says 172.21.15.47:59940) 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f197fe00700 1 -- 172.21.15.47:0/1564934113 learned_addr learned my addr 172.21.15.47:0/1564934113 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1984e00700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d9105df0 0x5600d92825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1985800700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d9283050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.826 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:51 smithi066 ceph-mon[35981]: pgmap v440: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1984e00700 1 -- 172.21.15.47:0/1564934113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 msgr2=0x5600d9283050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1984e00700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d9283050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1984e00700 1 -- 172.21.15.47:0/1564934113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d92839a0 msgr2=0x5600d9282b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1984e00700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d92839a0 0x5600d9282b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f1984e00700 1 -- 172.21.15.47:0/1564934113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600d92a5ad0 con 0x5600d9105df0 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.825+0000 7f197fe00700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d92839a0 0x5600d9282b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1984e00700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d9105df0 0x5600d92825d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f197400eb00 tx=0x7f19740aa030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676acbfb8b425b86 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1966a00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1966a00700 1 -- 172.21.15.47:0/1564934113 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974073060 con 0x5600d9105df0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f196c01d8c0 con 0x5600d9105df0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1966a00700 1 -- 172.21.15.47:0/1564934113 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f19740b08d0 con 0x5600d9105df0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1966a00700 1 -- 172.21.15.47:0/1564934113 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19740c2070 con 0x5600d9105df0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1996258b80 10 client.25084 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.826+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5600d9308540 con 0x5600d9105df0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1966a00700 1 -- 172.21.15.47:0/1564934113 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f196c01d8c0 con 0x5600d9105df0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1966a00700 1 -- 172.21.15.47:0/1564934113 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f19740a8d80 con 0x5600d9105df0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1996258b80 10 client.25084 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1996258b80 10 client.25084 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1996258b80 20 client.25084 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1996258b80 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d930a7c0 0x5600d930bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1996258b80 4 client.25084 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "status"}) -- 0x5600d91b33b0 con 0x5600d930a7c0 2024-05-14T12:24:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.827+0000 7f197fe00700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d930a7c0 0x5600d930bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.828+0000 7f197fe00700 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d930a7c0 0x5600d930bc30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e26ca44b8b7ddab7 server_cookie=51a4c5506a9a951d in_seq=0 out_seq=0 2024-05-14T12:24:51.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.828+0000 7f1966a00700 10 client.25084 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.828+0000 7f1966a00700 1 -- 172.21.15.47:0/1564934113 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5600d91b33b0 con 0x5600d930a7c0 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.828+0000 7f1966a00700 10 client.25084 handle_command_reply: tid=0 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.828+0000 7f1996258b80 1 client.25084 shutdown 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d9105df0 msgr2=0x5600d92825d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d9105df0 0x5600d92825d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f197400eb00 tx=0x7f19740aa030 comp rx=0 tx=0).stop 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 shutdown_connections 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x5600d930a7c0 0x5600d930bc30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5600d92897e0 0x5600d9283050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600d9105df0 0x5600d92825d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 --2- 172.21.15.47:0/1564934113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5600d92839a0 0x5600d9282b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 >> 172.21.15.47:0/1564934113 conn(0x5600d914af20 msgr2=0x5600d92880c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1966a00700 0 client.25084 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:24:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 shutdown_connections 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 1 -- 172.21.15.47:0/1564934113 wait complete. 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.829+0000 7f1996258b80 20 client.25084 trim_cache size 0 max 16384 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 2, 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24517, 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 212.444477054, 2024-05-14T12:24:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 264.182673088 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19680b2980 msgr2=0x7f19680b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19680b2980 0x7f19680b4e90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1978009fd0 tx=0x7f197800b040 comp rx=0 tx=0).stop 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19801034c0 msgr2=0x7f198019d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19801034c0 0x7f198019d080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f197400eb30 tx=0x7f197400ee40 comp rx=0 tx=0).stop 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 shutdown_connections 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f19680b2980 0x7f19680b4e90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1980108740 0x7f19801a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19801034c0 0x7f198019d080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 --2- 172.21.15.47:0/3304017341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1980107df0 0x7f198019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 >> 172.21.15.47:0/3304017341 conn(0x7f19800fedc0 msgr2=0x7f198010ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 shutdown_connections 2024-05-14T12:24:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:51.830+0000 7f1987800700 1 -- 172.21.15.47:0/3304017341 wait complete. 2024-05-14T12:24:52.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-14T12:24:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:53.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:53 smithi047 ceph-mon[31254]: pgmap v441: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:53.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:53 smithi073 ceph-mon[35809]: pgmap v441: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:53 smithi066 ceph-mon[35981]: pgmap v441: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:55.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:55 smithi047 ceph-mon[31254]: pgmap v442: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:24:55.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:55 smithi073 ceph-mon[35809]: pgmap v442: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:24:55.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 -- 172.21.15.47:0/4017456974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106ed0 msgr2=0x7f0d14113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 --2- 172.21.15.47:0/4017456974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106ed0 0x7f0d14113360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b0a0 tx=0x7f0d0c00b3b0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 -- 172.21.15.47:0/4017456974 shutdown_connections 2024-05-14T12:24:55.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 --2- 172.21.15.47:0/4017456974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106ed0 0x7f0d14113360 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 --2- 172.21.15.47:0/4017456974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d1410c5c0 0x7f0d1410c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 --2- 172.21.15.47:0/4017456974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d14106580 0x7f0d14106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 -- 172.21.15.47:0/4017456974 >> 172.21.15.47:0/4017456974 conn(0x7f0d14102080 msgr2=0x7f0d141044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:55.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 -- 172.21.15.47:0/4017456974 shutdown_connections 2024-05-14T12:24:55.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.780+0000 7f0d19000700 1 -- 172.21.15.47:0/4017456974 wait complete. 2024-05-14T12:24:55.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 Processor -- start 2024-05-14T12:24:55.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 -- start start 2024-05-14T12:24:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106580 0x7f0d1419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d14106ed0 0x7f0d1419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d1410c5c0 0x7f0d141a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14116740 con 0x7f0d14106ed0 2024-05-14T12:24:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141165c0 con 0x7f0d1410c5c0 2024-05-14T12:24:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.782+0000 7f0d19000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141168c0 con 0x7f0d14106580 2024-05-14T12:24:55.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d14106ed0 0x7f0d1419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d14106ed0 0x7f0d1419d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59960/0 (socket says 172.21.15.47:59960) 2024-05-14T12:24:55.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 -- 172.21.15.47:0/2623219873 learned_addr learned my addr 172.21.15.47:0/2623219873 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:55.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11e00700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106580 0x7f0d1419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d12800700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d1410c5c0 0x7f0d141a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 -- 172.21.15.47:0/2623219873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106580 msgr2=0x7f0d1419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106580 0x7f0d1419d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 -- 172.21.15.47:0/2623219873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d1410c5c0 msgr2=0x7f0d141a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d1410c5c0 0x7f0d141a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.783+0000 7f0d11400700 1 -- 172.21.15.47:0/2623219873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d141a1ee0 con 0x7f0d14106ed0 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.784+0000 7f0d11400700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d14106ed0 0x7f0d1419d5b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009fd0 tx=0x7f0d0000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.784+0000 7f0d0aa00700 1 -- 172.21.15.47:0/2623219873 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000eea0 con 0x7f0d14106ed0 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.784+0000 7f0d0aa00700 1 -- 172.21.15.47:0/2623219873 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d000044d0 con 0x7f0d14106ed0 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.784+0000 7f0d0aa00700 1 -- 172.21.15.47:0/2623219873 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00003dd0 con 0x7f0d14106ed0 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.784+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d141a21d0 con 0x7f0d14106ed0 2024-05-14T12:24:55.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.784+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d141a9af0 con 0x7f0d14106ed0 2024-05-14T12:24:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.788+0000 7f0d0aa00700 1 -- 172.21.15.47:0/2623219873 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0d00003f90 con 0x7f0d14106ed0 2024-05-14T12:24:55.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.789+0000 7f0d27ab8b80 1 Processor -- start 2024-05-14T12:24:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.789+0000 7f0d27ab8b80 1 -- start start 2024-05-14T12:24:55.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d0aa00700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cf80b2880 0x7f0cf80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c871080660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d0aa00700 1 -- 172.21.15.47:0/2623219873 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d000e22e0 con 0x7f0d14106ed0 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c871080ba0 0x55c87107a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c87107b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d12800700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cf80b2880 0x7f0cf80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c870f9c9d0 con 0x55c871080ba0 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c870f3a710 con 0x55c87107ac00 2024-05-14T12:24:55.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c870f98990 con 0x55c870efcdf0 2024-05-14T12:24:55.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d11e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c871080660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d11e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c871080660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51888/0 (socket says 172.21.15.47:51888) 2024-05-14T12:24:55.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d11e00700 1 -- 172.21.15.47:0/3529914660 learned_addr learned my addr 172.21.15.47:0/3529914660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:55.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d11400700 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c871080ba0 0x55c87107a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.790+0000 7f0d12800700 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c87107b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0d11e00700 1 -- 172.21.15.47:0/3529914660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 msgr2=0x55c87107b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0d11e00700 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c87107b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0d11e00700 1 -- 172.21.15.47:0/3529914660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c871080ba0 msgr2=0x55c87107a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0d11e00700 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c871080ba0 0x55c87107a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0d11e00700 1 -- 172.21.15.47:0/3529914660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c870ee9880 con 0x55c870efcdf0 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0d12800700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cf80b2880 0x7f0cf80b4d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b780 tx=0x7f0d0c00bb90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0d11e00700 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c871080660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d04009d20 tx=0x7f0d04011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d19d446f117dfc96 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0cff400700 1 -- 172.21.15.47:0/3529914660 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0401e070 con 0x55c870efcdf0 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0cff400700 1 -- 172.21.15.47:0/3529914660 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d04019ae0 con 0x55c870efcdf0 2024-05-14T12:24:55.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.791+0000 7f0cff400700 1 -- 172.21.15.47:0/3529914660 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0400ea20 con 0x55c870efcdf0 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.792+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/3529914660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 msgr2=0x55c871080660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.792+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c871080660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d04009d20 tx=0x7f0d04011720 comp rx=0 tx=0).stop 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/3529914660 shutdown_connections 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c87107b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c871080660 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/3529914660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c871080ba0 0x55c87107a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/3529914660 >> 172.21.15.47:0/3529914660 conn(0x55c870f3ba30 msgr2=0x55c871075740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/3529914660 shutdown_connections 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/3529914660 wait complete. 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.793+0000 7f0d27ab8b80 1 -- start start 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 1 Processor -- start 2024-05-14T12:24:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c871084380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710848c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c871080ba0 0x55c871084e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c871087670 con 0x55c870efcdf0 2024-05-14T12:24:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c870f02ad0 con 0x55c87107ac00 2024-05-14T12:24:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c8710877f0 con 0x55c871080ba0 2024-05-14T12:24:55.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.794+0000 7f0d27ab8b80 10 client.0 _ll_register_callbacks cb 0x55c870f30330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c871084380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710848c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710848c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56820/0 (socket says 172.21.15.47:56820) 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11400700 1 -- 172.21.15.47:0/1028774655 learned_addr learned my addr 172.21.15.47:0/1028774655 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d12800700 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c871080ba0 0x55c871084e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11e00700 1 -- 172.21.15.47:0/1028774655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c871080ba0 msgr2=0x55c871084e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11e00700 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c871080ba0 0x55c871084e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11e00700 1 -- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 msgr2=0x55c8710848c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11e00700 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710848c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11e00700 1 -- 172.21.15.47:0/1028774655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c870f623d0 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.795+0000 7f0d11400700 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710848c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0d11e00700 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c871084380 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d0401c040 tx=0x7f0d0400e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c382bcca6a69496c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0cf3e00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0cf3e00700 1 -- 172.21.15.47:0/1028774655 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0401e050 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0cf3e00700 1 -- 172.21.15.47:0/1028774655 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d04005040 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d04019ae0 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0cf3e00700 1 -- 172.21.15.47:0/1028774655 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d04005240 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0d27ab8b80 10 client.14967 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.796+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8710922f0 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0cf3e00700 1 -- 172.21.15.47:0/1028774655 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d04019ae0 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0cf3e00700 1 -- 172.21.15.47:0/1028774655 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0d040048f0 con 0x55c870efcdf0 2024-05-14T12:24:55.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0d27ab8b80 10 client.14967 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:55.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0d27ab8b80 10 client.14967 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T12:24:55.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0d27ab8b80 20 client.14967 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:55.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c8710946b0 0x55c871095b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0d27ab8b80 4 client.14967 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:24:55.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c871047020 con 0x55c8710946b0 2024-05-14T12:24:55.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.797+0000 7f0d11400700 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c8710946b0 0x55c871095b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.798+0000 7f0d11400700 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c8710946b0 0x55c871095b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5b021b1662afd7d server_cookie=c0bec19a54391ab6 in_seq=0 out_seq=0 2024-05-14T12:24:55.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.798+0000 7f0cf3e00700 10 client.14967 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:24:55.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0cf3e00700 1 -- 172.21.15.47:0/1028774655 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c871047020 con 0x55c8710946b0 2024-05-14T12:24:55.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0cf3e00700 10 client.14967 handle_command_reply: tid=0 2024-05-14T12:24:55.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 client.14967 shutdown 2024-05-14T12:24:55.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 msgr2=0x55c871084380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c871084380 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d0401c040 tx=0x7f0d0400e5e0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 shutdown_connections 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c871080ba0 0x55c871084e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c871084380 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c8710946b0 0x55c871095b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/1028774655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710848c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.799+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 >> 172.21.15.47:0/1028774655 conn(0x55c870f3ba30 msgr2=0x55c87106f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.800+0000 7f0cf3e00700 0 client.14967 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.800+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 shutdown_connections 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.800+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/1028774655 wait complete. 2024-05-14T12:24:55.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.800+0000 7f0d27ab8b80 20 client.14967 trim_cache size 0 max 16384 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.823+0000 7f0d27ab8b80 1 Processor -- start 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.823+0000 7f0d27ab8b80 1 -- start start 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.823+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c870f3ba30 0x55c87107a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.823+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c87107eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c87107ac00 0x55c871081fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c871093e60 con 0x55c87107ac00 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c871094530 con 0x55c870f3ba30 2024-05-14T12:24:55.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c871094c00 con 0x55c870efcdf0 2024-05-14T12:24:55.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:55 smithi066 ceph-mon[35981]: pgmap v442: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c870f3ba30 0x55c87107a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d12800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c87107ac00 0x55c871081fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c870f3ba30 0x55c87107a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56830/0 (socket says 172.21.15.47:56830) 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 -- 172.21.15.47:0/694237054 learned_addr learned my addr 172.21.15.47:0/694237054 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11400700 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c87107eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 -- 172.21.15.47:0/694237054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 msgr2=0x55c87107eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c87107eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 -- 172.21.15.47:0/694237054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c87107ac00 msgr2=0x55c871081fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c87107ac00 0x55c871081fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d11e00700 1 -- 172.21.15.47:0/694237054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c871085440 con 0x55c870f3ba30 2024-05-14T12:24:55.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.824+0000 7f0d12800700 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c87107ac00 0x55c871081fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:55.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.825+0000 7f0d11e00700 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c870f3ba30 0x55c87107a6c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d04004c90 tx=0x7f0d04011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e94d951e23c1850 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:55.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.825+0000 7f0cfea00700 1 -- 172.21.15.47:0/694237054 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0401e040 con 0x55c870f3ba30 2024-05-14T12:24:55.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.825+0000 7f0cfea00700 1 -- 172.21.15.47:0/694237054 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d0402a070 con 0x55c870f3ba30 2024-05-14T12:24:55.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.825+0000 7f0cfea00700 1 -- 172.21.15.47:0/694237054 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040197c0 con 0x55c870f3ba30 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/694237054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c870f3ba30 msgr2=0x55c87107a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c870f3ba30 0x55c87107a6c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d04004c90 tx=0x7f0d04011720 comp rx=0 tx=0).stop 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/694237054 shutdown_connections 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c87107ac00 0x55c871081fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c870f3ba30 0x55c87107a6c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/694237054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870efcdf0 0x55c87107eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/694237054 >> 172.21.15.47:0/694237054 conn(0x55c871093a50 msgr2=0x55c87106fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/694237054 shutdown_connections 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/694237054 wait complete. 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.826+0000 7f0d27ab8b80 1 -- start start 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 1 Processor -- start 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c87109f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870f3ba30 0x55c871083c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8710959a0 con 0x55c870efcdf0 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c8710952d0 con 0x55c87107ac00 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c871096070 con 0x55c870f3ba30 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.827+0000 7f0d27ab8b80 10 client.0 _ll_register_callbacks cb 0x55c870f30330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c87109f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c87109f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59998/0 (socket says 172.21.15.47:59998) 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d12800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11e00700 1 -- 172.21.15.47:0/2339413012 learned_addr learned my addr 172.21.15.47:0/2339413012 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11400700 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870f3ba30 0x55c871083c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11400700 1 -- 172.21.15.47:0/2339413012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 msgr2=0x55c8710841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11400700 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11400700 1 -- 172.21.15.47:0/2339413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 msgr2=0x55c87109f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:55.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11400700 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c87109f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11400700 1 -- 172.21.15.47:0/2339413012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c871084920 con 0x55c870f3ba30 2024-05-14T12:24:55.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.828+0000 7f0d11e00700 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c87109f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0d11400700 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870f3ba30 0x55c871083c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000c5b0 tx=0x7f0d00091040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f01a957303813 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0cf3e00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0cf3e00700 1 -- 172.21.15.47:0/2339413012 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000a93d0 con 0x55c870f3ba30 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0cf3e00700 1 -- 172.21.15.47:0/2339413012 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d0000cbd0 con 0x55c870f3ba30 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d0402a070 con 0x55c870f3ba30 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0cf3e00700 1 -- 172.21.15.47:0/2339413012 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d000a9fc0 con 0x55c870f3ba30 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0d27ab8b80 10 client.25102 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8710ffb20 con 0x55c870f3ba30 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.829+0000 7f0cf3e00700 1 -- 172.21.15.47:0/2339413012 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d0402a070 con 0x55c870f3ba30 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0cf3e00700 1 -- 172.21.15.47:0/2339413012 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0d000a9b20 con 0x55c870f3ba30 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0d27ab8b80 10 client.25102 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:55.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0d27ab8b80 10 client.25102 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0d27ab8b80 20 client.25102 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c871080ba0 0x55c871103430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0d27ab8b80 4 client.25102 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "status"}) -- 0x55c870faa3b0 con 0x55c871080ba0 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.830+0000 7f0d11e00700 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c871080ba0 0x55c871103430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d11e00700 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c871080ba0 0x55c871103430 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=467a60e1fef4f638 server_cookie=661599fc100c27cd in_seq=0 out_seq=0 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0cf3e00700 10 client.25102 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0cf3e00700 1 -- 172.21.15.47:0/2339413012 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c870faa3b0 con 0x55c871080ba0 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0cf3e00700 10 client.25102 handle_command_reply: tid=0 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 client.25102 shutdown 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870f3ba30 msgr2=0x55c871083c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870f3ba30 0x55c871083c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000c5b0 tx=0x7f0d00091040 comp rx=0 tx=0).stop 2024-05-14T12:24:55.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 shutdown_connections 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x55c871080ba0 0x55c871103430 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c87107ac00 0x55c8710841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c870efcdf0 0x55c87109f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 --2- 172.21.15.47:0/2339413012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c870f3ba30 0x55c871083c60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 >> 172.21.15.47:0/2339413012 conn(0x55c871093a50 msgr2=0x55c87106fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.831+0000 7f0cf3e00700 0 client.25102 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.832+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 shutdown_connections 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.832+0000 7f0d27ab8b80 1 -- 172.21.15.47:0/2339413012 wait complete. 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.832+0000 7f0d27ab8b80 20 client.25102 trim_cache size 0 max 16384 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:24:55.835 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 1, 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24521, 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 217.462449585, 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 256.01610832300003 2024-05-14T12:24:55.836 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:24:55.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.832+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cf80b2880 msgr2=0x7f0cf80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.832+0000 7f0d19000700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cf80b2880 0x7f0cf80b4d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b780 tx=0x7f0d0c00bb90 comp rx=0 tx=0).stop 2024-05-14T12:24:55.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.832+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d14106ed0 msgr2=0x7f0d1419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.832+0000 7f0d19000700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d14106ed0 0x7f0d1419d5b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009fd0 tx=0x7f0d0000ed10 comp rx=0 tx=0).stop 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 shutdown_connections 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cf80b2880 0x7f0cf80b4d90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d1410c5c0 0x7f0d141a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d14106580 0x7f0d1419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 --2- 172.21.15.47:0/2623219873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d14106ed0 0x7f0d1419d5b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 >> 172.21.15.47:0/2623219873 conn(0x7f0d14102080 msgr2=0x7f0d14104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 shutdown_connections 2024-05-14T12:24:55.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:55.833+0000 7f0d19000700 1 -- 172.21.15.47:0/2623219873 wait complete. 2024-05-14T12:24:56.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.a status 2024-05-14T12:24:57.183 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:24:57.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:57 smithi047 ceph-mon[31254]: pgmap v443: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:57.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:57 smithi073 ceph-mon[35809]: pgmap v443: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:57 smithi066 ceph-mon[35981]: pgmap v443: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:24:59.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 -- 172.21.15.47:0/3805223808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 msgr2=0x7ff9a010e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 --2- 172.21.15.47:0/3805223808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a010e3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff988009990 tx=0x7ff988009ca0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 -- 172.21.15.47:0/3805223808 shutdown_connections 2024-05-14T12:24:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 --2- 172.21.15.47:0/3805223808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9a010e900 0x7ff9a0110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 --2- 172.21.15.47:0/3805223808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9a0105520 0x7ff9a0105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 --2- 172.21.15.47:0/3805223808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a010e3c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 -- 172.21.15.47:0/3805223808 >> 172.21.15.47:0/3805223808 conn(0x7ff9a00fedc0 msgr2=0x7ff9a01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 -- 172.21.15.47:0/3805223808 shutdown_connections 2024-05-14T12:24:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.452+0000 7ff9a6000700 1 -- 172.21.15.47:0/3805223808 wait complete. 2024-05-14T12:24:59.454 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:24:59 smithi047 ceph-mon[31254]: pgmap v444: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:59.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.453+0000 7ff9a6000700 1 Processor -- start 2024-05-14T12:24:59.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.454+0000 7ff9a6000700 1 -- start start 2024-05-14T12:24:59.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.454+0000 7ff9a6000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9a0105520 0x7ff9a019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.454+0000 7ff9a6000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.454+0000 7ff9a6000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9a010e900 0x7ff9a01a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.454+0000 7ff9a6000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a0114490 con 0x7ff9a0105e70 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.454+0000 7ff9a6000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a0114310 con 0x7ff9a010e900 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.454+0000 7ff9a6000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a0114610 con 0x7ff9a0105520 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a019d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59620/0 (socket says 172.21.15.47:59620) 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99ea00700 1 -- 172.21.15.47:0/2483334451 learned_addr learned my addr 172.21.15.47:0/2483334451 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99f400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9a0105520 0x7ff9a019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99fe00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9a010e900 0x7ff9a01a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99fe00700 1 -- 172.21.15.47:0/2483334451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9a0105520 msgr2=0x7ff9a019d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99fe00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9a0105520 0x7ff9a019d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99fe00700 1 -- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 msgr2=0x7ff9a019d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99fe00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a019d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99fe00700 1 -- 172.21.15.47:0/2483334451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a01a1f10 con 0x7ff9a010e900 2024-05-14T12:24:59.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.455+0000 7ff99ea00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a019d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:59.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.456+0000 7ff99fe00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9a010e900 0x7ff9a01a1870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff99800efc0 tx=0x7ff99800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:59.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.456+0000 7ff997e00700 1 -- 172.21.15.47:0/2483334451 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980092e0 con 0x7ff9a010e900 2024-05-14T12:24:59.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.456+0000 7ff997e00700 1 -- 172.21.15.47:0/2483334451 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff998004bb0 con 0x7ff9a010e900 2024-05-14T12:24:59.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.456+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a01a21a0 con 0x7ff9a010e900 2024-05-14T12:24:59.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.456+0000 7ff997e00700 1 -- 172.21.15.47:0/2483334451 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998004020 con 0x7ff9a010e900 2024-05-14T12:24:59.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.456+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a01a9b20 con 0x7ff9a010e900 2024-05-14T12:24:59.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.462+0000 7ff997e00700 1 -- 172.21.15.47:0/2483334451 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff99801b030 con 0x7ff9a010e900 2024-05-14T12:24:59.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.462+0000 7ff9b4b95b80 1 Processor -- start 2024-05-14T12:24:59.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff9b4b95b80 1 -- start start 2024-05-14T12:24:59.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd4d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd4ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b96fc6f9d0 con 0x55b96fd4d9a0 2024-05-14T12:24:59.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b96fc0d710 con 0x55b96fd537e0 2024-05-14T12:24:59.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b96fc6b990 con 0x55b96fbcfdf0 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff99ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff99ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd4ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff99ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd4ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59630/0 (socket says 172.21.15.47:59630) 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff99ea00700 1 -- 172.21.15.47:0/1886492350 learned_addr learned my addr 172.21.15.47:0/1886492350 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.463+0000 7ff99f400700 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd4d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff99f400700 1 -- 172.21.15.47:0/1886492350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 msgr2=0x55b96fd532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff99f400700 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff99f400700 1 -- 172.21.15.47:0/1886492350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 msgr2=0x55b96fd4ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff99f400700 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd4ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff99f400700 1 -- 172.21.15.47:0/1886492350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96fbbc880 con 0x55b96fd537e0 2024-05-14T12:24:59.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff997e00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff9840b2900 0x7ff9840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff99ea00700 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd4ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:59.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff997e00700 1 -- 172.21.15.47:0/2483334451 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff9980e1c60 con 0x7ff9a010e900 2024-05-14T12:24:59.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.464+0000 7ff99f400700 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd4d460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff99000bc80 tx=0x7ff99000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe3c10af39ea7826 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:59.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.465+0000 7ff99ea00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff9840b2900 0x7ff9840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.465+0000 7ff994c00700 1 -- 172.21.15.47:0/1886492350 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990010ca0 con 0x55b96fd537e0 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.465+0000 7ff994c00700 1 -- 172.21.15.47:0/1886492350 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff990010e40 con 0x55b96fd537e0 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.465+0000 7ff994c00700 1 -- 172.21.15.47:0/1886492350 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990005280 con 0x55b96fd537e0 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/1886492350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 msgr2=0x55b96fd4d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff99ea00700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff9840b2900 0x7ff9840b4e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff9880096e0 tx=0x7ff98800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd4d460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff99000bc80 tx=0x7ff99000bf90 comp rx=0 tx=0).stop 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/1886492350 shutdown_connections 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd4ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/1886492350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd4d460 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/1886492350 >> 172.21.15.47:0/1886492350 conn(0x55b96fc14f20 msgr2=0x55b96fd48280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/1886492350 shutdown_connections 2024-05-14T12:24:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.466+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/1886492350 wait complete. 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.467+0000 7ff9b4b95b80 1 -- start start 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.467+0000 7ff9b4b95b80 1 Processor -- start 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd56fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd57500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd5a2c0 con 0x55b96fd4d9a0 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b96fbd5ad0 con 0x55b96fd537e0 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd5a440 con 0x55b96fbcfdf0 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff9b4b95b80 10 client.0 _ll_register_callbacks cb 0x55b96fc16c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff99ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd57500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff99ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd57500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59640/0 (socket says 172.21.15.47:59640) 2024-05-14T12:24:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff99ea00700 1 -- 172.21.15.47:0/3449149848 learned_addr learned my addr 172.21.15.47:0/3449149848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff99f400700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd56fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.468+0000 7ff99fe00700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff99f400700 1 -- 172.21.15.47:0/3449149848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 msgr2=0x55b96fd57a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff99f400700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff99f400700 1 -- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 msgr2=0x55b96fd57500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff99f400700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd57500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff99f400700 1 -- 172.21.15.47:0/3449149848 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96fc353d0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff99ea00700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd57500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff99f400700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd56fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff990011010 tx=0x7ff990004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d0ff0692ea2f177 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff98d600700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff98d600700 1 -- 172.21.15.47:0/3449149848 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990004040 con 0x55b96fbcfdf0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff98d600700 1 -- 172.21.15.47:0/3449149848 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff9900041e0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.469+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff990010e40 con 0x55b96fbcfdf0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.470+0000 7ff98d600700 1 -- 172.21.15.47:0/3449149848 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff9900043e0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.470+0000 7ff9b4b95b80 10 client.25114 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.470+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b96fd64dd0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.470+0000 7ff98d600700 1 -- 172.21.15.47:0/3449149848 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff990010e40 con 0x55b96fbcfdf0 2024-05-14T12:24:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.470+0000 7ff98d600700 1 -- 172.21.15.47:0/3449149848 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff990004ed0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.470+0000 7ff9b4b95b80 10 client.25114 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.470+0000 7ff9b4b95b80 10 client.25114 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T12:24:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.471+0000 7ff9b4b95b80 20 client.25114 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.471+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fd67160 0x55b96fd685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.471+0000 7ff9b4b95b80 4 client.25114 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:24:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.471+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b96fd1a170 con 0x55b96fd67160 2024-05-14T12:24:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.471+0000 7ff99ea00700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fd67160 0x55b96fd685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.472+0000 7ff98d600700 10 client.25114 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.472+0000 7ff99ea00700 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fd67160 0x55b96fd685d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd48859e735a1e60 server_cookie=4c4843c487927925 in_seq=0 out_seq=0 2024-05-14T12:24:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.472+0000 7ff98d600700 1 -- 172.21.15.47:0/3449149848 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b96fd1a170 con 0x55b96fd67160 2024-05-14T12:24:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.472+0000 7ff98d600700 10 client.25114 handle_command_reply: tid=0 2024-05-14T12:24:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.472+0000 7ff9b4b95b80 1 client.25114 shutdown 2024-05-14T12:24:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 msgr2=0x55b96fd56fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd56fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff990011010 tx=0x7ff990004750 comp rx=0 tx=0).stop 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 shutdown_connections 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fd67160 0x55b96fd685d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd56fc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3449149848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd57500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 >> 172.21.15.47:0/3449149848 conn(0x55b96fc14f20 msgr2=0x55b96fd4c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff98d600700 0 client.25114 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 shutdown_connections 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3449149848 wait complete. 2024-05-14T12:24:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.473+0000 7ff9b4b95b80 20 client.25114 trim_cache size 0 max 16384 2024-05-14T12:24:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 Processor -- start 2024-05-14T12:24:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 -- start start 2024-05-14T12:24:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd4d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd66910 con 0x55b96fd4d9a0 2024-05-14T12:24:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd66fe0 con 0x55b96fd537e0 2024-05-14T12:24:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd676b0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff99f400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd4d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.497+0000 7ff99f400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd4d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:57416/0 (socket says 172.21.15.47:57416) 2024-05-14T12:24:59.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99f400700 1 -- 172.21.15.47:0/3803889173 learned_addr learned my addr 172.21.15.47:0/3803889173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:59.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99fe00700 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99ea00700 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99f400700 1 -- 172.21.15.47:0/3803889173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 msgr2=0x55b96fd57880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99f400700 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99f400700 1 -- 172.21.15.47:0/3803889173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 msgr2=0x55b96fd636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99f400700 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99f400700 1 -- 172.21.15.47:0/3803889173 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96fd5a3f0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff99f400700 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd4d460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff990005460 tx=0x7ff99000b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4395b2ba23bc23b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.498+0000 7ff98fe00700 1 -- 172.21.15.47:0/3803889173 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990034070 con 0x55b96fbcfdf0 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff98fe00700 1 -- 172.21.15.47:0/3803889173 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9900106b0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff98fe00700 1 -- 172.21.15.47:0/3803889173 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990003680 con 0x55b96fbcfdf0 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3803889173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 msgr2=0x55b96fd4d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd4d460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff990005460 tx=0x7ff99000b810 comp rx=0 tx=0).stop 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3803889173 shutdown_connections 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fd537e0 0x55b96fd57880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fbcfdf0 0x55b96fd4d460 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/3803889173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.499+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3803889173 >> 172.21.15.47:0/3803889173 conn(0x55b96fc14f20 msgr2=0x55b96fd52060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.500+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3803889173 shutdown_connections 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.500+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/3803889173 wait complete. 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.500+0000 7ff9b4b95b80 1 -- start start 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.500+0000 7ff9b4b95b80 1 Processor -- start 2024-05-14T12:24:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fbcfdf0 0x55b96fd6bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd6c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff9b4b95b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fd537e0 0x55b96fd6ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd68450 con 0x55b96fd4d9a0 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd67d80 con 0x55b96fbcfdf0 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff9b4b95b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b96fd68b20 con 0x55b96fd537e0 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff9b4b95b80 10 client.0 _ll_register_callbacks cb 0x55b96fc16c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff99f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fbcfdf0 0x55b96fd6bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff99f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fbcfdf0 0x55b96fd6bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41952/0 (socket says 172.21.15.47:41952) 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff99f400700 1 -- 172.21.15.47:0/2344192341 learned_addr learned my addr 172.21.15.47:0/2344192341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff99ea00700 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd6c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.501+0000 7ff99fe00700 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fd537e0 0x55b96fd6ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff99f400700 1 -- 172.21.15.47:0/2344192341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fd537e0 msgr2=0x55b96fd6ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff99f400700 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fd537e0 0x55b96fd6ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff99f400700 1 -- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 msgr2=0x55b96fd6c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff99f400700 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd6c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff99f400700 1 -- 172.21.15.47:0/2344192341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96fd710d0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff99f400700 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fbcfdf0 0x55b96fd6bfd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff990032040 tx=0x7ff990010aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6d78c330741599 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff98d600700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:24:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff98d600700 1 -- 172.21.15.47:0/2344192341 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990034070 con 0x55b96fbcfdf0 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9900106b0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.502+0000 7ff98d600700 1 -- 172.21.15.47:0/2344192341 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff990004e10 con 0x55b96fbcfdf0 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff98d600700 1 -- 172.21.15.47:0/2344192341 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff990010e90 con 0x55b96fbcfdf0 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff9b4b95b80 10 client.25094 fetch_fsmap learned FSMap version 28 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b96fdd2870 con 0x55b96fbcfdf0 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff98d600700 1 -- 172.21.15.47:0/2344192341 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9900106b0 con 0x55b96fbcfdf0 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff98d600700 1 -- 172.21.15.47:0/2344192341 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff990025510 con 0x55b96fbcfdf0 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff9b4b95b80 10 client.25094 fetch_fsmap finished waiting for FSMap version 28 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff9b4b95b80 10 client.25094 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.503+0000 7ff9b4b95b80 20 client.25094 populate_metadata read hostname 'smithi047' 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.504+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fdd4940 0x55b96fdd5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.504+0000 7ff9b4b95b80 4 client.25094 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.504+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "status"}) -- 0x55b96fc7d3b0 con 0x55b96fdd4940 2024-05-14T12:24:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.504+0000 7ff99ea00700 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fdd4940 0x55b96fdd5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:24:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.504+0000 7ff99ea00700 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fdd4940 0x55b96fdd5db0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a632d92c0fd70263 server_cookie=1353fa6a8f6b37c3 in_seq=0 out_seq=0 2024-05-14T12:24:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.504+0000 7ff98d600700 10 client.25094 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff98d600700 1 -- 172.21.15.47:0/2344192341 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b96fc7d3b0 con 0x55b96fdd4940 2024-05-14T12:24:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff98d600700 10 client.25094 handle_command_reply: tid=0 2024-05-14T12:24:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 client.25094 shutdown 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fbcfdf0 msgr2=0x55b96fd6bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fbcfdf0 0x55b96fd6bfd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff990032040 tx=0x7ff990010aa0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 shutdown_connections 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b96fdd4940 0x55b96fdd5db0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b96fd537e0 0x55b96fd6ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b96fbcfdf0 0x55b96fd6bfd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 --2- 172.21.15.47:0/2344192341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b96fd4d9a0 0x55b96fd6c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff98d600700 0 client.25094 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 >> 172.21.15.47:0/2344192341 conn(0x55b96fc14f20 msgr2=0x55b96fd578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 shutdown_connections 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 1 -- 172.21.15.47:0/2344192341 wait complete. 2024-05-14T12:24:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.505+0000 7ff9b4b95b80 20 client.25094 trim_cache size 0 max 16384 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24535, 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 236.830295474, 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 28, 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 82, 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 262.49973719799999 2024-05-14T12:24:59.509 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:24:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff9840b2900 msgr2=0x7ff9840b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff9840b2900 0x7ff9840b4e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff9880096e0 tx=0x7ff98800b280 comp rx=0 tx=0).stop 2024-05-14T12:24:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9a010e900 msgr2=0x7ff9a01a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:24:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9a010e900 0x7ff9a01a1870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff99800efc0 tx=0x7ff99800c3a0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 shutdown_connections 2024-05-14T12:24:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff9840b2900 0x7ff9840b4e10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9a010e900 0x7ff9a01a1870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9a0105520 0x7ff9a019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 --2- 172.21.15.47:0/2483334451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a0105e70 0x7ff9a019d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:24:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.506+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 >> 172.21.15.47:0/2483334451 conn(0x7ff9a00fedc0 msgr2=0x7ff9a01031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:24:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.507+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 shutdown_connections 2024-05-14T12:24:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:24:59.507+0000 7ff9a6000700 1 -- 172.21.15.47:0/2483334451 wait complete. 2024-05-14T12:24:59.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:24:59 smithi073 ceph-mon[35809]: pgmap v444: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:24:59.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:24:59 smithi066 ceph-mon[35981]: pgmap v444: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:25:00.441 INFO:teuthology.run_tasks:Running task sequential... 2024-05-14T12:25:00.456 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-14T12:25:00.456 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-14T12:25:00.457 INFO:teuthology.task.print:Enabling mgr modules 2024-05-14T12:25:00.457 INFO:teuthology.run_tasks:Running task kclient... 2024-05-14T12:25:00.501 INFO:tasks.kclient:Mounting kernel clients... 2024-05-14T12:25:00.501 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-14T12:25:00.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:00.502 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-14T12:25:00.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:00.563 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-14T12:25:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-05-14T12:25:00.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:25:00.663 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-05-14T12:25:00.663 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T12:25:00.663 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:00.663 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-14T12:25:01.140 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:01.548 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:01 smithi047 ceph-mon[31254]: pgmap v445: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:25:01.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:01 smithi073 ceph-mon[35809]: pgmap v445: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:25:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:01 smithi066 ceph-mon[35981]: pgmap v445: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:25:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 -- 172.21.15.47:0/1311396623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 msgr2=0x7fd5881049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 --2- 172.21.15.47:0/1311396623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd5881049e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd5780099c0 tx=0x7fd578009cd0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 -- 172.21.15.47:0/1311396623 shutdown_connections 2024-05-14T12:25:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 --2- 172.21.15.47:0/1311396623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd588109850 0x7fd5881111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 --2- 172.21.15.47:0/1311396623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd5881049e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 --2- 172.21.15.47:0/1311396623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd588108f00 0x7fd588109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 -- 172.21.15.47:0/1311396623 >> 172.21.15.47:0/1311396623 conn(0x7fd5880ffea0 msgr2=0x7fd5881022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:03.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 -- 172.21.15.47:0/1311396623 shutdown_connections 2024-05-14T12:25:03.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.558+0000 7fd58e400700 1 -- 172.21.15.47:0/1311396623 wait complete. 2024-05-14T12:25:03.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.559+0000 7fd58e400700 1 Processor -- start 2024-05-14T12:25:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.559+0000 7fd58e400700 1 -- start start 2024-05-14T12:25:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd58e400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd58819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd58e400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd588108f00 0x7fd58819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd58e400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd588109850 0x7fd5881a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd58e400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114480 con 0x7fd5881045d0 2024-05-14T12:25:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd58e400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114300 con 0x7fd588109850 2024-05-14T12:25:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd58e400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114600 con 0x7fd588108f00 2024-05-14T12:25:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd587400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd58819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd586a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd588108f00 0x7fd58819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd587400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd58819d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59676/0 (socket says 172.21.15.47:59676) 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.560+0000 7fd587400700 1 -- 172.21.15.47:0/3394264466 learned_addr learned my addr 172.21.15.47:0/3394264466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587e00700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd588109850 0x7fd5881a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587400700 1 -- 172.21.15.47:0/3394264466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd588108f00 msgr2=0x7fd58819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd588108f00 0x7fd58819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587400700 1 -- 172.21.15.47:0/3394264466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd588109850 msgr2=0x7fd5881a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd588109850 0x7fd5881a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587400700 1 -- 172.21.15.47:0/3394264466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5881a2000 con 0x7fd5881045d0 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587e00700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd588109850 0x7fd5881a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.561+0000 7fd587400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd58819d130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd578006010 tx=0x7fd578005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.562+0000 7fd57fe00700 1 -- 172.21.15.47:0/3394264466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578026070 con 0x7fd5881045d0 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.562+0000 7fd57fe00700 1 -- 172.21.15.47:0/3394264466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd578005680 con 0x7fd5881045d0 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.562+0000 7fd57fe00700 1 -- 172.21.15.47:0/3394264466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57800fb20 con 0x7fd5881045d0 2024-05-14T12:25:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.562+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5881a2290 con 0x7fd5881045d0 2024-05-14T12:25:03.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.562+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5881a2720 con 0x7fd5881045d0 2024-05-14T12:25:03.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.563+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5880512c0 con 0x7fd5881045d0 2024-05-14T12:25:03.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.566+0000 7fd57fe00700 1 -- 172.21.15.47:0/3394264466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd578029070 con 0x7fd5881045d0 2024-05-14T12:25:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.567+0000 7fd57fe00700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd56c0b2880 0x7fd56c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.567+0000 7fd57fe00700 1 -- 172.21.15.47:0/3394264466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd5780e3160 con 0x7fd5881045d0 2024-05-14T12:25:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.568+0000 7fd586a00700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd56c0b2880 0x7fd56c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.568+0000 7fd586a00700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd56c0b2880 0x7fd56c0b4d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd588107640 tx=0x7fd574009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.570+0000 7fd57fe00700 1 -- 172.21.15.47:0/3394264466 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd578030080 con 0x7fd5881045d0 2024-05-14T12:25:03.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:03 smithi047 ceph-mon[31254]: pgmap v446: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:25:03.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:03 smithi073 ceph-mon[35809]: pgmap v446: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:25:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:03 smithi066 ceph-mon[35981]: pgmap v446: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:25:03.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.863+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd5881a9cd0 con 0x7fd5881045d0 2024-05-14T12:25:03.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.864+0000 7fd57fe00700 1 -- 172.21.15.47:0/3394264466 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7fd578013070 con 0x7fd5881045d0 2024-05-14T12:25:03.865 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T12:25:03.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.867+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd56c0b2880 msgr2=0x7fd56c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:03.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.867+0000 7fd58e400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd56c0b2880 0x7fd56c0b4d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd588107640 tx=0x7fd574009260 comp rx=0 tx=0).stop 2024-05-14T12:25:03.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.867+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 msgr2=0x7fd58819d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:03.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.867+0000 7fd58e400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd58819d130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd578006010 tx=0x7fd578005280 comp rx=0 tx=0).stop 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.867+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 shutdown_connections 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.868+0000 7fd58e400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd56c0b2880 0x7fd56c0b4d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.868+0000 7fd58e400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd588109850 0x7fd5881a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.868+0000 7fd58e400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5881045d0 0x7fd58819d130 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.868+0000 7fd58e400700 1 --2- 172.21.15.47:0/3394264466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd588108f00 0x7fd58819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.868+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 >> 172.21.15.47:0/3394264466 conn(0x7fd5880ffea0 msgr2=0x7fd588110480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.868+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 shutdown_connections 2024-05-14T12:25:03.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:03.868+0000 7fd58e400700 1 -- 172.21.15.47:0/3394264466 wait complete. 2024-05-14T12:25:04.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:04 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3394264466' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T12:25:04.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:04 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3394264466' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T12:25:04.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:04 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3394264466' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T12:25:04.893 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T12:25:04.894 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T12:25:04.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:04.895 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-14T12:25:04.955 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T12:25:04.955 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T12:25:04.955 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T12:25:04.955 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-14T12:25:04.955 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-14T12:25:04.955 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-14T12:25:04.956 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 41762sec preferred_lft 41762sec 2024-05-14T12:25:04.957 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-05-14T12:25:04.957 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-14T12:25:04.957 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T12:25:04.957 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-14T12:25:04.957 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-14T12:25:04.958 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T12:25:04.958 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T12:25:04.958 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-14T12:25:04.959 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-05-14T12:25:04.959 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-05-14T12:25:04.959 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-05-14T12:25:04.959 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T12:25:04.959 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-14T12:25:05.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T12:25:05.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:05.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:05.474 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-14T12:25:05.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:05.551 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T12:25:05.618 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T12:25:05.618 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-14T12:25:05.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T12:25:05.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T12:25:05.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T12:25:05.618 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T12:25:05.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:05 smithi047 ceph-mon[31254]: pgmap v447: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:25:05.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:05 smithi073 ceph-mon[35809]: pgmap v447: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:25:05.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:05 smithi066 ceph-mon[35981]: pgmap v447: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:25:06.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:06.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:06.358 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-14T12:25:06.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:06.417 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-14T12:25:06.475 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T12:25:06.475 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-14T12:25:06.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T12:25:06.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-14T12:25:06.476 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-14T12:25:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T12:25:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:06.679 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-14T12:25:06.679 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T12:25:06.679 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-14T12:25:06.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-14T12:25:06.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T12:25:06.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-14T12:25:06.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-14T12:25:06.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-14T12:25:06.680 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-14T12:25:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T12:25:07.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:07.010 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T12:25:07.010 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-14T12:25:07.010 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-14T12:25:07.010 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T12:25:07.010 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-14T12:25:07.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T12:25:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:07.225 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T12:25:07.225 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:07.273 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T12:25:07.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T12:25:07.273 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:07.322 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-14T12:25:07.322 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-14T12:25:07.323 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/861dd1bf-e8ef-4241-938f-ed5a8904f261 2024-05-14T12:25:07.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:07.323 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/861dd1bf-e8ef-4241-938f-ed5a8904f261 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-05-14T12:25:07.543 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-05-14T12:25:07.543 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-05-14T12:25:07.725 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:07 smithi047 ceph-mon[31254]: pgmap v448: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:25:07.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:07 smithi073 ceph-mon[35809]: pgmap v448: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:25:07.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:07 smithi066 ceph-mon[35981]: pgmap v448: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:25:08.292 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-05-14T12:25:08.292 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-05-14T12:25:08.292 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.66:3300,172.21.15.73:3300" 2024-05-14T12:25:08.293 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with new device syntax: 0@e5959f02-11ea-11ef-bc98-c7b262605968.cephfs=/volumes/qa/sv_1/861dd1bf-e8ef-4241-938f-ed5a8904f261 2024-05-14T12:25:08.293 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync,name=0,key=0,mon_addr=172.21.15.47:3300/172.21.15.66:3300/172.21.15.73:3300" will pass to kernel 2024-05-14T12:25:08.300 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-14T12:25:08.300 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-05-14T12:25:08.300 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-14T12:25:08.300 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-05-14T12:25:08.300 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-14T12:25:08.307 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-14T12:25:08.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:25:08.307 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:08.399 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T12:25:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T12:25:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:08.528 INFO:teuthology.orchestra.run.smithi047.stdout:client25103 2024-05-14T12:25:08.528 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:25:08.528 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T12:25:08.585 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T12:25:08.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T12:25:08.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:08.711 INFO:teuthology.orchestra.run.smithi047.stdout:client25103 2024-05-14T12:25:08.711 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T12:25:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T12:25:08.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:08.836 INFO:teuthology.orchestra.run.smithi047.stdout:client25103 2024-05-14T12:25:08.836 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e5959f02-11ea-11ef-bc98-c7b262605968.client25103/status') 2024-05-14T12:25:08.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T12:25:08.980 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.25103 (3)172.21.15.47:0/2311713047 2024-05-14T12:25:08.980 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-05-14T12:25:08.980 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-05-14T12:25:08.980 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-05-14T12:25:08.980 INFO:teuthology.orchestra.run.smithi047.stderr:71 bytes copied, 0.000123598 s, 574 kB/s 2024-05-14T12:25:08.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T12:25:08.994 INFO:teuthology.run_tasks:Running task exec... 2024-05-14T12:25:09.008 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T12:25:09.008 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T12:25:09.008 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-05-14T12:25:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 -- 172.21.15.47:0/1628564671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27241099c0 msgr2=0x7f272410bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 --2- 172.21.15.47:0/1628564671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27241099c0 0x7f272410bde0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f271c009ca0 tx=0x7f271c02a8c0 comp rx=0 tx=0).stop 2024-05-14T12:25:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 -- 172.21.15.47:0/1628564671 shutdown_connections 2024-05-14T12:25:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 --2- 172.21.15.47:0/1628564671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27241099c0 0x7f272410bde0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:09.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 --2- 172.21.15.47:0/1628564671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2724104cc0 0x7f27241050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:09.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 --2- 172.21.15.47:0/1628564671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2724103a80 0x7f2724104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:09.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 -- 172.21.15.47:0/1628564671 >> 172.21.15.47:0/1628564671 conn(0x7f27240fec70 msgr2=0x7f2724101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:09.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 -- 172.21.15.47:0/1628564671 shutdown_connections 2024-05-14T12:25:09.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.286+0000 7f272a600640 1 -- 172.21.15.47:0/1628564671 wait complete. 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.287+0000 7f272a600640 1 Processor -- start 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.287+0000 7f272a600640 1 -- start start 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f272a600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2724103a80 0x7f272419c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f272a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2724104cc0 0x7f272419c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f272a600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27241099c0 0x7f27241a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f272a600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f272410f6a0 con 0x7f2724104cc0 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f272a600640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f272410f520 con 0x7f27241099c0 2024-05-14T12:25:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f272a600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f272410f820 con 0x7f2724103a80 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f271be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2724104cc0 0x7f272419c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f2729200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2724103a80 0x7f272419c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f271be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2724104cc0 0x7f272419c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57156/0 (socket says 172.21.15.47:57156) 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f271be00640 1 -- 172.21.15.47:0/3462438255 learned_addr learned my addr 172.21.15.47:0/3462438255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.288+0000 7f2729c00640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27241099c0 0x7f27241a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2729200640 1 -- 172.21.15.47:0/3462438255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27241099c0 msgr2=0x7f27241a3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2729200640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27241099c0 0x7f27241a3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2729200640 1 -- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2724104cc0 msgr2=0x7f272419c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2729200640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2724104cc0 0x7f272419c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2729200640 1 -- 172.21.15.47:0/3462438255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27241a3e80 con 0x7f2724103a80 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f271be00640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2724104cc0 0x7f272419c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2729200640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2724103a80 0x7f272419c340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2724103350 tx=0x7f270c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:09.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2722000640 1 -- 172.21.15.47:0/3462438255 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c00cc40 con 0x7f2724103a80 2024-05-14T12:25:09.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2722000640 1 -- 172.21.15.47:0/3462438255 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f270c00cde0 con 0x7f2724103a80 2024-05-14T12:25:09.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27241a4170 con 0x7f2724103a80 2024-05-14T12:25:09.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f2722000640 1 -- 172.21.15.47:0/3462438255 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c010430 con 0x7f2724103a80 2024-05-14T12:25:09.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.289+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27241a4710 con 0x7f2724103a80 2024-05-14T12:25:09.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.291+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27241a49d0 con 0x7f2724103a80 2024-05-14T12:25:09.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.293+0000 7f2722000640 1 -- 172.21.15.47:0/3462438255 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f270c003eb0 con 0x7f2724103a80 2024-05-14T12:25:09.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.295+0000 7f2722000640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f27040b2920 0x7f27040b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:09.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.295+0000 7f2722000640 1 -- 172.21.15.47:0/3462438255 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f270c0e2690 con 0x7f2724103a80 2024-05-14T12:25:09.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.295+0000 7f271be00640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f27040b2920 0x7f27040b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:09.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.296+0000 7f271be00640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f27040b2920 0x7f27040b4e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f272419d3e0 tx=0x7f2714005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:09.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.297+0000 7f2722000640 1 -- 172.21.15.47:0/3462438255 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f270c0aa400 con 0x7f2724103a80 2024-05-14T12:25:09.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:09.554+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f27241a4ba0 con 0x7f2724103a80 2024-05-14T12:25:09.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:09 smithi047 ceph-mon[31254]: pgmap v449: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:25:09.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:09 smithi073 ceph-mon[35809]: pgmap v449: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:25:09.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:09 smithi066 ceph-mon[35981]: pgmap v449: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:25:10.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.486+0000 7f2722000640 1 -- 172.21.15.47:0/3462438255 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f270c0a9d00 con 0x7f2724103a80 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f27040b2920 msgr2=0x7f27040b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f27040b2920 0x7f27040b4e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f272419d3e0 tx=0x7f2714005f90 comp rx=0 tx=0).stop 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2724103a80 msgr2=0x7f272419c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2724103a80 0x7f272419c340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2724103350 tx=0x7f270c00ee50 comp rx=0 tx=0).stop 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 shutdown_connections 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f27040b2920 0x7f27040b4e30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27241099c0 0x7f27241a3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2724104cc0 0x7f272419c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 --2- 172.21.15.47:0/3462438255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2724103a80 0x7f272419c340 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:10.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.490+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 >> 172.21.15.47:0/3462438255 conn(0x7f27240fec70 msgr2=0x7f27240ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:10.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.491+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 shutdown_connections 2024-05-14T12:25:10.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:10.491+0000 7f272a600640 1 -- 172.21.15.47:0/3462438255 wait complete. 2024-05-14T12:25:10.526 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-14T12:25:10.537 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-14T12:25:10.579 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T12:25:10.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-14T12:25:10.587 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-14T12:25:10.632 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-14T12:25:10.632 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T12:25:10.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:10 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3462438255' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T12:25:10.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:10 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T12:25:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:10 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3462438255' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T12:25:10.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:10 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T12:25:10.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:10 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3462438255' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T12:25:10.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:10 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T12:25:11.085 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:11 smithi073 ceph-mon[35809]: pgmap v450: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T12:25:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:11 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T12:25:11.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:11 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:25:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:11 smithi066 ceph-mon[35981]: pgmap v450: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T12:25:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:11 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T12:25:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:11 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:25:11.973 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:11 smithi047 ceph-mon[31254]: pgmap v450: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-14T12:25:11.973 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:11 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T12:25:11.973 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:11 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:25:13.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 -- 172.21.15.47:0/2698068109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 msgr2=0x7fd2e0112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:13.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 --2- 172.21.15.47:0/2698068109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 0x7fd2e0112e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b0a0 tx=0x7fd2d800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 -- 172.21.15.47:0/2698068109 shutdown_connections 2024-05-14T12:25:13.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 --2- 172.21.15.47:0/2698068109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 0x7fd2e0112e10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 --2- 172.21.15.47:0/2698068109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 0x7fd2e0076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 --2- 172.21.15.47:0/2698068109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2e0076680 0x7fd2e0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 -- 172.21.15.47:0/2698068109 >> 172.21.15.47:0/2698068109 conn(0x7fd2e0079d10 msgr2=0x7fd2e007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:13.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 -- 172.21.15.47:0/2698068109 shutdown_connections 2024-05-14T12:25:13.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.379+0000 7fd2df200700 1 -- 172.21.15.47:0/2698068109 wait complete. 2024-05-14T12:25:13.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.381+0000 7fd2df200700 1 Processor -- start 2024-05-14T12:25:13.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.381+0000 7fd2df200700 1 -- start start 2024-05-14T12:25:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.381+0000 7fd2df200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 0x7fd2e019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.381+0000 7fd2df200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2e0076680 0x7fd2e019d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.381+0000 7fd2df200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 0x7fd2e01a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.381+0000 7fd2df200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e01164e0 con 0x7fd2e0076680 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.381+0000 7fd2df200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0116360 con 0x7fd2e0075d30 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 0x7fd2e019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2df200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0116660 con 0x7fd2e01109b0 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 0x7fd2e019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:44034/0 (socket says 172.21.15.47:44034) 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 -- 172.21.15.47:0/2778582673 learned_addr learned my addr 172.21.15.47:0/2778582673 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dd400700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2e0076680 0x7fd2e019d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2de800700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 0x7fd2e01a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:13.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 -- 172.21.15.47:0/2778582673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 msgr2=0x7fd2e01a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 0x7fd2e01a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 -- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2e0076680 msgr2=0x7fd2e019d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2e0076680 0x7fd2e019d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dde00700 1 -- 172.21.15.47:0/2778582673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e01a1d00 con 0x7fd2e0075d30 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.382+0000 7fd2dd400700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2e0076680 0x7fd2e019d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.383+0000 7fd2dde00700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 0x7fd2e019ce30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000e9a0 tx=0x7fd2d000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.383+0000 7fd2d6a00700 1 -- 172.21.15.47:0/2778582673 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000cbd0 con 0x7fd2e0075d30 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.383+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e01a1ff0 con 0x7fd2e0075d30 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.383+0000 7fd2d6a00700 1 -- 172.21.15.47:0/2778582673 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d000cd70 con 0x7fd2e0075d30 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.383+0000 7fd2d6a00700 1 -- 172.21.15.47:0/2778582673 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0018680 con 0x7fd2e0075d30 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.383+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01a9910 con 0x7fd2e0075d30 2024-05-14T12:25:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.384+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e00772a0 con 0x7fd2e0075d30 2024-05-14T12:25:13.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.387+0000 7fd2d6a00700 1 -- 172.21.15.47:0/2778582673 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd2d0010430 con 0x7fd2e0075d30 2024-05-14T12:25:13.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.388+0000 7fd2d6a00700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2c40b2880 0x7fd2c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:13.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.389+0000 7fd2d6a00700 1 -- 172.21.15.47:0/2778582673 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd2d00e2980 con 0x7fd2e0075d30 2024-05-14T12:25:13.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.389+0000 7fd2dd400700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2c40b2880 0x7fd2c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:13.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.389+0000 7fd2dd400700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2c40b2880 0x7fd2c40b4d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2e01127c0 tx=0x7fd2cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:13.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.391+0000 7fd2d6a00700 1 -- 172.21.15.47:0/2778582673 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2d00aa660 con 0x7fd2e0075d30 2024-05-14T12:25:13.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.628+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2e0063c00 con 0x7fd2c40b2880 2024-05-14T12:25:13.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.641+0000 7fd2d6a00700 1 -- 172.21.15.47:0/2778582673 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258887 (secure 0 0 0) 0x7fd2e0063c00 con 0x7fd2c40b2880 2024-05-14T12:25:13.642 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:13 smithi047 ceph-mon[31254]: pgmap v451: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:25:13.644 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:25:13.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2c40b2880 msgr2=0x7fd2c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:13.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2c40b2880 0x7fd2c40b4d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd2e01127c0 tx=0x7fd2cc009260 comp rx=0 tx=0).stop 2024-05-14T12:25:13.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 msgr2=0x7fd2e019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:13.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 0x7fd2e019ce30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000e9a0 tx=0x7fd2d000ecb0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 shutdown_connections 2024-05-14T12:25:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd2c40b2880 0x7fd2c40b4d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2e01109b0 0x7fd2e01a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2e0075d30 0x7fd2e019ce30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 --2- 172.21.15.47:0/2778582673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2e0076680 0x7fd2e019d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.647+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 >> 172.21.15.47:0/2778582673 conn(0x7fd2e0079d10 msgr2=0x7fd2e0100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.648+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 shutdown_connections 2024-05-14T12:25:13.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:13.648+0000 7fd2df200700 1 -- 172.21.15.47:0/2778582673 wait complete. 2024-05-14T12:25:13.652 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-14T12:25:13.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:13 smithi073 ceph-mon[35809]: pgmap v451: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:25:13.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:13 smithi066 ceph-mon[35981]: pgmap v451: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:25:14.559 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-05-14T12:25:12.366624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663681,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2382,"num_read_kb":1302,"num_write":388,"num_write_kb":2306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2952484,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374664,"kb_used_data":13032,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567160,"statfs":{"total":1151940427776,"available":1151556771840,"internally_reserved":0,"allocated":13344768,"data_stored":7310979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":620,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":67,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.011157"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.249926+0000","last_change":"2024-05-14T12:20:59.669913+0000","last_active":"2024-05-14T12:23:08.249926+0000","last_peered":"2024-05-14T12:23:08.249926+0000","last_clean":"2024-05-14T12:23:08.249926+0000","last_became_active":"2024-05-14T12:20:59.668481+0000","last_became_peered":"2024-05-14T12:20:59.668481+0000","last_unstale":"2024-05-14T12:23:08.249926+0000","last_undegraded":"2024-05-14T12:23:08.249926+0000","last_fullsized":"2024-05-14T12:23:08.249926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:13.671516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247467+0000","last_change":"2024-05-14T12:20:59.665032+0000","last_active":"2024-05-14T12:23:08.247467+0000","last_peered":"2024-05-14T12:23:08.247467+0000","last_clean":"2024-05-14T12:23:08.247467+0000","last_became_active":"2024-05-14T12:20:59.664471+0000","last_became_peered":"2024-05-14T12:20:59.664471+0000","last_unstale":"2024-05-14T12:23:08.247467+0000","last_undegraded":"2024-05-14T12:23:08.247467+0000","last_fullsized":"2024-05-14T12:23:08.247467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:58:02.354064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255407+0000","last_change":"2024-05-14T12:20:59.679975+0000","last_active":"2024-05-14T12:23:08.255407+0000","last_peered":"2024-05-14T12:23:08.255407+0000","last_clean":"2024-05-14T12:23:08.255407+0000","last_became_active":"2024-05-14T12:20:59.679586+0000","last_became_peered":"2024-05-14T12:20:59.679586+0000","last_unstale":"2024-05-14T12:23:08.255407+0000","last_undegraded":"2024-05-14T12:23:08.255407+0000","last_fullsized":"2024-05-14T12:23:08.255407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:45:37.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241224+0000","last_change":"2024-05-14T12:20:59.668125+0000","last_active":"2024-05-14T12:23:08.241224+0000","last_peered":"2024-05-14T12:23:08.241224+0000","last_clean":"2024-05-14T12:23:08.241224+0000","last_became_active":"2024-05-14T12:20:59.667664+0000","last_became_peered":"2024-05-14T12:20:59.667664+0000","last_unstale":"2024-05-14T12:23:08.241224+0000","last_undegraded":"2024-05-14T12:23:08.241224+0000","last_fullsized":"2024-05-14T12:23:08.241224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:29.995159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256345+0000","last_change":"2024-05-14T12:20:59.682787+0000","last_active":"2024-05-14T12:23:08.256345+0000","last_peered":"2024-05-14T12:23:08.256345+0000","last_clean":"2024-05-14T12:23:08.256345+0000","last_became_active":"2024-05-14T12:20:59.682462+0000","last_became_peered":"2024-05-14T12:20:59.682462+0000","last_unstale":"2024-05-14T12:23:08.256345+0000","last_undegraded":"2024-05-14T12:23:08.256345+0000","last_fullsized":"2024-05-14T12:23:08.256345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:27.287750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.242052+0000","last_change":"2024-05-14T12:21:39.506661+0000","last_active":"2024-05-14T12:23:08.242052+0000","last_peered":"2024-05-14T12:23:08.242052+0000","last_clean":"2024-05-14T12:23:08.242052+0000","last_became_active":"2024-05-14T12:21:39.506116+0000","last_became_peered":"2024-05-14T12:21:39.506116+0000","last_unstale":"2024-05-14T12:23:08.242052+0000","last_undegraded":"2024-05-14T12:23:08.242052+0000","last_fullsized":"2024-05-14T12:23:08.242052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:18.551207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244412+0000","last_change":"2024-05-14T12:20:59.671683+0000","last_active":"2024-05-14T12:23:08.244412+0000","last_peered":"2024-05-14T12:23:08.244412+0000","last_clean":"2024-05-14T12:23:08.244412+0000","last_became_active":"2024-05-14T12:20:59.671307+0000","last_became_peered":"2024-05-14T12:20:59.671307+0000","last_unstale":"2024-05-14T12:23:08.244412+0000","last_undegraded":"2024-05-14T12:23:08.244412+0000","last_fullsized":"2024-05-14T12:23:08.244412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.744159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253965+0000","last_change":"2024-05-14T12:21:39.504953+0000","last_active":"2024-05-14T12:23:08.253965+0000","last_peered":"2024-05-14T12:23:08.253965+0000","last_clean":"2024-05-14T12:23:08.253965+0000","last_became_active":"2024-05-14T12:21:39.504267+0000","last_became_peered":"2024-05-14T12:21:39.504267+0000","last_unstale":"2024-05-14T12:23:08.253965+0000","last_undegraded":"2024-05-14T12:23:08.253965+0000","last_fullsized":"2024-05-14T12:23:08.253965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:04.329324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247427+0000","last_change":"2024-05-14T12:20:59.663319+0000","last_active":"2024-05-14T12:23:08.247427+0000","last_peered":"2024-05-14T12:23:08.247427+0000","last_clean":"2024-05-14T12:23:08.247427+0000","last_became_active":"2024-05-14T12:20:59.662618+0000","last_became_peered":"2024-05-14T12:20:59.662618+0000","last_unstale":"2024-05-14T12:23:08.247427+0000","last_undegraded":"2024-05-14T12:23:08.247427+0000","last_fullsized":"2024-05-14T12:23:08.247427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:18.032899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244456+0000","last_change":"2024-05-14T12:20:59.671006+0000","last_active":"2024-05-14T12:23:08.244456+0000","last_peered":"2024-05-14T12:23:08.244456+0000","last_clean":"2024-05-14T12:23:08.244456+0000","last_became_active":"2024-05-14T12:20:59.670632+0000","last_became_peered":"2024-05-14T12:20:59.670632+0000","last_unstale":"2024-05-14T12:23:08.244456+0000","last_undegraded":"2024-05-14T12:23:08.244456+0000","last_fullsized":"2024-05-14T12:23:08.244456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:12:30.144637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245298+0000","last_change":"2024-05-14T12:20:59.675968+0000","last_active":"2024-05-14T12:23:08.245298+0000","last_peered":"2024-05-14T12:23:08.245298+0000","last_clean":"2024-05-14T12:23:08.245298+0000","last_became_active":"2024-05-14T12:20:59.675551+0000","last_became_peered":"2024-05-14T12:20:59.675551+0000","last_unstale":"2024-05-14T12:23:08.245298+0000","last_undegraded":"2024-05-14T12:23:08.245298+0000","last_fullsized":"2024-05-14T12:23:08.245298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:39.562658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241448+0000","last_change":"2024-05-14T12:20:59.671011+0000","last_active":"2024-05-14T12:23:08.241448+0000","last_peered":"2024-05-14T12:23:08.241448+0000","last_clean":"2024-05-14T12:23:08.241448+0000","last_became_active":"2024-05-14T12:20:59.670637+0000","last_became_peered":"2024-05-14T12:20:59.670637+0000","last_unstale":"2024-05-14T12:23:08.241448+0000","last_undegraded":"2024-05-14T12:23:08.241448+0000","last_fullsized":"2024-05-14T12:23:08.241448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:53.808936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.265171+0000","last_change":"2024-05-14T12:20:59.680039+0000","last_active":"2024-05-14T12:23:08.265171+0000","last_peered":"2024-05-14T12:23:08.265171+0000","last_clean":"2024-05-14T12:23:08.265171+0000","last_became_active":"2024-05-14T12:20:59.678120+0000","last_became_peered":"2024-05-14T12:20:59.678120+0000","last_unstale":"2024-05-14T12:23:08.265171+0000","last_undegraded":"2024-05-14T12:23:08.265171+0000","last_fullsized":"2024-05-14T12:23:08.265171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:19:28.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238936+0000","last_change":"2024-05-14T12:20:59.675301+0000","last_active":"2024-05-14T12:23:08.238936+0000","last_peered":"2024-05-14T12:23:08.238936+0000","last_clean":"2024-05-14T12:23:08.238936+0000","last_became_active":"2024-05-14T12:20:59.669861+0000","last_became_peered":"2024-05-14T12:20:59.669861+0000","last_unstale":"2024-05-14T12:23:08.238936+0000","last_undegraded":"2024-05-14T12:23:08.238936+0000","last_fullsized":"2024-05-14T12:23:08.238936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:19:17.931719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246879+0000","last_change":"2024-05-14T12:20:59.682378+0000","last_active":"2024-05-14T12:23:08.246879+0000","last_peered":"2024-05-14T12:23:08.246879+0000","last_clean":"2024-05-14T12:23:08.246879+0000","last_became_active":"2024-05-14T12:20:59.680598+0000","last_became_peered":"2024-05-14T12:20:59.680598+0000","last_unstale":"2024-05-14T12:23:08.246879+0000","last_undegraded":"2024-05-14T12:23:08.246879+0000","last_fullsized":"2024-05-14T12:23:08.246879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:22.189038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254566+0000","last_change":"2024-05-14T12:20:59.685447+0000","last_active":"2024-05-14T12:23:08.254566+0000","last_peered":"2024-05-14T12:23:08.254566+0000","last_clean":"2024-05-14T12:23:08.254566+0000","last_became_active":"2024-05-14T12:20:59.684963+0000","last_became_peered":"2024-05-14T12:20:59.684963+0000","last_unstale":"2024-05-14T12:23:08.254566+0000","last_undegraded":"2024-05-14T12:23:08.254566+0000","last_fullsized":"2024-05-14T12:23:08.254566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:47.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250053+0000","last_change":"2024-05-14T12:20:59.681870+0000","last_active":"2024-05-14T12:23:08.250053+0000","last_peered":"2024-05-14T12:23:08.250053+0000","last_clean":"2024-05-14T12:23:08.250053+0000","last_became_active":"2024-05-14T12:20:59.681405+0000","last_became_peered":"2024-05-14T12:20:59.681405+0000","last_unstale":"2024-05-14T12:23:08.250053+0000","last_undegraded":"2024-05-14T12:23:08.250053+0000","last_fullsized":"2024-05-14T12:23:08.250053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:20.002496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253917+0000","last_change":"2024-05-14T12:20:59.667486+0000","last_active":"2024-05-14T12:23:08.253917+0000","last_peered":"2024-05-14T12:23:08.253917+0000","last_clean":"2024-05-14T12:23:08.253917+0000","last_became_active":"2024-05-14T12:20:59.667032+0000","last_became_peered":"2024-05-14T12:20:59.667032+0000","last_unstale":"2024-05-14T12:23:08.253917+0000","last_undegraded":"2024-05-14T12:23:08.253917+0000","last_fullsized":"2024-05-14T12:23:08.253917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:25.325504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253867+0000","last_change":"2024-05-14T12:20:59.672065+0000","last_active":"2024-05-14T12:23:08.253867+0000","last_peered":"2024-05-14T12:23:08.253867+0000","last_clean":"2024-05-14T12:23:08.253867+0000","last_became_active":"2024-05-14T12:20:59.671692+0000","last_became_peered":"2024-05-14T12:20:59.671692+0000","last_unstale":"2024-05-14T12:23:08.253867+0000","last_undegraded":"2024-05-14T12:23:08.253867+0000","last_fullsized":"2024-05-14T12:23:08.253867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:11:47.952421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":270,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:08.898124+0000","last_change":"2024-05-14T12:20:55.611507+0000","last_active":"2024-05-14T12:25:08.898124+0000","last_peered":"2024-05-14T12:25:08.898124+0000","last_clean":"2024-05-14T12:25:08.898124+0000","last_became_active":"2024-05-14T12:20:55.606794+0000","last_became_peered":"2024-05-14T12:20:55.606794+0000","last_unstale":"2024-05-14T12:25:08.898124+0000","last_undegraded":"2024-05-14T12:25:08.898124+0000","last_fullsized":"2024-05-14T12:25:08.898124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:51.301124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247216+0000","last_change":"2024-05-14T12:20:59.673013+0000","last_active":"2024-05-14T12:23:08.247216+0000","last_peered":"2024-05-14T12:23:08.247216+0000","last_clean":"2024-05-14T12:23:08.247216+0000","last_became_active":"2024-05-14T12:20:59.672575+0000","last_became_peered":"2024-05-14T12:20:59.672575+0000","last_unstale":"2024-05-14T12:23:08.247216+0000","last_undegraded":"2024-05-14T12:23:08.247216+0000","last_fullsized":"2024-05-14T12:23:08.247216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:00:26.549099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:56.369914+0000","last_change":"2024-05-14T12:20:55.963853+0000","last_active":"2024-05-14T12:22:56.369914+0000","last_peered":"2024-05-14T12:22:56.369914+0000","last_clean":"2024-05-14T12:22:56.369914+0000","last_became_active":"2024-05-14T12:20:55.962018+0000","last_became_peered":"2024-05-14T12:20:55.962018+0000","last_unstale":"2024-05-14T12:22:56.369914+0000","last_undegraded":"2024-05-14T12:22:56.369914+0000","last_fullsized":"2024-05-14T12:22:56.369914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:06:22.374595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254121+0000","last_change":"2024-05-14T12:20:59.671243+0000","last_active":"2024-05-14T12:23:08.254121+0000","last_peered":"2024-05-14T12:23:08.254121+0000","last_clean":"2024-05-14T12:23:08.254121+0000","last_became_active":"2024-05-14T12:20:59.665885+0000","last_became_peered":"2024-05-14T12:20:59.665885+0000","last_unstale":"2024-05-14T12:23:08.254121+0000","last_undegraded":"2024-05-14T12:23:08.254121+0000","last_fullsized":"2024-05-14T12:23:08.254121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:48.656774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.527444+0000","last_change":"2024-05-14T12:21:39.526944+0000","last_active":"2024-05-14T12:21:39.527444+0000","last_peered":"2024-05-14T12:21:39.527444+0000","last_clean":"2024-05-14T12:21:39.527444+0000","last_became_active":"2024-05-14T12:21:39.506478+0000","last_became_peered":"2024-05-14T12:21:39.506478+0000","last_unstale":"2024-05-14T12:21:39.527444+0000","last_undegraded":"2024-05-14T12:21:39.527444+0000","last_fullsized":"2024-05-14T12:21:39.527444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:41.812733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256880+0000","last_change":"2024-05-14T12:20:59.671282+0000","last_active":"2024-05-14T12:23:08.256880+0000","last_peered":"2024-05-14T12:23:08.256880+0000","last_clean":"2024-05-14T12:23:08.256880+0000","last_became_active":"2024-05-14T12:20:59.670645+0000","last_became_peered":"2024-05-14T12:20:59.670645+0000","last_unstale":"2024-05-14T12:23:08.256880+0000","last_undegraded":"2024-05-14T12:23:08.256880+0000","last_fullsized":"2024-05-14T12:23:08.256880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:51:57.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501912+0000","last_change":"2024-05-14T12:20:55.604757+0000","last_active":"2024-05-14T12:21:39.501912+0000","last_peered":"2024-05-14T12:21:39.501912+0000","last_clean":"2024-05-14T12:21:39.501912+0000","last_became_active":"2024-05-14T12:20:55.604281+0000","last_became_peered":"2024-05-14T12:20:55.604281+0000","last_unstale":"2024-05-14T12:21:39.501912+0000","last_undegraded":"2024-05-14T12:21:39.501912+0000","last_fullsized":"2024-05-14T12:21:39.501912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:52.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245684+0000","last_change":"2024-05-14T12:20:59.672498+0000","last_active":"2024-05-14T12:23:08.245684+0000","last_peered":"2024-05-14T12:23:08.245684+0000","last_clean":"2024-05-14T12:23:08.245684+0000","last_became_active":"2024-05-14T12:20:59.672116+0000","last_became_peered":"2024-05-14T12:20:59.672116+0000","last_unstale":"2024-05-14T12:23:08.245684+0000","last_undegraded":"2024-05-14T12:23:08.245684+0000","last_fullsized":"2024-05-14T12:23:08.245684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:47:34.614427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:09.966325+0000","last_change":"2024-05-14T12:21:39.515431+0000","last_active":"2024-05-14T12:25:09.966325+0000","last_peered":"2024-05-14T12:25:09.966325+0000","last_clean":"2024-05-14T12:25:09.966325+0000","last_became_active":"2024-05-14T12:21:39.503217+0000","last_became_peered":"2024-05-14T12:21:39.503217+0000","last_unstale":"2024-05-14T12:25:09.966325+0000","last_undegraded":"2024-05-14T12:25:09.966325+0000","last_fullsized":"2024-05-14T12:25:09.966325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:52:21.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255983+0000","last_change":"2024-05-14T12:20:59.664725+0000","last_active":"2024-05-14T12:23:08.255983+0000","last_peered":"2024-05-14T12:23:08.255983+0000","last_clean":"2024-05-14T12:23:08.255983+0000","last_became_active":"2024-05-14T12:20:59.664323+0000","last_became_peered":"2024-05-14T12:20:59.664323+0000","last_unstale":"2024-05-14T12:23:08.255983+0000","last_undegraded":"2024-05-14T12:23:08.255983+0000","last_fullsized":"2024-05-14T12:23:08.255983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.729787+0000","last_change":"2024-05-14T12:21:39.729236+0000","last_active":"2024-05-14T12:21:39.729787+0000","last_peered":"2024-05-14T12:21:39.729787+0000","last_clean":"2024-05-14T12:21:39.729787+0000","last_became_active":"2024-05-14T12:21:39.722405+0000","last_became_peered":"2024-05-14T12:21:39.722405+0000","last_unstale":"2024-05-14T12:21:39.729787+0000","last_undegraded":"2024-05-14T12:21:39.729787+0000","last_fullsized":"2024-05-14T12:21:39.729787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:14:19.461411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245385+0000","last_change":"2024-05-14T12:20:59.671870+0000","last_active":"2024-05-14T12:23:08.245385+0000","last_peered":"2024-05-14T12:23:08.245385+0000","last_clean":"2024-05-14T12:23:08.245385+0000","last_became_active":"2024-05-14T12:20:59.671467+0000","last_became_peered":"2024-05-14T12:20:59.671467+0000","last_unstale":"2024-05-14T12:23:08.245385+0000","last_undegraded":"2024-05-14T12:23:08.245385+0000","last_fullsized":"2024-05-14T12:23:08.245385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:18.195518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498590+0000","last_change":"2024-05-14T12:20:55.613626+0000","last_active":"2024-05-14T12:21:39.498590+0000","last_peered":"2024-05-14T12:21:39.498590+0000","last_clean":"2024-05-14T12:21:39.498590+0000","last_became_active":"2024-05-14T12:20:55.613039+0000","last_became_peered":"2024-05-14T12:20:55.613039+0000","last_unstale":"2024-05-14T12:21:39.498590+0000","last_undegraded":"2024-05-14T12:21:39.498590+0000","last_fullsized":"2024-05-14T12:21:39.498590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:19.479433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259965+0000","last_change":"2024-05-14T12:20:59.683152+0000","last_active":"2024-05-14T12:23:08.259965+0000","last_peered":"2024-05-14T12:23:08.259965+0000","last_clean":"2024-05-14T12:23:08.259965+0000","last_became_active":"2024-05-14T12:20:59.682863+0000","last_became_peered":"2024-05-14T12:20:59.682863+0000","last_unstale":"2024-05-14T12:23:08.259965+0000","last_undegraded":"2024-05-14T12:23:08.259965+0000","last_fullsized":"2024-05-14T12:23:08.259965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:26.975487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496446+0000","last_change":"2024-05-14T12:20:55.604785+0000","last_active":"2024-05-14T12:21:39.496446+0000","last_peered":"2024-05-14T12:21:39.496446+0000","last_clean":"2024-05-14T12:21:39.496446+0000","last_became_active":"2024-05-14T12:20:55.604249+0000","last_became_peered":"2024-05-14T12:20:55.604249+0000","last_unstale":"2024-05-14T12:21:39.496446+0000","last_undegraded":"2024-05-14T12:21:39.496446+0000","last_fullsized":"2024-05-14T12:21:39.496446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:51.954691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254982+0000","last_change":"2024-05-14T12:20:59.677047+0000","last_active":"2024-05-14T12:23:08.254982+0000","last_peered":"2024-05-14T12:23:08.254982+0000","last_clean":"2024-05-14T12:23:08.254982+0000","last_became_active":"2024-05-14T12:20:59.673314+0000","last_became_peered":"2024-05-14T12:20:59.673314+0000","last_unstale":"2024-05-14T12:23:08.254982+0000","last_undegraded":"2024-05-14T12:23:08.254982+0000","last_fullsized":"2024-05-14T12:23:08.254982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:54.069762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":489,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:09.965036+0000","last_change":"2024-05-14T12:20:55.608986+0000","last_active":"2024-05-14T12:25:09.965036+0000","last_peered":"2024-05-14T12:25:09.965036+0000","last_clean":"2024-05-14T12:25:09.965036+0000","last_became_active":"2024-05-14T12:20:55.608476+0000","last_became_peered":"2024-05-14T12:20:55.608476+0000","last_unstale":"2024-05-14T12:25:09.965036+0000","last_undegraded":"2024-05-14T12:25:09.965036+0000","last_fullsized":"2024-05-14T12:25:09.965036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:15:40.777724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":457,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251635+0000","last_change":"2024-05-14T12:20:59.673404+0000","last_active":"2024-05-14T12:23:08.251635+0000","last_peered":"2024-05-14T12:23:08.251635+0000","last_clean":"2024-05-14T12:23:08.251635+0000","last_became_active":"2024-05-14T12:20:59.673035+0000","last_became_peered":"2024-05-14T12:20:59.673035+0000","last_unstale":"2024-05-14T12:23:08.251635+0000","last_undegraded":"2024-05-14T12:23:08.251635+0000","last_fullsized":"2024-05-14T12:23:08.251635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:29:42.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498557+0000","last_change":"2024-05-14T12:20:55.605789+0000","last_active":"2024-05-14T12:21:39.498557+0000","last_peered":"2024-05-14T12:21:39.498557+0000","last_clean":"2024-05-14T12:21:39.498557+0000","last_became_active":"2024-05-14T12:20:55.605166+0000","last_became_peered":"2024-05-14T12:20:55.605166+0000","last_unstale":"2024-05-14T12:21:39.498557+0000","last_undegraded":"2024-05-14T12:21:39.498557+0000","last_fullsized":"2024-05-14T12:21:39.498557+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:44.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244142+0000","last_change":"2024-05-14T12:20:59.678373+0000","last_active":"2024-05-14T12:23:08.244142+0000","last_peered":"2024-05-14T12:23:08.244142+0000","last_clean":"2024-05-14T12:23:08.244142+0000","last_became_active":"2024-05-14T12:20:59.673378+0000","last_became_peered":"2024-05-14T12:20:59.673378+0000","last_unstale":"2024-05-14T12:23:08.244142+0000","last_undegraded":"2024-05-14T12:23:08.244142+0000","last_fullsized":"2024-05-14T12:23:08.244142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:17:36.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496591+0000","last_change":"2024-05-14T12:20:55.966507+0000","last_active":"2024-05-14T12:21:39.496591+0000","last_peered":"2024-05-14T12:21:39.496591+0000","last_clean":"2024-05-14T12:21:39.496591+0000","last_became_active":"2024-05-14T12:20:55.966066+0000","last_became_peered":"2024-05-14T12:20:55.966066+0000","last_unstale":"2024-05-14T12:21:39.496591+0000","last_undegraded":"2024-05-14T12:21:39.496591+0000","last_fullsized":"2024-05-14T12:21:39.496591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:20.276346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250342+0000","last_change":"2024-05-14T12:20:59.669926+0000","last_active":"2024-05-14T12:23:08.250342+0000","last_peered":"2024-05-14T12:23:08.250342+0000","last_clean":"2024-05-14T12:23:08.250342+0000","last_became_active":"2024-05-14T12:20:59.669502+0000","last_became_peered":"2024-05-14T12:20:59.669502+0000","last_unstale":"2024-05-14T12:23:08.250342+0000","last_undegraded":"2024-05-14T12:23:08.250342+0000","last_fullsized":"2024-05-14T12:23:08.250342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:02.036442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'39","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:10.821561+0000","last_change":"2024-05-14T12:20:55.602307+0000","last_active":"2024-05-14T12:25:10.821561+0000","last_peered":"2024-05-14T12:25:10.821561+0000","last_clean":"2024-05-14T12:25:10.821561+0000","last_became_active":"2024-05-14T12:20:55.601879+0000","last_became_peered":"2024-05-14T12:20:55.601879+0000","last_unstale":"2024-05-14T12:25:10.821561+0000","last_undegraded":"2024-05-14T12:25:10.821561+0000","last_fullsized":"2024-05-14T12:25:10.821561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:10.839268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65283,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":298,"num_write":41,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244715+0000","last_change":"2024-05-14T12:20:59.676162+0000","last_active":"2024-05-14T12:23:08.244715+0000","last_peered":"2024-05-14T12:23:08.244715+0000","last_clean":"2024-05-14T12:23:08.244715+0000","last_became_active":"2024-05-14T12:20:59.675742+0000","last_became_peered":"2024-05-14T12:20:59.675742+0000","last_unstale":"2024-05-14T12:23:08.244715+0000","last_undegraded":"2024-05-14T12:23:08.244715+0000","last_fullsized":"2024-05-14T12:23:08.244715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:52:00.100743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501460+0000","last_change":"2024-05-14T12:20:55.616014+0000","last_active":"2024-05-14T12:21:39.501460+0000","last_peered":"2024-05-14T12:21:39.501460+0000","last_clean":"2024-05-14T12:21:39.501460+0000","last_became_active":"2024-05-14T12:20:55.615331+0000","last_became_peered":"2024-05-14T12:20:55.615331+0000","last_unstale":"2024-05-14T12:21:39.501460+0000","last_undegraded":"2024-05-14T12:21:39.501460+0000","last_fullsized":"2024-05-14T12:21:39.501460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:53.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261957+0000","last_change":"2024-05-14T12:20:59.690299+0000","last_active":"2024-05-14T12:23:08.261957+0000","last_peered":"2024-05-14T12:23:08.261957+0000","last_clean":"2024-05-14T12:23:08.261957+0000","last_became_active":"2024-05-14T12:20:59.689959+0000","last_became_peered":"2024-05-14T12:20:59.689959+0000","last_unstale":"2024-05-14T12:23:08.261957+0000","last_undegraded":"2024-05-14T12:23:08.261957+0000","last_fullsized":"2024-05-14T12:23:08.261957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:53.017238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496270+0000","last_change":"2024-05-14T12:20:55.615860+0000","last_active":"2024-05-14T12:21:39.496270+0000","last_peered":"2024-05-14T12:21:39.496270+0000","last_clean":"2024-05-14T12:21:39.496270+0000","last_became_active":"2024-05-14T12:20:55.615415+0000","last_became_peered":"2024-05-14T12:20:55.615415+0000","last_unstale":"2024-05-14T12:21:39.496270+0000","last_undegraded":"2024-05-14T12:21:39.496270+0000","last_fullsized":"2024-05-14T12:21:39.496270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:27:55.368122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.258058+0000","last_change":"2024-05-14T12:20:59.684759+0000","last_active":"2024-05-14T12:23:08.258058+0000","last_peered":"2024-05-14T12:23:08.258058+0000","last_clean":"2024-05-14T12:23:08.258058+0000","last_became_active":"2024-05-14T12:20:59.684277+0000","last_became_peered":"2024-05-14T12:20:59.684277+0000","last_unstale":"2024-05-14T12:23:08.258058+0000","last_undegraded":"2024-05-14T12:23:08.258058+0000","last_fullsized":"2024-05-14T12:23:08.258058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:42:08.535580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:10.904659+0000","last_change":"2024-05-14T12:20:55.602130+0000","last_active":"2024-05-14T12:25:10.904659+0000","last_peered":"2024-05-14T12:25:10.904659+0000","last_clean":"2024-05-14T12:25:10.904659+0000","last_became_active":"2024-05-14T12:20:55.601635+0000","last_became_peered":"2024-05-14T12:20:55.601635+0000","last_unstale":"2024-05-14T12:25:10.904659+0000","last_undegraded":"2024-05-14T12:25:10.904659+0000","last_fullsized":"2024-05-14T12:25:10.904659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:24:34.599413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":898,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251007+0000","last_change":"2024-05-14T12:21:39.505509+0000","last_active":"2024-05-14T12:23:08.251007+0000","last_peered":"2024-05-14T12:23:08.251007+0000","last_clean":"2024-05-14T12:23:08.251007+0000","last_became_active":"2024-05-14T12:21:39.504817+0000","last_became_peered":"2024-05-14T12:21:39.504817+0000","last_unstale":"2024-05-14T12:23:08.251007+0000","last_undegraded":"2024-05-14T12:23:08.251007+0000","last_fullsized":"2024-05-14T12:23:08.251007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:05:08.309898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501589+0000","last_change":"2024-05-14T12:20:55.962404+0000","last_active":"2024-05-14T12:21:39.501589+0000","last_peered":"2024-05-14T12:21:39.501589+0000","last_clean":"2024-05-14T12:21:39.501589+0000","last_became_active":"2024-05-14T12:20:55.961886+0000","last_became_peered":"2024-05-14T12:20:55.961886+0000","last_unstale":"2024-05-14T12:21:39.501589+0000","last_undegraded":"2024-05-14T12:21:39.501589+0000","last_fullsized":"2024-05-14T12:21:39.501589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:30.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245497+0000","last_change":"2024-05-14T12:20:59.674010+0000","last_active":"2024-05-14T12:23:08.245497+0000","last_peered":"2024-05-14T12:23:08.245497+0000","last_clean":"2024-05-14T12:23:08.245497+0000","last_became_active":"2024-05-14T12:20:59.673546+0000","last_became_peered":"2024-05-14T12:20:59.673546+0000","last_unstale":"2024-05-14T12:23:08.245497+0000","last_undegraded":"2024-05-14T12:23:08.245497+0000","last_fullsized":"2024-05-14T12:23:08.245497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:59.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:41.801527+0000","last_change":"2024-05-14T12:21:39.512745+0000","last_active":"2024-05-14T12:21:41.801527+0000","last_peered":"2024-05-14T12:21:41.801527+0000","last_clean":"2024-05-14T12:21:41.801527+0000","last_became_active":"2024-05-14T12:21:39.502690+0000","last_became_peered":"2024-05-14T12:21:39.502690+0000","last_unstale":"2024-05-14T12:21:41.801527+0000","last_undegraded":"2024-05-14T12:21:41.801527+0000","last_fullsized":"2024-05-14T12:21:41.801527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:55:22.829094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240989+0000","last_change":"2024-05-14T12:20:59.671773+0000","last_active":"2024-05-14T12:23:08.240989+0000","last_peered":"2024-05-14T12:23:08.240989+0000","last_clean":"2024-05-14T12:23:08.240989+0000","last_became_active":"2024-05-14T12:20:59.671380+0000","last_became_peered":"2024-05-14T12:20:59.671380+0000","last_unstale":"2024-05-14T12:23:08.240989+0000","last_undegraded":"2024-05-14T12:23:08.240989+0000","last_fullsized":"2024-05-14T12:23:08.240989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:23.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:03.964016+0000","last_change":"2024-05-14T12:20:55.965843+0000","last_active":"2024-05-14T12:23:03.964016+0000","last_peered":"2024-05-14T12:23:03.964016+0000","last_clean":"2024-05-14T12:23:03.964016+0000","last_became_active":"2024-05-14T12:20:55.963827+0000","last_became_peered":"2024-05-14T12:20:55.963827+0000","last_unstale":"2024-05-14T12:23:03.964016+0000","last_undegraded":"2024-05-14T12:23:03.964016+0000","last_fullsized":"2024-05-14T12:23:03.964016+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:22.464989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259445+0000","last_change":"2024-05-14T12:20:59.674932+0000","last_active":"2024-05-14T12:23:08.259445+0000","last_peered":"2024-05-14T12:23:08.259445+0000","last_clean":"2024-05-14T12:23:08.259445+0000","last_became_active":"2024-05-14T12:20:59.674259+0000","last_became_peered":"2024-05-14T12:20:59.674259+0000","last_unstale":"2024-05-14T12:23:08.259445+0000","last_undegraded":"2024-05-14T12:23:08.259445+0000","last_fullsized":"2024-05-14T12:23:08.259445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:45.362069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":265,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:07.896720+0000","last_change":"2024-05-14T12:20:55.610031+0000","last_active":"2024-05-14T12:25:07.896720+0000","last_peered":"2024-05-14T12:25:07.896720+0000","last_clean":"2024-05-14T12:25:07.896720+0000","last_became_active":"2024-05-14T12:20:55.609730+0000","last_became_peered":"2024-05-14T12:20:55.609730+0000","last_unstale":"2024-05-14T12:25:07.896720+0000","last_undegraded":"2024-05-14T12:25:07.896720+0000","last_fullsized":"2024-05-14T12:25:07.896720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:35.763466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241288+0000","last_change":"2024-05-14T12:20:59.673504+0000","last_active":"2024-05-14T12:23:08.241288+0000","last_peered":"2024-05-14T12:23:08.241288+0000","last_clean":"2024-05-14T12:23:08.241288+0000","last_became_active":"2024-05-14T12:20:59.673100+0000","last_became_peered":"2024-05-14T12:20:59.673100+0000","last_unstale":"2024-05-14T12:23:08.241288+0000","last_undegraded":"2024-05-14T12:23:08.241288+0000","last_fullsized":"2024-05-14T12:23:08.241288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:02.262916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.234816+0000","last_change":"2024-05-14T12:20:59.674694+0000","last_active":"2024-05-14T12:23:08.234816+0000","last_peered":"2024-05-14T12:23:08.234816+0000","last_clean":"2024-05-14T12:23:08.234816+0000","last_became_active":"2024-05-14T12:20:59.673566+0000","last_became_peered":"2024-05-14T12:20:59.673566+0000","last_unstale":"2024-05-14T12:23:08.234816+0000","last_undegraded":"2024-05-14T12:23:08.234816+0000","last_fullsized":"2024-05-14T12:23:08.234816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:49:28.596919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":261,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:08.262888+0000","last_change":"2024-05-14T12:20:55.963207+0000","last_active":"2024-05-14T12:25:08.262888+0000","last_peered":"2024-05-14T12:25:08.262888+0000","last_clean":"2024-05-14T12:25:08.262888+0000","last_became_active":"2024-05-14T12:20:55.962084+0000","last_became_peered":"2024-05-14T12:20:55.962084+0000","last_unstale":"2024-05-14T12:25:08.262888+0000","last_undegraded":"2024-05-14T12:25:08.262888+0000","last_fullsized":"2024-05-14T12:25:08.262888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:17.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":227,"num_read_kb":227,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254903+0000","last_change":"2024-05-14T12:20:59.682629+0000","last_active":"2024-05-14T12:23:08.254903+0000","last_peered":"2024-05-14T12:23:08.254903+0000","last_clean":"2024-05-14T12:23:08.254903+0000","last_became_active":"2024-05-14T12:20:59.672656+0000","last_became_peered":"2024-05-14T12:20:59.672656+0000","last_unstale":"2024-05-14T12:23:08.254903+0000","last_undegraded":"2024-05-14T12:23:08.254903+0000","last_fullsized":"2024-05-14T12:23:08.254903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:23:29.651740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:02.283374+0000","last_change":"2024-05-14T12:20:55.605223+0000","last_active":"2024-05-14T12:23:02.283374+0000","last_peered":"2024-05-14T12:23:02.283374+0000","last_clean":"2024-05-14T12:23:02.283374+0000","last_became_active":"2024-05-14T12:20:55.604743+0000","last_became_peered":"2024-05-14T12:20:55.604743+0000","last_unstale":"2024-05-14T12:23:02.283374+0000","last_undegraded":"2024-05-14T12:23:02.283374+0000","last_fullsized":"2024-05-14T12:23:02.283374+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:15.258776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:59.696764+0000","last_change":"2024-05-14T12:19:22.477995+0000","last_active":"2024-05-14T12:21:59.696764+0000","last_peered":"2024-05-14T12:21:59.696764+0000","last_clean":"2024-05-14T12:21:59.696764+0000","last_became_active":"2024-05-14T12:19:22.471890+0000","last_became_peered":"2024-05-14T12:19:22.471890+0000","last_unstale":"2024-05-14T12:21:59.696764+0000","last_undegraded":"2024-05-14T12:21:59.696764+0000","last_fullsized":"2024-05-14T12:21:59.696764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_clean_scrub_stamp":"2024-05-14T12:15:26.966159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:18.761547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239274+0000","last_change":"2024-05-14T12:20:59.674341+0000","last_active":"2024-05-14T12:23:08.239274+0000","last_peered":"2024-05-14T12:23:08.239274+0000","last_clean":"2024-05-14T12:23:08.239274+0000","last_became_active":"2024-05-14T12:20:59.672199+0000","last_became_peered":"2024-05-14T12:20:59.672199+0000","last_unstale":"2024-05-14T12:23:08.239274+0000","last_undegraded":"2024-05-14T12:23:08.239274+0000","last_fullsized":"2024-05-14T12:23:08.239274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.666708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:54.703757+0000","last_change":"2024-05-14T12:20:55.605513+0000","last_active":"2024-05-14T12:22:54.703757+0000","last_peered":"2024-05-14T12:22:54.703757+0000","last_clean":"2024-05-14T12:22:54.703757+0000","last_became_active":"2024-05-14T12:20:55.605131+0000","last_became_peered":"2024-05-14T12:20:55.605131+0000","last_unstale":"2024-05-14T12:22:54.703757+0000","last_undegraded":"2024-05-14T12:22:54.703757+0000","last_fullsized":"2024-05-14T12:22:54.703757+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:56.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:59.980943+0000","last_change":"2024-05-14T12:20:55.966357+0000","last_active":"2024-05-14T12:22:59.980943+0000","last_peered":"2024-05-14T12:22:59.980943+0000","last_clean":"2024-05-14T12:22:59.980943+0000","last_became_active":"2024-05-14T12:20:55.965946+0000","last_became_peered":"2024-05-14T12:20:55.965946+0000","last_unstale":"2024-05-14T12:22:59.980943+0000","last_undegraded":"2024-05-14T12:22:59.980943+0000","last_fullsized":"2024-05-14T12:22:59.980943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:20.843819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253081+0000","last_change":"2024-05-14T12:20:59.675130+0000","last_active":"2024-05-14T12:23:08.253081+0000","last_peered":"2024-05-14T12:23:08.253081+0000","last_clean":"2024-05-14T12:23:08.253081+0000","last_became_active":"2024-05-14T12:20:59.674639+0000","last_became_peered":"2024-05-14T12:20:59.674639+0000","last_unstale":"2024-05-14T12:23:08.253081+0000","last_undegraded":"2024-05-14T12:23:08.253081+0000","last_fullsized":"2024-05-14T12:23:08.253081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:34:47.167894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'17","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.964764+0000","last_change":"2024-05-14T12:20:55.615975+0000","last_active":"2024-05-14T12:23:08.964764+0000","last_peered":"2024-05-14T12:23:08.964764+0000","last_clean":"2024-05-14T12:23:08.964764+0000","last_became_active":"2024-05-14T12:20:55.615542+0000","last_became_peered":"2024-05-14T12:20:55.615542+0000","last_unstale":"2024-05-14T12:23:08.964764+0000","last_undegraded":"2024-05-14T12:23:08.964764+0000","last_fullsized":"2024-05-14T12:23:08.964764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:52:46.621227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260341+0000","last_change":"2024-05-14T12:20:59.679047+0000","last_active":"2024-05-14T12:23:08.260341+0000","last_peered":"2024-05-14T12:23:08.260341+0000","last_clean":"2024-05-14T12:23:08.260341+0000","last_became_active":"2024-05-14T12:20:59.678620+0000","last_became_peered":"2024-05-14T12:20:59.678620+0000","last_unstale":"2024-05-14T12:23:08.260341+0000","last_undegraded":"2024-05-14T12:23:08.260341+0000","last_fullsized":"2024-05-14T12:23:08.260341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:30.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501411+0000","last_change":"2024-05-14T12:20:55.836121+0000","last_active":"2024-05-14T12:21:39.501411+0000","last_peered":"2024-05-14T12:21:39.501411+0000","last_clean":"2024-05-14T12:21:39.501411+0000","last_became_active":"2024-05-14T12:20:55.835758+0000","last_became_peered":"2024-05-14T12:20:55.835758+0000","last_unstale":"2024-05-14T12:21:39.501411+0000","last_undegraded":"2024-05-14T12:21:39.501411+0000","last_fullsized":"2024-05-14T12:21:39.501411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:29:12.627760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261142+0000","last_change":"2024-05-14T12:20:59.679664+0000","last_active":"2024-05-14T12:23:08.261142+0000","last_peered":"2024-05-14T12:23:08.261142+0000","last_clean":"2024-05-14T12:23:08.261142+0000","last_became_active":"2024-05-14T12:20:59.679242+0000","last_became_peered":"2024-05-14T12:20:59.679242+0000","last_unstale":"2024-05-14T12:23:08.261142+0000","last_undegraded":"2024-05-14T12:23:08.261142+0000","last_fullsized":"2024-05-14T12:23:08.261142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:38:17.910624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721087+0000","last_change":"2024-05-14T12:20:55.965927+0000","last_active":"2024-05-14T12:21:39.721087+0000","last_peered":"2024-05-14T12:21:39.721087+0000","last_clean":"2024-05-14T12:21:39.721087+0000","last_became_active":"2024-05-14T12:20:55.965570+0000","last_became_peered":"2024-05-14T12:20:55.965570+0000","last_unstale":"2024-05-14T12:21:39.721087+0000","last_undegraded":"2024-05-14T12:21:39.721087+0000","last_fullsized":"2024-05-14T12:21:39.721087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:16:23.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239485+0000","last_change":"2024-05-14T12:20:59.662521+0000","last_active":"2024-05-14T12:23:08.239485+0000","last_peered":"2024-05-14T12:23:08.239485+0000","last_clean":"2024-05-14T12:23:08.239485+0000","last_became_active":"2024-05-14T12:20:59.662140+0000","last_became_peered":"2024-05-14T12:20:59.662140+0000","last_unstale":"2024-05-14T12:23:08.239485+0000","last_undegraded":"2024-05-14T12:23:08.239485+0000","last_fullsized":"2024-05-14T12:23:08.239485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:44.471630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702986+0000","last_change":"2024-05-14T12:20:55.614124+0000","last_active":"2024-05-14T12:21:39.702986+0000","last_peered":"2024-05-14T12:21:39.702986+0000","last_clean":"2024-05-14T12:21:39.702986+0000","last_became_active":"2024-05-14T12:20:55.610826+0000","last_became_peered":"2024-05-14T12:20:55.610826+0000","last_unstale":"2024-05-14T12:21:39.702986+0000","last_undegraded":"2024-05-14T12:21:39.702986+0000","last_fullsized":"2024-05-14T12:21:39.702986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:01:30.296978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241601+0000","last_change":"2024-05-14T12:20:59.684356+0000","last_active":"2024-05-14T12:23:08.241601+0000","last_peered":"2024-05-14T12:23:08.241601+0000","last_clean":"2024-05-14T12:23:08.241601+0000","last_became_active":"2024-05-14T12:20:59.683942+0000","last_became_peered":"2024-05-14T12:20:59.683942+0000","last_unstale":"2024-05-14T12:23:08.241601+0000","last_undegraded":"2024-05-14T12:23:08.241601+0000","last_fullsized":"2024-05-14T12:23:08.241601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:50.421104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501801+0000","last_change":"2024-05-14T12:20:55.615921+0000","last_active":"2024-05-14T12:21:39.501801+0000","last_peered":"2024-05-14T12:21:39.501801+0000","last_clean":"2024-05-14T12:21:39.501801+0000","last_became_active":"2024-05-14T12:20:55.615448+0000","last_became_peered":"2024-05-14T12:20:55.615448+0000","last_unstale":"2024-05-14T12:21:39.501801+0000","last_undegraded":"2024-05-14T12:21:39.501801+0000","last_fullsized":"2024-05-14T12:21:39.501801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:41:00.260869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260052+0000","last_change":"2024-05-14T12:20:59.690629+0000","last_active":"2024-05-14T12:23:08.260052+0000","last_peered":"2024-05-14T12:23:08.260052+0000","last_clean":"2024-05-14T12:23:08.260052+0000","last_became_active":"2024-05-14T12:20:59.689696+0000","last_became_peered":"2024-05-14T12:20:59.689696+0000","last_unstale":"2024-05-14T12:23:08.260052+0000","last_undegraded":"2024-05-14T12:23:08.260052+0000","last_fullsized":"2024-05-14T12:23:08.260052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:27.678235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.531447+0000","last_change":"2024-05-14T12:21:39.530824+0000","last_active":"2024-05-14T12:21:39.531447+0000","last_peered":"2024-05-14T12:21:39.531447+0000","last_clean":"2024-05-14T12:21:39.531447+0000","last_became_active":"2024-05-14T12:21:39.507316+0000","last_became_peered":"2024-05-14T12:21:39.507316+0000","last_unstale":"2024-05-14T12:21:39.531447+0000","last_undegraded":"2024-05-14T12:21:39.531447+0000","last_fullsized":"2024-05-14T12:21:39.531447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:06:46.506545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257038+0000","last_change":"2024-05-14T12:20:59.679078+0000","last_active":"2024-05-14T12:23:08.257038+0000","last_peered":"2024-05-14T12:23:08.257038+0000","last_clean":"2024-05-14T12:23:08.257038+0000","last_became_active":"2024-05-14T12:20:59.678713+0000","last_became_peered":"2024-05-14T12:20:59.678713+0000","last_unstale":"2024-05-14T12:23:08.257038+0000","last_undegraded":"2024-05-14T12:23:08.257038+0000","last_fullsized":"2024-05-14T12:23:08.257038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:46:44.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:08.816217+0000","last_change":"2024-05-14T12:20:55.965829+0000","last_active":"2024-05-14T12:25:08.816217+0000","last_peered":"2024-05-14T12:25:08.816217+0000","last_clean":"2024-05-14T12:25:08.816217+0000","last_became_active":"2024-05-14T12:20:55.965316+0000","last_became_peered":"2024-05-14T12:20:55.965316+0000","last_unstale":"2024-05-14T12:25:08.816217+0000","last_undegraded":"2024-05-14T12:25:08.816217+0000","last_fullsized":"2024-05-14T12:25:08.816217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:46:36.879599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245162+0000","last_change":"2024-05-14T12:20:59.673582+0000","last_active":"2024-05-14T12:23:08.245162+0000","last_peered":"2024-05-14T12:23:08.245162+0000","last_clean":"2024-05-14T12:23:08.245162+0000","last_became_active":"2024-05-14T12:20:59.672475+0000","last_became_peered":"2024-05-14T12:20:59.672475+0000","last_unstale":"2024-05-14T12:23:08.245162+0000","last_undegraded":"2024-05-14T12:23:08.245162+0000","last_fullsized":"2024-05-14T12:23:08.245162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:06:04.861177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496398+0000","last_change":"2024-05-14T12:20:55.615870+0000","last_active":"2024-05-14T12:21:39.496398+0000","last_peered":"2024-05-14T12:21:39.496398+0000","last_clean":"2024-05-14T12:21:39.496398+0000","last_became_active":"2024-05-14T12:20:55.615444+0000","last_became_peered":"2024-05-14T12:20:55.615444+0000","last_unstale":"2024-05-14T12:21:39.496398+0000","last_undegraded":"2024-05-14T12:21:39.496398+0000","last_fullsized":"2024-05-14T12:21:39.496398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:03.081164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259667+0000","last_change":"2024-05-14T12:20:59.688252+0000","last_active":"2024-05-14T12:23:08.259667+0000","last_peered":"2024-05-14T12:23:08.259667+0000","last_clean":"2024-05-14T12:23:08.259667+0000","last_became_active":"2024-05-14T12:20:59.687861+0000","last_became_peered":"2024-05-14T12:20:59.687861+0000","last_unstale":"2024-05-14T12:23:08.259667+0000","last_undegraded":"2024-05-14T12:23:08.259667+0000","last_fullsized":"2024-05-14T12:23:08.259667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:29:00.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500452+0000","last_change":"2024-05-14T12:20:55.616119+0000","last_active":"2024-05-14T12:21:39.500452+0000","last_peered":"2024-05-14T12:21:39.500452+0000","last_clean":"2024-05-14T12:21:39.500452+0000","last_became_active":"2024-05-14T12:20:55.615700+0000","last_became_peered":"2024-05-14T12:20:55.615700+0000","last_unstale":"2024-05-14T12:21:39.500452+0000","last_undegraded":"2024-05-14T12:21:39.500452+0000","last_fullsized":"2024-05-14T12:21:39.500452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:39.342610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245535+0000","last_change":"2024-05-14T12:20:59.672495+0000","last_active":"2024-05-14T12:23:08.245535+0000","last_peered":"2024-05-14T12:23:08.245535+0000","last_clean":"2024-05-14T12:23:08.245535+0000","last_became_active":"2024-05-14T12:20:59.671983+0000","last_became_peered":"2024-05-14T12:20:59.671983+0000","last_unstale":"2024-05-14T12:23:08.245535+0000","last_undegraded":"2024-05-14T12:23:08.245535+0000","last_fullsized":"2024-05-14T12:23:08.245535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:41.336895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240059+0000","last_change":"2024-05-14T12:20:59.663818+0000","last_active":"2024-05-14T12:23:08.240059+0000","last_peered":"2024-05-14T12:23:08.240059+0000","last_clean":"2024-05-14T12:23:08.240059+0000","last_became_active":"2024-05-14T12:20:59.663431+0000","last_became_peered":"2024-05-14T12:20:59.663431+0000","last_unstale":"2024-05-14T12:23:08.240059+0000","last_undegraded":"2024-05-14T12:23:08.240059+0000","last_fullsized":"2024-05-14T12:23:08.240059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:40:10.435481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245374+0000","last_change":"2024-05-14T12:20:59.668412+0000","last_active":"2024-05-14T12:23:08.245374+0000","last_peered":"2024-05-14T12:23:08.245374+0000","last_clean":"2024-05-14T12:23:08.245374+0000","last_became_active":"2024-05-14T12:20:59.667963+0000","last_became_peered":"2024-05-14T12:20:59.667963+0000","last_unstale":"2024-05-14T12:23:08.245374+0000","last_undegraded":"2024-05-14T12:23:08.245374+0000","last_fullsized":"2024-05-14T12:23:08.245374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:50:19.463843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243183+0000","last_change":"2024-05-14T12:20:59.668796+0000","last_active":"2024-05-14T12:23:08.243183+0000","last_peered":"2024-05-14T12:23:08.243183+0000","last_clean":"2024-05-14T12:23:08.243183+0000","last_became_active":"2024-05-14T12:20:59.668414+0000","last_became_peered":"2024-05-14T12:20:59.668414+0000","last_unstale":"2024-05-14T12:23:08.243183+0000","last_undegraded":"2024-05-14T12:23:08.243183+0000","last_fullsized":"2024-05-14T12:23:08.243183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:28.669547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257674+0000","last_change":"2024-05-14T12:20:59.687417+0000","last_active":"2024-05-14T12:23:08.257674+0000","last_peered":"2024-05-14T12:23:08.257674+0000","last_clean":"2024-05-14T12:23:08.257674+0000","last_became_active":"2024-05-14T12:20:59.686373+0000","last_became_peered":"2024-05-14T12:20:59.686373+0000","last_unstale":"2024-05-14T12:23:08.257674+0000","last_undegraded":"2024-05-14T12:23:08.257674+0000","last_fullsized":"2024-05-14T12:23:08.257674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:55.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255534+0000","last_change":"2024-05-14T12:21:40.359831+0000","last_active":"2024-05-14T12:23:08.255534+0000","last_peered":"2024-05-14T12:23:08.255534+0000","last_clean":"2024-05-14T12:23:08.255534+0000","last_became_active":"2024-05-14T12:21:40.358347+0000","last_became_peered":"2024-05-14T12:21:40.358347+0000","last_unstale":"2024-05-14T12:23:08.255534+0000","last_undegraded":"2024-05-14T12:23:08.255534+0000","last_fullsized":"2024-05-14T12:23:08.255534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:03:58.165602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238787+0000","last_change":"2024-05-14T12:20:59.663332+0000","last_active":"2024-05-14T12:23:08.238787+0000","last_peered":"2024-05-14T12:23:08.238787+0000","last_clean":"2024-05-14T12:23:08.238787+0000","last_became_active":"2024-05-14T12:20:59.662714+0000","last_became_peered":"2024-05-14T12:20:59.662714+0000","last_unstale":"2024-05-14T12:23:08.238787+0000","last_undegraded":"2024-05-14T12:23:08.238787+0000","last_fullsized":"2024-05-14T12:23:08.238787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:59.140579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.234610+0000","last_change":"2024-05-14T12:20:59.665482+0000","last_active":"2024-05-14T12:23:08.234610+0000","last_peered":"2024-05-14T12:23:08.234610+0000","last_clean":"2024-05-14T12:23:08.234610+0000","last_became_active":"2024-05-14T12:20:59.665001+0000","last_became_peered":"2024-05-14T12:20:59.665001+0000","last_unstale":"2024-05-14T12:23:08.234610+0000","last_undegraded":"2024-05-14T12:23:08.234610+0000","last_fullsized":"2024-05-14T12:23:08.234610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:26.074054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246632+0000","last_change":"2024-05-14T12:20:59.679317+0000","last_active":"2024-05-14T12:23:08.246632+0000","last_peered":"2024-05-14T12:23:08.246632+0000","last_clean":"2024-05-14T12:23:08.246632+0000","last_became_active":"2024-05-14T12:20:59.675797+0000","last_became_peered":"2024-05-14T12:20:59.675797+0000","last_unstale":"2024-05-14T12:23:08.246632+0000","last_undegraded":"2024-05-14T12:23:08.246632+0000","last_fullsized":"2024-05-14T12:23:08.246632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:58.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250723+0000","last_change":"2024-05-14T12:20:59.669982+0000","last_active":"2024-05-14T12:23:08.250723+0000","last_peered":"2024-05-14T12:23:08.250723+0000","last_clean":"2024-05-14T12:23:08.250723+0000","last_became_active":"2024-05-14T12:20:59.669587+0000","last_became_peered":"2024-05-14T12:20:59.669587+0000","last_unstale":"2024-05-14T12:23:08.250723+0000","last_undegraded":"2024-05-14T12:23:08.250723+0000","last_fullsized":"2024-05-14T12:23:08.250723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:31.474906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260491+0000","last_change":"2024-05-14T12:20:59.672672+0000","last_active":"2024-05-14T12:23:08.260491+0000","last_peered":"2024-05-14T12:23:08.260491+0000","last_clean":"2024-05-14T12:23:08.260491+0000","last_became_active":"2024-05-14T12:20:59.672191+0000","last_became_peered":"2024-05-14T12:20:59.672191+0000","last_unstale":"2024-05-14T12:23:08.260491+0000","last_undegraded":"2024-05-14T12:23:08.260491+0000","last_fullsized":"2024-05-14T12:23:08.260491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:53:14.530296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260678+0000","last_change":"2024-05-14T12:20:59.684548+0000","last_active":"2024-05-14T12:23:08.260678+0000","last_peered":"2024-05-14T12:23:08.260678+0000","last_clean":"2024-05-14T12:23:08.260678+0000","last_became_active":"2024-05-14T12:20:59.684069+0000","last_became_peered":"2024-05-14T12:20:59.684069+0000","last_unstale":"2024-05-14T12:23:08.260678+0000","last_undegraded":"2024-05-14T12:23:08.260678+0000","last_fullsized":"2024-05-14T12:23:08.260678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:58.759384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.264740+0000","last_change":"2024-05-14T12:20:59.682386+0000","last_active":"2024-05-14T12:23:08.264740+0000","last_peered":"2024-05-14T12:23:08.264740+0000","last_clean":"2024-05-14T12:23:08.264740+0000","last_became_active":"2024-05-14T12:20:59.682037+0000","last_became_peered":"2024-05-14T12:20:59.682037+0000","last_unstale":"2024-05-14T12:23:08.264740+0000","last_undegraded":"2024-05-14T12:23:08.264740+0000","last_fullsized":"2024-05-14T12:23:08.264740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:24.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241032+0000","last_change":"2024-05-14T12:20:59.672679+0000","last_active":"2024-05-14T12:23:08.241032+0000","last_peered":"2024-05-14T12:23:08.241032+0000","last_clean":"2024-05-14T12:23:08.241032+0000","last_became_active":"2024-05-14T12:20:59.672324+0000","last_became_peered":"2024-05-14T12:20:59.672324+0000","last_unstale":"2024-05-14T12:23:08.241032+0000","last_undegraded":"2024-05-14T12:23:08.241032+0000","last_fullsized":"2024-05-14T12:23:08.241032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:45.513792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73079,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2306,"num_read_kb":1238,"num_write":263,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":644,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":219237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776200,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1101142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939726,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":444450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135957,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":444806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364890,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1544192,"data_stored":1037797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561121,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":510895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":511115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149809,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953580,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757352,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1548288,"data_stored":1036011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T12:25:14.564 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T12:25:14.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:14 smithi073 ceph-mon[35809]: from='client.25115 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:14.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:14 smithi066 ceph-mon[35981]: from='client.25115 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:14.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:14 smithi047 ceph-mon[31254]: from='client.25115 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:15.087 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:15.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:15 smithi073 ceph-mon[35809]: pgmap v452: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T12:25:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:15 smithi066 ceph-mon[35981]: pgmap v452: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T12:25:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:15 smithi047 ceph-mon[31254]: pgmap v452: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T12:25:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.411+0000 7f31e1600700 1 -- 172.21.15.47:0/2532339770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10a990 msgr2=0x7f31dc10ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.411+0000 7f31e1600700 1 --2- 172.21.15.47:0/2532339770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10a990 0x7f31dc10ada0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31c40098f0 tx=0x7f31c4009c00 comp rx=0 tx=0).stop 2024-05-14T12:25:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.412+0000 7f31e1600700 1 -- 172.21.15.47:0/2532339770 shutdown_connections 2024-05-14T12:25:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.412+0000 7f31e1600700 1 --2- 172.21.15.47:0/2532339770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31dc10b2e0 0x7f31dc117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.412+0000 7f31e1600700 1 --2- 172.21.15.47:0/2532339770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc110970 0x7f31dc110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.412+0000 7f31e1600700 1 --2- 172.21.15.47:0/2532339770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10a990 0x7f31dc10ada0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.412+0000 7f31e1600700 1 -- 172.21.15.47:0/2532339770 >> 172.21.15.47:0/2532339770 conn(0x7f31dc077c80 msgr2=0x7f31dc0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.412+0000 7f31e1600700 1 -- 172.21.15.47:0/2532339770 shutdown_connections 2024-05-14T12:25:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.412+0000 7f31e1600700 1 -- 172.21.15.47:0/2532339770 wait complete. 2024-05-14T12:25:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.413+0000 7f31e1600700 1 Processor -- start 2024-05-14T12:25:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.414+0000 7f31e1600700 1 -- start start 2024-05-14T12:25:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.414+0000 7f31e1600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc10a990 0x7f31dc1a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.414+0000 7f31e1600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10b2e0 0x7f31dc1a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.414+0000 7f31e1600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31dc110970 0x7f31dc1a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.414+0000 7f31e1600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc11aae0 con 0x7f31dc110970 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.414+0000 7f31e1600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc11a960 con 0x7f31dc10a990 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.414+0000 7f31e1600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc11ac60 con 0x7f31dc10b2e0 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc10a990 0x7f31dc1a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc10a990 0x7f31dc1a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:44048/0 (socket says 172.21.15.47:44048) 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 -- 172.21.15.47:0/3283307263 learned_addr learned my addr 172.21.15.47:0/3283307263 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31da000700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10b2e0 0x7f31dc1a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31db400700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31dc110970 0x7f31dc1a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 -- 172.21.15.47:0/3283307263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10b2e0 msgr2=0x7f31dc1a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10b2e0 0x7f31dc1a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 -- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31dc110970 msgr2=0x7f31dc1a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31dc110970 0x7f31dc1a5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.415+0000 7f31daa00700 1 -- 172.21.15.47:0/3283307263 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc1a63e0 con 0x7f31dc10a990 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.416+0000 7f31daa00700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc10a990 0x7f31dc1a1510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e970 tx=0x7f31cc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.416+0000 7f31d3400700 1 -- 172.21.15.47:0/3283307263 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc004a30 con 0x7f31dc10a990 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.416+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc1a66d0 con 0x7f31dc10a990 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.416+0000 7f31d3400700 1 -- 172.21.15.47:0/3283307263 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31cc00cc90 con 0x7f31dc10a990 2024-05-14T12:25:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.416+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc1adff0 con 0x7f31dc10a990 2024-05-14T12:25:17.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.416+0000 7f31d3400700 1 -- 172.21.15.47:0/3283307263 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc005610 con 0x7f31dc10a990 2024-05-14T12:25:17.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.418+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b8005330 con 0x7f31dc10a990 2024-05-14T12:25:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.421+0000 7f31d3400700 1 -- 172.21.15.47:0/3283307263 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f31cc00c7e0 con 0x7f31dc10a990 2024-05-14T12:25:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.422+0000 7f31d3400700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f31c00b2900 0x7f31c00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.422+0000 7f31d3400700 1 -- 172.21.15.47:0/3283307263 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f31cc0e2390 con 0x7f31dc10a990 2024-05-14T12:25:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.423+0000 7f31da000700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f31c00b2900 0x7f31c00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:17.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.423+0000 7f31da000700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f31c00b2900 0x7f31c00b4e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009fd0 tx=0x7f31c4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:17.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.427+0000 7f31d3400700 1 -- 172.21.15.47:0/3283307263 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f31cc0aa070 con 0x7f31dc10a990 2024-05-14T12:25:17.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.661+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31b8000bc0 con 0x7f31c00b2900 2024-05-14T12:25:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.674+0000 7f31d3400700 1 -- 172.21.15.47:0/3283307263 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258914 (secure 0 0 0) 0x7f31c4066380 con 0x7f31c00b2900 2024-05-14T12:25:17.674 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:17 smithi047 ceph-mon[31254]: pgmap v453: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T12:25:17.678 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:25:17.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.681+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f31c00b2900 msgr2=0x7f31c00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.681+0000 7f31e1600700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f31c00b2900 0x7f31c00b4e10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009fd0 tx=0x7f31c4019040 comp rx=0 tx=0).stop 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.681+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc10a990 msgr2=0x7f31dc1a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.681+0000 7f31e1600700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc10a990 0x7f31dc1a1510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e970 tx=0x7f31cc00ec80 comp rx=0 tx=0).stop 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 shutdown_connections 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f31c00b2900 0x7f31c00b4e10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31dc110970 0x7f31dc1a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31dc10a990 0x7f31dc1a1510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 --2- 172.21.15.47:0/3283307263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31dc10b2e0 0x7f31dc1a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 >> 172.21.15.47:0/3283307263 conn(0x7f31dc077c80 msgr2=0x7f31dc07b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 shutdown_connections 2024-05-14T12:25:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:17.682+0000 7f31e1600700 1 -- 172.21.15.47:0/3283307263 wait complete. 2024-05-14T12:25:17.683 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-14T12:25:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:17 smithi066 ceph-mon[35981]: pgmap v453: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T12:25:18.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:17 smithi073 ceph-mon[35809]: pgmap v453: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T12:25:18.643 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":453,"stamp":"2024-05-14T12:25:16.368612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":669054,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2423,"num_read_kb":1333,"num_write":389,"num_write_kb":2312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2952484,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374680,"kb_used_data":13048,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567144,"statfs":{"total":1151940427776,"available":1151556755456,"internally_reserved":0,"allocated":13361152,"data_stored":7321725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":73,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005807"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.249926+0000","last_change":"2024-05-14T12:20:59.669913+0000","last_active":"2024-05-14T12:23:08.249926+0000","last_peered":"2024-05-14T12:23:08.249926+0000","last_clean":"2024-05-14T12:23:08.249926+0000","last_became_active":"2024-05-14T12:20:59.668481+0000","last_became_peered":"2024-05-14T12:20:59.668481+0000","last_unstale":"2024-05-14T12:23:08.249926+0000","last_undegraded":"2024-05-14T12:23:08.249926+0000","last_fullsized":"2024-05-14T12:23:08.249926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:13.671516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247467+0000","last_change":"2024-05-14T12:20:59.665032+0000","last_active":"2024-05-14T12:23:08.247467+0000","last_peered":"2024-05-14T12:23:08.247467+0000","last_clean":"2024-05-14T12:23:08.247467+0000","last_became_active":"2024-05-14T12:20:59.664471+0000","last_became_peered":"2024-05-14T12:20:59.664471+0000","last_unstale":"2024-05-14T12:23:08.247467+0000","last_undegraded":"2024-05-14T12:23:08.247467+0000","last_fullsized":"2024-05-14T12:23:08.247467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:58:02.354064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255407+0000","last_change":"2024-05-14T12:20:59.679975+0000","last_active":"2024-05-14T12:23:08.255407+0000","last_peered":"2024-05-14T12:23:08.255407+0000","last_clean":"2024-05-14T12:23:08.255407+0000","last_became_active":"2024-05-14T12:20:59.679586+0000","last_became_peered":"2024-05-14T12:20:59.679586+0000","last_unstale":"2024-05-14T12:23:08.255407+0000","last_undegraded":"2024-05-14T12:23:08.255407+0000","last_fullsized":"2024-05-14T12:23:08.255407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:45:37.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241224+0000","last_change":"2024-05-14T12:20:59.668125+0000","last_active":"2024-05-14T12:23:08.241224+0000","last_peered":"2024-05-14T12:23:08.241224+0000","last_clean":"2024-05-14T12:23:08.241224+0000","last_became_active":"2024-05-14T12:20:59.667664+0000","last_became_peered":"2024-05-14T12:20:59.667664+0000","last_unstale":"2024-05-14T12:23:08.241224+0000","last_undegraded":"2024-05-14T12:23:08.241224+0000","last_fullsized":"2024-05-14T12:23:08.241224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:29.995159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256345+0000","last_change":"2024-05-14T12:20:59.682787+0000","last_active":"2024-05-14T12:23:08.256345+0000","last_peered":"2024-05-14T12:23:08.256345+0000","last_clean":"2024-05-14T12:23:08.256345+0000","last_became_active":"2024-05-14T12:20:59.682462+0000","last_became_peered":"2024-05-14T12:20:59.682462+0000","last_unstale":"2024-05-14T12:23:08.256345+0000","last_undegraded":"2024-05-14T12:23:08.256345+0000","last_fullsized":"2024-05-14T12:23:08.256345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:27.287750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.242052+0000","last_change":"2024-05-14T12:21:39.506661+0000","last_active":"2024-05-14T12:23:08.242052+0000","last_peered":"2024-05-14T12:23:08.242052+0000","last_clean":"2024-05-14T12:23:08.242052+0000","last_became_active":"2024-05-14T12:21:39.506116+0000","last_became_peered":"2024-05-14T12:21:39.506116+0000","last_unstale":"2024-05-14T12:23:08.242052+0000","last_undegraded":"2024-05-14T12:23:08.242052+0000","last_fullsized":"2024-05-14T12:23:08.242052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:18.551207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244412+0000","last_change":"2024-05-14T12:20:59.671683+0000","last_active":"2024-05-14T12:23:08.244412+0000","last_peered":"2024-05-14T12:23:08.244412+0000","last_clean":"2024-05-14T12:23:08.244412+0000","last_became_active":"2024-05-14T12:20:59.671307+0000","last_became_peered":"2024-05-14T12:20:59.671307+0000","last_unstale":"2024-05-14T12:23:08.244412+0000","last_undegraded":"2024-05-14T12:23:08.244412+0000","last_fullsized":"2024-05-14T12:23:08.244412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.744159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253965+0000","last_change":"2024-05-14T12:21:39.504953+0000","last_active":"2024-05-14T12:23:08.253965+0000","last_peered":"2024-05-14T12:23:08.253965+0000","last_clean":"2024-05-14T12:23:08.253965+0000","last_became_active":"2024-05-14T12:21:39.504267+0000","last_became_peered":"2024-05-14T12:21:39.504267+0000","last_unstale":"2024-05-14T12:23:08.253965+0000","last_undegraded":"2024-05-14T12:23:08.253965+0000","last_fullsized":"2024-05-14T12:23:08.253965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:04.329324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247427+0000","last_change":"2024-05-14T12:20:59.663319+0000","last_active":"2024-05-14T12:23:08.247427+0000","last_peered":"2024-05-14T12:23:08.247427+0000","last_clean":"2024-05-14T12:23:08.247427+0000","last_became_active":"2024-05-14T12:20:59.662618+0000","last_became_peered":"2024-05-14T12:20:59.662618+0000","last_unstale":"2024-05-14T12:23:08.247427+0000","last_undegraded":"2024-05-14T12:23:08.247427+0000","last_fullsized":"2024-05-14T12:23:08.247427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:18.032899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244456+0000","last_change":"2024-05-14T12:20:59.671006+0000","last_active":"2024-05-14T12:23:08.244456+0000","last_peered":"2024-05-14T12:23:08.244456+0000","last_clean":"2024-05-14T12:23:08.244456+0000","last_became_active":"2024-05-14T12:20:59.670632+0000","last_became_peered":"2024-05-14T12:20:59.670632+0000","last_unstale":"2024-05-14T12:23:08.244456+0000","last_undegraded":"2024-05-14T12:23:08.244456+0000","last_fullsized":"2024-05-14T12:23:08.244456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:12:30.144637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245298+0000","last_change":"2024-05-14T12:20:59.675968+0000","last_active":"2024-05-14T12:23:08.245298+0000","last_peered":"2024-05-14T12:23:08.245298+0000","last_clean":"2024-05-14T12:23:08.245298+0000","last_became_active":"2024-05-14T12:20:59.675551+0000","last_became_peered":"2024-05-14T12:20:59.675551+0000","last_unstale":"2024-05-14T12:23:08.245298+0000","last_undegraded":"2024-05-14T12:23:08.245298+0000","last_fullsized":"2024-05-14T12:23:08.245298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:39.562658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241448+0000","last_change":"2024-05-14T12:20:59.671011+0000","last_active":"2024-05-14T12:23:08.241448+0000","last_peered":"2024-05-14T12:23:08.241448+0000","last_clean":"2024-05-14T12:23:08.241448+0000","last_became_active":"2024-05-14T12:20:59.670637+0000","last_became_peered":"2024-05-14T12:20:59.670637+0000","last_unstale":"2024-05-14T12:23:08.241448+0000","last_undegraded":"2024-05-14T12:23:08.241448+0000","last_fullsized":"2024-05-14T12:23:08.241448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:53.808936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.265171+0000","last_change":"2024-05-14T12:20:59.680039+0000","last_active":"2024-05-14T12:23:08.265171+0000","last_peered":"2024-05-14T12:23:08.265171+0000","last_clean":"2024-05-14T12:23:08.265171+0000","last_became_active":"2024-05-14T12:20:59.678120+0000","last_became_peered":"2024-05-14T12:20:59.678120+0000","last_unstale":"2024-05-14T12:23:08.265171+0000","last_undegraded":"2024-05-14T12:23:08.265171+0000","last_fullsized":"2024-05-14T12:23:08.265171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:19:28.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238936+0000","last_change":"2024-05-14T12:20:59.675301+0000","last_active":"2024-05-14T12:23:08.238936+0000","last_peered":"2024-05-14T12:23:08.238936+0000","last_clean":"2024-05-14T12:23:08.238936+0000","last_became_active":"2024-05-14T12:20:59.669861+0000","last_became_peered":"2024-05-14T12:20:59.669861+0000","last_unstale":"2024-05-14T12:23:08.238936+0000","last_undegraded":"2024-05-14T12:23:08.238936+0000","last_fullsized":"2024-05-14T12:23:08.238936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:19:17.931719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246879+0000","last_change":"2024-05-14T12:20:59.682378+0000","last_active":"2024-05-14T12:23:08.246879+0000","last_peered":"2024-05-14T12:23:08.246879+0000","last_clean":"2024-05-14T12:23:08.246879+0000","last_became_active":"2024-05-14T12:20:59.680598+0000","last_became_peered":"2024-05-14T12:20:59.680598+0000","last_unstale":"2024-05-14T12:23:08.246879+0000","last_undegraded":"2024-05-14T12:23:08.246879+0000","last_fullsized":"2024-05-14T12:23:08.246879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:22.189038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254566+0000","last_change":"2024-05-14T12:20:59.685447+0000","last_active":"2024-05-14T12:23:08.254566+0000","last_peered":"2024-05-14T12:23:08.254566+0000","last_clean":"2024-05-14T12:23:08.254566+0000","last_became_active":"2024-05-14T12:20:59.684963+0000","last_became_peered":"2024-05-14T12:20:59.684963+0000","last_unstale":"2024-05-14T12:23:08.254566+0000","last_undegraded":"2024-05-14T12:23:08.254566+0000","last_fullsized":"2024-05-14T12:23:08.254566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:47.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250053+0000","last_change":"2024-05-14T12:20:59.681870+0000","last_active":"2024-05-14T12:23:08.250053+0000","last_peered":"2024-05-14T12:23:08.250053+0000","last_clean":"2024-05-14T12:23:08.250053+0000","last_became_active":"2024-05-14T12:20:59.681405+0000","last_became_peered":"2024-05-14T12:20:59.681405+0000","last_unstale":"2024-05-14T12:23:08.250053+0000","last_undegraded":"2024-05-14T12:23:08.250053+0000","last_fullsized":"2024-05-14T12:23:08.250053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:20.002496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253917+0000","last_change":"2024-05-14T12:20:59.667486+0000","last_active":"2024-05-14T12:23:08.253917+0000","last_peered":"2024-05-14T12:23:08.253917+0000","last_clean":"2024-05-14T12:23:08.253917+0000","last_became_active":"2024-05-14T12:20:59.667032+0000","last_became_peered":"2024-05-14T12:20:59.667032+0000","last_unstale":"2024-05-14T12:23:08.253917+0000","last_undegraded":"2024-05-14T12:23:08.253917+0000","last_fullsized":"2024-05-14T12:23:08.253917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:25.325504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253867+0000","last_change":"2024-05-14T12:20:59.672065+0000","last_active":"2024-05-14T12:23:08.253867+0000","last_peered":"2024-05-14T12:23:08.253867+0000","last_clean":"2024-05-14T12:23:08.253867+0000","last_became_active":"2024-05-14T12:20:59.671692+0000","last_became_peered":"2024-05-14T12:20:59.671692+0000","last_unstale":"2024-05-14T12:23:08.253867+0000","last_undegraded":"2024-05-14T12:23:08.253867+0000","last_fullsized":"2024-05-14T12:23:08.253867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:11:47.952421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":275,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:12.906984+0000","last_change":"2024-05-14T12:20:55.611507+0000","last_active":"2024-05-14T12:25:12.906984+0000","last_peered":"2024-05-14T12:25:12.906984+0000","last_clean":"2024-05-14T12:25:12.906984+0000","last_became_active":"2024-05-14T12:20:55.606794+0000","last_became_peered":"2024-05-14T12:20:55.606794+0000","last_unstale":"2024-05-14T12:25:12.906984+0000","last_undegraded":"2024-05-14T12:25:12.906984+0000","last_fullsized":"2024-05-14T12:25:12.906984+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:51.301124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":233,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247216+0000","last_change":"2024-05-14T12:20:59.673013+0000","last_active":"2024-05-14T12:23:08.247216+0000","last_peered":"2024-05-14T12:23:08.247216+0000","last_clean":"2024-05-14T12:23:08.247216+0000","last_became_active":"2024-05-14T12:20:59.672575+0000","last_became_peered":"2024-05-14T12:20:59.672575+0000","last_unstale":"2024-05-14T12:23:08.247216+0000","last_undegraded":"2024-05-14T12:23:08.247216+0000","last_fullsized":"2024-05-14T12:23:08.247216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:00:26.549099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:56.369914+0000","last_change":"2024-05-14T12:20:55.963853+0000","last_active":"2024-05-14T12:22:56.369914+0000","last_peered":"2024-05-14T12:22:56.369914+0000","last_clean":"2024-05-14T12:22:56.369914+0000","last_became_active":"2024-05-14T12:20:55.962018+0000","last_became_peered":"2024-05-14T12:20:55.962018+0000","last_unstale":"2024-05-14T12:22:56.369914+0000","last_undegraded":"2024-05-14T12:22:56.369914+0000","last_fullsized":"2024-05-14T12:22:56.369914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:06:22.374595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254121+0000","last_change":"2024-05-14T12:20:59.671243+0000","last_active":"2024-05-14T12:23:08.254121+0000","last_peered":"2024-05-14T12:23:08.254121+0000","last_clean":"2024-05-14T12:23:08.254121+0000","last_became_active":"2024-05-14T12:20:59.665885+0000","last_became_peered":"2024-05-14T12:20:59.665885+0000","last_unstale":"2024-05-14T12:23:08.254121+0000","last_undegraded":"2024-05-14T12:23:08.254121+0000","last_fullsized":"2024-05-14T12:23:08.254121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:48.656774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.527444+0000","last_change":"2024-05-14T12:21:39.526944+0000","last_active":"2024-05-14T12:21:39.527444+0000","last_peered":"2024-05-14T12:21:39.527444+0000","last_clean":"2024-05-14T12:21:39.527444+0000","last_became_active":"2024-05-14T12:21:39.506478+0000","last_became_peered":"2024-05-14T12:21:39.506478+0000","last_unstale":"2024-05-14T12:21:39.527444+0000","last_undegraded":"2024-05-14T12:21:39.527444+0000","last_fullsized":"2024-05-14T12:21:39.527444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:41.812733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256880+0000","last_change":"2024-05-14T12:20:59.671282+0000","last_active":"2024-05-14T12:23:08.256880+0000","last_peered":"2024-05-14T12:23:08.256880+0000","last_clean":"2024-05-14T12:23:08.256880+0000","last_became_active":"2024-05-14T12:20:59.670645+0000","last_became_peered":"2024-05-14T12:20:59.670645+0000","last_unstale":"2024-05-14T12:23:08.256880+0000","last_undegraded":"2024-05-14T12:23:08.256880+0000","last_fullsized":"2024-05-14T12:23:08.256880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:51:57.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501912+0000","last_change":"2024-05-14T12:20:55.604757+0000","last_active":"2024-05-14T12:21:39.501912+0000","last_peered":"2024-05-14T12:21:39.501912+0000","last_clean":"2024-05-14T12:21:39.501912+0000","last_became_active":"2024-05-14T12:20:55.604281+0000","last_became_peered":"2024-05-14T12:20:55.604281+0000","last_unstale":"2024-05-14T12:21:39.501912+0000","last_undegraded":"2024-05-14T12:21:39.501912+0000","last_fullsized":"2024-05-14T12:21:39.501912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:52.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245684+0000","last_change":"2024-05-14T12:20:59.672498+0000","last_active":"2024-05-14T12:23:08.245684+0000","last_peered":"2024-05-14T12:23:08.245684+0000","last_clean":"2024-05-14T12:23:08.245684+0000","last_became_active":"2024-05-14T12:20:59.672116+0000","last_became_peered":"2024-05-14T12:20:59.672116+0000","last_unstale":"2024-05-14T12:23:08.245684+0000","last_undegraded":"2024-05-14T12:23:08.245684+0000","last_fullsized":"2024-05-14T12:23:08.245684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:47:34.614427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:09.966325+0000","last_change":"2024-05-14T12:21:39.515431+0000","last_active":"2024-05-14T12:25:09.966325+0000","last_peered":"2024-05-14T12:25:09.966325+0000","last_clean":"2024-05-14T12:25:09.966325+0000","last_became_active":"2024-05-14T12:21:39.503217+0000","last_became_peered":"2024-05-14T12:21:39.503217+0000","last_unstale":"2024-05-14T12:25:09.966325+0000","last_undegraded":"2024-05-14T12:25:09.966325+0000","last_fullsized":"2024-05-14T12:25:09.966325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:52:21.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255983+0000","last_change":"2024-05-14T12:20:59.664725+0000","last_active":"2024-05-14T12:23:08.255983+0000","last_peered":"2024-05-14T12:23:08.255983+0000","last_clean":"2024-05-14T12:23:08.255983+0000","last_became_active":"2024-05-14T12:20:59.664323+0000","last_became_peered":"2024-05-14T12:20:59.664323+0000","last_unstale":"2024-05-14T12:23:08.255983+0000","last_undegraded":"2024-05-14T12:23:08.255983+0000","last_fullsized":"2024-05-14T12:23:08.255983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.729787+0000","last_change":"2024-05-14T12:21:39.729236+0000","last_active":"2024-05-14T12:21:39.729787+0000","last_peered":"2024-05-14T12:21:39.729787+0000","last_clean":"2024-05-14T12:21:39.729787+0000","last_became_active":"2024-05-14T12:21:39.722405+0000","last_became_peered":"2024-05-14T12:21:39.722405+0000","last_unstale":"2024-05-14T12:21:39.729787+0000","last_undegraded":"2024-05-14T12:21:39.729787+0000","last_fullsized":"2024-05-14T12:21:39.729787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:14:19.461411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245385+0000","last_change":"2024-05-14T12:20:59.671870+0000","last_active":"2024-05-14T12:23:08.245385+0000","last_peered":"2024-05-14T12:23:08.245385+0000","last_clean":"2024-05-14T12:23:08.245385+0000","last_became_active":"2024-05-14T12:20:59.671467+0000","last_became_peered":"2024-05-14T12:20:59.671467+0000","last_unstale":"2024-05-14T12:23:08.245385+0000","last_undegraded":"2024-05-14T12:23:08.245385+0000","last_fullsized":"2024-05-14T12:23:08.245385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:18.195518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498590+0000","last_change":"2024-05-14T12:20:55.613626+0000","last_active":"2024-05-14T12:21:39.498590+0000","last_peered":"2024-05-14T12:21:39.498590+0000","last_clean":"2024-05-14T12:21:39.498590+0000","last_became_active":"2024-05-14T12:20:55.613039+0000","last_became_peered":"2024-05-14T12:20:55.613039+0000","last_unstale":"2024-05-14T12:21:39.498590+0000","last_undegraded":"2024-05-14T12:21:39.498590+0000","last_fullsized":"2024-05-14T12:21:39.498590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:19.479433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259965+0000","last_change":"2024-05-14T12:20:59.683152+0000","last_active":"2024-05-14T12:23:08.259965+0000","last_peered":"2024-05-14T12:23:08.259965+0000","last_clean":"2024-05-14T12:23:08.259965+0000","last_became_active":"2024-05-14T12:20:59.682863+0000","last_became_peered":"2024-05-14T12:20:59.682863+0000","last_unstale":"2024-05-14T12:23:08.259965+0000","last_undegraded":"2024-05-14T12:23:08.259965+0000","last_fullsized":"2024-05-14T12:23:08.259965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:26.975487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496446+0000","last_change":"2024-05-14T12:20:55.604785+0000","last_active":"2024-05-14T12:21:39.496446+0000","last_peered":"2024-05-14T12:21:39.496446+0000","last_clean":"2024-05-14T12:21:39.496446+0000","last_became_active":"2024-05-14T12:20:55.604249+0000","last_became_peered":"2024-05-14T12:20:55.604249+0000","last_unstale":"2024-05-14T12:21:39.496446+0000","last_undegraded":"2024-05-14T12:21:39.496446+0000","last_fullsized":"2024-05-14T12:21:39.496446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:51.954691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254982+0000","last_change":"2024-05-14T12:20:59.677047+0000","last_active":"2024-05-14T12:23:08.254982+0000","last_peered":"2024-05-14T12:23:08.254982+0000","last_clean":"2024-05-14T12:23:08.254982+0000","last_became_active":"2024-05-14T12:20:59.673314+0000","last_became_peered":"2024-05-14T12:20:59.673314+0000","last_unstale":"2024-05-14T12:23:08.254982+0000","last_undegraded":"2024-05-14T12:23:08.254982+0000","last_fullsized":"2024-05-14T12:23:08.254982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:54.069762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:14.976449+0000","last_change":"2024-05-14T12:20:55.608986+0000","last_active":"2024-05-14T12:25:14.976449+0000","last_peered":"2024-05-14T12:25:14.976449+0000","last_clean":"2024-05-14T12:25:14.976449+0000","last_became_active":"2024-05-14T12:20:55.608476+0000","last_became_peered":"2024-05-14T12:20:55.608476+0000","last_unstale":"2024-05-14T12:25:14.976449+0000","last_undegraded":"2024-05-14T12:25:14.976449+0000","last_fullsized":"2024-05-14T12:25:14.976449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:15:40.777724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":467,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251635+0000","last_change":"2024-05-14T12:20:59.673404+0000","last_active":"2024-05-14T12:23:08.251635+0000","last_peered":"2024-05-14T12:23:08.251635+0000","last_clean":"2024-05-14T12:23:08.251635+0000","last_became_active":"2024-05-14T12:20:59.673035+0000","last_became_peered":"2024-05-14T12:20:59.673035+0000","last_unstale":"2024-05-14T12:23:08.251635+0000","last_undegraded":"2024-05-14T12:23:08.251635+0000","last_fullsized":"2024-05-14T12:23:08.251635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:29:42.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498557+0000","last_change":"2024-05-14T12:20:55.605789+0000","last_active":"2024-05-14T12:21:39.498557+0000","last_peered":"2024-05-14T12:21:39.498557+0000","last_clean":"2024-05-14T12:21:39.498557+0000","last_became_active":"2024-05-14T12:20:55.605166+0000","last_became_peered":"2024-05-14T12:20:55.605166+0000","last_unstale":"2024-05-14T12:21:39.498557+0000","last_undegraded":"2024-05-14T12:21:39.498557+0000","last_fullsized":"2024-05-14T12:21:39.498557+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:44.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244142+0000","last_change":"2024-05-14T12:20:59.678373+0000","last_active":"2024-05-14T12:23:08.244142+0000","last_peered":"2024-05-14T12:23:08.244142+0000","last_clean":"2024-05-14T12:23:08.244142+0000","last_became_active":"2024-05-14T12:20:59.673378+0000","last_became_peered":"2024-05-14T12:20:59.673378+0000","last_unstale":"2024-05-14T12:23:08.244142+0000","last_undegraded":"2024-05-14T12:23:08.244142+0000","last_fullsized":"2024-05-14T12:23:08.244142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:17:36.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496591+0000","last_change":"2024-05-14T12:20:55.966507+0000","last_active":"2024-05-14T12:21:39.496591+0000","last_peered":"2024-05-14T12:21:39.496591+0000","last_clean":"2024-05-14T12:21:39.496591+0000","last_became_active":"2024-05-14T12:20:55.966066+0000","last_became_peered":"2024-05-14T12:20:55.966066+0000","last_unstale":"2024-05-14T12:21:39.496591+0000","last_undegraded":"2024-05-14T12:21:39.496591+0000","last_fullsized":"2024-05-14T12:21:39.496591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:20.276346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250342+0000","last_change":"2024-05-14T12:20:59.669926+0000","last_active":"2024-05-14T12:23:08.250342+0000","last_peered":"2024-05-14T12:23:08.250342+0000","last_clean":"2024-05-14T12:23:08.250342+0000","last_became_active":"2024-05-14T12:20:59.669502+0000","last_became_peered":"2024-05-14T12:20:59.669502+0000","last_unstale":"2024-05-14T12:23:08.250342+0000","last_undegraded":"2024-05-14T12:23:08.250342+0000","last_fullsized":"2024-05-14T12:23:08.250342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:02.036442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":547,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:15.828915+0000","last_change":"2024-05-14T12:20:55.602307+0000","last_active":"2024-05-14T12:25:15.828915+0000","last_peered":"2024-05-14T12:25:15.828915+0000","last_clean":"2024-05-14T12:25:15.828915+0000","last_became_active":"2024-05-14T12:20:55.601879+0000","last_became_peered":"2024-05-14T12:20:55.601879+0000","last_unstale":"2024-05-14T12:25:15.828915+0000","last_undegraded":"2024-05-14T12:25:15.828915+0000","last_fullsized":"2024-05-14T12:25:15.828915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:10.839268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70656,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":309,"num_write":42,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244715+0000","last_change":"2024-05-14T12:20:59.676162+0000","last_active":"2024-05-14T12:23:08.244715+0000","last_peered":"2024-05-14T12:23:08.244715+0000","last_clean":"2024-05-14T12:23:08.244715+0000","last_became_active":"2024-05-14T12:20:59.675742+0000","last_became_peered":"2024-05-14T12:20:59.675742+0000","last_unstale":"2024-05-14T12:23:08.244715+0000","last_undegraded":"2024-05-14T12:23:08.244715+0000","last_fullsized":"2024-05-14T12:23:08.244715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:52:00.100743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501460+0000","last_change":"2024-05-14T12:20:55.616014+0000","last_active":"2024-05-14T12:21:39.501460+0000","last_peered":"2024-05-14T12:21:39.501460+0000","last_clean":"2024-05-14T12:21:39.501460+0000","last_became_active":"2024-05-14T12:20:55.615331+0000","last_became_peered":"2024-05-14T12:20:55.615331+0000","last_unstale":"2024-05-14T12:21:39.501460+0000","last_undegraded":"2024-05-14T12:21:39.501460+0000","last_fullsized":"2024-05-14T12:21:39.501460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:53.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261957+0000","last_change":"2024-05-14T12:20:59.690299+0000","last_active":"2024-05-14T12:23:08.261957+0000","last_peered":"2024-05-14T12:23:08.261957+0000","last_clean":"2024-05-14T12:23:08.261957+0000","last_became_active":"2024-05-14T12:20:59.689959+0000","last_became_peered":"2024-05-14T12:20:59.689959+0000","last_unstale":"2024-05-14T12:23:08.261957+0000","last_undegraded":"2024-05-14T12:23:08.261957+0000","last_fullsized":"2024-05-14T12:23:08.261957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:53.017238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496270+0000","last_change":"2024-05-14T12:20:55.615860+0000","last_active":"2024-05-14T12:21:39.496270+0000","last_peered":"2024-05-14T12:21:39.496270+0000","last_clean":"2024-05-14T12:21:39.496270+0000","last_became_active":"2024-05-14T12:20:55.615415+0000","last_became_peered":"2024-05-14T12:20:55.615415+0000","last_unstale":"2024-05-14T12:21:39.496270+0000","last_undegraded":"2024-05-14T12:21:39.496270+0000","last_fullsized":"2024-05-14T12:21:39.496270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:27:55.368122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.258058+0000","last_change":"2024-05-14T12:20:59.684759+0000","last_active":"2024-05-14T12:23:08.258058+0000","last_peered":"2024-05-14T12:23:08.258058+0000","last_clean":"2024-05-14T12:23:08.258058+0000","last_became_active":"2024-05-14T12:20:59.684277+0000","last_became_peered":"2024-05-14T12:20:59.684277+0000","last_unstale":"2024-05-14T12:23:08.258058+0000","last_undegraded":"2024-05-14T12:23:08.258058+0000","last_fullsized":"2024-05-14T12:23:08.258058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:42:08.535580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:10.904659+0000","last_change":"2024-05-14T12:20:55.602130+0000","last_active":"2024-05-14T12:25:10.904659+0000","last_peered":"2024-05-14T12:25:10.904659+0000","last_clean":"2024-05-14T12:25:10.904659+0000","last_became_active":"2024-05-14T12:20:55.601635+0000","last_became_peered":"2024-05-14T12:20:55.601635+0000","last_unstale":"2024-05-14T12:25:10.904659+0000","last_undegraded":"2024-05-14T12:25:10.904659+0000","last_fullsized":"2024-05-14T12:25:10.904659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:24:34.599413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":898,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251007+0000","last_change":"2024-05-14T12:21:39.505509+0000","last_active":"2024-05-14T12:23:08.251007+0000","last_peered":"2024-05-14T12:23:08.251007+0000","last_clean":"2024-05-14T12:23:08.251007+0000","last_became_active":"2024-05-14T12:21:39.504817+0000","last_became_peered":"2024-05-14T12:21:39.504817+0000","last_unstale":"2024-05-14T12:23:08.251007+0000","last_undegraded":"2024-05-14T12:23:08.251007+0000","last_fullsized":"2024-05-14T12:23:08.251007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:05:08.309898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501589+0000","last_change":"2024-05-14T12:20:55.962404+0000","last_active":"2024-05-14T12:21:39.501589+0000","last_peered":"2024-05-14T12:21:39.501589+0000","last_clean":"2024-05-14T12:21:39.501589+0000","last_became_active":"2024-05-14T12:20:55.961886+0000","last_became_peered":"2024-05-14T12:20:55.961886+0000","last_unstale":"2024-05-14T12:21:39.501589+0000","last_undegraded":"2024-05-14T12:21:39.501589+0000","last_fullsized":"2024-05-14T12:21:39.501589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:30.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245497+0000","last_change":"2024-05-14T12:20:59.674010+0000","last_active":"2024-05-14T12:23:08.245497+0000","last_peered":"2024-05-14T12:23:08.245497+0000","last_clean":"2024-05-14T12:23:08.245497+0000","last_became_active":"2024-05-14T12:20:59.673546+0000","last_became_peered":"2024-05-14T12:20:59.673546+0000","last_unstale":"2024-05-14T12:23:08.245497+0000","last_undegraded":"2024-05-14T12:23:08.245497+0000","last_fullsized":"2024-05-14T12:23:08.245497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:59.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:41.801527+0000","last_change":"2024-05-14T12:21:39.512745+0000","last_active":"2024-05-14T12:21:41.801527+0000","last_peered":"2024-05-14T12:21:41.801527+0000","last_clean":"2024-05-14T12:21:41.801527+0000","last_became_active":"2024-05-14T12:21:39.502690+0000","last_became_peered":"2024-05-14T12:21:39.502690+0000","last_unstale":"2024-05-14T12:21:41.801527+0000","last_undegraded":"2024-05-14T12:21:41.801527+0000","last_fullsized":"2024-05-14T12:21:41.801527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:55:22.829094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240989+0000","last_change":"2024-05-14T12:20:59.671773+0000","last_active":"2024-05-14T12:23:08.240989+0000","last_peered":"2024-05-14T12:23:08.240989+0000","last_clean":"2024-05-14T12:23:08.240989+0000","last_became_active":"2024-05-14T12:20:59.671380+0000","last_became_peered":"2024-05-14T12:20:59.671380+0000","last_unstale":"2024-05-14T12:23:08.240989+0000","last_undegraded":"2024-05-14T12:23:08.240989+0000","last_fullsized":"2024-05-14T12:23:08.240989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:23.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:03.964016+0000","last_change":"2024-05-14T12:20:55.965843+0000","last_active":"2024-05-14T12:23:03.964016+0000","last_peered":"2024-05-14T12:23:03.964016+0000","last_clean":"2024-05-14T12:23:03.964016+0000","last_became_active":"2024-05-14T12:20:55.963827+0000","last_became_peered":"2024-05-14T12:20:55.963827+0000","last_unstale":"2024-05-14T12:23:03.964016+0000","last_undegraded":"2024-05-14T12:23:03.964016+0000","last_fullsized":"2024-05-14T12:23:03.964016+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:22.464989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259445+0000","last_change":"2024-05-14T12:20:59.674932+0000","last_active":"2024-05-14T12:23:08.259445+0000","last_peered":"2024-05-14T12:23:08.259445+0000","last_clean":"2024-05-14T12:23:08.259445+0000","last_became_active":"2024-05-14T12:20:59.674259+0000","last_became_peered":"2024-05-14T12:20:59.674259+0000","last_unstale":"2024-05-14T12:23:08.259445+0000","last_undegraded":"2024-05-14T12:23:08.259445+0000","last_fullsized":"2024-05-14T12:23:08.259445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:45.362069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":270,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:12.907952+0000","last_change":"2024-05-14T12:20:55.610031+0000","last_active":"2024-05-14T12:25:12.907952+0000","last_peered":"2024-05-14T12:25:12.907952+0000","last_clean":"2024-05-14T12:25:12.907952+0000","last_became_active":"2024-05-14T12:20:55.609730+0000","last_became_peered":"2024-05-14T12:20:55.609730+0000","last_unstale":"2024-05-14T12:25:12.907952+0000","last_undegraded":"2024-05-14T12:25:12.907952+0000","last_fullsized":"2024-05-14T12:25:12.907952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:35.763466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241288+0000","last_change":"2024-05-14T12:20:59.673504+0000","last_active":"2024-05-14T12:23:08.241288+0000","last_peered":"2024-05-14T12:23:08.241288+0000","last_clean":"2024-05-14T12:23:08.241288+0000","last_became_active":"2024-05-14T12:20:59.673100+0000","last_became_peered":"2024-05-14T12:20:59.673100+0000","last_unstale":"2024-05-14T12:23:08.241288+0000","last_undegraded":"2024-05-14T12:23:08.241288+0000","last_fullsized":"2024-05-14T12:23:08.241288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:02.262916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.234816+0000","last_change":"2024-05-14T12:20:59.674694+0000","last_active":"2024-05-14T12:23:08.234816+0000","last_peered":"2024-05-14T12:23:08.234816+0000","last_clean":"2024-05-14T12:23:08.234816+0000","last_became_active":"2024-05-14T12:20:59.673566+0000","last_became_peered":"2024-05-14T12:20:59.673566+0000","last_unstale":"2024-05-14T12:23:08.234816+0000","last_undegraded":"2024-05-14T12:23:08.234816+0000","last_fullsized":"2024-05-14T12:23:08.234816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:49:28.596919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:11.906196+0000","last_change":"2024-05-14T12:20:55.963207+0000","last_active":"2024-05-14T12:25:11.906196+0000","last_peered":"2024-05-14T12:25:11.906196+0000","last_clean":"2024-05-14T12:25:11.906196+0000","last_became_active":"2024-05-14T12:20:55.962084+0000","last_became_peered":"2024-05-14T12:20:55.962084+0000","last_unstale":"2024-05-14T12:25:11.906196+0000","last_undegraded":"2024-05-14T12:25:11.906196+0000","last_fullsized":"2024-05-14T12:25:11.906196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:17.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254903+0000","last_change":"2024-05-14T12:20:59.682629+0000","last_active":"2024-05-14T12:23:08.254903+0000","last_peered":"2024-05-14T12:23:08.254903+0000","last_clean":"2024-05-14T12:23:08.254903+0000","last_became_active":"2024-05-14T12:20:59.672656+0000","last_became_peered":"2024-05-14T12:20:59.672656+0000","last_unstale":"2024-05-14T12:23:08.254903+0000","last_undegraded":"2024-05-14T12:23:08.254903+0000","last_fullsized":"2024-05-14T12:23:08.254903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:23:29.651740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:02.283374+0000","last_change":"2024-05-14T12:20:55.605223+0000","last_active":"2024-05-14T12:23:02.283374+0000","last_peered":"2024-05-14T12:23:02.283374+0000","last_clean":"2024-05-14T12:23:02.283374+0000","last_became_active":"2024-05-14T12:20:55.604743+0000","last_became_peered":"2024-05-14T12:20:55.604743+0000","last_unstale":"2024-05-14T12:23:02.283374+0000","last_undegraded":"2024-05-14T12:23:02.283374+0000","last_fullsized":"2024-05-14T12:23:02.283374+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:15.258776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:59.696764+0000","last_change":"2024-05-14T12:19:22.477995+0000","last_active":"2024-05-14T12:21:59.696764+0000","last_peered":"2024-05-14T12:21:59.696764+0000","last_clean":"2024-05-14T12:21:59.696764+0000","last_became_active":"2024-05-14T12:19:22.471890+0000","last_became_peered":"2024-05-14T12:19:22.471890+0000","last_unstale":"2024-05-14T12:21:59.696764+0000","last_undegraded":"2024-05-14T12:21:59.696764+0000","last_fullsized":"2024-05-14T12:21:59.696764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_clean_scrub_stamp":"2024-05-14T12:15:26.966159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:18.761547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.603310+0000","last_change":"2024-05-14T12:20:59.674341+0000","last_active":"2024-05-14T12:23:08.603310+0000","last_peered":"2024-05-14T12:23:08.603310+0000","last_clean":"2024-05-14T12:23:08.603310+0000","last_became_active":"2024-05-14T12:20:59.672199+0000","last_became_peered":"2024-05-14T12:20:59.672199+0000","last_unstale":"2024-05-14T12:23:08.603310+0000","last_undegraded":"2024-05-14T12:23:08.603310+0000","last_fullsized":"2024-05-14T12:23:08.603310+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.666708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:54.703757+0000","last_change":"2024-05-14T12:20:55.605513+0000","last_active":"2024-05-14T12:22:54.703757+0000","last_peered":"2024-05-14T12:22:54.703757+0000","last_clean":"2024-05-14T12:22:54.703757+0000","last_became_active":"2024-05-14T12:20:55.605131+0000","last_became_peered":"2024-05-14T12:20:55.605131+0000","last_unstale":"2024-05-14T12:22:54.703757+0000","last_undegraded":"2024-05-14T12:22:54.703757+0000","last_fullsized":"2024-05-14T12:22:54.703757+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:56.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:59.980943+0000","last_change":"2024-05-14T12:20:55.966357+0000","last_active":"2024-05-14T12:22:59.980943+0000","last_peered":"2024-05-14T12:22:59.980943+0000","last_clean":"2024-05-14T12:22:59.980943+0000","last_became_active":"2024-05-14T12:20:55.965946+0000","last_became_peered":"2024-05-14T12:20:55.965946+0000","last_unstale":"2024-05-14T12:22:59.980943+0000","last_undegraded":"2024-05-14T12:22:59.980943+0000","last_fullsized":"2024-05-14T12:22:59.980943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:20.843819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.603416+0000","last_change":"2024-05-14T12:20:59.675130+0000","last_active":"2024-05-14T12:23:08.603416+0000","last_peered":"2024-05-14T12:23:08.603416+0000","last_clean":"2024-05-14T12:23:08.603416+0000","last_became_active":"2024-05-14T12:20:59.674639+0000","last_became_peered":"2024-05-14T12:20:59.674639+0000","last_unstale":"2024-05-14T12:23:08.603416+0000","last_undegraded":"2024-05-14T12:23:08.603416+0000","last_fullsized":"2024-05-14T12:23:08.603416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:34:47.167894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'17","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.964764+0000","last_change":"2024-05-14T12:20:55.615975+0000","last_active":"2024-05-14T12:23:08.964764+0000","last_peered":"2024-05-14T12:23:08.964764+0000","last_clean":"2024-05-14T12:23:08.964764+0000","last_became_active":"2024-05-14T12:20:55.615542+0000","last_became_peered":"2024-05-14T12:20:55.615542+0000","last_unstale":"2024-05-14T12:23:08.964764+0000","last_undegraded":"2024-05-14T12:23:08.964764+0000","last_fullsized":"2024-05-14T12:23:08.964764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:52:46.621227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260341+0000","last_change":"2024-05-14T12:20:59.679047+0000","last_active":"2024-05-14T12:23:08.260341+0000","last_peered":"2024-05-14T12:23:08.260341+0000","last_clean":"2024-05-14T12:23:08.260341+0000","last_became_active":"2024-05-14T12:20:59.678620+0000","last_became_peered":"2024-05-14T12:20:59.678620+0000","last_unstale":"2024-05-14T12:23:08.260341+0000","last_undegraded":"2024-05-14T12:23:08.260341+0000","last_fullsized":"2024-05-14T12:23:08.260341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:30.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501411+0000","last_change":"2024-05-14T12:20:55.836121+0000","last_active":"2024-05-14T12:21:39.501411+0000","last_peered":"2024-05-14T12:21:39.501411+0000","last_clean":"2024-05-14T12:21:39.501411+0000","last_became_active":"2024-05-14T12:20:55.835758+0000","last_became_peered":"2024-05-14T12:20:55.835758+0000","last_unstale":"2024-05-14T12:21:39.501411+0000","last_undegraded":"2024-05-14T12:21:39.501411+0000","last_fullsized":"2024-05-14T12:21:39.501411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:29:12.627760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261142+0000","last_change":"2024-05-14T12:20:59.679664+0000","last_active":"2024-05-14T12:23:08.261142+0000","last_peered":"2024-05-14T12:23:08.261142+0000","last_clean":"2024-05-14T12:23:08.261142+0000","last_became_active":"2024-05-14T12:20:59.679242+0000","last_became_peered":"2024-05-14T12:20:59.679242+0000","last_unstale":"2024-05-14T12:23:08.261142+0000","last_undegraded":"2024-05-14T12:23:08.261142+0000","last_fullsized":"2024-05-14T12:23:08.261142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:38:17.910624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.721087+0000","last_change":"2024-05-14T12:20:55.965927+0000","last_active":"2024-05-14T12:21:39.721087+0000","last_peered":"2024-05-14T12:21:39.721087+0000","last_clean":"2024-05-14T12:21:39.721087+0000","last_became_active":"2024-05-14T12:20:55.965570+0000","last_became_peered":"2024-05-14T12:20:55.965570+0000","last_unstale":"2024-05-14T12:21:39.721087+0000","last_undegraded":"2024-05-14T12:21:39.721087+0000","last_fullsized":"2024-05-14T12:21:39.721087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:16:23.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.239485+0000","last_change":"2024-05-14T12:20:59.662521+0000","last_active":"2024-05-14T12:23:08.239485+0000","last_peered":"2024-05-14T12:23:08.239485+0000","last_clean":"2024-05-14T12:23:08.239485+0000","last_became_active":"2024-05-14T12:20:59.662140+0000","last_became_peered":"2024-05-14T12:20:59.662140+0000","last_unstale":"2024-05-14T12:23:08.239485+0000","last_undegraded":"2024-05-14T12:23:08.239485+0000","last_fullsized":"2024-05-14T12:23:08.239485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:44.471630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.702986+0000","last_change":"2024-05-14T12:20:55.614124+0000","last_active":"2024-05-14T12:21:39.702986+0000","last_peered":"2024-05-14T12:21:39.702986+0000","last_clean":"2024-05-14T12:21:39.702986+0000","last_became_active":"2024-05-14T12:20:55.610826+0000","last_became_peered":"2024-05-14T12:20:55.610826+0000","last_unstale":"2024-05-14T12:21:39.702986+0000","last_undegraded":"2024-05-14T12:21:39.702986+0000","last_fullsized":"2024-05-14T12:21:39.702986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:01:30.296978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241601+0000","last_change":"2024-05-14T12:20:59.684356+0000","last_active":"2024-05-14T12:23:08.241601+0000","last_peered":"2024-05-14T12:23:08.241601+0000","last_clean":"2024-05-14T12:23:08.241601+0000","last_became_active":"2024-05-14T12:20:59.683942+0000","last_became_peered":"2024-05-14T12:20:59.683942+0000","last_unstale":"2024-05-14T12:23:08.241601+0000","last_undegraded":"2024-05-14T12:23:08.241601+0000","last_fullsized":"2024-05-14T12:23:08.241601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:50.421104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:05.004787+0000","last_change":"2024-05-14T12:20:55.615921+0000","last_active":"2024-05-14T12:23:05.004787+0000","last_peered":"2024-05-14T12:23:05.004787+0000","last_clean":"2024-05-14T12:23:05.004787+0000","last_became_active":"2024-05-14T12:20:55.615448+0000","last_became_peered":"2024-05-14T12:20:55.615448+0000","last_unstale":"2024-05-14T12:23:05.004787+0000","last_undegraded":"2024-05-14T12:23:05.004787+0000","last_fullsized":"2024-05-14T12:23:05.004787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:41:00.260869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260052+0000","last_change":"2024-05-14T12:20:59.690629+0000","last_active":"2024-05-14T12:23:08.260052+0000","last_peered":"2024-05-14T12:23:08.260052+0000","last_clean":"2024-05-14T12:23:08.260052+0000","last_became_active":"2024-05-14T12:20:59.689696+0000","last_became_peered":"2024-05-14T12:20:59.689696+0000","last_unstale":"2024-05-14T12:23:08.260052+0000","last_undegraded":"2024-05-14T12:23:08.260052+0000","last_fullsized":"2024-05-14T12:23:08.260052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:27.678235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.531447+0000","last_change":"2024-05-14T12:21:39.530824+0000","last_active":"2024-05-14T12:21:39.531447+0000","last_peered":"2024-05-14T12:21:39.531447+0000","last_clean":"2024-05-14T12:21:39.531447+0000","last_became_active":"2024-05-14T12:21:39.507316+0000","last_became_peered":"2024-05-14T12:21:39.507316+0000","last_unstale":"2024-05-14T12:21:39.531447+0000","last_undegraded":"2024-05-14T12:21:39.531447+0000","last_fullsized":"2024-05-14T12:21:39.531447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:06:46.506545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257038+0000","last_change":"2024-05-14T12:20:59.679078+0000","last_active":"2024-05-14T12:23:08.257038+0000","last_peered":"2024-05-14T12:23:08.257038+0000","last_clean":"2024-05-14T12:23:08.257038+0000","last_became_active":"2024-05-14T12:20:59.678713+0000","last_became_peered":"2024-05-14T12:20:59.678713+0000","last_unstale":"2024-05-14T12:23:08.257038+0000","last_undegraded":"2024-05-14T12:23:08.257038+0000","last_fullsized":"2024-05-14T12:23:08.257038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:46:44.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":271,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:13.824745+0000","last_change":"2024-05-14T12:20:55.965829+0000","last_active":"2024-05-14T12:25:13.824745+0000","last_peered":"2024-05-14T12:25:13.824745+0000","last_clean":"2024-05-14T12:25:13.824745+0000","last_became_active":"2024-05-14T12:20:55.965316+0000","last_became_peered":"2024-05-14T12:20:55.965316+0000","last_unstale":"2024-05-14T12:25:13.824745+0000","last_undegraded":"2024-05-14T12:25:13.824745+0000","last_fullsized":"2024-05-14T12:25:13.824745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:46:36.879599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245162+0000","last_change":"2024-05-14T12:20:59.673582+0000","last_active":"2024-05-14T12:23:08.245162+0000","last_peered":"2024-05-14T12:23:08.245162+0000","last_clean":"2024-05-14T12:23:08.245162+0000","last_became_active":"2024-05-14T12:20:59.672475+0000","last_became_peered":"2024-05-14T12:20:59.672475+0000","last_unstale":"2024-05-14T12:23:08.245162+0000","last_undegraded":"2024-05-14T12:23:08.245162+0000","last_fullsized":"2024-05-14T12:23:08.245162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:06:04.861177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496398+0000","last_change":"2024-05-14T12:20:55.615870+0000","last_active":"2024-05-14T12:21:39.496398+0000","last_peered":"2024-05-14T12:21:39.496398+0000","last_clean":"2024-05-14T12:21:39.496398+0000","last_became_active":"2024-05-14T12:20:55.615444+0000","last_became_peered":"2024-05-14T12:20:55.615444+0000","last_unstale":"2024-05-14T12:21:39.496398+0000","last_undegraded":"2024-05-14T12:21:39.496398+0000","last_fullsized":"2024-05-14T12:21:39.496398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:03.081164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259667+0000","last_change":"2024-05-14T12:20:59.688252+0000","last_active":"2024-05-14T12:23:08.259667+0000","last_peered":"2024-05-14T12:23:08.259667+0000","last_clean":"2024-05-14T12:23:08.259667+0000","last_became_active":"2024-05-14T12:20:59.687861+0000","last_became_peered":"2024-05-14T12:20:59.687861+0000","last_unstale":"2024-05-14T12:23:08.259667+0000","last_undegraded":"2024-05-14T12:23:08.259667+0000","last_fullsized":"2024-05-14T12:23:08.259667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:29:00.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500452+0000","last_change":"2024-05-14T12:20:55.616119+0000","last_active":"2024-05-14T12:21:39.500452+0000","last_peered":"2024-05-14T12:21:39.500452+0000","last_clean":"2024-05-14T12:21:39.500452+0000","last_became_active":"2024-05-14T12:20:55.615700+0000","last_became_peered":"2024-05-14T12:20:55.615700+0000","last_unstale":"2024-05-14T12:21:39.500452+0000","last_undegraded":"2024-05-14T12:21:39.500452+0000","last_fullsized":"2024-05-14T12:21:39.500452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:39.342610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245535+0000","last_change":"2024-05-14T12:20:59.672495+0000","last_active":"2024-05-14T12:23:08.245535+0000","last_peered":"2024-05-14T12:23:08.245535+0000","last_clean":"2024-05-14T12:23:08.245535+0000","last_became_active":"2024-05-14T12:20:59.671983+0000","last_became_peered":"2024-05-14T12:20:59.671983+0000","last_unstale":"2024-05-14T12:23:08.245535+0000","last_undegraded":"2024-05-14T12:23:08.245535+0000","last_fullsized":"2024-05-14T12:23:08.245535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:41.336895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240059+0000","last_change":"2024-05-14T12:20:59.663818+0000","last_active":"2024-05-14T12:23:08.240059+0000","last_peered":"2024-05-14T12:23:08.240059+0000","last_clean":"2024-05-14T12:23:08.240059+0000","last_became_active":"2024-05-14T12:20:59.663431+0000","last_became_peered":"2024-05-14T12:20:59.663431+0000","last_unstale":"2024-05-14T12:23:08.240059+0000","last_undegraded":"2024-05-14T12:23:08.240059+0000","last_fullsized":"2024-05-14T12:23:08.240059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:40:10.435481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245374+0000","last_change":"2024-05-14T12:20:59.668412+0000","last_active":"2024-05-14T12:23:08.245374+0000","last_peered":"2024-05-14T12:23:08.245374+0000","last_clean":"2024-05-14T12:23:08.245374+0000","last_became_active":"2024-05-14T12:20:59.667963+0000","last_became_peered":"2024-05-14T12:20:59.667963+0000","last_unstale":"2024-05-14T12:23:08.245374+0000","last_undegraded":"2024-05-14T12:23:08.245374+0000","last_fullsized":"2024-05-14T12:23:08.245374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:50:19.463843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243183+0000","last_change":"2024-05-14T12:20:59.668796+0000","last_active":"2024-05-14T12:23:08.243183+0000","last_peered":"2024-05-14T12:23:08.243183+0000","last_clean":"2024-05-14T12:23:08.243183+0000","last_became_active":"2024-05-14T12:20:59.668414+0000","last_became_peered":"2024-05-14T12:20:59.668414+0000","last_unstale":"2024-05-14T12:23:08.243183+0000","last_undegraded":"2024-05-14T12:23:08.243183+0000","last_fullsized":"2024-05-14T12:23:08.243183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:28.669547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257674+0000","last_change":"2024-05-14T12:20:59.687417+0000","last_active":"2024-05-14T12:23:08.257674+0000","last_peered":"2024-05-14T12:23:08.257674+0000","last_clean":"2024-05-14T12:23:08.257674+0000","last_became_active":"2024-05-14T12:20:59.686373+0000","last_became_peered":"2024-05-14T12:20:59.686373+0000","last_unstale":"2024-05-14T12:23:08.257674+0000","last_undegraded":"2024-05-14T12:23:08.257674+0000","last_fullsized":"2024-05-14T12:23:08.257674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:55.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255534+0000","last_change":"2024-05-14T12:21:40.359831+0000","last_active":"2024-05-14T12:23:08.255534+0000","last_peered":"2024-05-14T12:23:08.255534+0000","last_clean":"2024-05-14T12:23:08.255534+0000","last_became_active":"2024-05-14T12:21:40.358347+0000","last_became_peered":"2024-05-14T12:21:40.358347+0000","last_unstale":"2024-05-14T12:23:08.255534+0000","last_undegraded":"2024-05-14T12:23:08.255534+0000","last_fullsized":"2024-05-14T12:23:08.255534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:03:58.165602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238787+0000","last_change":"2024-05-14T12:20:59.663332+0000","last_active":"2024-05-14T12:23:08.238787+0000","last_peered":"2024-05-14T12:23:08.238787+0000","last_clean":"2024-05-14T12:23:08.238787+0000","last_became_active":"2024-05-14T12:20:59.662714+0000","last_became_peered":"2024-05-14T12:20:59.662714+0000","last_unstale":"2024-05-14T12:23:08.238787+0000","last_undegraded":"2024-05-14T12:23:08.238787+0000","last_fullsized":"2024-05-14T12:23:08.238787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:59.140579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.234610+0000","last_change":"2024-05-14T12:20:59.665482+0000","last_active":"2024-05-14T12:23:08.234610+0000","last_peered":"2024-05-14T12:23:08.234610+0000","last_clean":"2024-05-14T12:23:08.234610+0000","last_became_active":"2024-05-14T12:20:59.665001+0000","last_became_peered":"2024-05-14T12:20:59.665001+0000","last_unstale":"2024-05-14T12:23:08.234610+0000","last_undegraded":"2024-05-14T12:23:08.234610+0000","last_fullsized":"2024-05-14T12:23:08.234610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:26.074054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246632+0000","last_change":"2024-05-14T12:20:59.679317+0000","last_active":"2024-05-14T12:23:08.246632+0000","last_peered":"2024-05-14T12:23:08.246632+0000","last_clean":"2024-05-14T12:23:08.246632+0000","last_became_active":"2024-05-14T12:20:59.675797+0000","last_became_peered":"2024-05-14T12:20:59.675797+0000","last_unstale":"2024-05-14T12:23:08.246632+0000","last_undegraded":"2024-05-14T12:23:08.246632+0000","last_fullsized":"2024-05-14T12:23:08.246632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:58.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250723+0000","last_change":"2024-05-14T12:20:59.669982+0000","last_active":"2024-05-14T12:23:08.250723+0000","last_peered":"2024-05-14T12:23:08.250723+0000","last_clean":"2024-05-14T12:23:08.250723+0000","last_became_active":"2024-05-14T12:20:59.669587+0000","last_became_peered":"2024-05-14T12:20:59.669587+0000","last_unstale":"2024-05-14T12:23:08.250723+0000","last_undegraded":"2024-05-14T12:23:08.250723+0000","last_fullsized":"2024-05-14T12:23:08.250723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:31.474906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260491+0000","last_change":"2024-05-14T12:20:59.672672+0000","last_active":"2024-05-14T12:23:08.260491+0000","last_peered":"2024-05-14T12:23:08.260491+0000","last_clean":"2024-05-14T12:23:08.260491+0000","last_became_active":"2024-05-14T12:20:59.672191+0000","last_became_peered":"2024-05-14T12:20:59.672191+0000","last_unstale":"2024-05-14T12:23:08.260491+0000","last_undegraded":"2024-05-14T12:23:08.260491+0000","last_fullsized":"2024-05-14T12:23:08.260491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:53:14.530296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260678+0000","last_change":"2024-05-14T12:20:59.684548+0000","last_active":"2024-05-14T12:23:08.260678+0000","last_peered":"2024-05-14T12:23:08.260678+0000","last_clean":"2024-05-14T12:23:08.260678+0000","last_became_active":"2024-05-14T12:20:59.684069+0000","last_became_peered":"2024-05-14T12:20:59.684069+0000","last_unstale":"2024-05-14T12:23:08.260678+0000","last_undegraded":"2024-05-14T12:23:08.260678+0000","last_fullsized":"2024-05-14T12:23:08.260678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:58.759384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.264740+0000","last_change":"2024-05-14T12:20:59.682386+0000","last_active":"2024-05-14T12:23:08.264740+0000","last_peered":"2024-05-14T12:23:08.264740+0000","last_clean":"2024-05-14T12:23:08.264740+0000","last_became_active":"2024-05-14T12:20:59.682037+0000","last_became_peered":"2024-05-14T12:20:59.682037+0000","last_unstale":"2024-05-14T12:23:08.264740+0000","last_undegraded":"2024-05-14T12:23:08.264740+0000","last_fullsized":"2024-05-14T12:23:08.264740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:24.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241032+0000","last_change":"2024-05-14T12:20:59.672679+0000","last_active":"2024-05-14T12:23:08.241032+0000","last_peered":"2024-05-14T12:23:08.241032+0000","last_clean":"2024-05-14T12:23:08.241032+0000","last_became_active":"2024-05-14T12:20:59.672324+0000","last_became_peered":"2024-05-14T12:20:59.672324+0000","last_unstale":"2024-05-14T12:23:08.241032+0000","last_undegraded":"2024-05-14T12:23:08.241032+0000","last_fullsized":"2024-05-14T12:23:08.241032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:45.513792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78452,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2347,"num_read_kb":1269,"num_write":264,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":644,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":229983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776201,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1638400,"data_stored":1106515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939727,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":444450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135958,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":444806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1544192,"data_stored":1037797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561122,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":510895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":516488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149809,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953580,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757352,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1548288,"data_stored":1036011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":72702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T12:25:18.647 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-14T12:25:18.648 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T12:25:18.771 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:18 smithi047 ceph-mon[31254]: from='client.25121 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:18.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:18 smithi066 ceph-mon[35981]: from='client.25121 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:19.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:18 smithi073 ceph-mon[35809]: from='client.25121 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:19.634 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:19 smithi047 ceph-mon[31254]: pgmap v454: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-14T12:25:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:19 smithi066 ceph-mon[35981]: pgmap v454: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-14T12:25:20.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:19 smithi073 ceph-mon[35809]: pgmap v454: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-14T12:25:21.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 -- 172.21.15.47:0/1683149873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 msgr2=0x7fe32c110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 --2- 172.21.15.47:0/1683149873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 0x7fe32c110be0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe32400b0a0 tx=0x7fe32400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 -- 172.21.15.47:0/1683149873 shutdown_connections 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 --2- 172.21.15.47:0/1683149873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 0x7fe32c110be0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 --2- 172.21.15.47:0/1683149873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 0x7fe32c1056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 --2- 172.21.15.47:0/1683149873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe32c105be0 0x7fe32c10e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 -- 172.21.15.47:0/1683149873 >> 172.21.15.47:0/1683149873 conn(0x7fe32c078ac0 msgr2=0x7fe32c078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 -- 172.21.15.47:0/1683149873 shutdown_connections 2024-05-14T12:25:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.660+0000 7fe330a00700 1 -- 172.21.15.47:0/1683149873 wait complete. 2024-05-14T12:25:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.662+0000 7fe330a00700 1 Processor -- start 2024-05-14T12:25:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.662+0000 7fe330a00700 1 -- start start 2024-05-14T12:25:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe330a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 0x7fe32c102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe330a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe32c105be0 0x7fe32c1034c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe330a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 0x7fe32c103a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe330a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c1142b0 con 0x7fe32c105be0 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe330a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c114130 con 0x7fe32c10e700 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe330a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c114430 con 0x7fe32c105290 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe32a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 0x7fe32c102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe32a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 0x7fe32c102f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59742/0 (socket says 172.21.15.47:59742) 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe32a800700 1 -- 172.21.15.47:0/3916748811 learned_addr learned my addr 172.21.15.47:0/3916748811 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe32b200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 0x7fe32c103a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:21.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.663+0000 7fe329e00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe32c105be0 0x7fe32c1034c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe32a800700 1 -- 172.21.15.47:0/3916748811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 msgr2=0x7fe32c103a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe32a800700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 0x7fe32c103a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe32a800700 1 -- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe32c105be0 msgr2=0x7fe32c1034c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe32a800700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe32c105be0 0x7fe32c1034c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe32a800700 1 -- 172.21.15.47:0/3916748811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c1a8f80 con 0x7fe32c105290 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe32b200700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 0x7fe32c103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe32a800700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 0x7fe32c102f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e9a0 tx=0x7fe31c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe323400700 1 -- 172.21.15.47:0/3916748811 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00ca10 con 0x7fe32c105290 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe323400700 1 -- 172.21.15.47:0/3916748811 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe31c00cbb0 con 0x7fe32c105290 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.664+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c1a9270 con 0x7fe32c105290 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.665+0000 7fe323400700 1 -- 172.21.15.47:0/3916748811 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c018680 con 0x7fe32c105290 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.665+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c1a97b0 con 0x7fe32c105290 2024-05-14T12:25:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.666+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32c0512c0 con 0x7fe32c105290 2024-05-14T12:25:21.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.669+0000 7fe323400700 1 -- 172.21.15.47:0/3916748811 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe31c010430 con 0x7fe32c105290 2024-05-14T12:25:21.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.670+0000 7fe323400700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe3100b2880 0x7fe3100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:21.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.671+0000 7fe323400700 1 -- 172.21.15.47:0/3916748811 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe31c0e2700 con 0x7fe32c105290 2024-05-14T12:25:21.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.671+0000 7fe329e00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe3100b2880 0x7fe3100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:21.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.672+0000 7fe323400700 1 -- 172.21.15.47:0/3916748811 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe31c0aa3e0 con 0x7fe32c105290 2024-05-14T12:25:21.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.672+0000 7fe329e00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe3100b2880 0x7fe3100b4d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe32c102660 tx=0x7fe314009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:21.803 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:21 smithi073 ceph-mon[35809]: pgmap v455: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T12:25:21.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:21 smithi066 ceph-mon[35981]: pgmap v455: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T12:25:21.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.923+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 --> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe32c063c00 con 0x7fe3100b2880 2024-05-14T12:25:21.923 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:21 smithi047 ceph-mon[31254]: pgmap v455: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T12:25:21.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.936+0000 7fe323400700 1 -- 172.21.15.47:0/3916748811 <== mgr.14152 v2:172.21.15.47:6800/1176244093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258891 (secure 0 0 0) 0x7fe32c063c00 con 0x7fe3100b2880 2024-05-14T12:25:21.940 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:25:21.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe3100b2880 msgr2=0x7fe3100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe3100b2880 0x7fe3100b4d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe32c102660 tx=0x7fe314009260 comp rx=0 tx=0).stop 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 msgr2=0x7fe32c102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 0x7fe32c102f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e9a0 tx=0x7fe31c00ecb0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 shutdown_connections 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe3100b2880 0x7fe3100b4d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe32c10e700 0x7fe32c103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe32c105290 0x7fe32c102f80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 --2- 172.21.15.47:0/3916748811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe32c105be0 0x7fe32c1034c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 >> 172.21.15.47:0/3916748811 conn(0x7fe32c078ac0 msgr2=0x7fe32c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:21.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 shutdown_connections 2024-05-14T12:25:21.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:21.942+0000 7fe330a00700 1 -- 172.21.15.47:0/3916748811 wait complete. 2024-05-14T12:25:21.943 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-14T12:25:22.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:22 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:25:22.802 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2024-05-14T12:25:20.370685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":669054,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2453,"num_read_kb":1343,"num_write":389,"num_write_kb":2312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2952484,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374688,"kb_used_data":13056,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567136,"statfs":{"total":1151940427776,"available":1151556747264,"internally_reserved":0,"allocated":13369344,"data_stored":7327098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":68,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005812"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.249926+0000","last_change":"2024-05-14T12:20:59.669913+0000","last_active":"2024-05-14T12:23:08.249926+0000","last_peered":"2024-05-14T12:23:08.249926+0000","last_clean":"2024-05-14T12:23:08.249926+0000","last_became_active":"2024-05-14T12:20:59.668481+0000","last_became_peered":"2024-05-14T12:20:59.668481+0000","last_unstale":"2024-05-14T12:23:08.249926+0000","last_undegraded":"2024-05-14T12:23:08.249926+0000","last_fullsized":"2024-05-14T12:23:08.249926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:13.671516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247467+0000","last_change":"2024-05-14T12:20:59.665032+0000","last_active":"2024-05-14T12:23:08.247467+0000","last_peered":"2024-05-14T12:23:08.247467+0000","last_clean":"2024-05-14T12:23:08.247467+0000","last_became_active":"2024-05-14T12:20:59.664471+0000","last_became_peered":"2024-05-14T12:20:59.664471+0000","last_unstale":"2024-05-14T12:23:08.247467+0000","last_undegraded":"2024-05-14T12:23:08.247467+0000","last_fullsized":"2024-05-14T12:23:08.247467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:58:02.354064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255407+0000","last_change":"2024-05-14T12:20:59.679975+0000","last_active":"2024-05-14T12:23:08.255407+0000","last_peered":"2024-05-14T12:23:08.255407+0000","last_clean":"2024-05-14T12:23:08.255407+0000","last_became_active":"2024-05-14T12:20:59.679586+0000","last_became_peered":"2024-05-14T12:20:59.679586+0000","last_unstale":"2024-05-14T12:23:08.255407+0000","last_undegraded":"2024-05-14T12:23:08.255407+0000","last_fullsized":"2024-05-14T12:23:08.255407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:45:37.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241224+0000","last_change":"2024-05-14T12:20:59.668125+0000","last_active":"2024-05-14T12:23:08.241224+0000","last_peered":"2024-05-14T12:23:08.241224+0000","last_clean":"2024-05-14T12:23:08.241224+0000","last_became_active":"2024-05-14T12:20:59.667664+0000","last_became_peered":"2024-05-14T12:20:59.667664+0000","last_unstale":"2024-05-14T12:23:08.241224+0000","last_undegraded":"2024-05-14T12:23:08.241224+0000","last_fullsized":"2024-05-14T12:23:08.241224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:29.995159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256345+0000","last_change":"2024-05-14T12:20:59.682787+0000","last_active":"2024-05-14T12:23:08.256345+0000","last_peered":"2024-05-14T12:23:08.256345+0000","last_clean":"2024-05-14T12:23:08.256345+0000","last_became_active":"2024-05-14T12:20:59.682462+0000","last_became_peered":"2024-05-14T12:20:59.682462+0000","last_unstale":"2024-05-14T12:23:08.256345+0000","last_undegraded":"2024-05-14T12:23:08.256345+0000","last_fullsized":"2024-05-14T12:23:08.256345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:27.287750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.242052+0000","last_change":"2024-05-14T12:21:39.506661+0000","last_active":"2024-05-14T12:23:08.242052+0000","last_peered":"2024-05-14T12:23:08.242052+0000","last_clean":"2024-05-14T12:23:08.242052+0000","last_became_active":"2024-05-14T12:21:39.506116+0000","last_became_peered":"2024-05-14T12:21:39.506116+0000","last_unstale":"2024-05-14T12:23:08.242052+0000","last_undegraded":"2024-05-14T12:23:08.242052+0000","last_fullsized":"2024-05-14T12:23:08.242052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:28:18.551207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244412+0000","last_change":"2024-05-14T12:20:59.671683+0000","last_active":"2024-05-14T12:23:08.244412+0000","last_peered":"2024-05-14T12:23:08.244412+0000","last_clean":"2024-05-14T12:23:08.244412+0000","last_became_active":"2024-05-14T12:20:59.671307+0000","last_became_peered":"2024-05-14T12:20:59.671307+0000","last_unstale":"2024-05-14T12:23:08.244412+0000","last_undegraded":"2024-05-14T12:23:08.244412+0000","last_fullsized":"2024-05-14T12:23:08.244412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.744159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253965+0000","last_change":"2024-05-14T12:21:39.504953+0000","last_active":"2024-05-14T12:23:08.253965+0000","last_peered":"2024-05-14T12:23:08.253965+0000","last_clean":"2024-05-14T12:23:08.253965+0000","last_became_active":"2024-05-14T12:21:39.504267+0000","last_became_peered":"2024-05-14T12:21:39.504267+0000","last_unstale":"2024-05-14T12:23:08.253965+0000","last_undegraded":"2024-05-14T12:23:08.253965+0000","last_fullsized":"2024-05-14T12:23:08.253965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:04.329324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247427+0000","last_change":"2024-05-14T12:20:59.663319+0000","last_active":"2024-05-14T12:23:08.247427+0000","last_peered":"2024-05-14T12:23:08.247427+0000","last_clean":"2024-05-14T12:23:08.247427+0000","last_became_active":"2024-05-14T12:20:59.662618+0000","last_became_peered":"2024-05-14T12:20:59.662618+0000","last_unstale":"2024-05-14T12:23:08.247427+0000","last_undegraded":"2024-05-14T12:23:08.247427+0000","last_fullsized":"2024-05-14T12:23:08.247427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:11:18.032899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244456+0000","last_change":"2024-05-14T12:20:59.671006+0000","last_active":"2024-05-14T12:23:08.244456+0000","last_peered":"2024-05-14T12:23:08.244456+0000","last_clean":"2024-05-14T12:23:08.244456+0000","last_became_active":"2024-05-14T12:20:59.670632+0000","last_became_peered":"2024-05-14T12:20:59.670632+0000","last_unstale":"2024-05-14T12:23:08.244456+0000","last_undegraded":"2024-05-14T12:23:08.244456+0000","last_fullsized":"2024-05-14T12:23:08.244456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:12:30.144637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245298+0000","last_change":"2024-05-14T12:20:59.675968+0000","last_active":"2024-05-14T12:23:08.245298+0000","last_peered":"2024-05-14T12:23:08.245298+0000","last_clean":"2024-05-14T12:23:08.245298+0000","last_became_active":"2024-05-14T12:20:59.675551+0000","last_became_peered":"2024-05-14T12:20:59.675551+0000","last_unstale":"2024-05-14T12:23:08.245298+0000","last_undegraded":"2024-05-14T12:23:08.245298+0000","last_fullsized":"2024-05-14T12:23:08.245298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:39.562658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241448+0000","last_change":"2024-05-14T12:20:59.671011+0000","last_active":"2024-05-14T12:23:08.241448+0000","last_peered":"2024-05-14T12:23:08.241448+0000","last_clean":"2024-05-14T12:23:08.241448+0000","last_became_active":"2024-05-14T12:20:59.670637+0000","last_became_peered":"2024-05-14T12:20:59.670637+0000","last_unstale":"2024-05-14T12:23:08.241448+0000","last_undegraded":"2024-05-14T12:23:08.241448+0000","last_fullsized":"2024-05-14T12:23:08.241448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:53.808936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.265171+0000","last_change":"2024-05-14T12:20:59.680039+0000","last_active":"2024-05-14T12:23:08.265171+0000","last_peered":"2024-05-14T12:23:08.265171+0000","last_clean":"2024-05-14T12:23:08.265171+0000","last_became_active":"2024-05-14T12:20:59.678120+0000","last_became_peered":"2024-05-14T12:20:59.678120+0000","last_unstale":"2024-05-14T12:23:08.265171+0000","last_undegraded":"2024-05-14T12:23:08.265171+0000","last_fullsized":"2024-05-14T12:23:08.265171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:19:28.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238936+0000","last_change":"2024-05-14T12:20:59.675301+0000","last_active":"2024-05-14T12:23:08.238936+0000","last_peered":"2024-05-14T12:23:08.238936+0000","last_clean":"2024-05-14T12:23:08.238936+0000","last_became_active":"2024-05-14T12:20:59.669861+0000","last_became_peered":"2024-05-14T12:20:59.669861+0000","last_unstale":"2024-05-14T12:23:08.238936+0000","last_undegraded":"2024-05-14T12:23:08.238936+0000","last_fullsized":"2024-05-14T12:23:08.238936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:19:17.931719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246879+0000","last_change":"2024-05-14T12:20:59.682378+0000","last_active":"2024-05-14T12:23:08.246879+0000","last_peered":"2024-05-14T12:23:08.246879+0000","last_clean":"2024-05-14T12:23:08.246879+0000","last_became_active":"2024-05-14T12:20:59.680598+0000","last_became_peered":"2024-05-14T12:20:59.680598+0000","last_unstale":"2024-05-14T12:23:08.246879+0000","last_undegraded":"2024-05-14T12:23:08.246879+0000","last_fullsized":"2024-05-14T12:23:08.246879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:22.189038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254566+0000","last_change":"2024-05-14T12:20:59.685447+0000","last_active":"2024-05-14T12:23:08.254566+0000","last_peered":"2024-05-14T12:23:08.254566+0000","last_clean":"2024-05-14T12:23:08.254566+0000","last_became_active":"2024-05-14T12:20:59.684963+0000","last_became_peered":"2024-05-14T12:20:59.684963+0000","last_unstale":"2024-05-14T12:23:08.254566+0000","last_undegraded":"2024-05-14T12:23:08.254566+0000","last_fullsized":"2024-05-14T12:23:08.254566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:47.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250053+0000","last_change":"2024-05-14T12:20:59.681870+0000","last_active":"2024-05-14T12:23:08.250053+0000","last_peered":"2024-05-14T12:23:08.250053+0000","last_clean":"2024-05-14T12:23:08.250053+0000","last_became_active":"2024-05-14T12:20:59.681405+0000","last_became_peered":"2024-05-14T12:20:59.681405+0000","last_unstale":"2024-05-14T12:23:08.250053+0000","last_undegraded":"2024-05-14T12:23:08.250053+0000","last_fullsized":"2024-05-14T12:23:08.250053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:20.002496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253917+0000","last_change":"2024-05-14T12:20:59.667486+0000","last_active":"2024-05-14T12:23:08.253917+0000","last_peered":"2024-05-14T12:23:08.253917+0000","last_clean":"2024-05-14T12:23:08.253917+0000","last_became_active":"2024-05-14T12:20:59.667032+0000","last_became_peered":"2024-05-14T12:20:59.667032+0000","last_unstale":"2024-05-14T12:23:08.253917+0000","last_undegraded":"2024-05-14T12:23:08.253917+0000","last_fullsized":"2024-05-14T12:23:08.253917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:25.325504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.253867+0000","last_change":"2024-05-14T12:20:59.672065+0000","last_active":"2024-05-14T12:23:08.253867+0000","last_peered":"2024-05-14T12:23:08.253867+0000","last_clean":"2024-05-14T12:23:08.253867+0000","last_became_active":"2024-05-14T12:20:59.671692+0000","last_became_peered":"2024-05-14T12:20:59.671692+0000","last_unstale":"2024-05-14T12:23:08.253867+0000","last_undegraded":"2024-05-14T12:23:08.253867+0000","last_fullsized":"2024-05-14T12:23:08.253867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:11:47.952421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":280,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:17.917370+0000","last_change":"2024-05-14T12:20:55.611507+0000","last_active":"2024-05-14T12:25:17.917370+0000","last_peered":"2024-05-14T12:25:17.917370+0000","last_clean":"2024-05-14T12:25:17.917370+0000","last_became_active":"2024-05-14T12:20:55.606794+0000","last_became_peered":"2024-05-14T12:20:55.606794+0000","last_unstale":"2024-05-14T12:25:17.917370+0000","last_undegraded":"2024-05-14T12:25:17.917370+0000","last_fullsized":"2024-05-14T12:25:17.917370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:51.301124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.247216+0000","last_change":"2024-05-14T12:20:59.673013+0000","last_active":"2024-05-14T12:23:08.247216+0000","last_peered":"2024-05-14T12:23:08.247216+0000","last_clean":"2024-05-14T12:23:08.247216+0000","last_became_active":"2024-05-14T12:20:59.672575+0000","last_became_peered":"2024-05-14T12:20:59.672575+0000","last_unstale":"2024-05-14T12:23:08.247216+0000","last_undegraded":"2024-05-14T12:23:08.247216+0000","last_fullsized":"2024-05-14T12:23:08.247216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:00:26.549099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:56.369914+0000","last_change":"2024-05-14T12:20:55.963853+0000","last_active":"2024-05-14T12:22:56.369914+0000","last_peered":"2024-05-14T12:22:56.369914+0000","last_clean":"2024-05-14T12:22:56.369914+0000","last_became_active":"2024-05-14T12:20:55.962018+0000","last_became_peered":"2024-05-14T12:20:55.962018+0000","last_unstale":"2024-05-14T12:22:56.369914+0000","last_undegraded":"2024-05-14T12:22:56.369914+0000","last_fullsized":"2024-05-14T12:22:56.369914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:06:22.374595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254121+0000","last_change":"2024-05-14T12:20:59.671243+0000","last_active":"2024-05-14T12:23:08.254121+0000","last_peered":"2024-05-14T12:23:08.254121+0000","last_clean":"2024-05-14T12:23:08.254121+0000","last_became_active":"2024-05-14T12:20:59.665885+0000","last_became_peered":"2024-05-14T12:20:59.665885+0000","last_unstale":"2024-05-14T12:23:08.254121+0000","last_undegraded":"2024-05-14T12:23:08.254121+0000","last_fullsized":"2024-05-14T12:23:08.254121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:10:48.656774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.527444+0000","last_change":"2024-05-14T12:21:39.526944+0000","last_active":"2024-05-14T12:21:39.527444+0000","last_peered":"2024-05-14T12:21:39.527444+0000","last_clean":"2024-05-14T12:21:39.527444+0000","last_became_active":"2024-05-14T12:21:39.506478+0000","last_became_peered":"2024-05-14T12:21:39.506478+0000","last_unstale":"2024-05-14T12:21:39.527444+0000","last_undegraded":"2024-05-14T12:21:39.527444+0000","last_fullsized":"2024-05-14T12:21:39.527444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:41.812733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.256880+0000","last_change":"2024-05-14T12:20:59.671282+0000","last_active":"2024-05-14T12:23:08.256880+0000","last_peered":"2024-05-14T12:23:08.256880+0000","last_clean":"2024-05-14T12:23:08.256880+0000","last_became_active":"2024-05-14T12:20:59.670645+0000","last_became_peered":"2024-05-14T12:20:59.670645+0000","last_unstale":"2024-05-14T12:23:08.256880+0000","last_undegraded":"2024-05-14T12:23:08.256880+0000","last_fullsized":"2024-05-14T12:23:08.256880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:51:57.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501912+0000","last_change":"2024-05-14T12:20:55.604757+0000","last_active":"2024-05-14T12:21:39.501912+0000","last_peered":"2024-05-14T12:21:39.501912+0000","last_clean":"2024-05-14T12:21:39.501912+0000","last_became_active":"2024-05-14T12:20:55.604281+0000","last_became_peered":"2024-05-14T12:20:55.604281+0000","last_unstale":"2024-05-14T12:21:39.501912+0000","last_undegraded":"2024-05-14T12:21:39.501912+0000","last_fullsized":"2024-05-14T12:21:39.501912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:52.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245684+0000","last_change":"2024-05-14T12:20:59.672498+0000","last_active":"2024-05-14T12:23:08.245684+0000","last_peered":"2024-05-14T12:23:08.245684+0000","last_clean":"2024-05-14T12:23:08.245684+0000","last_became_active":"2024-05-14T12:20:59.672116+0000","last_became_peered":"2024-05-14T12:20:59.672116+0000","last_unstale":"2024-05-14T12:23:08.245684+0000","last_undegraded":"2024-05-14T12:23:08.245684+0000","last_fullsized":"2024-05-14T12:23:08.245684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:47:34.614427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":235,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:14.977146+0000","last_change":"2024-05-14T12:21:39.515431+0000","last_active":"2024-05-14T12:25:14.977146+0000","last_peered":"2024-05-14T12:25:14.977146+0000","last_clean":"2024-05-14T12:25:14.977146+0000","last_became_active":"2024-05-14T12:21:39.503217+0000","last_became_peered":"2024-05-14T12:21:39.503217+0000","last_unstale":"2024-05-14T12:25:14.977146+0000","last_undegraded":"2024-05-14T12:25:14.977146+0000","last_fullsized":"2024-05-14T12:25:14.977146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:52:21.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255983+0000","last_change":"2024-05-14T12:20:59.664725+0000","last_active":"2024-05-14T12:23:08.255983+0000","last_peered":"2024-05-14T12:23:08.255983+0000","last_clean":"2024-05-14T12:23:08.255983+0000","last_became_active":"2024-05-14T12:20:59.664323+0000","last_became_peered":"2024-05-14T12:20:59.664323+0000","last_unstale":"2024-05-14T12:23:08.255983+0000","last_undegraded":"2024-05-14T12:23:08.255983+0000","last_fullsized":"2024-05-14T12:23:08.255983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.729787+0000","last_change":"2024-05-14T12:21:39.729236+0000","last_active":"2024-05-14T12:21:39.729787+0000","last_peered":"2024-05-14T12:21:39.729787+0000","last_clean":"2024-05-14T12:21:39.729787+0000","last_became_active":"2024-05-14T12:21:39.722405+0000","last_became_peered":"2024-05-14T12:21:39.722405+0000","last_unstale":"2024-05-14T12:21:39.729787+0000","last_undegraded":"2024-05-14T12:21:39.729787+0000","last_fullsized":"2024-05-14T12:21:39.729787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:14:19.461411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245385+0000","last_change":"2024-05-14T12:20:59.671870+0000","last_active":"2024-05-14T12:23:08.245385+0000","last_peered":"2024-05-14T12:23:08.245385+0000","last_clean":"2024-05-14T12:23:08.245385+0000","last_became_active":"2024-05-14T12:20:59.671467+0000","last_became_peered":"2024-05-14T12:20:59.671467+0000","last_unstale":"2024-05-14T12:23:08.245385+0000","last_undegraded":"2024-05-14T12:23:08.245385+0000","last_fullsized":"2024-05-14T12:23:08.245385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:18.195518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498590+0000","last_change":"2024-05-14T12:20:55.613626+0000","last_active":"2024-05-14T12:21:39.498590+0000","last_peered":"2024-05-14T12:21:39.498590+0000","last_clean":"2024-05-14T12:21:39.498590+0000","last_became_active":"2024-05-14T12:20:55.613039+0000","last_became_peered":"2024-05-14T12:20:55.613039+0000","last_unstale":"2024-05-14T12:21:39.498590+0000","last_undegraded":"2024-05-14T12:21:39.498590+0000","last_fullsized":"2024-05-14T12:21:39.498590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:19.479433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259965+0000","last_change":"2024-05-14T12:20:59.683152+0000","last_active":"2024-05-14T12:23:08.259965+0000","last_peered":"2024-05-14T12:23:08.259965+0000","last_clean":"2024-05-14T12:23:08.259965+0000","last_became_active":"2024-05-14T12:20:59.682863+0000","last_became_peered":"2024-05-14T12:20:59.682863+0000","last_unstale":"2024-05-14T12:23:08.259965+0000","last_undegraded":"2024-05-14T12:23:08.259965+0000","last_fullsized":"2024-05-14T12:23:08.259965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:26.975487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496446+0000","last_change":"2024-05-14T12:20:55.604785+0000","last_active":"2024-05-14T12:21:39.496446+0000","last_peered":"2024-05-14T12:21:39.496446+0000","last_clean":"2024-05-14T12:21:39.496446+0000","last_became_active":"2024-05-14T12:20:55.604249+0000","last_became_peered":"2024-05-14T12:20:55.604249+0000","last_unstale":"2024-05-14T12:21:39.496446+0000","last_undegraded":"2024-05-14T12:21:39.496446+0000","last_fullsized":"2024-05-14T12:21:39.496446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:18:51.954691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254982+0000","last_change":"2024-05-14T12:20:59.677047+0000","last_active":"2024-05-14T12:23:08.254982+0000","last_peered":"2024-05-14T12:23:08.254982+0000","last_clean":"2024-05-14T12:23:08.254982+0000","last_became_active":"2024-05-14T12:20:59.673314+0000","last_became_peered":"2024-05-14T12:20:59.673314+0000","last_unstale":"2024-05-14T12:23:08.254982+0000","last_undegraded":"2024-05-14T12:23:08.254982+0000","last_fullsized":"2024-05-14T12:23:08.254982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:54.069762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:14.976449+0000","last_change":"2024-05-14T12:20:55.608986+0000","last_active":"2024-05-14T12:25:14.976449+0000","last_peered":"2024-05-14T12:25:14.976449+0000","last_clean":"2024-05-14T12:25:14.976449+0000","last_became_active":"2024-05-14T12:20:55.608476+0000","last_became_peered":"2024-05-14T12:20:55.608476+0000","last_unstale":"2024-05-14T12:25:14.976449+0000","last_undegraded":"2024-05-14T12:25:14.976449+0000","last_fullsized":"2024-05-14T12:25:14.976449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:15:40.777724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":467,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251635+0000","last_change":"2024-05-14T12:20:59.673404+0000","last_active":"2024-05-14T12:23:08.251635+0000","last_peered":"2024-05-14T12:23:08.251635+0000","last_clean":"2024-05-14T12:23:08.251635+0000","last_became_active":"2024-05-14T12:20:59.673035+0000","last_became_peered":"2024-05-14T12:20:59.673035+0000","last_unstale":"2024-05-14T12:23:08.251635+0000","last_undegraded":"2024-05-14T12:23:08.251635+0000","last_fullsized":"2024-05-14T12:23:08.251635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:29:42.180288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.498557+0000","last_change":"2024-05-14T12:20:55.605789+0000","last_active":"2024-05-14T12:21:39.498557+0000","last_peered":"2024-05-14T12:21:39.498557+0000","last_clean":"2024-05-14T12:21:39.498557+0000","last_became_active":"2024-05-14T12:20:55.605166+0000","last_became_peered":"2024-05-14T12:20:55.605166+0000","last_unstale":"2024-05-14T12:21:39.498557+0000","last_undegraded":"2024-05-14T12:21:39.498557+0000","last_fullsized":"2024-05-14T12:21:39.498557+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:44.186098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244142+0000","last_change":"2024-05-14T12:20:59.678373+0000","last_active":"2024-05-14T12:23:08.244142+0000","last_peered":"2024-05-14T12:23:08.244142+0000","last_clean":"2024-05-14T12:23:08.244142+0000","last_became_active":"2024-05-14T12:20:59.673378+0000","last_became_peered":"2024-05-14T12:20:59.673378+0000","last_unstale":"2024-05-14T12:23:08.244142+0000","last_undegraded":"2024-05-14T12:23:08.244142+0000","last_fullsized":"2024-05-14T12:23:08.244142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:17:36.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496591+0000","last_change":"2024-05-14T12:20:55.966507+0000","last_active":"2024-05-14T12:21:39.496591+0000","last_peered":"2024-05-14T12:21:39.496591+0000","last_clean":"2024-05-14T12:21:39.496591+0000","last_became_active":"2024-05-14T12:20:55.966066+0000","last_became_peered":"2024-05-14T12:20:55.966066+0000","last_unstale":"2024-05-14T12:21:39.496591+0000","last_undegraded":"2024-05-14T12:21:39.496591+0000","last_fullsized":"2024-05-14T12:21:39.496591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:18:20.276346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250342+0000","last_change":"2024-05-14T12:20:59.669926+0000","last_active":"2024-05-14T12:23:08.250342+0000","last_peered":"2024-05-14T12:23:08.250342+0000","last_clean":"2024-05-14T12:23:08.250342+0000","last_became_active":"2024-05-14T12:20:59.669502+0000","last_became_peered":"2024-05-14T12:20:59.669502+0000","last_unstale":"2024-05-14T12:23:08.250342+0000","last_undegraded":"2024-05-14T12:23:08.250342+0000","last_fullsized":"2024-05-14T12:23:08.250342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:02.036442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":547,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:15.828915+0000","last_change":"2024-05-14T12:20:55.602307+0000","last_active":"2024-05-14T12:25:15.828915+0000","last_peered":"2024-05-14T12:25:15.828915+0000","last_clean":"2024-05-14T12:25:15.828915+0000","last_became_active":"2024-05-14T12:20:55.601879+0000","last_became_peered":"2024-05-14T12:20:55.601879+0000","last_unstale":"2024-05-14T12:25:15.828915+0000","last_undegraded":"2024-05-14T12:25:15.828915+0000","last_fullsized":"2024-05-14T12:25:15.828915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:08:10.839268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70656,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":309,"num_write":42,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.244715+0000","last_change":"2024-05-14T12:20:59.676162+0000","last_active":"2024-05-14T12:23:08.244715+0000","last_peered":"2024-05-14T12:23:08.244715+0000","last_clean":"2024-05-14T12:23:08.244715+0000","last_became_active":"2024-05-14T12:20:59.675742+0000","last_became_peered":"2024-05-14T12:20:59.675742+0000","last_unstale":"2024-05-14T12:23:08.244715+0000","last_undegraded":"2024-05-14T12:23:08.244715+0000","last_fullsized":"2024-05-14T12:23:08.244715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:52:00.100743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501460+0000","last_change":"2024-05-14T12:20:55.616014+0000","last_active":"2024-05-14T12:21:39.501460+0000","last_peered":"2024-05-14T12:21:39.501460+0000","last_clean":"2024-05-14T12:21:39.501460+0000","last_became_active":"2024-05-14T12:20:55.615331+0000","last_became_peered":"2024-05-14T12:20:55.615331+0000","last_unstale":"2024-05-14T12:21:39.501460+0000","last_undegraded":"2024-05-14T12:21:39.501460+0000","last_fullsized":"2024-05-14T12:21:39.501460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:53.539842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261957+0000","last_change":"2024-05-14T12:20:59.690299+0000","last_active":"2024-05-14T12:23:08.261957+0000","last_peered":"2024-05-14T12:23:08.261957+0000","last_clean":"2024-05-14T12:23:08.261957+0000","last_became_active":"2024-05-14T12:20:59.689959+0000","last_became_peered":"2024-05-14T12:20:59.689959+0000","last_unstale":"2024-05-14T12:23:08.261957+0000","last_undegraded":"2024-05-14T12:23:08.261957+0000","last_fullsized":"2024-05-14T12:23:08.261957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:53.017238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496270+0000","last_change":"2024-05-14T12:20:55.615860+0000","last_active":"2024-05-14T12:21:39.496270+0000","last_peered":"2024-05-14T12:21:39.496270+0000","last_clean":"2024-05-14T12:21:39.496270+0000","last_became_active":"2024-05-14T12:20:55.615415+0000","last_became_peered":"2024-05-14T12:20:55.615415+0000","last_unstale":"2024-05-14T12:21:39.496270+0000","last_undegraded":"2024-05-14T12:21:39.496270+0000","last_fullsized":"2024-05-14T12:21:39.496270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:27:55.368122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.258058+0000","last_change":"2024-05-14T12:20:59.684759+0000","last_active":"2024-05-14T12:23:08.258058+0000","last_peered":"2024-05-14T12:23:08.258058+0000","last_clean":"2024-05-14T12:23:08.258058+0000","last_became_active":"2024-05-14T12:20:59.684277+0000","last_became_peered":"2024-05-14T12:20:59.684277+0000","last_unstale":"2024-05-14T12:23:08.258058+0000","last_undegraded":"2024-05-14T12:23:08.258058+0000","last_fullsized":"2024-05-14T12:23:08.258058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:42:08.535580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":271,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:15.915857+0000","last_change":"2024-05-14T12:20:55.602130+0000","last_active":"2024-05-14T12:25:15.915857+0000","last_peered":"2024-05-14T12:25:15.915857+0000","last_clean":"2024-05-14T12:25:15.915857+0000","last_became_active":"2024-05-14T12:20:55.601635+0000","last_became_peered":"2024-05-14T12:20:55.601635+0000","last_unstale":"2024-05-14T12:25:15.915857+0000","last_undegraded":"2024-05-14T12:25:15.915857+0000","last_fullsized":"2024-05-14T12:25:15.915857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:24:34.599413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":898,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.251007+0000","last_change":"2024-05-14T12:21:39.505509+0000","last_active":"2024-05-14T12:23:08.251007+0000","last_peered":"2024-05-14T12:23:08.251007+0000","last_clean":"2024-05-14T12:23:08.251007+0000","last_became_active":"2024-05-14T12:21:39.504817+0000","last_became_peered":"2024-05-14T12:21:39.504817+0000","last_unstale":"2024-05-14T12:23:08.251007+0000","last_undegraded":"2024-05-14T12:23:08.251007+0000","last_fullsized":"2024-05-14T12:23:08.251007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:05:08.309898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.501589+0000","last_change":"2024-05-14T12:20:55.962404+0000","last_active":"2024-05-14T12:21:39.501589+0000","last_peered":"2024-05-14T12:21:39.501589+0000","last_clean":"2024-05-14T12:21:39.501589+0000","last_became_active":"2024-05-14T12:20:55.961886+0000","last_became_peered":"2024-05-14T12:20:55.961886+0000","last_unstale":"2024-05-14T12:21:39.501589+0000","last_undegraded":"2024-05-14T12:21:39.501589+0000","last_fullsized":"2024-05-14T12:21:39.501589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:30.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245497+0000","last_change":"2024-05-14T12:20:59.674010+0000","last_active":"2024-05-14T12:23:08.245497+0000","last_peered":"2024-05-14T12:23:08.245497+0000","last_clean":"2024-05-14T12:23:08.245497+0000","last_became_active":"2024-05-14T12:20:59.673546+0000","last_became_peered":"2024-05-14T12:20:59.673546+0000","last_unstale":"2024-05-14T12:23:08.245497+0000","last_undegraded":"2024-05-14T12:23:08.245497+0000","last_fullsized":"2024-05-14T12:23:08.245497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:59.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:41.801527+0000","last_change":"2024-05-14T12:21:39.512745+0000","last_active":"2024-05-14T12:21:41.801527+0000","last_peered":"2024-05-14T12:21:41.801527+0000","last_clean":"2024-05-14T12:21:41.801527+0000","last_became_active":"2024-05-14T12:21:39.502690+0000","last_became_peered":"2024-05-14T12:21:39.502690+0000","last_unstale":"2024-05-14T12:21:41.801527+0000","last_undegraded":"2024-05-14T12:21:41.801527+0000","last_fullsized":"2024-05-14T12:21:41.801527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:55:22.829094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240989+0000","last_change":"2024-05-14T12:20:59.671773+0000","last_active":"2024-05-14T12:23:08.240989+0000","last_peered":"2024-05-14T12:23:08.240989+0000","last_clean":"2024-05-14T12:23:08.240989+0000","last_became_active":"2024-05-14T12:20:59.671380+0000","last_became_peered":"2024-05-14T12:20:59.671380+0000","last_unstale":"2024-05-14T12:23:08.240989+0000","last_undegraded":"2024-05-14T12:23:08.240989+0000","last_fullsized":"2024-05-14T12:23:08.240989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:51:23.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:03.964016+0000","last_change":"2024-05-14T12:20:55.965843+0000","last_active":"2024-05-14T12:23:03.964016+0000","last_peered":"2024-05-14T12:23:03.964016+0000","last_clean":"2024-05-14T12:23:03.964016+0000","last_became_active":"2024-05-14T12:20:55.963827+0000","last_became_peered":"2024-05-14T12:20:55.963827+0000","last_unstale":"2024-05-14T12:23:03.964016+0000","last_undegraded":"2024-05-14T12:23:03.964016+0000","last_fullsized":"2024-05-14T12:23:03.964016+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:57:22.464989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259445+0000","last_change":"2024-05-14T12:20:59.674932+0000","last_active":"2024-05-14T12:23:08.259445+0000","last_peered":"2024-05-14T12:23:08.259445+0000","last_clean":"2024-05-14T12:23:08.259445+0000","last_became_active":"2024-05-14T12:20:59.674259+0000","last_became_peered":"2024-05-14T12:20:59.674259+0000","last_unstale":"2024-05-14T12:23:08.259445+0000","last_undegraded":"2024-05-14T12:23:08.259445+0000","last_fullsized":"2024-05-14T12:23:08.259445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:45.362069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'7","reported_seq":275,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:17.918155+0000","last_change":"2024-05-14T12:20:55.610031+0000","last_active":"2024-05-14T12:25:17.918155+0000","last_peered":"2024-05-14T12:25:17.918155+0000","last_clean":"2024-05-14T12:25:17.918155+0000","last_became_active":"2024-05-14T12:20:55.609730+0000","last_became_peered":"2024-05-14T12:20:55.609730+0000","last_unstale":"2024-05-14T12:25:17.918155+0000","last_undegraded":"2024-05-14T12:25:17.918155+0000","last_fullsized":"2024-05-14T12:25:17.918155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:35.763466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241288+0000","last_change":"2024-05-14T12:20:59.673504+0000","last_active":"2024-05-14T12:23:08.241288+0000","last_peered":"2024-05-14T12:23:08.241288+0000","last_clean":"2024-05-14T12:23:08.241288+0000","last_became_active":"2024-05-14T12:20:59.673100+0000","last_became_peered":"2024-05-14T12:20:59.673100+0000","last_unstale":"2024-05-14T12:23:08.241288+0000","last_undegraded":"2024-05-14T12:23:08.241288+0000","last_fullsized":"2024-05-14T12:23:08.241288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:02.262916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.234816+0000","last_change":"2024-05-14T12:20:59.674694+0000","last_active":"2024-05-14T12:23:08.234816+0000","last_peered":"2024-05-14T12:23:08.234816+0000","last_clean":"2024-05-14T12:23:08.234816+0000","last_became_active":"2024-05-14T12:20:59.673566+0000","last_became_peered":"2024-05-14T12:20:59.673566+0000","last_unstale":"2024-05-14T12:23:08.234816+0000","last_undegraded":"2024-05-14T12:23:08.234816+0000","last_fullsized":"2024-05-14T12:23:08.234816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:49:28.596919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":271,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:16.917753+0000","last_change":"2024-05-14T12:20:55.963207+0000","last_active":"2024-05-14T12:25:16.917753+0000","last_peered":"2024-05-14T12:25:16.917753+0000","last_clean":"2024-05-14T12:25:16.917753+0000","last_became_active":"2024-05-14T12:20:55.962084+0000","last_became_peered":"2024-05-14T12:20:55.962084+0000","last_unstale":"2024-05-14T12:25:16.917753+0000","last_undegraded":"2024-05-14T12:25:16.917753+0000","last_fullsized":"2024-05-14T12:25:16.917753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:17.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237,"num_read_kb":237,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.254903+0000","last_change":"2024-05-14T12:20:59.682629+0000","last_active":"2024-05-14T12:23:08.254903+0000","last_peered":"2024-05-14T12:23:08.254903+0000","last_clean":"2024-05-14T12:23:08.254903+0000","last_became_active":"2024-05-14T12:20:59.672656+0000","last_became_peered":"2024-05-14T12:20:59.672656+0000","last_unstale":"2024-05-14T12:23:08.254903+0000","last_undegraded":"2024-05-14T12:23:08.254903+0000","last_fullsized":"2024-05-14T12:23:08.254903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:23:29.651740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:02.283374+0000","last_change":"2024-05-14T12:20:55.605223+0000","last_active":"2024-05-14T12:23:02.283374+0000","last_peered":"2024-05-14T12:23:02.283374+0000","last_clean":"2024-05-14T12:23:02.283374+0000","last_became_active":"2024-05-14T12:20:55.604743+0000","last_became_peered":"2024-05-14T12:20:55.604743+0000","last_unstale":"2024-05-14T12:23:02.283374+0000","last_undegraded":"2024-05-14T12:23:02.283374+0000","last_fullsized":"2024-05-14T12:23:02.283374+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:53:15.258776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:59.696764+0000","last_change":"2024-05-14T12:19:22.477995+0000","last_active":"2024-05-14T12:21:59.696764+0000","last_peered":"2024-05-14T12:21:59.696764+0000","last_clean":"2024-05-14T12:21:59.696764+0000","last_became_active":"2024-05-14T12:19:22.471890+0000","last_became_peered":"2024-05-14T12:19:22.471890+0000","last_unstale":"2024-05-14T12:21:59.696764+0000","last_undegraded":"2024-05-14T12:21:59.696764+0000","last_fullsized":"2024-05-14T12:21:59.696764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:15:26.966159+0000","last_clean_scrub_stamp":"2024-05-14T12:15:26.966159+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:18.761547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.603310+0000","last_change":"2024-05-14T12:20:59.674341+0000","last_active":"2024-05-14T12:23:08.603310+0000","last_peered":"2024-05-14T12:23:08.603310+0000","last_clean":"2024-05-14T12:23:08.603310+0000","last_became_active":"2024-05-14T12:20:59.672199+0000","last_became_peered":"2024-05-14T12:20:59.672199+0000","last_unstale":"2024-05-14T12:23:08.603310+0000","last_undegraded":"2024-05-14T12:23:08.603310+0000","last_fullsized":"2024-05-14T12:23:08.603310+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.666708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:54.703757+0000","last_change":"2024-05-14T12:20:55.605513+0000","last_active":"2024-05-14T12:22:54.703757+0000","last_peered":"2024-05-14T12:22:54.703757+0000","last_clean":"2024-05-14T12:22:54.703757+0000","last_became_active":"2024-05-14T12:20:55.605131+0000","last_became_peered":"2024-05-14T12:20:55.605131+0000","last_unstale":"2024-05-14T12:22:54.703757+0000","last_undegraded":"2024-05-14T12:22:54.703757+0000","last_fullsized":"2024-05-14T12:22:54.703757+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:56.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:22:59.980943+0000","last_change":"2024-05-14T12:20:55.966357+0000","last_active":"2024-05-14T12:22:59.980943+0000","last_peered":"2024-05-14T12:22:59.980943+0000","last_clean":"2024-05-14T12:22:59.980943+0000","last_became_active":"2024-05-14T12:20:55.965946+0000","last_became_peered":"2024-05-14T12:20:55.965946+0000","last_unstale":"2024-05-14T12:22:59.980943+0000","last_undegraded":"2024-05-14T12:22:59.980943+0000","last_fullsized":"2024-05-14T12:22:59.980943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:20.843819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.603416+0000","last_change":"2024-05-14T12:20:59.675130+0000","last_active":"2024-05-14T12:23:08.603416+0000","last_peered":"2024-05-14T12:23:08.603416+0000","last_clean":"2024-05-14T12:23:08.603416+0000","last_became_active":"2024-05-14T12:20:59.674639+0000","last_became_peered":"2024-05-14T12:20:59.674639+0000","last_unstale":"2024-05-14T12:23:08.603416+0000","last_undegraded":"2024-05-14T12:23:08.603416+0000","last_fullsized":"2024-05-14T12:23:08.603416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:34:47.167894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'17","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:08.732604+0000","last_change":"2024-05-14T12:20:55.615975+0000","last_active":"2024-05-14T12:25:08.732604+0000","last_peered":"2024-05-14T12:25:08.732604+0000","last_clean":"2024-05-14T12:25:08.732604+0000","last_became_active":"2024-05-14T12:20:55.615542+0000","last_became_peered":"2024-05-14T12:20:55.615542+0000","last_unstale":"2024-05-14T12:25:08.732604+0000","last_undegraded":"2024-05-14T12:25:08.732604+0000","last_fullsized":"2024-05-14T12:25:08.732604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:52:46.621227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260341+0000","last_change":"2024-05-14T12:20:59.679047+0000","last_active":"2024-05-14T12:23:08.260341+0000","last_peered":"2024-05-14T12:23:08.260341+0000","last_clean":"2024-05-14T12:23:08.260341+0000","last_became_active":"2024-05-14T12:20:59.678620+0000","last_became_peered":"2024-05-14T12:20:59.678620+0000","last_unstale":"2024-05-14T12:23:08.260341+0000","last_undegraded":"2024-05-14T12:23:08.260341+0000","last_fullsized":"2024-05-14T12:23:08.260341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:30.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:07.284079+0000","last_change":"2024-05-14T12:20:55.836121+0000","last_active":"2024-05-14T12:23:07.284079+0000","last_peered":"2024-05-14T12:23:07.284079+0000","last_clean":"2024-05-14T12:23:07.284079+0000","last_became_active":"2024-05-14T12:20:55.835758+0000","last_became_peered":"2024-05-14T12:20:55.835758+0000","last_unstale":"2024-05-14T12:23:07.284079+0000","last_undegraded":"2024-05-14T12:23:07.284079+0000","last_fullsized":"2024-05-14T12:23:07.284079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:29:12.627760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.261142+0000","last_change":"2024-05-14T12:20:59.679664+0000","last_active":"2024-05-14T12:23:08.261142+0000","last_peered":"2024-05-14T12:23:08.261142+0000","last_clean":"2024-05-14T12:23:08.261142+0000","last_became_active":"2024-05-14T12:20:59.679242+0000","last_became_peered":"2024-05-14T12:20:59.679242+0000","last_unstale":"2024-05-14T12:23:08.261142+0000","last_undegraded":"2024-05-14T12:23:08.261142+0000","last_fullsized":"2024-05-14T12:23:08.261142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:38:17.910624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:06.942905+0000","last_change":"2024-05-14T12:20:55.965927+0000","last_active":"2024-05-14T12:23:06.942905+0000","last_peered":"2024-05-14T12:23:06.942905+0000","last_clean":"2024-05-14T12:23:06.942905+0000","last_became_active":"2024-05-14T12:20:55.965570+0000","last_became_peered":"2024-05-14T12:20:55.965570+0000","last_unstale":"2024-05-14T12:23:06.942905+0000","last_undegraded":"2024-05-14T12:23:06.942905+0000","last_fullsized":"2024-05-14T12:23:06.942905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:16:23.869388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:09.982381+0000","last_change":"2024-05-14T12:20:59.662521+0000","last_active":"2024-05-14T12:23:09.982381+0000","last_peered":"2024-05-14T12:23:09.982381+0000","last_clean":"2024-05-14T12:23:09.982381+0000","last_became_active":"2024-05-14T12:20:59.662140+0000","last_became_peered":"2024-05-14T12:20:59.662140+0000","last_unstale":"2024-05-14T12:23:09.982381+0000","last_undegraded":"2024-05-14T12:23:09.982381+0000","last_fullsized":"2024-05-14T12:23:09.982381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:44.471630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:06.372073+0000","last_change":"2024-05-14T12:20:55.614124+0000","last_active":"2024-05-14T12:23:06.372073+0000","last_peered":"2024-05-14T12:23:06.372073+0000","last_clean":"2024-05-14T12:23:06.372073+0000","last_became_active":"2024-05-14T12:20:55.610826+0000","last_became_peered":"2024-05-14T12:20:55.610826+0000","last_unstale":"2024-05-14T12:23:06.372073+0000","last_undegraded":"2024-05-14T12:23:06.372073+0000","last_fullsized":"2024-05-14T12:23:06.372073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:01:30.296978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241601+0000","last_change":"2024-05-14T12:20:59.684356+0000","last_active":"2024-05-14T12:23:08.241601+0000","last_peered":"2024-05-14T12:23:08.241601+0000","last_clean":"2024-05-14T12:23:08.241601+0000","last_became_active":"2024-05-14T12:20:59.683942+0000","last_became_peered":"2024-05-14T12:20:59.683942+0000","last_unstale":"2024-05-14T12:23:08.241601+0000","last_undegraded":"2024-05-14T12:23:08.241601+0000","last_fullsized":"2024-05-14T12:23:08.241601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:19:50.421104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:05.004787+0000","last_change":"2024-05-14T12:20:55.615921+0000","last_active":"2024-05-14T12:23:05.004787+0000","last_peered":"2024-05-14T12:23:05.004787+0000","last_clean":"2024-05-14T12:23:05.004787+0000","last_became_active":"2024-05-14T12:20:55.615448+0000","last_became_peered":"2024-05-14T12:20:55.615448+0000","last_unstale":"2024-05-14T12:23:05.004787+0000","last_undegraded":"2024-05-14T12:23:05.004787+0000","last_fullsized":"2024-05-14T12:23:05.004787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:41:00.260869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260052+0000","last_change":"2024-05-14T12:20:59.690629+0000","last_active":"2024-05-14T12:23:08.260052+0000","last_peered":"2024-05-14T12:23:08.260052+0000","last_clean":"2024-05-14T12:23:08.260052+0000","last_became_active":"2024-05-14T12:20:59.689696+0000","last_became_peered":"2024-05-14T12:20:59.689696+0000","last_unstale":"2024-05-14T12:23:08.260052+0000","last_undegraded":"2024-05-14T12:23:08.260052+0000","last_fullsized":"2024-05-14T12:23:08.260052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:27.678235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.531447+0000","last_change":"2024-05-14T12:21:39.530824+0000","last_active":"2024-05-14T12:21:39.531447+0000","last_peered":"2024-05-14T12:21:39.531447+0000","last_clean":"2024-05-14T12:21:39.531447+0000","last_became_active":"2024-05-14T12:21:39.507316+0000","last_became_peered":"2024-05-14T12:21:39.507316+0000","last_unstale":"2024-05-14T12:21:39.531447+0000","last_undegraded":"2024-05-14T12:21:39.531447+0000","last_fullsized":"2024-05-14T12:21:39.531447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:06:46.506545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:09.705681+0000","last_change":"2024-05-14T12:20:59.679078+0000","last_active":"2024-05-14T12:23:09.705681+0000","last_peered":"2024-05-14T12:23:09.705681+0000","last_clean":"2024-05-14T12:23:09.705681+0000","last_became_active":"2024-05-14T12:20:59.678713+0000","last_became_peered":"2024-05-14T12:20:59.678713+0000","last_unstale":"2024-05-14T12:23:09.705681+0000","last_undegraded":"2024-05-14T12:23:09.705681+0000","last_fullsized":"2024-05-14T12:23:09.705681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:46:44.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":276,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:25:18.833734+0000","last_change":"2024-05-14T12:20:55.965829+0000","last_active":"2024-05-14T12:25:18.833734+0000","last_peered":"2024-05-14T12:25:18.833734+0000","last_clean":"2024-05-14T12:25:18.833734+0000","last_became_active":"2024-05-14T12:20:55.965316+0000","last_became_peered":"2024-05-14T12:20:55.965316+0000","last_unstale":"2024-05-14T12:25:18.833734+0000","last_undegraded":"2024-05-14T12:25:18.833734+0000","last_fullsized":"2024-05-14T12:25:18.833734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:46:36.879599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245162+0000","last_change":"2024-05-14T12:20:59.673582+0000","last_active":"2024-05-14T12:23:08.245162+0000","last_peered":"2024-05-14T12:23:08.245162+0000","last_clean":"2024-05-14T12:23:08.245162+0000","last_became_active":"2024-05-14T12:20:59.672475+0000","last_became_peered":"2024-05-14T12:20:59.672475+0000","last_unstale":"2024-05-14T12:23:08.245162+0000","last_undegraded":"2024-05-14T12:23:08.245162+0000","last_fullsized":"2024-05-14T12:23:08.245162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:06:04.861177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.496398+0000","last_change":"2024-05-14T12:20:55.615870+0000","last_active":"2024-05-14T12:21:39.496398+0000","last_peered":"2024-05-14T12:21:39.496398+0000","last_clean":"2024-05-14T12:21:39.496398+0000","last_became_active":"2024-05-14T12:20:55.615444+0000","last_became_peered":"2024-05-14T12:20:55.615444+0000","last_unstale":"2024-05-14T12:21:39.496398+0000","last_undegraded":"2024-05-14T12:21:39.496398+0000","last_fullsized":"2024-05-14T12:21:39.496398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:23:03.081164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.259667+0000","last_change":"2024-05-14T12:20:59.688252+0000","last_active":"2024-05-14T12:23:08.259667+0000","last_peered":"2024-05-14T12:23:08.259667+0000","last_clean":"2024-05-14T12:23:08.259667+0000","last_became_active":"2024-05-14T12:20:59.687861+0000","last_became_peered":"2024-05-14T12:20:59.687861+0000","last_unstale":"2024-05-14T12:23:08.259667+0000","last_undegraded":"2024-05-14T12:23:08.259667+0000","last_fullsized":"2024-05-14T12:23:08.259667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:29:00.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:21:39.500452+0000","last_change":"2024-05-14T12:20:55.616119+0000","last_active":"2024-05-14T12:21:39.500452+0000","last_peered":"2024-05-14T12:21:39.500452+0000","last_clean":"2024-05-14T12:21:39.500452+0000","last_became_active":"2024-05-14T12:20:55.615700+0000","last_became_peered":"2024-05-14T12:20:55.615700+0000","last_unstale":"2024-05-14T12:21:39.500452+0000","last_undegraded":"2024-05-14T12:21:39.500452+0000","last_fullsized":"2024-05-14T12:21:39.500452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:54.569450+0000","last_clean_scrub_stamp":"2024-05-14T12:20:54.569450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:39.342610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245535+0000","last_change":"2024-05-14T12:20:59.672495+0000","last_active":"2024-05-14T12:23:08.245535+0000","last_peered":"2024-05-14T12:23:08.245535+0000","last_clean":"2024-05-14T12:23:08.245535+0000","last_became_active":"2024-05-14T12:20:59.671983+0000","last_became_peered":"2024-05-14T12:20:59.671983+0000","last_unstale":"2024-05-14T12:23:08.245535+0000","last_undegraded":"2024-05-14T12:23:08.245535+0000","last_fullsized":"2024-05-14T12:23:08.245535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:41.336895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.240059+0000","last_change":"2024-05-14T12:20:59.663818+0000","last_active":"2024-05-14T12:23:08.240059+0000","last_peered":"2024-05-14T12:23:08.240059+0000","last_clean":"2024-05-14T12:23:08.240059+0000","last_became_active":"2024-05-14T12:20:59.663431+0000","last_became_peered":"2024-05-14T12:20:59.663431+0000","last_unstale":"2024-05-14T12:23:08.240059+0000","last_undegraded":"2024-05-14T12:23:08.240059+0000","last_fullsized":"2024-05-14T12:23:08.240059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:40:10.435481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.245374+0000","last_change":"2024-05-14T12:20:59.668412+0000","last_active":"2024-05-14T12:23:08.245374+0000","last_peered":"2024-05-14T12:23:08.245374+0000","last_clean":"2024-05-14T12:23:08.245374+0000","last_became_active":"2024-05-14T12:20:59.667963+0000","last_became_peered":"2024-05-14T12:20:59.667963+0000","last_unstale":"2024-05-14T12:23:08.245374+0000","last_undegraded":"2024-05-14T12:23:08.245374+0000","last_fullsized":"2024-05-14T12:23:08.245374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:50:19.463843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.243183+0000","last_change":"2024-05-14T12:20:59.668796+0000","last_active":"2024-05-14T12:23:08.243183+0000","last_peered":"2024-05-14T12:23:08.243183+0000","last_clean":"2024-05-14T12:23:08.243183+0000","last_became_active":"2024-05-14T12:20:59.668414+0000","last_became_peered":"2024-05-14T12:20:59.668414+0000","last_unstale":"2024-05-14T12:23:08.243183+0000","last_undegraded":"2024-05-14T12:23:08.243183+0000","last_fullsized":"2024-05-14T12:23:08.243183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:40:28.669547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.257674+0000","last_change":"2024-05-14T12:20:59.687417+0000","last_active":"2024-05-14T12:23:08.257674+0000","last_peered":"2024-05-14T12:23:08.257674+0000","last_clean":"2024-05-14T12:23:08.257674+0000","last_became_active":"2024-05-14T12:20:59.686373+0000","last_became_peered":"2024-05-14T12:20:59.686373+0000","last_unstale":"2024-05-14T12:23:08.257674+0000","last_undegraded":"2024-05-14T12:23:08.257674+0000","last_fullsized":"2024-05-14T12:23:08.257674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:55.469950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.255534+0000","last_change":"2024-05-14T12:21:40.359831+0000","last_active":"2024-05-14T12:23:08.255534+0000","last_peered":"2024-05-14T12:23:08.255534+0000","last_clean":"2024-05-14T12:23:08.255534+0000","last_became_active":"2024-05-14T12:21:40.358347+0000","last_became_peered":"2024-05-14T12:21:40.358347+0000","last_unstale":"2024-05-14T12:23:08.255534+0000","last_undegraded":"2024-05-14T12:23:08.255534+0000","last_fullsized":"2024-05-14T12:23:08.255534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:03:58.165602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.238787+0000","last_change":"2024-05-14T12:20:59.663332+0000","last_active":"2024-05-14T12:23:08.238787+0000","last_peered":"2024-05-14T12:23:08.238787+0000","last_clean":"2024-05-14T12:23:08.238787+0000","last_became_active":"2024-05-14T12:20:59.662714+0000","last_became_peered":"2024-05-14T12:20:59.662714+0000","last_unstale":"2024-05-14T12:23:08.238787+0000","last_undegraded":"2024-05-14T12:23:08.238787+0000","last_fullsized":"2024-05-14T12:23:08.238787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:59.140579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:10.005426+0000","last_change":"2024-05-14T12:20:59.665482+0000","last_active":"2024-05-14T12:23:10.005426+0000","last_peered":"2024-05-14T12:23:10.005426+0000","last_clean":"2024-05-14T12:23:10.005426+0000","last_became_active":"2024-05-14T12:20:59.665001+0000","last_became_peered":"2024-05-14T12:20:59.665001+0000","last_unstale":"2024-05-14T12:23:10.005426+0000","last_undegraded":"2024-05-14T12:23:10.005426+0000","last_fullsized":"2024-05-14T12:23:10.005426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:54:26.074054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.246632+0000","last_change":"2024-05-14T12:20:59.679317+0000","last_active":"2024-05-14T12:23:08.246632+0000","last_peered":"2024-05-14T12:23:08.246632+0000","last_clean":"2024-05-14T12:23:08.246632+0000","last_became_active":"2024-05-14T12:20:59.675797+0000","last_became_peered":"2024-05-14T12:20:59.675797+0000","last_unstale":"2024-05-14T12:23:08.246632+0000","last_undegraded":"2024-05-14T12:23:08.246632+0000","last_fullsized":"2024-05-14T12:23:08.246632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:58.509712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.250723+0000","last_change":"2024-05-14T12:20:59.669982+0000","last_active":"2024-05-14T12:23:08.250723+0000","last_peered":"2024-05-14T12:23:08.250723+0000","last_clean":"2024-05-14T12:23:08.250723+0000","last_became_active":"2024-05-14T12:20:59.669587+0000","last_became_peered":"2024-05-14T12:20:59.669587+0000","last_unstale":"2024-05-14T12:23:08.250723+0000","last_undegraded":"2024-05-14T12:23:08.250723+0000","last_fullsized":"2024-05-14T12:23:08.250723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:05:31.474906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260491+0000","last_change":"2024-05-14T12:20:59.672672+0000","last_active":"2024-05-14T12:23:08.260491+0000","last_peered":"2024-05-14T12:23:08.260491+0000","last_clean":"2024-05-14T12:23:08.260491+0000","last_became_active":"2024-05-14T12:20:59.672191+0000","last_became_peered":"2024-05-14T12:20:59.672191+0000","last_unstale":"2024-05-14T12:23:08.260491+0000","last_undegraded":"2024-05-14T12:23:08.260491+0000","last_fullsized":"2024-05-14T12:23:08.260491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:53:14.530296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.260678+0000","last_change":"2024-05-14T12:20:59.684548+0000","last_active":"2024-05-14T12:23:08.260678+0000","last_peered":"2024-05-14T12:23:08.260678+0000","last_clean":"2024-05-14T12:23:08.260678+0000","last_became_active":"2024-05-14T12:20:59.684069+0000","last_became_peered":"2024-05-14T12:20:59.684069+0000","last_unstale":"2024-05-14T12:23:08.260678+0000","last_undegraded":"2024-05-14T12:23:08.260678+0000","last_fullsized":"2024-05-14T12:23:08.260678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:58.759384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.264740+0000","last_change":"2024-05-14T12:20:59.682386+0000","last_active":"2024-05-14T12:23:08.264740+0000","last_peered":"2024-05-14T12:23:08.264740+0000","last_clean":"2024-05-14T12:23:08.264740+0000","last_became_active":"2024-05-14T12:20:59.682037+0000","last_became_peered":"2024-05-14T12:20:59.682037+0000","last_unstale":"2024-05-14T12:23:08.264740+0000","last_undegraded":"2024-05-14T12:23:08.264740+0000","last_fullsized":"2024-05-14T12:23:08.264740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:24.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-05-14T12:23:08.241032+0000","last_change":"2024-05-14T12:20:59.672679+0000","last_active":"2024-05-14T12:23:08.241032+0000","last_peered":"2024-05-14T12:23:08.241032+0000","last_clean":"2024-05-14T12:23:08.241032+0000","last_became_active":"2024-05-14T12:20:59.672324+0000","last_became_peered":"2024-05-14T12:20:59.672324+0000","last_unstale":"2024-05-14T12:23:08.241032+0000","last_undegraded":"2024-05-14T12:23:08.241032+0000","last_fullsized":"2024-05-14T12:23:08.241032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T12:20:58.620465+0000","last_clean_scrub_stamp":"2024-05-14T12:20:58.620465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:45.513792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78452,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2377,"num_read_kb":1279,"num_write":264,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":644,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":235356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":445696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776201,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1638400,"data_stored":1106515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939728,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":444450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135959,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":444806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1544192,"data_stored":1037797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561123,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":516268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411450,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":516488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149810,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953581,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":444338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757353,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32688,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712464,"statfs":{"total":95995035648,"available":95961563136,"internally_reserved":0,"allocated":1548288,"data_stored":1036011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":72702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T12:25:22.807 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:25:22.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:22 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:25:23.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:22 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:25:23.301 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:23 smithi047 ceph-mon[31254]: from='client.25150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:23 smithi047 ceph-mon[31254]: pgmap v456: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T12:25:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:25:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:25:23.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:25:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:23 smithi066 ceph-mon[35981]: from='client.25150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:23 smithi066 ceph-mon[35981]: pgmap v456: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T12:25:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:25:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:25:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:25:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.907+0000 7f8bf6400640 1 -- 172.21.15.47:0/1081886673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 msgr2=0x7f8bf010be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.907+0000 7f8bf6400640 1 --2- 172.21.15.47:0/1081886673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf010be00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009ca0 tx=0x7f8be802a8c0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.908+0000 7f8bf6400640 1 -- 172.21.15.47:0/1081886673 shutdown_connections 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.908+0000 7f8bf6400640 1 --2- 172.21.15.47:0/1081886673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf010be00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.908+0000 7f8bf6400640 1 --2- 172.21.15.47:0/1081886673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf0104ce0 0x7f8bf01050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.908+0000 7f8bf6400640 1 --2- 172.21.15.47:0/1081886673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 0x7f8bf01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.908+0000 7f8bf6400640 1 -- 172.21.15.47:0/1081886673 >> 172.21.15.47:0/1081886673 conn(0x7f8bf00fecb0 msgr2=0x7f8bf0101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.908+0000 7f8bf6400640 1 -- 172.21.15.47:0/1081886673 shutdown_connections 2024-05-14T12:25:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.908+0000 7f8bf6400640 1 -- 172.21.15.47:0/1081886673 wait complete. 2024-05-14T12:25:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 Processor -- start 2024-05-14T12:25:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 -- start start 2024-05-14T12:25:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 0x7f8bf019c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf0104ce0 0x7f8bf019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf01a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010f670 con 0x7f8bf01099e0 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010f4f0 con 0x7f8bf0104ce0 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.909+0000 7f8bf6400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010f7f0 con 0x7f8bf0103aa0 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8bf5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf01a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 0x7f8bf019c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8befe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf0104ce0 0x7f8bf019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 0x7f8bf019c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59764/0 (socket says 172.21.15.47:59764) 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8bf5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf01a3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44540/0 (socket says 172.21.15.47:44540) 2024-05-14T12:25:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8bf5000640 1 -- 172.21.15.47:0/3333330662 learned_addr learned my addr 172.21.15.47:0/3333330662 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8befe00640 1 -- 172.21.15.47:0/3333330662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 msgr2=0x7f8bf019c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8befe00640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 0x7f8bf019c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8befe00640 1 -- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 msgr2=0x7f8bf01a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8befe00640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf01a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8befe00640 1 -- 172.21.15.47:0/3333330662 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01a3e70 con 0x7f8bf0104ce0 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8bf5000640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 0x7f8bf019c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.910+0000 7f8bf5a00640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf01a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.911+0000 7f8befe00640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf0104ce0 0x7f8bf019c870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9f0 tx=0x7f8bdc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.911+0000 7f8bed600640 1 -- 172.21.15.47:0/3333330662 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00ccc0 con 0x7f8bf0104ce0 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.911+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf01a4160 con 0x7f8bf0104ce0 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.911+0000 7f8bed600640 1 -- 172.21.15.47:0/3333330662 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bdc0108e0 con 0x7f8bf0104ce0 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.911+0000 7f8bed600640 1 -- 172.21.15.47:0/3333330662 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc018880 con 0x7f8bf0104ce0 2024-05-14T12:25:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.911+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a46b0 con 0x7f8bf0104ce0 2024-05-14T12:25:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.914+0000 7f8bfea1f740 1 Processor -- start 2024-05-14T12:25:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bfea1f740 1 -- start start 2024-05-14T12:25:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bed600640 1 -- 172.21.15.47:0/3333330662 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8bdc010430 con 0x7f8bf0104ce0 2024-05-14T12:25:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26e21b0 0x5594d2a84300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a84880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a8b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5594d29e8550 con 0x5594d26e21b0 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5594d298dbc0 con 0x5594d26b92f0 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5594d29e4510 con 0x5594d26c14d0 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bf5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26e21b0 0x5594d2a84300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a84880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a84880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40604/0 (socket says 172.21.15.47:40604) 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8bf5000640 1 -- 172.21.15.47:0/2452112247 learned_addr learned my addr 172.21.15.47:0/2452112247 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.915+0000 7f8befe00640 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a8b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.916+0000 7f8bf5000640 1 -- 172.21.15.47:0/2452112247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 msgr2=0x5594d2a8b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.916+0000 7f8bf5000640 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a8b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.916+0000 7f8bf5000640 1 -- 172.21.15.47:0/2452112247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26e21b0 msgr2=0x5594d2a84300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.916+0000 7f8bf5000640 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26e21b0 0x5594d2a84300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.916+0000 7f8bf5000640 1 -- 172.21.15.47:0/2452112247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d26fa210 con 0x5594d26b92f0 2024-05-14T12:25:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.916+0000 7f8bf5a00640 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26e21b0 0x5594d2a84300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.916+0000 7f8bf5000640 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a84880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8be40115f0 tx=0x7f8be4011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e421a22627b60d20 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8be2000640 1 -- 172.21.15.47:0/2452112247 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be401e070 con 0x5594d26b92f0 2024-05-14T12:25:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8be2000640 1 -- 172.21.15.47:0/2452112247 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be400fb10 con 0x5594d26b92f0 2024-05-14T12:25:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8be2000640 1 -- 172.21.15.47:0/2452112247 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4019c40 con 0x5594d26b92f0 2024-05-14T12:25:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8bed600640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8bd80b28a0 0x7f8bd80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8bed600640 1 -- 172.21.15.47:0/3333330662 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8bdc0e2550 con 0x7f8bf0104ce0 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8bf5a00640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8bd80b28a0 0x7f8bd80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2452112247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 msgr2=0x5594d2a84880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.917+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a84880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8be40115f0 tx=0x7f8be4011ab0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2452112247 shutdown_connections 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a8b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a84880 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2452112247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26e21b0 0x5594d2a84300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2452112247 >> 172.21.15.47:0/2452112247 conn(0x5594d26d6300 msgr2=0x5594d2a7fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2452112247 shutdown_connections 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2452112247 wait complete. 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.918+0000 7f8bf5a00640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8bd80b28a0 0x7f8bd80b4db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5594d2a854d0 tx=0x7f8be802f490 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 -- start start 2024-05-14T12:25:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 Processor -- start 2024-05-14T12:25:23.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26c14d0 0x5594d2a8e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a95290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5594d2a8c1d0 con 0x5594d26b92f0 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5594d29a1660 con 0x5594d26c14d0 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.919+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5594d2a8c350 con 0x5594d26e21b0 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bfea1f740 10 client.0 _ll_register_callbacks cb 0x5594d296b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44568/0 (socket says 172.21.15.47:44568) 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 -- 172.21.15.47:0/2450629645 learned_addr learned my addr 172.21.15.47:0/2450629645 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8befe00640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26c14d0 0x5594d2a8e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5a00640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a95290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 -- 172.21.15.47:0/2450629645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 msgr2=0x5594d2a95290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a95290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 -- 172.21.15.47:0/2450629645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26c14d0 msgr2=0x5594d2a8e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26c14d0 0x5594d2a8e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8bf5000640 1 -- 172.21.15.47:0/2450629645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d27c6620 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.920+0000 7f8befe00640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26c14d0 0x5594d2a8e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bf5000640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8ddf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8be401c040 tx=0x7f8be4009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dabd95ce40ef7d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bd6a00640 1 -- 172.21.15.47:0/2450629645 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be401e040 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bd6a00640 1 -- 172.21.15.47:0/2450629645 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8be400f660 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be400fb10 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bd6a00640 1 -- 172.21.15.47:0/2450629645 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8be400f860 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bfea1f740 10 client.15033 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.921+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5594d2a981c0 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bd6a00640 1 -- 172.21.15.47:0/2450629645 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8be400fb10 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bd6a00640 1 -- 172.21.15.47:0/2450629645 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8be4021070 con 0x5594d26b92f0 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bfea1f740 10 client.15033 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bfea1f740 10 client.15033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bfea1f740 20 client.15033 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26a0d80 0x5594d2a9b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bfea1f740 4 client.15033 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594d29f6160 con 0x5594d26a0d80 2024-05-14T12:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.922+0000 7f8befe00640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26a0d80 0x5594d2a9b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.923+0000 7f8befe00640 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26a0d80 0x5594d2a9b7b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=157515279dabab94 server_cookie=21f63b295173bafc in_seq=0 out_seq=0 2024-05-14T12:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.923+0000 7f8bd6a00640 10 client.15033 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bd6a00640 1 -- 172.21.15.47:0/2450629645 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5594d29f6160 con 0x5594d26a0d80 2024-05-14T12:25:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bd6a00640 10 client.15033 handle_command_reply: tid=0 2024-05-14T12:25:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 client.15033 shutdown 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 msgr2=0x5594d2a8ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8ddf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8be401c040 tx=0x7f8be4009e70 comp rx=0 tx=0).stop 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 shutdown_connections 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26a0d80 0x5594d2a9b7b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a95290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26c14d0 0x5594d2a8e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bd6a00640 0 client.15033 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/2450629645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8ddf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 >> 172.21.15.47:0/2450629645 conn(0x5594d26d6300 msgr2=0x5594d2a82ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 shutdown_connections 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.924+0000 7f8bfea1f740 1 -- 172.21.15.47:0/2450629645 wait complete. 2024-05-14T12:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.925+0000 7f8bfea1f740 20 client.15033 trim_cache size 0 max 16384 2024-05-14T12:25:23.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 Processor -- start 2024-05-14T12:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 -- start start 2024-05-14T12:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a951b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26e21b0 0x5594d2a7f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ad330 con 0x5594d26b92f0 2024-05-14T12:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01aee70 con 0x5594d26e21b0 2024-05-14T12:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ada00 con 0x5594d26c14d0 2024-05-14T12:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8befe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bf5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44576/0 (socket says 172.21.15.47:44576) 2024-05-14T12:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.942+0000 7f8bf5000640 1 -- 172.21.15.47:0/4251403994 learned_addr learned my addr 172.21.15.47:0/4251403994 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8bf5a00640 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26e21b0 0x5594d2a7f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8befe00640 1 -- 172.21.15.47:0/4251403994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26e21b0 msgr2=0x5594d2a7f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8befe00640 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26e21b0 0x5594d2a7f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8befe00640 1 -- 172.21.15.47:0/4251403994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 msgr2=0x5594d2a8e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8befe00640 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8befe00640 1 -- 172.21.15.47:0/4251403994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d2a7b4a0 con 0x5594d26c14d0 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8bf5000640 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.943+0000 7f8befe00640 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a951b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0e5fd0 tx=0x7f8bdc0e49e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b1f5a07e2238261 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.944+0000 7f8be1600640 1 -- 172.21.15.47:0/4251403994 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a53b0 con 0x5594d26c14d0 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.944+0000 7f8be1600640 1 -- 172.21.15.47:0/4251403994 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bdc010720 con 0x5594d26c14d0 2024-05-14T12:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.944+0000 7f8be1600640 1 -- 172.21.15.47:0/4251403994 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0b29d0 con 0x5594d26c14d0 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 -- 172.21.15.47:0/4251403994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 msgr2=0x5594d2a951b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a951b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0e5fd0 tx=0x7f8bdc0e49e0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 -- 172.21.15.47:0/4251403994 shutdown_connections 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26e21b0 0x5594d2a7f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26c14d0 0x5594d2a951b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/4251403994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26b92f0 0x5594d2a8e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 -- 172.21.15.47:0/4251403994 >> 172.21.15.47:0/4251403994 conn(0x5594d26d6300 msgr2=0x5594d2a8d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 -- 172.21.15.47:0/4251403994 shutdown_connections 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 -- 172.21.15.47:0/4251403994 wait complete. 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 -- start start 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.945+0000 7f8bfea1f740 1 Processor -- start 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a94e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26c14d0 0x5594d2a919d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bfea1f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a91f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ae7a0 con 0x5594d26c14d0 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ae0d0 con 0x5594d26b92f0 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bfea1f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ab2f0 con 0x5594d26e21b0 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bfea1f740 10 client.0 _ll_register_callbacks cb 0x7f8be401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8befe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26c14d0 0x5594d2a919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bf5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a91f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8befe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26c14d0 0x5594d2a919d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44590/0 (socket says 172.21.15.47:44590) 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8befe00640 1 -- 172.21.15.47:0/3484890362 learned_addr learned my addr 172.21.15.47:0/3484890362 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.946+0000 7f8bf5000640 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a94e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8befe00640 1 -- 172.21.15.47:0/3484890362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 msgr2=0x5594d2a91f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8befe00640 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a91f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8befe00640 1 -- 172.21.15.47:0/3484890362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 msgr2=0x5594d2a94e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8befe00640 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a94e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8befe00640 1 -- 172.21.15.47:0/3484890362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d2a92450 con 0x5594d26c14d0 2024-05-14T12:25:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8befe00640 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26c14d0 0x5594d2a919d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0a9bb0 tx=0x7f8bdc0a9c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5a98b8e457803f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8bd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8bd6a00640 1 -- 172.21.15.47:0/3484890362 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc08e020 con 0x5594d26c14d0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5594d29effd0 con 0x5594d26c14d0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8bd6a00640 1 -- 172.21.15.47:0/3484890362 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8bdc0a6210 con 0x5594d26c14d0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8bd6a00640 1 -- 172.21.15.47:0/3484890362 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8bdc0b2310 con 0x5594d26c14d0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8bfea1f740 10 client.15039 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.947+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5594d2b02aa0 con 0x5594d26c14d0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bd6a00640 1 -- 172.21.15.47:0/3484890362 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5594d29effd0 con 0x5594d26c14d0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bd6a00640 1 -- 172.21.15.47:0/3484890362 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8bdc0e2230 con 0x5594d26c14d0 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bfea1f740 10 client.15039 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bfea1f740 10 client.15039 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bfea1f740 20 client.15039 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26761c0 0x5594d2b054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bfea1f740 4 client.15039 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:25:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594d296b4b0 con 0x5594d26761c0 2024-05-14T12:25:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.948+0000 7f8bf5000640 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26761c0 0x5594d2b054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.949+0000 7f8bf5000640 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26761c0 0x5594d2b054c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46b205ff088887d3 server_cookie=9e27c6d9924376ca in_seq=0 out_seq=0 2024-05-14T12:25:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.949+0000 7f8bd6a00640 10 client.15039 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bd6a00640 1 -- 172.21.15.47:0/3484890362 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594d296b4b0 con 0x5594d26761c0 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bd6a00640 10 client.15039 handle_command_reply: tid=0 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 client.15039 shutdown 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26c14d0 msgr2=0x5594d2a919d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26c14d0 0x5594d2a919d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0a9bb0 tx=0x7f8bdc0a9c60 comp rx=0 tx=0).stop 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 shutdown_connections 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5594d26761c0 0x5594d2b054c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5594d26e21b0 0x5594d2a91f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5594d26c14d0 0x5594d2a919d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bd6a00640 0 client.15039 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 --2- 172.21.15.47:0/3484890362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5594d26b92f0 0x5594d2a94e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 >> 172.21.15.47:0/3484890362 conn(0x5594d26d6300 msgr2=0x5594d2a834c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 shutdown_connections 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 1 -- 172.21.15.47:0/3484890362 wait complete. 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.962+0000 7f8bfea1f740 20 client.15039 trim_cache size 0 max 16384 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:25:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:25:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8bd80b28a0 msgr2=0x7f8bd80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8bd80b28a0 0x7f8bd80b4db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5594d2a854d0 tx=0x7f8be802f490 comp rx=0 tx=0).stop 2024-05-14T12:25:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf0104ce0 msgr2=0x7f8bf019c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf0104ce0 0x7f8bf019c870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9f0 tx=0x7f8bdc00eeb0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 shutdown_connections 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8bd80b28a0 0x7f8bd80b4db0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bf01099e0 0x7f8bf01a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf0104ce0 0x7f8bf019c870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 --2- 172.21.15.47:0/3333330662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf0103aa0 0x7f8bf019c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 >> 172.21.15.47:0/3333330662 conn(0x7f8bf00fecb0 msgr2=0x7f8bf00ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.963+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 shutdown_connections 2024-05-14T12:25:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:23.964+0000 7f8bf6400640 1 -- 172.21.15.47:0/3333330662 wait complete. 2024-05-14T12:25:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:23 smithi073 ceph-mon[35809]: from='client.25150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T12:25:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:23 smithi073 ceph-mon[35809]: pgmap v456: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T12:25:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:25:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:25:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:25:25.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 -- 172.21.15.47:0/3220444217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa0108f20 msgr2=0x7fcaa0109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3220444217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa0108f20 0x7fcaa0109330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009990 tx=0x7fca8c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 -- 172.21.15.47:0/3220444217 shutdown_connections 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3220444217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaa0109870 0x7fcaa01111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3220444217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa01045f0 0x7fcaa0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3220444217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa0108f20 0x7fcaa0109330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 -- 172.21.15.47:0/3220444217 >> 172.21.15.47:0/3220444217 conn(0x7fcaa0100040 msgr2=0x7fcaa0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 -- 172.21.15.47:0/3220444217 shutdown_connections 2024-05-14T12:25:25.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.689+0000 7fcaa6800700 1 -- 172.21.15.47:0/3220444217 wait complete. 2024-05-14T12:25:25.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:25 smithi047 ceph-mon[31254]: pgmap v457: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-14T12:25:25.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.690+0000 7fcaa6800700 1 Processor -- start 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.690+0000 7fcaa6800700 1 -- start start 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fcaa6800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa01045f0 0x7fcaa019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fcaa6800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0108f20 0x7fcaa019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fcaa6800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaa0109870 0x7fcaa019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fcaa6800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa01144d0 con 0x7fcaa0109870 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fcaa6800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0114350 con 0x7fcaa01045f0 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fcaa6800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0114650 con 0x7fcaa0108f20 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fca9f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa01045f0 0x7fcaa019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fca9f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa01045f0 0x7fcaa019af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40640/0 (socket says 172.21.15.47:40640) 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fca9f400700 1 -- 172.21.15.47:0/3476651468 learned_addr learned my addr 172.21.15.47:0/3476651468 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fca9fe00700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaa0109870 0x7fcaa019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.691+0000 7fca9ea00700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0108f20 0x7fcaa019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:25.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.692+0000 7fca9f400700 1 -- 172.21.15.47:0/3476651468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0108f20 msgr2=0x7fcaa019b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:25.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.692+0000 7fca9f400700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0108f20 0x7fcaa019b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.692+0000 7fca9f400700 1 -- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaa0109870 msgr2=0x7fcaa019f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:25.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.692+0000 7fca9f400700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaa0109870 0x7fcaa019f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.692+0000 7fca9f400700 1 -- 172.21.15.47:0/3476651468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa019fdf0 con 0x7fcaa01045f0 2024-05-14T12:25:25.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.692+0000 7fca9f400700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa01045f0 0x7fcaa019af20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca9000e9a0 tx=0x7fca9000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:25.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.692+0000 7fca97e00700 1 -- 172.21.15.47:0/3476651468 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9000ca10 con 0x7fcaa01045f0 2024-05-14T12:25:25.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.693+0000 7fca97e00700 1 -- 172.21.15.47:0/3476651468 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca9000cbb0 con 0x7fcaa01045f0 2024-05-14T12:25:25.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.693+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa01a00e0 con 0x7fcaa01045f0 2024-05-14T12:25:25.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.693+0000 7fca97e00700 1 -- 172.21.15.47:0/3476651468 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90018680 con 0x7fcaa01045f0 2024-05-14T12:25:25.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.693+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa01a7a00 con 0x7fcaa01045f0 2024-05-14T12:25:25.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.694+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa00512c0 con 0x7fcaa01045f0 2024-05-14T12:25:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.697+0000 7fca97e00700 1 -- 172.21.15.47:0/3476651468 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fca90010430 con 0x7fcaa01045f0 2024-05-14T12:25:25.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.698+0000 7fca97e00700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fca840b2900 0x7fca840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:25.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.698+0000 7fca97e00700 1 -- 172.21.15.47:0/3476651468 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fca900e2680 con 0x7fcaa01045f0 2024-05-14T12:25:25.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.698+0000 7fca9ea00700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fca840b2900 0x7fca840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:25.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.699+0000 7fca9ea00700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fca840b2900 0x7fca840b4e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0103a60 tx=0x7fca8c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:25.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.700+0000 7fca97e00700 1 -- 172.21.15.47:0/3476651468 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fca900aa360 con 0x7fcaa01045f0 2024-05-14T12:25:25.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:25 smithi066 ceph-mon[35981]: pgmap v457: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-14T12:25:25.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.991+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaa019c280 con 0x7fcaa01045f0 2024-05-14T12:25:25.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.992+0000 7fca97e00700 1 -- 172.21.15.47:0/3476651468 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11919 (secure 0 0 0) 0x7fca900b23e0 con 0x7fcaa01045f0 2024-05-14T12:25:25.993 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:25:25.993 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:25:09.557616+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24535,24521,24517,24490,24502]},"id":1}]} 2024-05-14T12:25:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fca840b2900 msgr2=0x7fca840b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fca840b2900 0x7fca840b4e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0103a60 tx=0x7fca8c00b260 comp rx=0 tx=0).stop 2024-05-14T12:25:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa01045f0 msgr2=0x7fcaa019af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa01045f0 0x7fcaa019af20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca9000e9a0 tx=0x7fca9000ecb0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 shutdown_connections 2024-05-14T12:25:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fca840b2900 0x7fca840b4e10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaa0109870 0x7fcaa019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa01045f0 0x7fcaa019af20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 --2- 172.21.15.47:0/3476651468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0108f20 0x7fcaa019b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 >> 172.21.15.47:0/3476651468 conn(0x7fcaa0100040 msgr2=0x7fcaa0108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.996+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 shutdown_connections 2024-05-14T12:25:25.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:25.997+0000 7fcaa6800700 1 -- 172.21.15.47:0/3476651468 wait complete. 2024-05-14T12:25:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-05-14T12:25:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:25 smithi073 ceph-mon[35809]: pgmap v457: 97 pgs: 97 active+clean; 653 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-14T12:25:26.734 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:26 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3476651468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:26.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:26 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3476651468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:26.928 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:25:27.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:26 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3476651468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:27.405 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:27.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:27 smithi066 ceph-mon[35981]: pgmap v458: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-05-14T12:25:27.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:27 smithi047 ceph-mon[31254]: pgmap v458: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-05-14T12:25:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:27 smithi073 ceph-mon[35809]: pgmap v458: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-05-14T12:25:29.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 -- 172.21.15.47:0/1919451851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be010a990 msgr2=0x7f3be010ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 --2- 172.21.15.47:0/1919451851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be010a990 0x7f3be010ada0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009990 tx=0x7f3bcc009ca0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 -- 172.21.15.47:0/1919451851 shutdown_connections 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 --2- 172.21.15.47:0/1919451851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 0x7f3be0117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 --2- 172.21.15.47:0/1919451851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be0110970 0x7f3be0110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 --2- 172.21.15.47:0/1919451851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be010a990 0x7f3be010ada0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 -- 172.21.15.47:0/1919451851 >> 172.21.15.47:0/1919451851 conn(0x7f3be0077c80 msgr2=0x7f3be00780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.640+0000 7f3be7400700 1 -- 172.21.15.47:0/1919451851 shutdown_connections 2024-05-14T12:25:29.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.641+0000 7f3be7400700 1 -- 172.21.15.47:0/1919451851 wait complete. 2024-05-14T12:25:29.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.642+0000 7f3be7400700 1 Processor -- start 2024-05-14T12:25:29.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.642+0000 7f3be7400700 1 -- start start 2024-05-14T12:25:29.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.642+0000 7f3be7400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be010a990 0x7f3be01a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.642+0000 7f3be7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 0x7f3be01a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3be7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be0110970 0x7f3be01a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3be7400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3be011aa90 con 0x7f3be0110970 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3be7400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3be011a910 con 0x7f3be010b2e0 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3be7400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3be011ac10 con 0x7f3be010a990 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 0x7f3be01a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 0x7f3be01a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:42070/0 (socket says 172.21.15.47:42070) 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 -- 172.21.15.47:0/3772387222 learned_addr learned my addr 172.21.15.47:0/3772387222 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3be4a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be010a990 0x7f3be01a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3be5400700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be0110970 0x7f3be01a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:29.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 -- 172.21.15.47:0/3772387222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be010a990 msgr2=0x7f3be01a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:29.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be010a990 0x7f3be01a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 -- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be0110970 msgr2=0x7f3be01a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:29.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be0110970 0x7f3be01a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3bdfe00700 1 -- 172.21.15.47:0/3772387222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be01a6330 con 0x7f3be010b2e0 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.643+0000 7f3be4a00700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be010a990 0x7f3be01a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.644+0000 7f3bdfe00700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 0x7f3be01a1a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.644+0000 7f3bdd600700 1 -- 172.21.15.47:0/3772387222 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc026070 con 0x7f3be010b2e0 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.644+0000 7f3bdd600700 1 -- 172.21.15.47:0/3772387222 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bcc021410 con 0x7f3be010b2e0 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.644+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be01a65c0 con 0x7f3be010b2e0 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.644+0000 7f3bdd600700 1 -- 172.21.15.47:0/3772387222 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc017650 con 0x7f3be010b2e0 2024-05-14T12:25:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.644+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be01adf40 con 0x7f3be010b2e0 2024-05-14T12:25:29.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.645+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be010c080 con 0x7f3be010b2e0 2024-05-14T12:25:29.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.648+0000 7f3bdd600700 1 -- 172.21.15.47:0/3772387222 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3bcc029070 con 0x7f3be010b2e0 2024-05-14T12:25:29.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.649+0000 7f3bdd600700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3bc80b2900 0x7f3bc80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:29.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.650+0000 7f3bdd600700 1 -- 172.21.15.47:0/3772387222 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3bcc0e2f10 con 0x7f3be010b2e0 2024-05-14T12:25:29.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.650+0000 7f3be4a00700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3bc80b2900 0x7f3bc80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:29.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.651+0000 7f3be4a00700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3bc80b2900 0x7f3bc80b4e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3be007d0f0 tx=0x7f3bd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:29.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.654+0000 7f3bdd600700 1 -- 172.21.15.47:0/3772387222 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3bcc013070 con 0x7f3be010b2e0 2024-05-14T12:25:29.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:29 smithi066 ceph-mon[35981]: pgmap v459: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-14T12:25:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.942+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3be002e5f0 con 0x7f3be010b2e0 2024-05-14T12:25:29.942 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:29 smithi047 ceph-mon[31254]: pgmap v459: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-14T12:25:29.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.943+0000 7f3bdd600700 1 -- 172.21.15.47:0/3772387222 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11919 (secure 0 0 0) 0x7f3bcc0aac80 con 0x7f3be010b2e0 2024-05-14T12:25:29.943 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:25:29.943 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:25:09.557616+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24535,24521,24517,24490,24502]},"id":1}]} 2024-05-14T12:25:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3bc80b2900 msgr2=0x7f3bc80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3bc80b2900 0x7f3bc80b4e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3be007d0f0 tx=0x7f3bd4009260 comp rx=0 tx=0).stop 2024-05-14T12:25:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 msgr2=0x7f3be01a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 0x7f3be01a1a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc009510 comp rx=0 tx=0).stop 2024-05-14T12:25:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 shutdown_connections 2024-05-14T12:25:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3bc80b2900 0x7f3bc80b4e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3be0110970 0x7f3be01a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be010a990 0x7f3be01a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 --2- 172.21.15.47:0/3772387222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3be010b2e0 0x7f3be01a1a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.946+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 >> 172.21.15.47:0/3772387222 conn(0x7f3be0077c80 msgr2=0x7f3be007b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.947+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 shutdown_connections 2024-05-14T12:25:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:29.947+0000 7f3be7400700 1 -- 172.21.15.47:0/3772387222 wait complete. 2024-05-14T12:25:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-05-14T12:25:30.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:29 smithi073 ceph-mon[35809]: pgmap v459: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-14T12:25:30.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:30 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3772387222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:30.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:30 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3772387222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:30.920 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:25:31.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:30 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3772387222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:31.383 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:31.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:31 smithi047 ceph-mon[31254]: pgmap v460: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-14T12:25:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:31 smithi073 ceph-mon[35809]: pgmap v460: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-14T12:25:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:31 smithi066 ceph-mon[35981]: pgmap v460: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-14T12:25:33.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 -- 172.21.15.47:0/2785118886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8108740 msgr2=0x7f02f81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:33.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 --2- 172.21.15.47:0/2785118886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8108740 0x7f02f81100a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f02f000b0d0 tx=0x7f02f000b3e0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:33 smithi047 ceph-mon[31254]: pgmap v461: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-14T12:25:33.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 -- 172.21.15.47:0/2785118886 shutdown_connections 2024-05-14T12:25:33.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 --2- 172.21.15.47:0/2785118886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8108740 0x7f02f81100a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 --2- 172.21.15.47:0/2785118886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 0x7f02f81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 --2- 172.21.15.47:0/2785118886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f8107df0 0x7f02f8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 -- 172.21.15.47:0/2785118886 >> 172.21.15.47:0/2785118886 conn(0x7f02f80fedc0 msgr2=0x7f02f81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 -- 172.21.15.47:0/2785118886 shutdown_connections 2024-05-14T12:25:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.734+0000 7f02fee00700 1 -- 172.21.15.47:0/2785118886 wait complete. 2024-05-14T12:25:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 Processor -- start 2024-05-14T12:25:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 -- start start 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 0x7f02f819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8107df0 0x7f02f819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f8108740 0x7f02f81a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81133c0 con 0x7f02f8107df0 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8113240 con 0x7f02f81034c0 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.736+0000 7f02fee00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8113540 con 0x7f02f8108740 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 0x7f02f819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8107df0 0x7f02f819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 0x7f02f819d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:42082/0 (socket says 172.21.15.47:42082) 2024-05-14T12:25:33.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 -- 172.21.15.47:0/3213795964 learned_addr learned my addr 172.21.15.47:0/3213795964 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02fce00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f8108740 0x7f02f81a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 -- 172.21.15.47:0/3213795964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f8108740 msgr2=0x7f02f81a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f8108740 0x7f02f81a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 -- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8107df0 msgr2=0x7f02f819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8107df0 0x7f02f819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.737+0000 7f02f7e00700 1 -- 172.21.15.47:0/3213795964 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f81a1f00 con 0x7f02f81034c0 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.738+0000 7f02f7e00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 0x7f02f819d080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02e800eb30 tx=0x7f02e800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.738+0000 7f02f4c00700 1 -- 172.21.15.47:0/3213795964 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e800cbd0 con 0x7f02f81034c0 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.738+0000 7f02f4c00700 1 -- 172.21.15.47:0/3213795964 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02e80044d0 con 0x7f02f81034c0 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.738+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f81a21f0 con 0x7f02f81034c0 2024-05-14T12:25:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.738+0000 7f02f4c00700 1 -- 172.21.15.47:0/3213795964 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8003e30 con 0x7f02f81034c0 2024-05-14T12:25:33.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.738+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f81a9b10 con 0x7f02f81034c0 2024-05-14T12:25:33.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.739+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f80512c0 con 0x7f02f81034c0 2024-05-14T12:25:33.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.742+0000 7f02f4c00700 1 -- 172.21.15.47:0/3213795964 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f02e8004000 con 0x7f02f81034c0 2024-05-14T12:25:33.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.743+0000 7f02f4c00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f02dc0b2880 0x7f02dc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:33.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.744+0000 7f02f4c00700 1 -- 172.21.15.47:0/3213795964 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f02e80e25e0 con 0x7f02f81034c0 2024-05-14T12:25:33.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.744+0000 7f02f7400700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f02dc0b2880 0x7f02dc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:33.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.745+0000 7f02f7400700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f02dc0b2880 0x7f02dc0b4d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02f8109890 tx=0x7f02e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:33.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.748+0000 7f02f4c00700 1 -- 172.21.15.47:0/3213795964 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f02e80042f0 con 0x7f02f81034c0 2024-05-14T12:25:33.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.986+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02f81a9ce0 con 0x7f02f81034c0 2024-05-14T12:25:33.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.988+0000 7f02f4c00700 1 -- 172.21.15.47:0/3213795964 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7f02e80aa2c0 con 0x7f02f81034c0 2024-05-14T12:25:33.989 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:25:33.989 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:25:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f02dc0b2880 msgr2=0x7f02dc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f02dc0b2880 0x7f02dc0b4d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02f8109890 tx=0x7f02e4009260 comp rx=0 tx=0).stop 2024-05-14T12:25:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 msgr2=0x7f02f819d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 0x7f02f819d080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02e800eb30 tx=0x7f02e800ee40 comp rx=0 tx=0).stop 2024-05-14T12:25:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 shutdown_connections 2024-05-14T12:25:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f02dc0b2880 0x7f02dc0b4d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f8108740 0x7f02f81a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f81034c0 0x7f02f819d080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 --2- 172.21.15.47:0/3213795964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02f8107df0 0x7f02f819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:33.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.992+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 >> 172.21.15.47:0/3213795964 conn(0x7f02f80fedc0 msgr2=0x7f02f806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:33.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.993+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 shutdown_connections 2024-05-14T12:25:33.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:33.993+0000 7f02fee00700 1 -- 172.21.15.47:0/3213795964 wait complete. 2024-05-14T12:25:34.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:33 smithi073 ceph-mon[35809]: pgmap v461: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-14T12:25:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:33 smithi066 ceph-mon[35981]: pgmap v461: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-14T12:25:34.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:34 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3213795964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:25:34.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-05-14T12:25:35.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:34 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3213795964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:25:35.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:34 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3213795964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:25:35.340 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:35.847 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:35 smithi047 ceph-mon[31254]: pgmap v462: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-14T12:25:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:35 smithi073 ceph-mon[35809]: pgmap v462: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-14T12:25:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:35 smithi066 ceph-mon[35981]: pgmap v462: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 -- 172.21.15.47:0/4267978366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc1036d0 msgr2=0x7f41dc103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 --2- 172.21.15.47:0/4267978366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc1036d0 0x7f41dc103ba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009ca0 tx=0x7f41d402a8c0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 -- 172.21.15.47:0/4267978366 shutdown_connections 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 --2- 172.21.15.47:0/4267978366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc1036d0 0x7f41dc103ba0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 --2- 172.21.15.47:0/4267978366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41dc102b70 0x7f41dc103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 --2- 172.21.15.47:0/4267978366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41dc102190 0x7f41dc1025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 -- 172.21.15.47:0/4267978366 >> 172.21.15.47:0/4267978366 conn(0x7f41dc0fdd60 msgr2=0x7f41dc1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 -- 172.21.15.47:0/4267978366 shutdown_connections 2024-05-14T12:25:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.194+0000 7f41e1800640 1 -- 172.21.15.47:0/4267978366 wait complete. 2024-05-14T12:25:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.195+0000 7f41e1800640 1 Processor -- start 2024-05-14T12:25:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41e1800640 1 -- start start 2024-05-14T12:25:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41e1800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc102190 0x7f41dc19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41e1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41dc102b70 0x7f41dc19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41e1800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41dc1036d0 0x7f41dc1a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41e1800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc111880 con 0x7f41dc102b70 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41e1800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc111700 con 0x7f41dc1036d0 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41e1800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc111a00 con 0x7f41dc102190 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41daa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc102190 0x7f41dc19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41daa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc102190 0x7f41dc19c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56562/0 (socket says 172.21.15.47:56562) 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.196+0000 7f41da000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41dc102b70 0x7f41dc19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41daa00640 1 -- 172.21.15.47:0/553310135 learned_addr learned my addr 172.21.15.47:0/553310135 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41db400640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41dc1036d0 0x7f41dc1a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41daa00640 1 -- 172.21.15.47:0/553310135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41dc1036d0 msgr2=0x7f41dc1a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41daa00640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41dc1036d0 0x7f41dc1a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41daa00640 1 -- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41dc102b70 msgr2=0x7f41dc19c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41daa00640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41dc102b70 0x7f41dc19c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41daa00640 1 -- 172.21.15.47:0/553310135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc1a3ee0 con 0x7f41dc102190 2024-05-14T12:25:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41da000640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41dc102b70 0x7f41dc19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:25:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.197+0000 7f41daa00640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc102190 0x7f41dc19c3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00e9f0 tx=0x7f41cc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.198+0000 7f41d3400640 1 -- 172.21.15.47:0/553310135 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00cd80 con 0x7f41dc102190 2024-05-14T12:25:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.198+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc1a41d0 con 0x7f41dc102190 2024-05-14T12:25:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.198+0000 7f41d3400640 1 -- 172.21.15.47:0/553310135 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41cc0054d0 con 0x7f41dc102190 2024-05-14T12:25:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.198+0000 7f41d3400640 1 -- 172.21.15.47:0/553310135 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc010690 con 0x7f41dc102190 2024-05-14T12:25:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.198+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc1a4720 con 0x7f41dc102190 2024-05-14T12:25:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.202+0000 7f41d3400640 1 -- 172.21.15.47:0/553310135 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f41cc010830 con 0x7f41dc102190 2024-05-14T12:25:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.202+0000 7f41e87fa740 1 Processor -- start 2024-05-14T12:25:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.203+0000 7f41e87fa740 1 -- start start 2024-05-14T12:25:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.203+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.203+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2be680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.203+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.203+0000 7f41e87fa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55783f222550 con 0x55783eefb4d0 2024-05-14T12:25:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.203+0000 7f41e87fa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55783f1c7bc0 con 0x55783eef32f0 2024-05-14T12:25:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.203+0000 7f41e87fa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55783f21e510 con 0x55783ef1c1b0 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2be680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:42108/0 (socket says 172.21.15.47:42108) 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 -- 172.21.15.47:0/2223644809 learned_addr learned my addr 172.21.15.47:0/2223644809 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41db400640 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41da000640 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 -- 172.21.15.47:0/2223644809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 msgr2=0x55783f2be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 -- 172.21.15.47:0/2223644809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 msgr2=0x55783f2c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.204+0000 7f41daa00640 1 -- 172.21.15.47:0/2223644809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783ef34210 con 0x55783eef32f0 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.205+0000 7f41daa00640 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2be680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0e8a90 tx=0x7f41cc0e8b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d3841041b8f549 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.205+0000 7f41d3400640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41c00b2920 0x7f41c00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.205+0000 7f41c7e00640 1 -- 172.21.15.47:0/2223644809 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0a9670 con 0x55783eef32f0 2024-05-14T12:25:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.205+0000 7f41c7e00640 1 -- 172.21.15.47:0/2223644809 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41cc0f2020 con 0x55783eef32f0 2024-05-14T12:25:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.205+0000 7f41c7e00640 1 -- 172.21.15.47:0/2223644809 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0a9860 con 0x55783eef32f0 2024-05-14T12:25:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.205+0000 7f41db400640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41c00b2920 0x7f41c00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.205+0000 7f41d3400640 1 -- 172.21.15.47:0/553310135 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f41cc0e2740 con 0x7f41dc102190 2024-05-14T12:25:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 -- 172.21.15.47:0/2223644809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 msgr2=0x55783f2be680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2be680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0e8a90 tx=0x7f41cc0e8b80 comp rx=0 tx=0).stop 2024-05-14T12:25:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41db400640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41c00b2920 0x7f41c00b4e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f41d402f500 tx=0x7f41d4031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 -- 172.21.15.47:0/2223644809 shutdown_connections 2024-05-14T12:25:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2be680 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 --2- 172.21.15.47:0/2223644809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 -- 172.21.15.47:0/2223644809 >> 172.21.15.47:0/2223644809 conn(0x55783ef10300 msgr2=0x55783f2b9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 -- 172.21.15.47:0/2223644809 shutdown_connections 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.206+0000 7f41e87fa740 1 -- 172.21.15.47:0/2223644809 wait complete. 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.207+0000 7f41e87fa740 1 -- start start 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.207+0000 7f41e87fa740 1 Processor -- start 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.208+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.208+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.208+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.208+0000 7f41e87fa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55783f2c5fd0 con 0x55783eefb4d0 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.208+0000 7f41e87fa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55783f1db660 con 0x55783eef32f0 2024-05-14T12:25:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.208+0000 7f41e87fa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55783f2c6150 con 0x55783ef1c1b0 2024-05-14T12:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.208+0000 7f41e87fa740 10 client.0 _ll_register_callbacks cb 0x55783f1a5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41da000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:42114/0 (socket says 172.21.15.47:42114) 2024-05-14T12:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 -- 172.21.15.47:0/3856246922 learned_addr learned my addr 172.21.15.47:0/3856246922 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41db400640 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 -- 172.21.15.47:0/3856246922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 msgr2=0x55783f2cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 -- 172.21.15.47:0/3856246922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 msgr2=0x55783f2c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 -- 172.21.15.47:0/3856246922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783f000620 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41db400640 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41daa00640 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7b70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0a9cb0 tx=0x7f41cc009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80da029fce5eb051 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.209+0000 7f41c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41c4c00640 1 -- 172.21.15.47:0/3856246922 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0f1060 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41c4c00640 1 -- 172.21.15.47:0/3856246922 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f41cc01c9b0 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41cc0f2020 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41c4c00640 1 -- 172.21.15.47:0/3856246922 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f41cc0c0020 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41e87fa740 10 client.25175 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55783f2d1f40 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41c4c00640 1 -- 172.21.15.47:0/3856246922 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41cc0f2020 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.210+0000 7f41c4c00640 1 -- 172.21.15.47:0/3856246922 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f41cc016330 con 0x55783eef32f0 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.211+0000 7f41e87fa740 10 client.25175 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.211+0000 7f41e87fa740 10 client.25175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.211+0000 7f41e87fa740 20 client.25175 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.211+0000 7f41e87fa740 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eedad80 0x55783f2d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.211+0000 7f41e87fa740 4 client.25175 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.211+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55783f230160 con 0x55783eedad80 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.211+0000 7f41da000640 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eedad80 0x55783f2d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.212+0000 7f41da000640 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eedad80 0x55783f2d52a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45057620bf08144a server_cookie=792bab54df4dca1b in_seq=0 out_seq=0 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.212+0000 7f41c4c00640 10 client.25175 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41c4c00640 1 -- 172.21.15.47:0/3856246922 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55783f230160 con 0x55783eedad80 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41c4c00640 10 client.25175 handle_command_reply: tid=0 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 client.25175 shutdown 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 msgr2=0x55783f2c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7b70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0a9cb0 tx=0x7f41cc009790 comp rx=0 tx=0).stop 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 shutdown_connections 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eedad80 0x55783f2d52a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41c4c00640 0 client.25175 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eefb4d0 0x55783f2c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 --2- 172.21.15.47:0/3856246922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7b70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.213+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 >> 172.21.15.47:0/3856246922 conn(0x55783ef10300 msgr2=0x55783f2bc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.214+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 shutdown_connections 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.214+0000 7f41e87fa740 1 -- 172.21.15.47:0/3856246922 wait complete. 2024-05-14T12:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.214+0000 7f41e87fa740 20 client.25175 trim_cache size 0 max 16384 2024-05-14T12:25:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 Processor -- start 2024-05-14T12:25:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 -- start start 2024-05-14T12:25:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783eefb4d0 0x55783f2cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783ef1c1b0 0x55783f2b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc1ad510 con 0x55783ef1c1b0 2024-05-14T12:25:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc1af050 con 0x55783eef32f0 2024-05-14T12:25:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.231+0000 7f41e87fa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc1adbe0 con 0x55783eefb4d0 2024-05-14T12:25:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783eefb4d0 0x55783f2cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41db400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783ef1c1b0 0x55783f2b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41db400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783ef1c1b0 0x55783f2b9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57332/0 (socket says 172.21.15.47:57332) 2024-05-14T12:25:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783eefb4d0 0x55783f2cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56592/0 (socket says 172.21.15.47:56592) 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41db400640 1 -- 172.21.15.47:0/4019509594 learned_addr learned my addr 172.21.15.47:0/4019509594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41daa00640 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 -- 172.21.15.47:0/4019509594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 msgr2=0x55783f2c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 -- 172.21.15.47:0/4019509594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783ef1c1b0 msgr2=0x55783f2b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783ef1c1b0 0x55783f2b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 -- 172.21.15.47:0/4019509594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783f2c5350 con 0x55783eefb4d0 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.232+0000 7f41da000640 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783eefb4d0 0x55783f2cefa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55783f2d58b0 tx=0x7f41c8004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc9900116f6e1b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.233+0000 7f41c7400640 1 -- 172.21.15.47:0/4019509594 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8003de0 con 0x55783eefb4d0 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.233+0000 7f41c7400640 1 -- 172.21.15.47:0/4019509594 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41c8022070 con 0x55783eefb4d0 2024-05-14T12:25:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.233+0000 7f41c7400640 1 -- 172.21.15.47:0/4019509594 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8011ac0 con 0x55783eefb4d0 2024-05-14T12:25:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 -- 172.21.15.47:0/4019509594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783eefb4d0 msgr2=0x55783f2cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783eefb4d0 0x55783f2cefa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55783f2d58b0 tx=0x7f41c8004410 comp rx=0 tx=0).stop 2024-05-14T12:25:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 -- 172.21.15.47:0/4019509594 shutdown_connections 2024-05-14T12:25:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783ef1c1b0 0x55783f2b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783eefb4d0 0x55783f2cefa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 --2- 172.21.15.47:0/4019509594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eef32f0 0x55783f2c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 -- 172.21.15.47:0/4019509594 >> 172.21.15.47:0/4019509594 conn(0x55783ef10300 msgr2=0x55783f2c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 -- 172.21.15.47:0/4019509594 shutdown_connections 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.234+0000 7f41e87fa740 1 -- 172.21.15.47:0/4019509594 wait complete. 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 -- start start 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 Processor -- start 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eef32f0 0x55783f2cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eefb4d0 0x55783f2ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc1ae980 con 0x55783eef32f0 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc1ae2b0 con 0x55783eefb4d0 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc1ab4d0 con 0x55783ef1c1b0 2024-05-14T12:25:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.235+0000 7f41e87fa740 10 client.0 _ll_register_callbacks cb 0x7f41cc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eefb4d0 0x55783f2ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eefb4d0 0x55783f2ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:42138/0 (socket says 172.21.15.47:42138) 2024-05-14T12:25:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41daa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eef32f0 0x55783f2cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 -- 172.21.15.47:0/1756589891 learned_addr learned my addr 172.21.15.47:0/1756589891 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41db400640 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 -- 172.21.15.47:0/1756589891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 msgr2=0x55783f2cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 -- 172.21.15.47:0/1756589891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eef32f0 msgr2=0x55783f2cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eef32f0 0x55783f2cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.236+0000 7f41da000640 1 -- 172.21.15.47:0/1756589891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783f2ce020 con 0x55783eefb4d0 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41da000640 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eefb4d0 0x55783f2ccb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009410 tx=0x7f41c8011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74101e2dcc1c0298 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41c4c00640 1 -- 172.21.15.47:0/1756589891 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8005230 con 0x55783eefb4d0 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41c8022070 con 0x55783eefb4d0 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41c4c00640 1 -- 172.21.15.47:0/1756589891 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f41c80053d0 con 0x55783eefb4d0 2024-05-14T12:25:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41c4c00640 1 -- 172.21.15.47:0/1756589891 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f41c8037050 con 0x55783eefb4d0 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41e87fa740 10 client.25181 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.237+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55783f33d520 con 0x55783eefb4d0 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41c4c00640 1 -- 172.21.15.47:0/1756589891 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41c8022070 con 0x55783eefb4d0 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41c4c00640 1 -- 172.21.15.47:0/1756589891 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f41c801d830 con 0x55783eefb4d0 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41e87fa740 10 client.25181 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41e87fa740 10 client.25181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41e87fa740 20 client.25181 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41e87fa740 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eeb01c0 0x55783f33fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41e87fa740 4 client.25181 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55783f229fd0 con 0x55783eeb01c0 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.238+0000 7f41daa00640 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eeb01c0 0x55783f33fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.239+0000 7f41daa00640 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eeb01c0 0x55783f33fdd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=516e8cdc9c0ae75d server_cookie=89f652606d5d8a74 in_seq=0 out_seq=0 2024-05-14T12:25:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.239+0000 7f41c4c00640 10 client.25181 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:37.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.246+0000 7f41c4c00640 1 -- 172.21.15.47:0/1756589891 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55783f229fd0 con 0x55783eeb01c0 2024-05-14T12:25:37.246 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.246+0000 7f41c4c00640 10 client.25181 handle_command_reply: tid=0 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.246+0000 7f41e87fa740 1 client.25181 shutdown 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.246+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eefb4d0 msgr2=0x55783f2ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.246+0000 7f41e87fa740 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eefb4d0 0x55783f2ccb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009410 tx=0x7f41c8011440 comp rx=0 tx=0).stop 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 shutdown_connections 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55783eeb01c0 0x55783f33fdd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55783ef1c1b0 0x55783f2cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783eefb4d0 0x55783f2ccb30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 --2- 172.21.15.47:0/1756589891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55783eef32f0 0x55783f2cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41c4c00640 0 client.25181 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 >> 172.21.15.47:0/1756589891 conn(0x55783ef10300 msgr2=0x55783f2b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 shutdown_connections 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 1 -- 172.21.15.47:0/1756589891 wait complete. 2024-05-14T12:25:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.247+0000 7f41e87fa740 20 client.25181 trim_cache size 0 max 16384 2024-05-14T12:25:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:25:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:25:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:25:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:25:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41c00b2920 msgr2=0x7f41c00b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41c00b2920 0x7f41c00b4e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f41d402f500 tx=0x7f41d4031af0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc102190 msgr2=0x7f41dc19c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc102190 0x7f41dc19c3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00e9f0 tx=0x7f41cc00edf0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 shutdown_connections 2024-05-14T12:25:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f41c00b2920 0x7f41c00b4e30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41dc1036d0 0x7f41dc1a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41dc102b70 0x7f41dc19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 --2- 172.21.15.47:0/553310135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41dc102190 0x7f41dc19c3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 >> 172.21.15.47:0/553310135 conn(0x7f41dc0fdd60 msgr2=0x7f41dc10a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 shutdown_connections 2024-05-14T12:25:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:37.248+0000 7f41e1800640 1 -- 172.21.15.47:0/553310135 wait complete. 2024-05-14T12:25:37.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:37 smithi047 ceph-mon[31254]: pgmap v463: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-14T12:25:38.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:37 smithi073 ceph-mon[35809]: pgmap v463: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-14T12:25:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:37 smithi066 ceph-mon[35981]: pgmap v463: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-14T12:25:38.621 INFO:teuthology.orchestra.run.smithi047.stdout:{"run_dir":"/var/run/ceph"} 2024-05-14T12:25:38.621 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-14T12:25:38.622 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 6285 2024-05-14T12:25:38.622 DEBUG:tasks.quiescer:Yielding 2024-05-14T12:25:38.622 INFO:teuthology.run_tasks:Running task workunit... 2024-05-14T12:25:38.636 INFO:tasks.workunit:Pulling workunits from ref e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:25:38.636 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-14T12:25:38.636 INFO:tasks.workunit:timeout=3h 2024-05-14T12:25:38.636 INFO:tasks.workunit:cleanup=True 2024-05-14T12:25:38.636 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:38.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-14 12:21:42.119114488 +0000 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-14 12:21:42.119114488 +0000 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-14 12:25:08.391688944 +0000 2024-05-14T12:25:38.689 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-14 12:21:42.119114488 +0000 2024-05-14T12:25:38.689 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-14T12:25:38.690 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-14T12:25:38.824 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T12:25:38.880 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-14T12:25:39.116 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:39.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:39 smithi047 ceph-mon[31254]: pgmap v464: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 340 B/s wr, 10 op/s 2024-05-14T12:25:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:39 smithi073 ceph-mon[35809]: pgmap v464: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 340 B/s wr, 10 op/s 2024-05-14T12:25:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:39 smithi066 ceph-mon[35981]: pgmap v464: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 340 B/s wr, 10 op/s 2024-05-14T12:25:41.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 -- 172.21.15.47:0/3021104650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 msgr2=0x7fa054114af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 --2- 172.21.15.47:0/3021104650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 0x7fa054114af0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa040009990 tx=0x7fa040009ca0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 -- 172.21.15.47:0/3021104650 shutdown_connections 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 --2- 172.21.15.47:0/3021104650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa054115030 0x7fa054117450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 --2- 172.21.15.47:0/3021104650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 0x7fa054078100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 --2- 172.21.15.47:0/3021104650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 0x7fa054114af0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 -- 172.21.15.47:0/3021104650 >> 172.21.15.47:0/3021104650 conn(0x7fa054102030 msgr2=0x7fa054104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.524+0000 7fa05b000700 1 -- 172.21.15.47:0/3021104650 shutdown_connections 2024-05-14T12:25:41.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.525+0000 7fa05b000700 1 -- 172.21.15.47:0/3021104650 wait complete. 2024-05-14T12:25:41.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.526+0000 7fa05b000700 1 Processor -- start 2024-05-14T12:25:41.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.526+0000 7fa05b000700 1 -- start start 2024-05-14T12:25:41.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa05b000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 0x7fa0541a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:41.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa05b000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 0x7fa0541a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:41.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa05b000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa054115030 0x7fa0541a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:41.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa05b000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa05411a8c0 con 0x7fa054078640 2024-05-14T12:25:41.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa05b000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa05411a740 con 0x7fa054115030 2024-05-14T12:25:41.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa05b000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa05411aa40 con 0x7fa054077cf0 2024-05-14T12:25:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 0x7fa0541a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 0x7fa0541a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa05a600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa054115030 0x7fa0541a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:41.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 0x7fa0541a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:57772/0 (socket says 172.21.15.47:57772) 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059c00700 1 -- 172.21.15.47:0/389439990 learned_addr learned my addr 172.21.15.47:0/389439990 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 0x7fa0541a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40752/0 (socket says 172.21.15.47:40752) 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059c00700 1 -- 172.21.15.47:0/389439990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa054115030 msgr2=0x7fa0541a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059c00700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa054115030 0x7fa0541a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.527+0000 7fa059c00700 1 -- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 msgr2=0x7fa0541a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa059c00700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 0x7fa0541a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa059c00700 1 -- 172.21.15.47:0/389439990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0541a6100 con 0x7fa054077cf0 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa059c00700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 0x7fa0541a1230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa04800e9c0 tx=0x7fa04800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa052000700 1 -- 172.21.15.47:0/389439990 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04800cbd0 con 0x7fa054077cf0 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0541a63f0 con 0x7fa054077cf0 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa052000700 1 -- 172.21.15.47:0/389439990 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa04800ee50 con 0x7fa054077cf0 2024-05-14T12:25:41.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa052000700 1 -- 172.21.15.47:0/389439990 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048005550 con 0x7fa054077cf0 2024-05-14T12:25:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.528+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0541add10 con 0x7fa054077cf0 2024-05-14T12:25:41.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.530+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0540512c0 con 0x7fa054077cf0 2024-05-14T12:25:41.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.532+0000 7fa052000700 1 -- 172.21.15.47:0/389439990 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa048047960 con 0x7fa054077cf0 2024-05-14T12:25:41.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.534+0000 7fa052000700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa03c0b2880 0x7fa03c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:41.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.534+0000 7fa052000700 1 -- 172.21.15.47:0/389439990 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa0480e24a0 con 0x7fa054077cf0 2024-05-14T12:25:41.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.534+0000 7fa059200700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa03c0b2880 0x7fa03c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:41.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.535+0000 7fa059200700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa03c0b2880 0x7fa03c0b4d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa040006010 tx=0x7fa040005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:41.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.536+0000 7fa052000700 1 -- 172.21.15.47:0/389439990 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa0480aa180 con 0x7fa054077cf0 2024-05-14T12:25:41.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.828+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0541a2590 con 0x7fa054077cf0 2024-05-14T12:25:41.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:41 smithi047 ceph-mon[31254]: pgmap v465: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:25:41.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.829+0000 7fa052000700 1 -- 172.21.15.47:0/389439990 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11919 (secure 0 0 0) 0x7fa0480b2030 con 0x7fa054077cf0 2024-05-14T12:25:41.830 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:25:41.830 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:25:09.557616+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24535,24521,24517,24490,24502]},"id":1}]} 2024-05-14T12:25:41.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa03c0b2880 msgr2=0x7fa03c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:41.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa03c0b2880 0x7fa03c0b4d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa040006010 tx=0x7fa040005960 comp rx=0 tx=0).stop 2024-05-14T12:25:41.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 msgr2=0x7fa0541a1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 0x7fa0541a1230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa04800e9c0 tx=0x7fa04800ecd0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 shutdown_connections 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa03c0b2880 0x7fa03c0b4d90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa054115030 0x7fa0541a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa054077cf0 0x7fa0541a1230 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 --2- 172.21.15.47:0/389439990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa054078640 0x7fa0541a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.832+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 >> 172.21.15.47:0/389439990 conn(0x7fa054102030 msgr2=0x7fa05407ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.833+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 shutdown_connections 2024-05-14T12:25:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:41.833+0000 7fa05b000700 1 -- 172.21.15.47:0/389439990 wait complete. 2024-05-14T12:25:41.835 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-05-14T12:25:42.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:41 smithi073 ceph-mon[35809]: pgmap v465: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:25:42.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:41 smithi066 ceph-mon[35981]: pgmap v465: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:25:42.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-14T12:21:02.642705+0000', 'modified': '2024-05-14T12:25:09.557616+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24535, 'mds_1': 24521, 'mds_2': 24517, 'mds_3': 24502, 'mds_4': 24490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6833/3730098623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 3730098623}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 3730098623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6833/1120434141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 1120434141}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 1120434141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/2635749889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 2635749889}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 2635749889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'd', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.47:6837/1559121259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6836', 'nonce': 1559121259}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 1559121259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6837/2588925145', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 2588925145}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 2588925145}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.73:6835/263909949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 263909949}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 263909949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.73:6837/3629841248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3629841248}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3629841248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.73:6839/2008561705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 2008561705}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 2008561705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.66:6839/2700854370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2700854370}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2700854370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24535': {'gid': 24535, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.47:6841/3387131427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6840', 'nonce': 3387131427}, {'type': 'v1', 'addr': '172.21.15.47:6841', 'nonce': 3387131427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24535, 'qdb_cluster': [24535, 24521, 24517, 24490, 24502]} 2024-05-14T12:25:42.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-14T12:25:42.681 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.f status 2024-05-14T12:25:42.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:42 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/389439990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:43.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:42 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/389439990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:43.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:42 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/389439990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:25:43.173 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:43 smithi047 ceph-mon[31254]: pgmap v466: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-14T12:25:44.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:43 smithi073 ceph-mon[35809]: pgmap v466: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-14T12:25:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:43 smithi066 ceph-mon[35981]: pgmap v466: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-14T12:25:45.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.509+0000 7fe482000700 1 -- 172.21.15.47:0/2442023211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c110970 msgr2=0x7fe47c110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.509+0000 7fe482000700 1 --2- 172.21.15.47:0/2442023211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c110970 0x7fe47c110d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009990 tx=0x7fe46c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.510+0000 7fe482000700 1 -- 172.21.15.47:0/2442023211 shutdown_connections 2024-05-14T12:25:45.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.510+0000 7fe482000700 1 --2- 172.21.15.47:0/2442023211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe47c10b2e0 0x7fe47c117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.510+0000 7fe482000700 1 --2- 172.21.15.47:0/2442023211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c110970 0x7fe47c110d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.510+0000 7fe482000700 1 --2- 172.21.15.47:0/2442023211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe47c10a990 0x7fe47c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.510+0000 7fe482000700 1 -- 172.21.15.47:0/2442023211 >> 172.21.15.47:0/2442023211 conn(0x7fe47c077c80 msgr2=0x7fe47c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:45.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.510+0000 7fe482000700 1 -- 172.21.15.47:0/2442023211 shutdown_connections 2024-05-14T12:25:45.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.510+0000 7fe482000700 1 -- 172.21.15.47:0/2442023211 wait complete. 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.511+0000 7fe482000700 1 Processor -- start 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe482000700 1 -- start start 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe482000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c10a990 0x7fe47c1a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe482000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe47c10b2e0 0x7fe47c1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe482000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe47c110970 0x7fe47c1a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe482000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c11aa70 con 0x7fe47c10b2e0 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe482000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c11a8f0 con 0x7fe47c110970 2024-05-14T12:25:45.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe482000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c11abf0 con 0x7fe47c10a990 2024-05-14T12:25:45.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe47b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c10a990 0x7fe47c1a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe47aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe47c10b2e0 0x7fe47c1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe47b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c10a990 0x7fe47c1a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:57790/0 (socket says 172.21.15.47:57790) 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.512+0000 7fe47b400700 1 -- 172.21.15.47:0/1287097314 learned_addr learned my addr 172.21.15.47:0/1287097314 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.513+0000 7fe47be00700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe47c110970 0x7fe47c1a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.513+0000 7fe47b400700 1 -- 172.21.15.47:0/1287097314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe47c110970 msgr2=0x7fe47c1a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.513+0000 7fe47b400700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe47c110970 0x7fe47c1a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.513+0000 7fe47b400700 1 -- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe47c10b2e0 msgr2=0x7fe47c1a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.513+0000 7fe47b400700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe47c10b2e0 0x7fe47c1a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.513+0000 7fe47b400700 1 -- 172.21.15.47:0/1287097314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c1a6310 con 0x7fe47c10a990 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.513+0000 7fe47b400700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c10a990 0x7fe47c1a1440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0057c0 tx=0x7fe46c00bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.514+0000 7fe473e00700 1 -- 172.21.15.47:0/1287097314 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c027070 con 0x7fe47c10a990 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.514+0000 7fe473e00700 1 -- 172.21.15.47:0/1287097314 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe46c022470 con 0x7fe47c10a990 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.514+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47c1a65a0 con 0x7fe47c10a990 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.514+0000 7fe473e00700 1 -- 172.21.15.47:0/1287097314 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c017650 con 0x7fe47c10a990 2024-05-14T12:25:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.514+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47c1adf20 con 0x7fe47c10a990 2024-05-14T12:25:45.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.518+0000 7fe473e00700 1 -- 172.21.15.47:0/1287097314 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe46c02a070 con 0x7fe47c10a990 2024-05-14T12:25:45.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 Processor -- start 2024-05-14T12:25:45.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 -- start start 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f257660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f2516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f252010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d0f1739d0 con 0x557d0f257ba0 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557d0f111710 con 0x557d0f251c00 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.519+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d0f16f990 con 0x557d0f0d3df0 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f2516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f257660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f257660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:57798/0 (socket says 172.21.15.47:57798) 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f2516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40782/0 (socket says 172.21.15.47:40782) 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 -- 172.21.15.47:0/4138808342 learned_addr learned my addr 172.21.15.47:0/4138808342 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:45.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47aa00700 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f252010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe473e00700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4600b2900 0x7fe4600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 -- 172.21.15.47:0/4138808342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 msgr2=0x557d0f252010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f252010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 -- 172.21.15.47:0/4138808342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 msgr2=0x557d0f2516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f2516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47be00700 1 -- 172.21.15.47:0/4138808342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0f0c0880 con 0x557d0f0d3df0 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe47aa00700 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f252010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.520+0000 7fe473e00700 1 -- 172.21.15.47:0/1287097314 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe46c0e2ec0 con 0x7fe47c10a990 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.521+0000 7fe47be00700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4600b2900 0x7fe4600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.521+0000 7fe47be00700 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f257660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe474011630 tx=0x7fe474009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52fa730125401d00 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:45.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.521+0000 7fe470c00700 1 -- 172.21.15.47:0/4138808342 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474004050 con 0x557d0f0d3df0 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.521+0000 7fe470c00700 1 -- 172.21.15.47:0/4138808342 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe474019030 con 0x557d0f0d3df0 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.521+0000 7fe470c00700 1 -- 172.21.15.47:0/4138808342 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474015410 con 0x557d0f0d3df0 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 -- 172.21.15.47:0/4138808342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 msgr2=0x557d0f257660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe47be00700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4600b2900 0x7fe4600b4e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe474012010 tx=0x7fe474015a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f257660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe474011630 tx=0x7fe474009920 comp rx=0 tx=0).stop 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 -- 172.21.15.47:0/4138808342 shutdown_connections 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f252010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f257660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/4138808342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f2516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 -- 172.21.15.47:0/4138808342 >> 172.21.15.47:0/4138808342 conn(0x557d0f112a30 msgr2=0x557d0f24c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.522+0000 7fe490bc8b80 1 -- 172.21.15.47:0/4138808342 shutdown_connections 2024-05-14T12:25:45.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.523+0000 7fe490bc8b80 1 -- 172.21.15.47:0/4138808342 wait complete. 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.523+0000 7fe490bc8b80 1 -- start start 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.523+0000 7fe490bc8b80 1 Processor -- start 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f25b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f251c00 0x557d0f25b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f257ba0 0x557d0f25bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d0f25e670 con 0x557d0f0d3df0 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557d0f0d9ad0 con 0x557d0f257ba0 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d0f25e7f0 con 0x557d0f251c00 2024-05-14T12:25:45.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe490bc8b80 10 client.0 _ll_register_callbacks cb 0x557d0f107330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe47b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f25b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe47b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f25b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40792/0 (socket says 172.21.15.47:40792) 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe47b400700 1 -- 172.21.15.47:0/1440351893 learned_addr learned my addr 172.21.15.47:0/1440351893 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.524+0000 7fe47aa00700 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f251c00 0x557d0f25b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe47be00700 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f257ba0 0x557d0f25bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe47b400700 1 -- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f251c00 msgr2=0x557d0f25b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe47b400700 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f251c00 0x557d0f25b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe47b400700 1 -- 172.21.15.47:0/1440351893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f257ba0 msgr2=0x557d0f25bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe47b400700 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f257ba0 0x557d0f25bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe47b400700 1 -- 172.21.15.47:0/1440351893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0f1393d0 con 0x557d0f0d3df0 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe47b400700 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f25b360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0a77a0 tx=0x7fe46c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5412e685f96e91a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:45.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.525+0000 7fe465600700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:25:45.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe465600700 1 -- 172.21.15.47:0/1440351893 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0aa300 con 0x557d0f0d3df0 2024-05-14T12:25:45.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe465600700 1 -- 172.21.15.47:0/1440351893 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe46c0920f0 con 0x557d0f0d3df0 2024-05-14T12:25:45.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe474019030 con 0x557d0f0d3df0 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe465600700 1 -- 172.21.15.47:0/1440351893 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe46c0a9ca0 con 0x557d0f0d3df0 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe490bc8b80 10 client.15090 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d0f269260 con 0x557d0f0d3df0 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe465600700 1 -- 172.21.15.47:0/1440351893 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe474019030 con 0x557d0f0d3df0 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.526+0000 7fe465600700 1 -- 172.21.15.47:0/1440351893 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe46c0b2e70 con 0x557d0f0d3df0 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.527+0000 7fe490bc8b80 10 client.15090 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.527+0000 7fe490bc8b80 10 client.15090 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.527+0000 7fe490bc8b80 20 client.15090 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.527+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f26b910 0x557d0f26cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.527+0000 7fe490bc8b80 4 client.15090 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.527+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d0f21e020 con 0x557d0f26b910 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.527+0000 7fe47aa00700 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f26b910 0x557d0f26cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.528+0000 7fe47aa00700 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f26b910 0x557d0f26cd80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8af1282411426078 server_cookie=3c09c9bb5d100395 in_seq=0 out_seq=0 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.528+0000 7fe465600700 10 client.15090 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.528+0000 7fe465600700 1 -- 172.21.15.47:0/1440351893 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557d0f21e020 con 0x557d0f26b910 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.528+0000 7fe465600700 10 client.15090 handle_command_reply: tid=0 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 client.15090 shutdown 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 msgr2=0x557d0f25b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f25b360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0a77a0 tx=0x7fe46c0095f0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 shutdown_connections 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f26b910 0x557d0f26cd80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f257ba0 0x557d0f25bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f25b360 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/1440351893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f251c00 0x557d0f25b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 >> 172.21.15.47:0/1440351893 conn(0x557d0f112a30 msgr2=0x557d0f2506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe465600700 0 client.15090 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:25:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 shutdown_connections 2024-05-14T12:25:45.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 1 -- 172.21.15.47:0/1440351893 wait complete. 2024-05-14T12:25:45.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.529+0000 7fe490bc8b80 20 client.15090 trim_cache size 0 max 16384 2024-05-14T12:25:45.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.553+0000 7fe490bc8b80 1 Processor -- start 2024-05-14T12:25:45.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.553+0000 7fe490bc8b80 1 -- start start 2024-05-14T12:25:45.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f2516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f267af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f257ba0 0x557d0f25ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d0f26b0c0 con 0x557d0f0d3df0 2024-05-14T12:25:45.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557d0f26b790 con 0x557d0f251c00 2024-05-14T12:25:45.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d0f26be60 con 0x557d0f257ba0 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f267af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f2516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f267af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:48822/0 (socket says 172.21.15.47:48822) 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 -- 172.21.15.47:0/921025033 learned_addr learned my addr 172.21.15.47:0/921025033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47be00700 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f257ba0 0x557d0f25ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 -- 172.21.15.47:0/921025033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f257ba0 msgr2=0x557d0f25ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f257ba0 0x557d0f25ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 -- 172.21.15.47:0/921025033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 msgr2=0x557d0f2516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f2516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.554+0000 7fe47aa00700 1 -- 172.21.15.47:0/921025033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0f2598f0 con 0x557d0f251c00 2024-05-14T12:25:45.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.555+0000 7fe47aa00700 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f267af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe47c07b060 tx=0x7fe468009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f23368505473b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.555+0000 7fe467e00700 1 -- 172.21.15.47:0/921025033 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468004830 con 0x557d0f251c00 2024-05-14T12:25:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.555+0000 7fe467e00700 1 -- 172.21.15.47:0/921025033 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe468005020 con 0x557d0f251c00 2024-05-14T12:25:45.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.555+0000 7fe467e00700 1 -- 172.21.15.47:0/921025033 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4680202d0 con 0x557d0f251c00 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 -- 172.21.15.47:0/921025033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 msgr2=0x557d0f267af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f267af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe47c07b060 tx=0x7fe468009260 comp rx=0 tx=0).stop 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 -- 172.21.15.47:0/921025033 shutdown_connections 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f257ba0 0x557d0f25ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f0d3df0 0x557d0f2516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/921025033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f267af0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 -- 172.21.15.47:0/921025033 >> 172.21.15.47:0/921025033 conn(0x557d0f112a30 msgr2=0x557d0f259c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 -- 172.21.15.47:0/921025033 shutdown_connections 2024-05-14T12:25:45.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.556+0000 7fe490bc8b80 1 -- 172.21.15.47:0/921025033 wait complete. 2024-05-14T12:25:45.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.557+0000 7fe490bc8b80 1 -- start start 2024-05-14T12:25:45.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.557+0000 7fe490bc8b80 1 Processor -- start 2024-05-14T12:25:45.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f276740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f266ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe490bc8b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f267020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d0f26cc00 con 0x557d0f257ba0 2024-05-14T12:25:45.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557d0f26c530 con 0x557d0f251c00 2024-05-14T12:25:45.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe490bc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d0f26d2d0 con 0x557d0f0d3df0 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe490bc8b80 10 client.0 _ll_register_callbacks cb 0x557d0f107330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f266ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f267020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f276740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f266ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:48838/0 (socket says 172.21.15.47:48838) 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47aa00700 1 -- 172.21.15.47:0/2788390420 learned_addr learned my addr 172.21.15.47:0/2788390420 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47aa00700 1 -- 172.21.15.47:0/2788390420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 msgr2=0x557d0f276740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47aa00700 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f276740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47aa00700 1 -- 172.21.15.47:0/2788390420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 msgr2=0x557d0f267020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.558+0000 7fe47aa00700 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f267020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.559+0000 7fe47aa00700 1 -- 172.21.15.47:0/2788390420 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0f2677a0 con 0x557d0f251c00 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.559+0000 7fe47aa00700 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f266ae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe468010ed0 tx=0x7fe468010f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1c8cae7e3e2c6bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.559+0000 7fe465600700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:25:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.559+0000 7fe465600700 1 -- 172.21.15.47:0/2788390420 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468004790 con 0x557d0f251c00 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.559+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe468005020 con 0x557d0f251c00 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.559+0000 7fe465600700 1 -- 172.21.15.47:0/2788390420 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe468004930 con 0x557d0f251c00 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe465600700 1 -- 172.21.15.47:0/2788390420 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe468004b30 con 0x557d0f251c00 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 10 client.25205 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d0f2d6d80 con 0x557d0f251c00 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe465600700 1 -- 172.21.15.47:0/2788390420 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe468005020 con 0x557d0f251c00 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe465600700 1 -- 172.21.15.47:0/2788390420 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe4680344e0 con 0x557d0f251c00 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 10 client.25205 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 10 client.25205 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 20 client.25205 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f2d8e80 0x557d0f2da2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 4 client.25205 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:25:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.560+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "status"}) -- 0x557d0f1813b0 con 0x557d0f2d8e80 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.561+0000 7fe47b400700 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f2d8e80 0x557d0f2da2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.561+0000 7fe47b400700 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f2d8e80 0x557d0f2da2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=83579bb24c0169b8 server_cookie=caf3a520d7f0ff35 in_seq=0 out_seq=0 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.561+0000 7fe465600700 10 client.25205 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.561+0000 7fe465600700 1 -- 172.21.15.47:0/2788390420 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557d0f1813b0 con 0x557d0f2d8e80 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.561+0000 7fe465600700 10 client.25205 handle_command_reply: tid=0 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.561+0000 7fe490bc8b80 1 client.25205 shutdown 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 msgr2=0x557d0f266ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f266ae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe468010ed0 tx=0x7fe468010f00 comp rx=0 tx=0).stop 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 shutdown_connections 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x557d0f2d8e80 0x557d0f2da2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0f257ba0 0x557d0f267020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d0f0d3df0 0x557d0f276740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 --2- 172.21.15.47:0/2788390420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557d0f251c00 0x557d0f266ae0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe465600700 0 client.25205 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 >> 172.21.15.47:0/2788390420 conn(0x557d0f112a30 msgr2=0x557d0f2463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 shutdown_connections 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 1 -- 172.21.15.47:0/2788390420 wait complete. 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.562+0000 7fe490bc8b80 20 client.25205 trim_cache size 0 max 16384 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:25:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 4, 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24490, 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 264.14741521000002, 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 29, 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 84, 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 326.53355073500001 2024-05-14T12:25:45.568 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4600b2900 msgr2=0x7fe4600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4600b2900 0x7fe4600b4e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe474012010 tx=0x7fe474015a20 comp rx=0 tx=0).stop 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c10a990 msgr2=0x7fe47c1a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c10a990 0x7fe47c1a1440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0057c0 tx=0x7fe46c00bfd0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 shutdown_connections 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4600b2900 0x7fe4600b4e10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe47c110970 0x7fe47c1a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe47c10a990 0x7fe47c1a1440 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 --2- 172.21.15.47:0/1287097314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe47c10b2e0 0x7fe47c1a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 >> 172.21.15.47:0/1287097314 conn(0x7fe47c077c80 msgr2=0x7fe47c07bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 shutdown_connections 2024-05-14T12:25:45.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:45.563+0000 7fe482000700 1 -- 172.21.15.47:0/1287097314 wait complete. 2024-05-14T12:25:45.964 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:45 smithi047 ceph-mon[31254]: pgmap v467: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-14T12:25:46.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:45 smithi073 ceph-mon[35809]: pgmap v467: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-14T12:25:46.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:45 smithi066 ceph-mon[35981]: pgmap v467: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-14T12:25:46.523 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-14T12:25:47.004 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:47.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:47 smithi047 ceph-mon[31254]: pgmap v468: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-14T12:25:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:47 smithi073 ceph-mon[35809]: pgmap v468: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-14T12:25:48.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:47 smithi066 ceph-mon[35981]: pgmap v468: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-14T12:25:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 -- 172.21.15.47:0/1567030208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 msgr2=0x7f4cdc113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/1567030208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 0x7f4cdc113200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009fc0 tx=0x7f4cd400b330 comp rx=0 tx=0).stop 2024-05-14T12:25:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 -- 172.21.15.47:0/1567030208 shutdown_connections 2024-05-14T12:25:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/1567030208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 0x7f4cdc113200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/1567030208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4cdc106620 0x7f4cdc106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/1567030208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc10af50 0x7f4cdc10b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 -- 172.21.15.47:0/1567030208 >> 172.21.15.47:0/1567030208 conn(0x7f4cdc102030 msgr2=0x7f4cdc104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 -- 172.21.15.47:0/1567030208 shutdown_connections 2024-05-14T12:25:49.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.288+0000 7f4ce1c00700 1 -- 172.21.15.47:0/1567030208 wait complete. 2024-05-14T12:25:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.289+0000 7f4ce1c00700 1 Processor -- start 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4ce1c00700 1 -- start start 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4ce1c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc106620 0x7f4cdc19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4ce1c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4cdc10af50 0x7f4cdc19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4ce1c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 0x7f4cdc1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4ce1c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc116520 con 0x7f4cdc106620 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4ce1c00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc1163a0 con 0x7f4cdc10af50 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4ce1c00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc1166a0 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.290+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc106620 0x7f4cdc19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4cdb400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4cdc10af50 0x7f4cdc19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc106620 0x7f4cdc19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55768/0 (socket says 172.21.15.47:55768) 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4cdbe00700 1 -- 172.21.15.47:0/3637792827 learned_addr learned my addr 172.21.15.47:0/3637792827 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4ce1200700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 0x7f4cdc1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4ce1200700 1 -- 172.21.15.47:0/3637792827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4cdc10af50 msgr2=0x7f4cdc19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4ce1200700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4cdc10af50 0x7f4cdc19d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4ce1200700 1 -- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc106620 msgr2=0x7f4cdc19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4ce1200700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc106620 0x7f4cdc19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4ce1200700 1 -- 172.21.15.47:0/3637792827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc1a1d20 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.291+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc106620 0x7f4cdc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.292+0000 7f4ce1200700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 0x7f4cdc1a1680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b6c0 tx=0x7f4cd400cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:49.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.292+0000 7f4cd8c00700 1 -- 172.21.15.47:0/3637792827 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4021070 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.292+0000 7f4cd8c00700 1 -- 172.21.15.47:0/3637792827 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd4007ac0 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.292+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc1a1fb0 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.292+0000 7f4cd8c00700 1 -- 172.21.15.47:0/3637792827 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4005040 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.292+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc1a9930 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.298+0000 7f4cd8c00700 1 -- 172.21.15.47:0/3637792827 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4cd4024070 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 Processor -- start 2024-05-14T12:25:49.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 -- start start 2024-05-14T12:25:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c269cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c273890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56049c18b9d0 con 0x56049c26a640 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56049c129710 con 0x56049c0ebdf0 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.299+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56049c187990 con 0x56049c26a230 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c273890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55772/0 (socket says 172.21.15.47:55772) 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdb400700 1 -- 172.21.15.47:0/3207455992 learned_addr learned my addr 172.21.15.47:0/3207455992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdb400700 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c269cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdbe00700 1 -- 172.21.15.47:0/3207455992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 msgr2=0x56049c269cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c269cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdbe00700 1 -- 172.21.15.47:0/3207455992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 msgr2=0x56049c275de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.300+0000 7f4cdbe00700 1 -- 172.21.15.47:0/3207455992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56049c0d8880 con 0x56049c26a230 2024-05-14T12:25:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.301+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c273890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc011570 tx=0x7f4ccc011880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af9113e0fd1ea351 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.301+0000 7f4cd1600700 1 -- 172.21.15.47:0/3207455992 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc004230 con 0x56049c26a230 2024-05-14T12:25:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.301+0000 7f4cd1600700 1 -- 172.21.15.47:0/3207455992 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ccc0043d0 con 0x56049c26a230 2024-05-14T12:25:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.301+0000 7f4cd1600700 1 -- 172.21.15.47:0/3207455992 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc019960 con 0x56049c26a230 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.301+0000 7f4cd8c00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc00b2880 0x7f4cc00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cdb400700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc00b2880 0x7f4cc00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cd8c00700 1 -- 172.21.15.47:0/3637792827 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4cd400f020 con 0x7f4cdc10b8a0 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/3207455992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 msgr2=0x56049c273890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c273890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc011570 tx=0x7f4ccc011880 comp rx=0 tx=0).stop 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/3207455992 shutdown_connections 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c269cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/3207455992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c273890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.302+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/3207455992 >> 172.21.15.47:0/3207455992 conn(0x56049c12aa30 msgr2=0x56049c264b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.303+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/3207455992 shutdown_connections 2024-05-14T12:25:49.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.303+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/3207455992 wait complete. 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.303+0000 7f4cdb400700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc00b2880 0x7f4cc00b4d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56049c26aad0 tx=0x7f4cc80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.303+0000 7f4cf1e28b80 1 -- start start 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.303+0000 7f4cf1e28b80 1 Processor -- start 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c273370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c2738b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c273df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56049c276750 con 0x56049c26a230 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56049c0f1ad0 con 0x56049c26a640 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56049c2768d0 con 0x56049c0ebdf0 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cf1e28b80 10 client.0 _ll_register_callbacks cb 0x56049c11f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.304+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c273370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4cdb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c2738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c273370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34030/0 (socket says 172.21.15.47:34030) 2024-05-14T12:25:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4cdbe00700 1 -- 172.21.15.47:0/4235509191 learned_addr learned my addr 172.21.15.47:0/4235509191 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:49.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4ce1200700 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c273df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4ce1200700 1 -- 172.21.15.47:0/4235509191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 msgr2=0x56049c273370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4ce1200700 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c273370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4ce1200700 1 -- 172.21.15.47:0/4235509191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 msgr2=0x56049c2738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4ce1200700 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c2738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4ce1200700 1 -- 172.21.15.47:0/4235509191 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56049c1513d0 con 0x56049c26a640 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4cdb400700 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c2738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4ce1200700 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c273df0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40e1030 tx=0x7f4cd40aa620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f4ad4fab6ac6d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.305+0000 7f4cc6000700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.306+0000 7f4cc6000700 1 -- 172.21.15.47:0/4235509191 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40b32f0 con 0x56049c26a640 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.306+0000 7f4cc6000700 1 -- 172.21.15.47:0/4235509191 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4cd40a71d0 con 0x56049c26a640 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.306+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ccc0043d0 con 0x56049c26a640 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.306+0000 7f4cc6000700 1 -- 172.21.15.47:0/4235509191 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4cd40aa6f0 con 0x56049c26a640 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.306+0000 7f4cf1e28b80 10 client.25217 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.306+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56049c281400 con 0x56049c26a640 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.306+0000 7f4cc6000700 1 -- 172.21.15.47:0/4235509191 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ccc0043d0 con 0x56049c26a640 2024-05-14T12:25:49.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cc6000700 1 -- 172.21.15.47:0/4235509191 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4cd4011070 con 0x56049c26a640 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cf1e28b80 10 client.25217 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cf1e28b80 10 client.25217 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cf1e28b80 20 client.25217 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c283a60 0x56049c284ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cf1e28b80 4 client.25217 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56049c236020 con 0x56049c283a60 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.307+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c283a60 0x56049c284ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.308+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c283a60 0x56049c284ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e17b01fd1fbb6f5 server_cookie=46ae5f24a9187d26 in_seq=0 out_seq=0 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.308+0000 7f4cc6000700 10 client.25217 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cc6000700 1 -- 172.21.15.47:0/4235509191 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56049c236020 con 0x56049c283a60 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cc6000700 10 client.25217 handle_command_reply: tid=0 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 client.25217 shutdown 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 msgr2=0x56049c273df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c273df0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40e1030 tx=0x7f4cd40aa620 comp rx=0 tx=0).stop 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 shutdown_connections 2024-05-14T12:25:49.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c273df0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c283a60 0x56049c284ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c273370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/4235509191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c2738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cc6000700 0 client.25217 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 >> 172.21.15.47:0/4235509191 conn(0x56049c12aa30 msgr2=0x56049c2686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 shutdown_connections 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/4235509191 wait complete. 2024-05-14T12:25:49.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.309+0000 7f4cf1e28b80 20 client.25217 trim_cache size 0 max 16384 2024-05-14T12:25:49.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.332+0000 7f4cf1e28b80 1 Processor -- start 2024-05-14T12:25:49.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cf1e28b80 1 -- start start 2024-05-14T12:25:49.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c282ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c27fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56049c283210 con 0x56049c26a640 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56049c2838e0 con 0x56049c0ebdf0 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56049c283fb0 con 0x56049c26a230 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c282ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.333+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c282ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54160/0 (socket says 172.21.15.47:54160) 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdbe00700 1 -- 172.21.15.47:0/2415103226 learned_addr learned my addr 172.21.15.47:0/2415103226 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdb400700 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c27fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4ce1200700 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdbe00700 1 -- 172.21.15.47:0/2415103226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 msgr2=0x56049c27fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c27fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdbe00700 1 -- 172.21.15.47:0/2415103226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 msgr2=0x56049c275130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdbe00700 1 -- 172.21.15.47:0/2415103226 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56049c2692d0 con 0x56049c0ebdf0 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.334+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c282ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc019490 tx=0x7f4ccc011880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58c64fc7242787d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.335+0000 7f4cd0c00700 1 -- 172.21.15.47:0/2415103226 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc031070 con 0x56049c0ebdf0 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.335+0000 7f4cd0c00700 1 -- 172.21.15.47:0/2415103226 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ccc003b30 con 0x56049c0ebdf0 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.335+0000 7f4cd0c00700 1 -- 172.21.15.47:0/2415103226 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc02b940 con 0x56049c0ebdf0 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/2415103226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 msgr2=0x56049c282ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c282ac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc019490 tx=0x7f4ccc011880 comp rx=0 tx=0).stop 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/2415103226 shutdown_connections 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a640 0x56049c275130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c0ebdf0 0x56049c282ac0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/2415103226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c26a230 0x56049c27fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/2415103226 >> 172.21.15.47:0/2415103226 conn(0x56049c12aa30 msgr2=0x56049c274a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:49.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/2415103226 shutdown_connections 2024-05-14T12:25:49.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/2415103226 wait complete. 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.336+0000 7f4cf1e28b80 1 -- start start 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 1 Processor -- start 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c287f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c288470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c2889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56049c284d50 con 0x56049c26a230 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56049c284680 con 0x56049c26a640 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56049c285420 con 0x56049c0ebdf0 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cf1e28b80 10 client.0 _ll_register_callbacks cb 0x56049c11f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.337+0000 7f4cdb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c288470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c287f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4ce1200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c2889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c288470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55802/0 (socket says 172.21.15.47:55802) 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdb400700 1 -- 172.21.15.47:0/1513511051 learned_addr learned my addr 172.21.15.47:0/1513511051 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdbe00700 1 -- 172.21.15.47:0/1513511051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 msgr2=0x56049c2889b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c2889b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdbe00700 1 -- 172.21.15.47:0/1513511051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 msgr2=0x56049c288470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c288470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdbe00700 1 -- 172.21.15.47:0/1513511051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56049c28c770 con 0x56049c0ebdf0 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4ce1200700 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c2889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cdbe00700 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c287f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc003f40 tx=0x7f4ccc003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77090ee50b3f3f8a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.338+0000 7f4cc6000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.339+0000 7f4cc6000700 1 -- 172.21.15.47:0/1513511051 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc031040 con 0x56049c0ebdf0 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.339+0000 7f4cc6000700 1 -- 172.21.15.47:0/1513511051 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4ccc003680 con 0x56049c0ebdf0 2024-05-14T12:25:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.339+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ccc003b30 con 0x56049c0ebdf0 2024-05-14T12:25:49.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.339+0000 7f4cc6000700 1 -- 172.21.15.47:0/1513511051 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ccc003880 con 0x56049c0ebdf0 2024-05-14T12:25:49.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.339+0000 7f4cf1e28b80 10 client.25246 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:49.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.339+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56049c2ef1a0 con 0x56049c0ebdf0 2024-05-14T12:25:49.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cc6000700 1 -- 172.21.15.47:0/1513511051 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ccc003b30 con 0x56049c0ebdf0 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cc6000700 1 -- 172.21.15.47:0/1513511051 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4ccc02bce0 con 0x56049c0ebdf0 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cf1e28b80 10 client.25246 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cf1e28b80 10 client.25246 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cf1e28b80 20 client.25246 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c2f0f20 0x56049c2f2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cf1e28b80 4 client.25246 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.340+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "status"}) -- 0x56049c1993b0 con 0x56049c2f0f20 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.341+0000 7f4cdb400700 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c2f0f20 0x56049c2f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.341+0000 7f4cdb400700 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c2f0f20 0x56049c2f2390 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7164e34de77c5b1b server_cookie=3baa39bc5ac0e67d in_seq=0 out_seq=0 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.341+0000 7f4cc6000700 10 client.25246 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.341+0000 7f4cc6000700 1 -- 172.21.15.47:0/1513511051 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56049c1993b0 con 0x56049c2f0f20 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.341+0000 7f4cc6000700 10 client.25246 handle_command_reply: tid=0 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.341+0000 7f4cf1e28b80 1 client.25246 shutdown 2024-05-14T12:25:49.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 msgr2=0x56049c287f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c287f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc003f40 tx=0x7f4ccc003ce0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 shutdown_connections 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56049c26a640 0x56049c2889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x56049c2f0f20 0x56049c2f2390 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56049c0ebdf0 0x56049c287f30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 --2- 172.21.15.47:0/1513511051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56049c26a230 0x56049c288470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cc6000700 0 client.25246 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 >> 172.21.15.47:0/1513511051 conn(0x56049c12aa30 msgr2=0x56049c271fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 shutdown_connections 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 1 -- 172.21.15.47:0/1513511051 wait complete. 2024-05-14T12:25:49.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.342+0000 7f4cf1e28b80 20 client.25246 trim_cache size 0 max 16384 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 3, 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24502, 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 268.93363662799999, 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 29, 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 84, 2024-05-14T12:25:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 327.37583989000001 2024-05-14T12:25:49.347 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:25:49.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc00b2880 msgr2=0x7f4cc00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc00b2880 0x7f4cc00b4d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56049c26aad0 tx=0x7f4cc80058e0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 msgr2=0x7f4cdc1a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:49.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 0x7f4cdc1a1680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b6c0 tx=0x7f4cd400cc30 comp rx=0 tx=0).stop 2024-05-14T12:25:49.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 shutdown_connections 2024-05-14T12:25:49.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4cc00b2880 0x7f4cc00b4d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4cdc10b8a0 0x7f4cdc1a1680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cdc106620 0x7f4cdc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 --2- 172.21.15.47:0/3637792827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4cdc10af50 0x7f4cdc19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:49.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.343+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 >> 172.21.15.47:0/3637792827 conn(0x7f4cdc102030 msgr2=0x7f4cdc10a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:49.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.344+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 shutdown_connections 2024-05-14T12:25:49.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:49.344+0000 7f4ce1c00700 1 -- 172.21.15.47:0/3637792827 wait complete. 2024-05-14T12:25:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:49 smithi047 ceph-mon[31254]: pgmap v469: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-14T12:25:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:49 smithi073 ceph-mon[35809]: pgmap v469: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-14T12:25:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:49 smithi066 ceph-mon[35981]: pgmap v469: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-14T12:25:50.352 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-14T12:25:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 -- 172.21.15.47:0/3351933831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641101e0 msgr2=0x7f4464112600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 --2- 172.21.15.47:0/3351933831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641101e0 0x7f4464112600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f445c009ca0 tx=0x7f445c02a8c0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 -- 172.21.15.47:0/3351933831 shutdown_connections 2024-05-14T12:25:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 --2- 172.21.15.47:0/3351933831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44641101e0 0x7f4464112600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 --2- 172.21.15.47:0/3351933831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4464075a10 0x7f446410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 --2- 172.21.15.47:0/3351933831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44640750c0 0x7f44640754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 -- 172.21.15.47:0/3351933831 >> 172.21.15.47:0/3351933831 conn(0x7f44640fec70 msgr2=0x7f4464101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 -- 172.21.15.47:0/3351933831 shutdown_connections 2024-05-14T12:25:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.482+0000 7f4468e00640 1 -- 172.21.15.47:0/3351933831 wait complete. 2024-05-14T12:25:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.483+0000 7f4468e00640 1 Processor -- start 2024-05-14T12:25:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4468e00640 1 -- start start 2024-05-14T12:25:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4468e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44640750c0 0x7f44641a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4468e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4464075a10 0x7f44641a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4468e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44641101e0 0x7f44641a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4468e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4464115c60 con 0x7f4464075a10 2024-05-14T12:25:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4468e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4464115ae0 con 0x7f44640750c0 2024-05-14T12:25:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4468e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4464115de0 con 0x7f44641101e0 2024-05-14T12:25:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4463e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44641101e0 0x7f44641a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4462a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4464075a10 0x7f44641a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4463e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44641101e0 0x7f44641a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34082/0 (socket says 172.21.15.47:34082) 2024-05-14T12:25:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4463e00640 1 -- 172.21.15.47:0/2276224867 learned_addr learned my addr 172.21.15.47:0/2276224867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.484+0000 7f4463400640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44640750c0 0x7f44641a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.485+0000 7f4463e00640 1 -- 172.21.15.47:0/2276224867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44640750c0 msgr2=0x7f44641a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.485+0000 7f4463e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44640750c0 0x7f44641a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.485+0000 7f4463e00640 1 -- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4464075a10 msgr2=0x7f44641a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.485+0000 7f4463e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4464075a10 0x7f44641a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.485+0000 7f4463e00640 1 -- 172.21.15.47:0/2276224867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44641a8290 con 0x7f44641101e0 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.485+0000 7f4463e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44641101e0 0x7f44641a7c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f445c033040 tx=0x7f445c031680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.486+0000 7f445be00640 1 -- 172.21.15.47:0/2276224867 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c003b70 con 0x7f44641101e0 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.486+0000 7f445be00640 1 -- 172.21.15.47:0/2276224867 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f445c003d10 con 0x7f44641101e0 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.486+0000 7f445be00640 1 -- 172.21.15.47:0/2276224867 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c02fab0 con 0x7f44641101e0 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.486+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44641a8520 con 0x7f44641101e0 2024-05-14T12:25:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.486+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44641a8a20 con 0x7f44641101e0 2024-05-14T12:25:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.490+0000 7f44713a4740 1 Processor -- start 2024-05-14T12:25:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.491+0000 7f445be00640 1 -- 172.21.15.47:0/2276224867 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f445c02fc70 con 0x7f44641101e0 2024-05-14T12:25:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.491+0000 7f44713a4740 1 -- start start 2024-05-14T12:25:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.491+0000 7f44713a4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc741b0 0x559b20016300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.491+0000 7f44713a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc4b2f0 0x559b20016880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.491+0000 7f44713a4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b2001d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.491+0000 7f44713a4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b1ff7a550 con 0x559b1fc534d0 2024-05-14T12:25:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.492+0000 7f44713a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559b1ff1fbc0 con 0x559b1fc4b2f0 2024-05-14T12:25:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.492+0000 7f44713a4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559b1ff76510 con 0x559b1fc741b0 2024-05-14T12:25:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.492+0000 7f4463400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc4b2f0 0x559b20016880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.492+0000 7f4463400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc4b2f0 0x559b20016880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54176/0 (socket says 172.21.15.47:54176) 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.492+0000 7f4463400640 1 -- 172.21.15.47:0/2048193534 learned_addr learned my addr 172.21.15.47:0/2048193534 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.492+0000 7f4462a00640 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc741b0 0x559b20016300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.492+0000 7f4462a00640 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b2001d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.493+0000 7f4463400640 1 -- 172.21.15.47:0/2048193534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc741b0 msgr2=0x559b20016300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.493+0000 7f4463400640 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc741b0 0x559b20016300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.493+0000 7f4463400640 1 -- 172.21.15.47:0/2048193534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 msgr2=0x559b2001d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.493+0000 7f4463400640 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b2001d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.493+0000 7f4463400640 1 -- 172.21.15.47:0/2048193534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b1fc8c210 con 0x559b1fc4b2f0 2024-05-14T12:25:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.493+0000 7f4463400640 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc4b2f0 0x559b20016880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4454009ca0 tx=0x7f4454011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73efcdc0399cba50 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.494+0000 7f4458c00640 1 -- 172.21.15.47:0/2048193534 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454005220 con 0x559b1fc4b2f0 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.494+0000 7f4458c00640 1 -- 172.21.15.47:0/2048193534 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4454004c50 con 0x559b1fc4b2f0 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.494+0000 7f4458c00640 1 -- 172.21.15.47:0/2048193534 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454019760 con 0x559b1fc4b2f0 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.494+0000 7f445be00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44480b28a0 0x7f44480b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.494+0000 7f445be00640 1 -- 172.21.15.47:0/2276224867 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f445c103790 con 0x7f44641101e0 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.494+0000 7f4462a00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44480b28a0 0x7f44480b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 -- 172.21.15.47:0/2048193534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc4b2f0 msgr2=0x559b20016880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc4b2f0 0x559b20016880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4454009ca0 tx=0x7f4454011810 comp rx=0 tx=0).stop 2024-05-14T12:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 -- 172.21.15.47:0/2048193534 shutdown_connections 2024-05-14T12:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b2001d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc4b2f0 0x559b20016880 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 --2- 172.21.15.47:0/2048193534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc741b0 0x559b20016300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 -- 172.21.15.47:0/2048193534 >> 172.21.15.47:0/2048193534 conn(0x559b1fc68300 msgr2=0x559b20011c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 -- 172.21.15.47:0/2048193534 shutdown_connections 2024-05-14T12:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f4462a00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44480b28a0 0x7f44480b4db0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x559b200174d0 tx=0x7f4450013040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.495+0000 7f44713a4740 1 -- 172.21.15.47:0/2048193534 wait complete. 2024-05-14T12:25:50.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.496+0000 7f44713a4740 1 -- start start 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.496+0000 7f44713a4740 1 Processor -- start 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.496+0000 7f44713a4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f44713a4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b20020360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f44713a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc741b0 0x559b200272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f44713a4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b2001e1d0 con 0x559b1fc534d0 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f44713a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559b1ff33660 con 0x559b1fc741b0 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f44713a4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559b2001e350 con 0x559b1fc4b2f0 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f44713a4740 10 client.0 _ll_register_callbacks cb 0x559b1fefd400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f4462a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b20020360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f4463400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f4462a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b20020360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55842/0 (socket says 172.21.15.47:55842) 2024-05-14T12:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f4462a00640 1 -- 172.21.15.47:0/3574793836 learned_addr learned my addr 172.21.15.47:0/3574793836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f4463e00640 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc741b0 0x559b200272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.497+0000 7f4462a00640 1 -- 172.21.15.47:0/3574793836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 msgr2=0x559b2001fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f4462a00640 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f4462a00640 1 -- 172.21.15.47:0/3574793836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc741b0 msgr2=0x559b200272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f4462a00640 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc741b0 0x559b200272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f4462a00640 1 -- 172.21.15.47:0/3574793836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b1fd58620 con 0x559b1fc534d0 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f4463e00640 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc741b0 0x559b200272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f4462a00640 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b20020360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4450003870 tx=0x7f4450005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257d186ed9aa4531 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f444d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f444d600640 1 -- 172.21.15.47:0/3574793836 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445001f0d0 con 0x559b1fc534d0 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f444d600640 1 -- 172.21.15.47:0/3574793836 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4450009030 con 0x559b1fc534d0 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.498+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4454004c50 con 0x559b1fc534d0 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.499+0000 7f444d600640 1 -- 172.21.15.47:0/3574793836 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f445001f270 con 0x559b1fc534d0 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.499+0000 7f44713a4740 10 client.15126 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.499+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b2002a2c0 con 0x559b1fc534d0 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.499+0000 7f444d600640 1 -- 172.21.15.47:0/3574793836 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4454004c50 con 0x559b1fc534d0 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.499+0000 7f444d600640 1 -- 172.21.15.47:0/3574793836 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4450029b20 con 0x559b1fc534d0 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.500+0000 7f44713a4740 10 client.15126 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.500+0000 7f44713a4740 10 client.15126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.500+0000 7f44713a4740 20 client.15126 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.500+0000 7f44713a4740 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc32d80 0x559b2002da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.500+0000 7f44713a4740 4 client.15126 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:25:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.500+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b1ff88160 con 0x559b1fc32d80 2024-05-14T12:25:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.500+0000 7f4463400640 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc32d80 0x559b2002da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.501+0000 7f4463400640 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc32d80 0x559b2002da00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64d94c62591bf8b server_cookie=bee1bd00b0faf647 in_seq=0 out_seq=0 2024-05-14T12:25:50.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.501+0000 7f444d600640 10 client.15126 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:50.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f444d600640 1 -- 172.21.15.47:0/3574793836 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559b1ff88160 con 0x559b1fc32d80 2024-05-14T12:25:50.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f444d600640 10 client.15126 handle_command_reply: tid=0 2024-05-14T12:25:50.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 client.15126 shutdown 2024-05-14T12:25:50.505 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 msgr2=0x559b20020360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b20020360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4450003870 tx=0x7f4450005f90 comp rx=0 tx=0).stop 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 shutdown_connections 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc32d80 0x559b2002da00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc741b0 0x559b200272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc534d0 0x559b20020360 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 --2- 172.21.15.47:0/3574793836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 >> 172.21.15.47:0/3574793836 conn(0x559b1fc68300 msgr2=0x559b20014ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f444d600640 0 client.15126 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.502+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 shutdown_connections 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.503+0000 7f44713a4740 1 -- 172.21.15.47:0/3574793836 wait complete. 2024-05-14T12:25:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.503+0000 7f44713a4740 20 client.15126 trim_cache size 0 max 16384 2024-05-14T12:25:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.519+0000 7f44713a4740 1 Processor -- start 2024-05-14T12:25:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.519+0000 7f44713a4740 1 -- start start 2024-05-14T12:25:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f44713a4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f44713a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b200271e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f44713a4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20027720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f44713a4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44641b16f0 con 0x559b1fc741b0 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f44713a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44641b3230 con 0x559b1fc534d0 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f44713a4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44641b1dc0 con 0x559b1fc4b2f0 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f4463e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20027720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f4462a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b200271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f4462a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b200271e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54202/0 (socket says 172.21.15.47:54202) 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f4463e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20027720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55858/0 (socket says 172.21.15.47:55858) 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f4463400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.520+0000 7f4462a00640 1 -- 172.21.15.47:0/449205234 learned_addr learned my addr 172.21.15.47:0/449205234 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f4463400640 1 -- 172.21.15.47:0/449205234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 msgr2=0x559b200271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f4463400640 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b200271e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f4463400640 1 -- 172.21.15.47:0/449205234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 msgr2=0x559b20027720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f4463400640 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20027720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f4463400640 1 -- 172.21.15.47:0/449205234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2000d4a0 con 0x559b1fc4b2f0 2024-05-14T12:25:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f4462a00640 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b200271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f4463400640 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001ee30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4454011d10 tx=0x7f4454009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cff8f0da815f0a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f444fe00640 1 -- 172.21.15.47:0/449205234 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454004040 con 0x559b1fc4b2f0 2024-05-14T12:25:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f444fe00640 1 -- 172.21.15.47:0/449205234 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44540035f0 con 0x559b1fc4b2f0 2024-05-14T12:25:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.521+0000 7f444fe00640 1 -- 172.21.15.47:0/449205234 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44540196b0 con 0x559b1fc4b2f0 2024-05-14T12:25:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.522+0000 7f44713a4740 1 -- 172.21.15.47:0/449205234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 msgr2=0x559b2001ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.522+0000 7f44713a4740 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001ee30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4454011d10 tx=0x7f4454009310 comp rx=0 tx=0).stop 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.522+0000 7f44713a4740 1 -- 172.21.15.47:0/449205234 shutdown_connections 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.522+0000 7f44713a4740 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20027720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.522+0000 7f44713a4740 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b200271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.522+0000 7f44713a4740 1 --2- 172.21.15.47:0/449205234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b2001ee30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.522+0000 7f44713a4740 1 -- 172.21.15.47:0/449205234 >> 172.21.15.47:0/449205234 conn(0x559b1fc68300 msgr2=0x559b2001e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.523+0000 7f44713a4740 1 -- 172.21.15.47:0/449205234 shutdown_connections 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.523+0000 7f44713a4740 1 -- 172.21.15.47:0/449205234 wait complete. 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.523+0000 7f44713a4740 1 -- start start 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.523+0000 7f44713a4740 1 Processor -- start 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f44713a4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b200279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f44713a4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b20024560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f44713a4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20024b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f44713a4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44641b2b60 con 0x559b1fc741b0 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f44713a4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44641b2490 con 0x559b1fc534d0 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f44713a4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44641af6b0 con 0x559b1fc4b2f0 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f44713a4740 10 client.0 _ll_register_callbacks cb 0x7f4450009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f4463400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b200279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f4463e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20024b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f4463400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b200279e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34124/0 (socket says 172.21.15.47:34124) 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f4463400640 1 -- 172.21.15.47:0/3748209603 learned_addr learned my addr 172.21.15.47:0/3748209603 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.524+0000 7f4462a00640 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b20024560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f4463e00640 1 -- 172.21.15.47:0/3748209603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 msgr2=0x559b200279e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f4463e00640 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b200279e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f4463e00640 1 -- 172.21.15.47:0/3748209603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 msgr2=0x559b20024560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f4463e00640 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b20024560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f4463e00640 1 -- 172.21.15.47:0/3748209603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b20093dd0 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f4462a00640 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b20024560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f4463e00640 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20024b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f445c0c7f50 tx=0x7f445c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bb7ef97c2e0e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f444d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f444d600640 1 -- 172.21.15.47:0/3748209603 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c0ca880 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f444d600640 1 -- 172.21.15.47:0/3748209603 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f445c0c72d0 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.525+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44540035f0 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f444d600640 1 -- 172.21.15.47:0/3748209603 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f445c0ac050 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 10 client.15132 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b200950d0 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f444d600640 1 -- 172.21.15.47:0/3748209603 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44540035f0 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f444d600640 1 -- 172.21.15.47:0/3748209603 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f445c0d3740 con 0x559b1fc741b0 2024-05-14T12:25:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 10 client.15132 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 10 client.15132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 20 client.15132 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc081c0 0x559b20097a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 4 client.15132 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.526+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b1ff81fd0 con 0x559b1fc081c0 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.527+0000 7f4463400640 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc081c0 0x559b20097a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.527+0000 7f4463400640 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc081c0 0x559b20097a90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=938f11f7dd8f7c97 server_cookie=726cb806b59dda2 in_seq=0 out_seq=0 2024-05-14T12:25:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.527+0000 7f444d600640 10 client.15132 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f444d600640 1 -- 172.21.15.47:0/3748209603 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b1ff81fd0 con 0x559b1fc081c0 2024-05-14T12:25:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f444d600640 10 client.15132 handle_command_reply: tid=0 2024-05-14T12:25:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 client.15132 shutdown 2024-05-14T12:25:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 msgr2=0x559b20024b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20024b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f445c0c7f50 tx=0x7f445c0095c0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 shutdown_connections 2024-05-14T12:25:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559b1fc081c0 0x559b20097a90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b1fc741b0 0x559b20024b60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b1fc534d0 0x559b20024560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 --2- 172.21.15.47:0/3748209603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559b1fc4b2f0 0x559b200279e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f444d600640 0 client.15132 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 >> 172.21.15.47:0/3748209603 conn(0x559b1fc68300 msgr2=0x559b20014a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 shutdown_connections 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.538+0000 7f44713a4740 1 -- 172.21.15.47:0/3748209603 wait complete. 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f44713a4740 20 client.15132 trim_cache size 0 max 16384 2024-05-14T12:25:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:25:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:25:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:25:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44480b28a0 msgr2=0x7f44480b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44480b28a0 0x7f44480b4db0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x559b200174d0 tx=0x7f4450013040 comp rx=0 tx=0).stop 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44641101e0 msgr2=0x7f44641a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44641101e0 0x7f44641a7c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f445c033040 tx=0x7f445c031680 comp rx=0 tx=0).stop 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 shutdown_connections 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44480b28a0 0x7f44480b4db0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44641101e0 0x7f44641a7c20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4464075a10 0x7f44641a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 --2- 172.21.15.47:0/2276224867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44640750c0 0x7f44641a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.539+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 >> 172.21.15.47:0/2276224867 conn(0x7f44640fec70 msgr2=0x7f4464103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.540+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 shutdown_connections 2024-05-14T12:25:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:25:50.540+0000 7f4468e00640 1 -- 172.21.15.47:0/2276224867 wait complete. 2024-05-14T12:25:50.843 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:51.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:51 smithi047 ceph-mon[31254]: pgmap v470: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T12:25:52.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:51 smithi073 ceph-mon[35809]: pgmap v470: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T12:25:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:51 smithi066 ceph-mon[35981]: pgmap v470: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-14T12:25:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 -- 172.21.15.47:0/480035786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc81045f0 msgr2=0x7efdc8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 --2- 172.21.15.47:0/480035786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc81045f0 0x7efdc8104a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009990 tx=0x7efdb8009ca0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 -- 172.21.15.47:0/480035786 shutdown_connections 2024-05-14T12:25:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 --2- 172.21.15.47:0/480035786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8109870 0x7efdc81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 --2- 172.21.15.47:0/480035786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc81045f0 0x7efdc8104a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 --2- 172.21.15.47:0/480035786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdc8108f20 0x7efdc8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 -- 172.21.15.47:0/480035786 >> 172.21.15.47:0/480035786 conn(0x7efdc8100040 msgr2=0x7efdc8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 -- 172.21.15.47:0/480035786 shutdown_connections 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.254+0000 7efdcd800700 1 -- 172.21.15.47:0/480035786 wait complete. 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.255+0000 7efdcd800700 1 Processor -- start 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdcd800700 1 -- start start 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdcd800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdc81045f0 0x7efdc819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdcd800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc8108f20 0x7efdc819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdcd800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8109870 0x7efdc81a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdcd800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81144f0 con 0x7efdc8109870 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdcd800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8114370 con 0x7efdc8108f20 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdcd800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8114670 con 0x7efdc81045f0 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdc6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdc81045f0 0x7efdc819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdc6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdc81045f0 0x7efdc819d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34142/0 (socket says 172.21.15.47:34142) 2024-05-14T12:25:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdc6a00700 1 -- 172.21.15.47:0/932045434 learned_addr learned my addr 172.21.15.47:0/932045434 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdc7400700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8109870 0x7efdc81a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.256+0000 7efdc6000700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc8108f20 0x7efdc819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.257+0000 7efdc6000700 1 -- 172.21.15.47:0/932045434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdc81045f0 msgr2=0x7efdc819d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.257+0000 7efdc6000700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdc81045f0 0x7efdc819d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.257+0000 7efdc6000700 1 -- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8109870 msgr2=0x7efdc81a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.257+0000 7efdc6000700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8109870 0x7efdc81a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.257+0000 7efdc6000700 1 -- 172.21.15.47:0/932045434 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc81a1f70 con 0x7efdc8108f20 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.257+0000 7efdc6000700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc8108f20 0x7efdc819d640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efdb400e9c0 tx=0x7efdb400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.258+0000 7efdbf400700 1 -- 172.21.15.47:0/932045434 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb400c9c0 con 0x7efdc8108f20 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.258+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc81a2260 con 0x7efdc8108f20 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.258+0000 7efdbf400700 1 -- 172.21.15.47:0/932045434 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdb400cb60 con 0x7efdc8108f20 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.258+0000 7efdbf400700 1 -- 172.21.15.47:0/932045434 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4018680 con 0x7efdc8108f20 2024-05-14T12:25:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.258+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc81a9b80 con 0x7efdc8108f20 2024-05-14T12:25:53.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.261+0000 7efdbf400700 1 -- 172.21.15.47:0/932045434 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efdb4010430 con 0x7efdc8108f20 2024-05-14T12:25:53.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.262+0000 7efddc2acb80 1 Processor -- start 2024-05-14T12:25:53.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efddc2acb80 1 -- start start 2024-05-14T12:25:53.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c95660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efdbf400700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efdac0b2880 0x7efdac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c8f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c8fc00 0x556863c90010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efddc2acb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556863bb19d0 con 0x556863c8fc00 2024-05-14T12:25:53.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efddc2acb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556863b4f710 con 0x556863c95ba0 2024-05-14T12:25:53.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.263+0000 7efddc2acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556863bad990 con 0x556863b11df0 2024-05-14T12:25:53.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdbf400700 1 -- 172.21.15.47:0/932045434 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efdb40e23b0 con 0x7efdc8108f20 2024-05-14T12:25:53.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc7400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c95660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc6a00700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efdac0b2880 0x7efdac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc7400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c95660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34146/0 (socket says 172.21.15.47:34146) 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc7400700 1 -- 172.21.15.47:0/1708041671 learned_addr learned my addr 172.21.15.47:0/1708041671 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc6000700 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c8f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc7400700 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c8fc00 0x556863c90010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc6000700 1 -- 172.21.15.47:0/1708041671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 msgr2=0x556863c95660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc6000700 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c95660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc6000700 1 -- 172.21.15.47:0/1708041671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c8fc00 msgr2=0x556863c90010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc6000700 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c8fc00 0x556863c90010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.264+0000 7efdc6000700 1 -- 172.21.15.47:0/1708041671 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556863afe880 con 0x556863c95ba0 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.265+0000 7efdc6000700 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c8f6c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efdb40a9690 tx=0x7efdb406d320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0b86dddd58bd32b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.265+0000 7efdc6a00700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efdac0b2880 0x7efdac0b4d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b790 tx=0x7efdb800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.265+0000 7efdb3e00700 1 -- 172.21.15.47:0/1708041671 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb406ce90 con 0x556863c95ba0 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.265+0000 7efdb3e00700 1 -- 172.21.15.47:0/1708041671 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdb40b2130 con 0x556863c95ba0 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.265+0000 7efdb3e00700 1 -- 172.21.15.47:0/1708041671 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb406c350 con 0x556863c95ba0 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 -- 172.21.15.47:0/1708041671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 msgr2=0x556863c8f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c8f6c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efdb40a9690 tx=0x7efdb406d320 comp rx=0 tx=0).stop 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 -- 172.21.15.47:0/1708041671 shutdown_connections 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c8fc00 0x556863c90010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c95660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1708041671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c8f6c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 -- 172.21.15.47:0/1708041671 >> 172.21.15.47:0/1708041671 conn(0x556863b50a30 msgr2=0x556863c8a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:53.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 -- 172.21.15.47:0/1708041671 shutdown_connections 2024-05-14T12:25:53.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.266+0000 7efddc2acb80 1 -- 172.21.15.47:0/1708041671 wait complete. 2024-05-14T12:25:53.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.267+0000 7efddc2acb80 1 -- start start 2024-05-14T12:25:53.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.267+0000 7efddc2acb80 1 Processor -- start 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c993d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c8fc00 0x556863c99910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c95ba0 0x556863c99e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efddc2acb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556863c9c670 con 0x556863c95ba0 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efddc2acb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556863b17ad0 con 0x556863c8fc00 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efddc2acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556863c9c7f0 con 0x556863b11df0 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efddc2acb80 10 client.0 _ll_register_callbacks cb 0x556863b45330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efdc6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efdc7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c95ba0 0x556863c99e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efdc6a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34152/0 (socket says 172.21.15.47:34152) 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efdc6a00700 1 -- 172.21.15.47:0/1775624090 learned_addr learned my addr 172.21.15.47:0/1775624090 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.268+0000 7efdc6000700 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c8fc00 0x556863c99910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdc6a00700 1 -- 172.21.15.47:0/1775624090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c8fc00 msgr2=0x556863c99910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdc6a00700 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c8fc00 0x556863c99910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdc6a00700 1 -- 172.21.15.47:0/1775624090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c95ba0 msgr2=0x556863c99e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdc6a00700 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c95ba0 0x556863c99e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdc6a00700 1 -- 172.21.15.47:0/1775624090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556863b773d0 con 0x556863b11df0 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdc7400700 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c95ba0 0x556863c99e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdc6a00700 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c993d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efdb800bc40 tx=0x7efdb8009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2b30159c1789fc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.269+0000 7efdb0c00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efdb0c00700 1 -- 172.21.15.47:0/1775624090 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8033060 con 0x556863b11df0 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556863c5c020 con 0x556863b11df0 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efdb0c00700 1 -- 172.21.15.47:0/1775624090 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efdb8003c20 con 0x556863b11df0 2024-05-14T12:25:53.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efdb0c00700 1 -- 172.21.15.47:0/1775624090 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efdb8003e20 con 0x556863b11df0 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efddc2acb80 10 client.25276 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556863ca72d0 con 0x556863b11df0 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efdb0c00700 1 -- 172.21.15.47:0/1775624090 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556863c5c020 con 0x556863b11df0 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.270+0000 7efdb0c00700 1 -- 172.21.15.47:0/1775624090 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efdb8038070 con 0x556863b11df0 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.271+0000 7efddc2acb80 10 client.25276 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.271+0000 7efddc2acb80 10 client.25276 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.271+0000 7efddc2acb80 20 client.25276 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.271+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863ca98b0 0x556863caad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.271+0000 7efddc2acb80 4 client.25276 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.271+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556863bbf3b0 con 0x556863ca98b0 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.271+0000 7efdc6000700 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863ca98b0 0x556863caad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.272+0000 7efdc6000700 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863ca98b0 0x556863caad20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d977078845467683 server_cookie=5091d3e0e994bb48 in_seq=0 out_seq=0 2024-05-14T12:25:53.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.272+0000 7efdb0c00700 10 client.25276 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.272+0000 7efdb0c00700 1 -- 172.21.15.47:0/1775624090 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556863bbf3b0 con 0x556863ca98b0 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.272+0000 7efdb0c00700 10 client.25276 handle_command_reply: tid=0 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 client.25276 shutdown 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 msgr2=0x556863c993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c993d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efdb800bc40 tx=0x7efdb8009ca0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 shutdown_connections 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863ca98b0 0x556863caad20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863c95ba0 0x556863c99e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863b11df0 0x556863c993d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efdb0c00700 0 client.25276 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1775624090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c8fc00 0x556863c99910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 >> 172.21.15.47:0/1775624090 conn(0x556863b50a30 msgr2=0x556863c8e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 shutdown_connections 2024-05-14T12:25:53.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 1 -- 172.21.15.47:0/1775624090 wait complete. 2024-05-14T12:25:53.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.273+0000 7efddc2acb80 20 client.25276 trim_cache size 0 max 16384 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.296+0000 7efddc2acb80 1 Processor -- start 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efddc2acb80 1 -- start start 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c8f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c94bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863ca5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efddc2acb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556863ca9060 con 0x556863b11df0 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efddc2acb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556863ca9730 con 0x556863c95ba0 2024-05-14T12:25:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efddc2acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556863ca9e00 con 0x556863c8fc00 2024-05-14T12:25:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.297+0000 7efdc7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863ca5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863ca5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54256/0 (socket says 172.21.15.47:54256) 2024-05-14T12:25:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 -- 172.21.15.47:0/2336635614 learned_addr learned my addr 172.21.15.47:0/2336635614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc6a00700 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c8f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc6000700 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c94bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 -- 172.21.15.47:0/2336635614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 msgr2=0x556863c94bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c94bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 -- 172.21.15.47:0/2336635614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 msgr2=0x556863c8f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c8f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 -- 172.21.15.47:0/2336635614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556863c9c7a0 con 0x556863c95ba0 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.298+0000 7efdc7400700 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863ca5a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efdc0008410 tx=0x7efdc0004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb040c9b01a2b902 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.299+0000 7efdb3400700 1 -- 172.21.15.47:0/2336635614 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc001f070 con 0x556863c95ba0 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.299+0000 7efdb3400700 1 -- 172.21.15.47:0/2336635614 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdc0003c10 con 0x556863c95ba0 2024-05-14T12:25:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.299+0000 7efdb3400700 1 -- 172.21.15.47:0/2336635614 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0007760 con 0x556863c95ba0 2024-05-14T12:25:53.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.299+0000 7efddc2acb80 1 -- 172.21.15.47:0/2336635614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 msgr2=0x556863ca5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.299+0000 7efddc2acb80 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863ca5a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efdc0008410 tx=0x7efdc0004b40 comp rx=0 tx=0).stop 2024-05-14T12:25:53.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 -- 172.21.15.47:0/2336635614 shutdown_connections 2024-05-14T12:25:53.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863ca5a50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c8f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 --2- 172.21.15.47:0/2336635614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c94bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 -- 172.21.15.47:0/2336635614 >> 172.21.15.47:0/2336635614 conn(0x556863b50a30 msgr2=0x556863c944b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:53.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 -- 172.21.15.47:0/2336635614 shutdown_connections 2024-05-14T12:25:53.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 -- 172.21.15.47:0/2336635614 wait complete. 2024-05-14T12:25:53.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.300+0000 7efddc2acb80 1 -- start start 2024-05-14T12:25:53.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 1 Processor -- start 2024-05-14T12:25:53.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c9a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c9ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c9b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556863caaba0 con 0x556863b11df0 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556863caa4d0 con 0x556863c95ba0 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556863cab270 con 0x556863c8fc00 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.301+0000 7efddc2acb80 10 client.0 _ll_register_callbacks cb 0x556863c992c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c9ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c9ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34176/0 (socket says 172.21.15.47:34176) 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 -- 172.21.15.47:0/1411327863 learned_addr learned my addr 172.21.15.47:0/1411327863 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6a00700 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c9a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc7400700 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c9b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 -- 172.21.15.47:0/1411327863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 msgr2=0x556863c9b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c9b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 -- 172.21.15.47:0/1411327863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 msgr2=0x556863c9a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c9a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 -- 172.21.15.47:0/1411327863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556863cb4bd0 con 0x556863c8fc00 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdc6000700 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c9ae20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efdb40a9b50 tx=0x7efdb4009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da377496f4b468f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.302+0000 7efdb0c00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efdb0c00700 1 -- 172.21.15.47:0/1411327863 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb406c570 con 0x556863c8fc00 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efdb0c00700 1 -- 172.21.15.47:0/1411327863 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efdb40dfef0 con 0x556863c8fc00 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc0003c10 con 0x556863c8fc00 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efdb0c00700 1 -- 172.21.15.47:0/1411327863 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efdb40aa090 con 0x556863c8fc00 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efddc2acb80 10 client.25282 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556863d14de0 con 0x556863c8fc00 2024-05-14T12:25:53.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efdb0c00700 1 -- 172.21.15.47:0/1411327863 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdc0003c10 con 0x556863c8fc00 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efdb0c00700 1 -- 172.21.15.47:0/1411327863 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efdb406c170 con 0x556863c8fc00 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.303+0000 7efddc2acb80 10 client.25282 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.304+0000 7efddc2acb80 10 client.25282 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.304+0000 7efddc2acb80 20 client.25282 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.304+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863d16d00 0x556863d18170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.304+0000 7efddc2acb80 4 client.25282 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.304+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "status"}) -- 0x556863bb9450 con 0x556863d16d00 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.304+0000 7efdc6a00700 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863d16d00 0x556863d18170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efdc6a00700 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863d16d00 0x556863d18170 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b812cf00555fe1a6 server_cookie=ede4a225431393d9 in_seq=0 out_seq=0 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efdb0c00700 10 client.25282 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efdb0c00700 1 -- 172.21.15.47:0/1411327863 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556863bb9450 con 0x556863d16d00 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efdb0c00700 10 client.25282 handle_command_reply: tid=0 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 client.25282 shutdown 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 msgr2=0x556863c9ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c9ae20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efdb40a9b50 tx=0x7efdb4009790 comp rx=0 tx=0).stop 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 shutdown_connections 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x556863d16d00 0x556863d18170 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556863c95ba0 0x556863c9b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556863b11df0 0x556863c9a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 --2- 172.21.15.47:0/1411327863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556863c8fc00 0x556863c9ae20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efdb0c00700 0 client.25282 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.305+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 >> 172.21.15.47:0/1411327863 conn(0x556863b50a30 msgr2=0x556863c93080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.306+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 shutdown_connections 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.306+0000 7efddc2acb80 1 -- 172.21.15.47:0/1411327863 wait complete. 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.306+0000 7efddc2acb80 20 client.25282 trim_cache size 0 max 16384 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 2, 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24517, 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 273.92217694800001, 2024-05-14T12:25:53.309 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 29, 2024-05-14T12:25:53.310 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:25:53.310 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 84, 2024-05-14T12:25:53.310 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 325.66038073599998 2024-05-14T12:25:53.310 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:25:53.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.306+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efdac0b2880 msgr2=0x7efdac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.306+0000 7efdcd800700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efdac0b2880 0x7efdac0b4d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b790 tx=0x7efdb800b260 comp rx=0 tx=0).stop 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.306+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc8108f20 msgr2=0x7efdc819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.306+0000 7efdcd800700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc8108f20 0x7efdc819d640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efdb400e9c0 tx=0x7efdb400ecd0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 shutdown_connections 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efdac0b2880 0x7efdac0b4d90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8109870 0x7efdc81a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdc81045f0 0x7efdc819d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 --2- 172.21.15.47:0/932045434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdc8108f20 0x7efdc819d640 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 >> 172.21.15.47:0/932045434 conn(0x7efdc8100040 msgr2=0x7efdc810a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 shutdown_connections 2024-05-14T12:25:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:53.307+0000 7efdcd800700 1 -- 172.21.15.47:0/932045434 wait complete. 2024-05-14T12:25:53.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:53 smithi047 ceph-mon[31254]: pgmap v471: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-05-14T12:25:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:53 smithi073 ceph-mon[35809]: pgmap v471: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-05-14T12:25:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:53 smithi066 ceph-mon[35981]: pgmap v471: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-05-14T12:25:54.136 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-14T12:25:54.610 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:55 smithi047 ceph-mon[31254]: pgmap v472: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-14T12:25:56.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:55 smithi073 ceph-mon[35809]: pgmap v472: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-14T12:25:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:55 smithi066 ceph-mon[35981]: pgmap v472: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-14T12:25:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 -- 172.21.15.47:0/1370815564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10af70 msgr2=0x7f3acc10b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/1370815564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10af70 0x7f3acc10b380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80098f0 tx=0x7f3ab8009c00 comp rx=0 tx=0).stop 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 -- 172.21.15.47:0/1370815564 shutdown_connections 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/1370815564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc10b8c0 0x7f3acc113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/1370815564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3acc106640 0x7f3acc106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/1370815564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10af70 0x7f3acc10b380 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 -- 172.21.15.47:0/1370815564 >> 172.21.15.47:0/1370815564 conn(0x7f3acc101ed0 msgr2=0x7f3acc104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 -- 172.21.15.47:0/1370815564 shutdown_connections 2024-05-14T12:25:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.070+0000 7f3ad1c00700 1 -- 172.21.15.47:0/1370815564 wait complete. 2024-05-14T12:25:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 Processor -- start 2024-05-14T12:25:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 -- start start 2024-05-14T12:25:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc106640 0x7f3acc19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3acc10af70 0x7f3acc19d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10b8c0 0x7f3acc1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc116520 con 0x7f3acc106640 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1163a0 con 0x7f3acc10b8c0 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.072+0000 7f3ad1c00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1166a0 con 0x7f3acc10af70 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc106640 0x7f3acc19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3ad1200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10b8c0 0x7f3acc1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc106640 0x7f3acc19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55924/0 (socket says 172.21.15.47:55924) 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3acbe00700 1 -- 172.21.15.47:0/178921906 learned_addr learned my addr 172.21.15.47:0/178921906 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3acb400700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3acc10af70 0x7f3acc19d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3ad1200700 1 -- 172.21.15.47:0/178921906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3acc10af70 msgr2=0x7f3acc19d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3ad1200700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3acc10af70 0x7f3acc19d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3ad1200700 1 -- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc106640 msgr2=0x7f3acc19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3ad1200700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc106640 0x7f3acc19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3ad1200700 1 -- 172.21.15.47:0/178921906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc1a1d80 con 0x7f3acc10b8c0 2024-05-14T12:25:57.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.073+0000 7f3ad1200700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10b8c0 0x7f3acc1a16e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4007fd0 tx=0x7f3ac400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:57.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.074+0000 7f3ac8c00700 1 -- 172.21.15.47:0/178921906 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4004bb0 con 0x7f3acc10b8c0 2024-05-14T12:25:57.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.074+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3acc1a2070 con 0x7f3acc10b8c0 2024-05-14T12:25:57.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.074+0000 7f3ac8c00700 1 -- 172.21.15.47:0/178921906 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac4004d50 con 0x7f3acc10b8c0 2024-05-14T12:25:57.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.074+0000 7f3ac8c00700 1 -- 172.21.15.47:0/178921906 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4005a10 con 0x7f3acc10b8c0 2024-05-14T12:25:57.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.074+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3acc1a9990 con 0x7f3acc10b8c0 2024-05-14T12:25:57.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.078+0000 7f3ac8c00700 1 -- 172.21.15.47:0/178921906 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3ac4005140 con 0x7f3acc10b8c0 2024-05-14T12:25:57.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.079+0000 7f3ae1e24b80 1 Processor -- start 2024-05-14T12:25:57.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.079+0000 7f3ae1e24b80 1 -- start start 2024-05-14T12:25:57.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.079+0000 7f3ac8c00700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ab00b2900 0x7f3ab00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d3acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d46de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ac8c00700 1 -- 172.21.15.47:0/178921906 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3ac40e19d0 con 0x7f3acc10b8c0 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e49c5c9d0 con 0x559e49d3b230 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e49bfa710 con 0x559e49d3b640 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559e49c58990 con 0x559e49bbcdf0 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3acb400700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ab00b2900 0x7f3ab00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3acb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3acb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55928/0 (socket says 172.21.15.47:55928) 2024-05-14T12:25:57.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3acb400700 1 -- 172.21.15.47:0/2202116514 learned_addr learned my addr 172.21.15.47:0/2202116514 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:57.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d3acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.080+0000 7f3ad1200700 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d46de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acbe00700 1 -- 172.21.15.47:0/2202116514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 msgr2=0x559e49d46de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acbe00700 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d46de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acbe00700 1 -- 172.21.15.47:0/2202116514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 msgr2=0x559e49d44890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acbe00700 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acbe00700 1 -- 172.21.15.47:0/2202116514 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e49ba9880 con 0x559e49bbcdf0 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acb400700 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acbe00700 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d3acf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00bdb0 tx=0x7f3abc0106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446e930e5d37f8d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3acb400700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ab00b2900 0x7f3ab00b4e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x559e49d371d0 tx=0x7f3ab80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.081+0000 7f3ac1600700 1 -- 172.21.15.47:0/2202116514 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc010e10 con 0x559e49bbcdf0 2024-05-14T12:25:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.082+0000 7f3ac1600700 1 -- 172.21.15.47:0/2202116514 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3abc0044e0 con 0x559e49bbcdf0 2024-05-14T12:25:57.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.082+0000 7f3ac1600700 1 -- 172.21.15.47:0/2202116514 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0116a0 con 0x559e49bbcdf0 2024-05-14T12:25:57.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.082+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/2202116514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 msgr2=0x559e49d3acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.082+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d3acf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00bdb0 tx=0x7f3abc0106b0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/2202116514 shutdown_connections 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d46de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d3acf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/2202116514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/2202116514 >> 172.21.15.47:0/2202116514 conn(0x559e49bfba30 msgr2=0x559e49d35b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/2202116514 shutdown_connections 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/2202116514 wait complete. 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.083+0000 7f3ae1e24b80 1 -- start start 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 1 Processor -- start 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49bbcdf0 0x559e49d443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b230 0x559e49d44910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d44e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e49d47750 con 0x559e49bbcdf0 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e49bc2ad0 con 0x559e49d3b640 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559e49d478d0 con 0x559e49d3b230 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3ae1e24b80 10 client.0 _ll_register_callbacks cb 0x559e49bf0330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.084+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49bbcdf0 0x559e49d443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acb400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b230 0x559e49d44910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49bbcdf0 0x559e49d443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55932/0 (socket says 172.21.15.47:55932) 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 -- 172.21.15.47:0/3303563147 learned_addr learned my addr 172.21.15.47:0/3303563147 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3ad1200700 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d44e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 -- 172.21.15.47:0/3303563147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b230 msgr2=0x559e49d44910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b230 0x559e49d44910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 -- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 msgr2=0x559e49d44e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d44e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 -- 172.21.15.47:0/3303563147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e49c223d0 con 0x559e49bbcdf0 2024-05-14T12:25:57.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3acbe00700 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49bbcdf0 0x559e49d443d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3abc005810 tx=0x7f3abc003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fa5ecea6e4bee9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:57.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.085+0000 7f3ab6000700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:25:57.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.086+0000 7f3ab6000700 1 -- 172.21.15.47:0/3303563147 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc029060 con 0x559e49bbcdf0 2024-05-14T12:25:57.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.086+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3abc0044e0 con 0x559e49bbcdf0 2024-05-14T12:25:57.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.086+0000 7f3ab6000700 1 -- 172.21.15.47:0/3303563147 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3abc010e20 con 0x559e49bbcdf0 2024-05-14T12:25:57.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.086+0000 7f3ab6000700 1 -- 172.21.15.47:0/3303563147 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3abc003c50 con 0x559e49bbcdf0 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.086+0000 7f3ae1e24b80 10 client.15162 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.086+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e49d52420 con 0x559e49bbcdf0 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ab6000700 1 -- 172.21.15.47:0/3303563147 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3abc0044e0 con 0x559e49bbcdf0 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ab6000700 1 -- 172.21.15.47:0/3303563147 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3abc02e070 con 0x559e49bbcdf0 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ae1e24b80 10 client.15162 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ae1e24b80 10 client.15162 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ae1e24b80 20 client.15162 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49d54710 0x559e49d55b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ae1e24b80 4 client.15162 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e49d07020 con 0x559e49d54710 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.087+0000 7f3acb400700 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49d54710 0x559e49d55b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.088+0000 7f3acb400700 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49d54710 0x559e49d55b80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da78064611eb12d1 server_cookie=1e8ffff285997499 in_seq=0 out_seq=0 2024-05-14T12:25:57.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.088+0000 7f3ab6000700 10 client.15162 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:25:57.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.089+0000 7f3ab6000700 1 -- 172.21.15.47:0/3303563147 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559e49d07020 con 0x559e49d54710 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.089+0000 7f3ab6000700 10 client.15162 handle_command_reply: tid=0 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.089+0000 7f3ae1e24b80 1 client.15162 shutdown 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.089+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49bbcdf0 msgr2=0x559e49d443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.089+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49bbcdf0 0x559e49d443d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3abc005810 tx=0x7f3abc003680 comp rx=0 tx=0).stop 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 shutdown_connections 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49d54710 0x559e49d55b80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b640 0x559e49d44e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49bbcdf0 0x559e49d443d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/3303563147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b230 0x559e49d44910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 >> 172.21.15.47:0/3303563147 conn(0x559e49bfba30 msgr2=0x559e49d396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ab6000700 0 client.15162 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:25:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 shutdown_connections 2024-05-14T12:25:57.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/3303563147 wait complete. 2024-05-14T12:25:57.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.090+0000 7f3ae1e24b80 20 client.15162 trim_cache size 0 max 16384 2024-05-14T12:25:57.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.113+0000 7f3ae1e24b80 1 Processor -- start 2024-05-14T12:25:57.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ae1e24b80 1 -- start start 2024-05-14T12:25:57.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49bbcdf0 0x559e49d53880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b640 0x559e49d39dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e49d53ec0 con 0x559e49d3b230 2024-05-14T12:25:57.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e49d54590 con 0x559e49bbcdf0 2024-05-14T12:25:57.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559e49d54c60 con 0x559e49d3b640 2024-05-14T12:25:57.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3acb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3acb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55936/0 (socket says 172.21.15.47:55936) 2024-05-14T12:25:57.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3acb400700 1 -- 172.21.15.47:0/1699380395 learned_addr learned my addr 172.21.15.47:0/1699380395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:57.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3acbe00700 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49bbcdf0 0x559e49d53880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.114+0000 7f3ad1200700 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b640 0x559e49d39dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3acb400700 1 -- 172.21.15.47:0/1699380395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b640 msgr2=0x559e49d39dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3acb400700 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b640 0x559e49d39dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3acb400700 1 -- 172.21.15.47:0/1699380395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49bbcdf0 msgr2=0x559e49d53880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3acb400700 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49bbcdf0 0x559e49d53880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3acb400700 1 -- 172.21.15.47:0/1699380395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e49d3c330 con 0x559e49d3b230 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3acbe00700 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49bbcdf0 0x559e49d53880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3ad1200700 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b640 0x559e49d39dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:25:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.115+0000 7f3acb400700 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8005e90 tx=0x7f3ab8005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb8bcff761f181f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:57.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.116+0000 7f3ac0c00700 1 -- 172.21.15.47:0/1699380395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab803b070 con 0x559e49d3b230 2024-05-14T12:25:57.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.116+0000 7f3ac0c00700 1 -- 172.21.15.47:0/1699380395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ab8003d80 con 0x559e49d3b230 2024-05-14T12:25:57.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.116+0000 7f3ac0c00700 1 -- 172.21.15.47:0/1699380395 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800f830 con 0x559e49d3b230 2024-05-14T12:25:57.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.116+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/1699380395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 msgr2=0x559e49d44c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.116+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8005e90 tx=0x7f3ab8005e20 comp rx=0 tx=0).stop 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/1699380395 shutdown_connections 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49d3b640 0x559e49d39dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49bbcdf0 0x559e49d53880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/1699380395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b230 0x559e49d44c90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/1699380395 >> 172.21.15.47:0/1699380395 conn(0x559e49bfba30 msgr2=0x559e49d396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/1699380395 shutdown_connections 2024-05-14T12:25:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/1699380395 wait complete. 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 -- start start 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.117+0000 7f3ae1e24b80 1 Processor -- start 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d57fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b230 0x559e49d584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3ae1e24b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b640 0x559e49dbdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e49d55a00 con 0x559e49d3b640 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e49d55330 con 0x559e49d3b230 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3ae1e24b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559e49d560d0 con 0x559e49bbcdf0 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3ae1e24b80 10 client.0 _ll_register_callbacks cb 0x559e49bf0330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.118+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d57fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3ad1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b640 0x559e49dbdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acb400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b230 0x559e49d584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d57fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34238/0 (socket says 172.21.15.47:34238) 2024-05-14T12:25:57.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acbe00700 1 -- 172.21.15.47:0/536814568 learned_addr learned my addr 172.21.15.47:0/536814568 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:25:57.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acb400700 1 -- 172.21.15.47:0/536814568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 msgr2=0x559e49d57fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acb400700 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d57fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acb400700 1 -- 172.21.15.47:0/536814568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b640 msgr2=0x559e49dbdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:25:57.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acb400700 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b640 0x559e49dbdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acb400700 1 -- 172.21.15.47:0/536814568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e49dbe0b0 con 0x559e49d3b230 2024-05-14T12:25:57.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3acb400700 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b230 0x559e49d584e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x559e49c65010 tx=0x7f3ab8004fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f140153d87711df server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:25:57.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.119+0000 7f3ab6000700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.120+0000 7f3ab6000700 1 -- 172.21.15.47:0/536814568 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab803b030 con 0x559e49d3b230 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.120+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ab8003d80 con 0x559e49d3b230 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.120+0000 7f3ab6000700 1 -- 172.21.15.47:0/536814568 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3ab800b6d0 con 0x559e49d3b230 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.120+0000 7f3ab6000700 1 -- 172.21.15.47:0/536814568 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ab800b910 con 0x559e49d3b230 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.120+0000 7f3ae1e24b80 10 client.25277 fetch_fsmap learned FSMap version 29 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.120+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e49dbf180 con 0x559e49d3b230 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.120+0000 7f3ab6000700 1 -- 172.21.15.47:0/536814568 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ab8003d80 con 0x559e49d3b230 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3ab6000700 1 -- 172.21.15.47:0/536814568 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3ab8026040 con 0x559e49d3b230 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3ae1e24b80 10 client.25277 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3ae1e24b80 10 client.25277 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3ae1e24b80 20 client.25277 populate_metadata read hostname 'smithi047' 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49dc0fc0 0x559e49dc2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:25:57.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3ae1e24b80 4 client.25277 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "status"}) -- 0x559e49c6a3b0 con 0x559e49dc0fc0 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.121+0000 7f3acbe00700 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49dc0fc0 0x559e49dc2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3acbe00700 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49dc0fc0 0x559e49dc2430 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5132a683e3db080b server_cookie=55d41413d595686b in_seq=0 out_seq=0 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ab6000700 10 client.25277 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ab6000700 1 -- 172.21.15.47:0/536814568 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559e49c6a3b0 con 0x559e49dc0fc0 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ab6000700 10 client.25277 handle_command_reply: tid=0 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 client.25277 shutdown 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b230 msgr2=0x559e49d584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b230 0x559e49d584e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x559e49c65010 tx=0x7f3ab8004fc0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 shutdown_connections 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e49d3b640 0x559e49dbdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e49bbcdf0 0x559e49d57fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x559e49dc0fc0 0x559e49dc2430 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 --2- 172.21.15.47:0/536814568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e49d3b230 0x559e49d584e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 >> 172.21.15.47:0/536814568 conn(0x559e49bfba30 msgr2=0x559e49d45860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ab6000700 0 client.25277 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.122+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 shutdown_connections 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.123+0000 7f3ae1e24b80 1 -- 172.21.15.47:0/536814568 wait complete. 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.123+0000 7f3ae1e24b80 20 client.25277 trim_cache size 0 max 16384 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 1, 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24521, 2024-05-14T12:25:57.128 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 278.75346834099997, 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 29, 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 84, 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 317.30712731400001 2024-05-14T12:25:57.129 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.123+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ab00b2900 msgr2=0x7f3ab00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.123+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ab00b2900 0x7f3ab00b4e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x559e49d371d0 tx=0x7f3ab80058e0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.123+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10b8c0 msgr2=0x7f3acc1a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.123+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10b8c0 0x7f3acc1a16e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4007fd0 tx=0x7f3ac400d3b0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 shutdown_connections 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3ab00b2900 0x7f3ab00b4e10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3acc10b8c0 0x7f3acc1a16e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc106640 0x7f3acc19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 --2- 172.21.15.47:0/178921906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3acc10af70 0x7f3acc19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:25:57.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 >> 172.21.15.47:0/178921906 conn(0x7f3acc101ed0 msgr2=0x7f3acc10c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:25:57.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 shutdown_connections 2024-05-14T12:25:57.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:25:57.124+0000 7f3ad1c00700 1 -- 172.21.15.47:0/178921906 wait complete. 2024-05-14T12:25:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:57 smithi047 ceph-mon[31254]: pgmap v473: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:25:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:57 smithi073 ceph-mon[35809]: pgmap v473: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:25:58.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.a status 2024-05-14T12:25:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:57 smithi066 ceph-mon[35981]: pgmap v473: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:25:58.533 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:25:59.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:25:59 smithi047 ceph-mon[31254]: pgmap v474: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T12:26:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:25:59 smithi073 ceph-mon[35809]: pgmap v474: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T12:26:00.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:25:59 smithi066 ceph-mon[35981]: pgmap v474: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T12:26:00.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 -- 172.21.15.47:0/500806769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c075d30 msgr2=0x7f4f5c076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 --2- 172.21.15.47:0/500806769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c075d30 0x7f4f5c076140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009990 tx=0x7f4f4c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 -- 172.21.15.47:0/500806769 shutdown_connections 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 --2- 172.21.15.47:0/500806769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c1109b0 0x7f4f5c112e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 --2- 172.21.15.47:0/500806769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c075d30 0x7f4f5c076140 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 --2- 172.21.15.47:0/500806769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f5c076680 0x7f4f5c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 -- 172.21.15.47:0/500806769 >> 172.21.15.47:0/500806769 conn(0x7f4f5c079d10 msgr2=0x7f4f5c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 -- 172.21.15.47:0/500806769 shutdown_connections 2024-05-14T12:26:00.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.858+0000 7f4f62600700 1 -- 172.21.15.47:0/500806769 wait complete. 2024-05-14T12:26:00.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.860+0000 7f4f62600700 1 Processor -- start 2024-05-14T12:26:00.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.860+0000 7f4f62600700 1 -- start start 2024-05-14T12:26:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f62600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c075d30 0x7f4f5c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f62600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f5c076680 0x7f4f5c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f62600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c1109b0 0x7f4f5c1a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f62600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c1164f0 con 0x7f4f5c076680 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f62600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c116370 con 0x7f4f5c1109b0 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f62600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c116670 con 0x7f4f5c075d30 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f61200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c075d30 0x7f4f5c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f53e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f5c076680 0x7f4f5c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f61200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c075d30 0x7f4f5c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56374/0 (socket says 172.21.15.47:56374) 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f61200700 1 -- 172.21.15.47:0/1152099075 learned_addr learned my addr 172.21.15.47:0/1152099075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.861+0000 7f4f61c00700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c1109b0 0x7f4f5c1a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f61200700 1 -- 172.21.15.47:0/1152099075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c1109b0 msgr2=0x7f4f5c1a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f61200700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c1109b0 0x7f4f5c1a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f61200700 1 -- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f5c076680 msgr2=0x7f4f5c19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f61200700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f5c076680 0x7f4f5c19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f61200700 1 -- 172.21.15.47:0/1152099075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c1a1d50 con 0x7f4f5c075d30 2024-05-14T12:26:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f53e00700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f5c076680 0x7f4f5c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f61200700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c075d30 0x7f4f5c19ce80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c000c00 tx=0x7f4f4c0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f5a000700 1 -- 172.21.15.47:0/1152099075 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c027070 con 0x7f4f5c075d30 2024-05-14T12:26:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f5a000700 1 -- 172.21.15.47:0/1152099075 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c022470 con 0x7f4f5c075d30 2024-05-14T12:26:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f5a000700 1 -- 172.21.15.47:0/1152099075 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c017650 con 0x7f4f5c075d30 2024-05-14T12:26:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.862+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c1a1fe0 con 0x7f4f5c075d30 2024-05-14T12:26:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.863+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5c1a9960 con 0x7f4f5c075d30 2024-05-14T12:26:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.866+0000 7f4f5a000700 1 -- 172.21.15.47:0/1152099075 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4f4c02a070 con 0x7f4f5c075d30 2024-05-14T12:26:00.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.867+0000 7f4f72833b80 1 Processor -- start 2024-05-14T12:26:00.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f72833b80 1 -- start start 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f5a000700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f3c0b2900 0x7f4f3c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592230 0x5628cc59b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f5a000700 1 -- 172.21.15.47:0/1152099075 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4f4c0e2fa0 con 0x7f4f5c075d30 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc59dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f72833b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628cc4b39d0 con 0x5628cc592640 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f72833b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5628cc451710 con 0x5628cc592230 2024-05-14T12:26:00.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.868+0000 7f4f72833b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5628cc4af990 con 0x5628cc413df0 2024-05-14T12:26:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f53e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592230 0x5628cc59b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56376/0 (socket says 172.21.15.47:56376) 2024-05-14T12:26:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 -- 172.21.15.47:0/1018519736 learned_addr learned my addr 172.21.15.47:0/1018519736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61c00700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f3c0b2900 0x7f4f3c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 -- 172.21.15.47:0/1018519736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592230 msgr2=0x5628cc59b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 --2- 172.21.15.47:0/1018519736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592230 0x5628cc59b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 -- 172.21.15.47:0/1018519736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 msgr2=0x5628cc59dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 --2- 172.21.15.47:0/1018519736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc59dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 -- 172.21.15.47:0/1018519736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628cc400880 con 0x5628cc413df0 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.869+0000 7f4f61200700 1 --2- 172.21.15.47:0/1018519736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0058b0 tx=0x7f4f4c0aa1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7790854003f80763 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.870+0000 7f4f61c00700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f3c0b2900 0x7f4f3c0b4e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5628cc592ad0 tx=0x7f4f54009750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.870+0000 7f4f52000700 1 -- 172.21.15.47:0/1018519736 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0ae9c0 con 0x5628cc413df0 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.870+0000 7f4f52000700 1 -- 172.21.15.47:0/1018519736 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c0b33e0 con 0x5628cc413df0 2024-05-14T12:26:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.870+0000 7f4f52000700 1 -- 172.21.15.47:0/1018519736 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0aa870 con 0x5628cc413df0 2024-05-14T12:26:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 -- 172.21.15.47:0/1018519736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 msgr2=0x5628cc591cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1018519736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0058b0 tx=0x7f4f4c0aa1a0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 -- 172.21.15.47:0/1018519736 shutdown_connections 2024-05-14T12:26:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1018519736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc59dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1018519736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1018519736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592230 0x5628cc59b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 -- 172.21.15.47:0/1018519736 >> 172.21.15.47:0/1018519736 conn(0x5628cc452a30 msgr2=0x5628cc58cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 -- 172.21.15.47:0/1018519736 shutdown_connections 2024-05-14T12:26:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.871+0000 7f4f72833b80 1 -- 172.21.15.47:0/1018519736 wait complete. 2024-05-14T12:26:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.872+0000 7f4f72833b80 1 -- start start 2024-05-14T12:26:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.872+0000 7f4f72833b80 1 Processor -- start 2024-05-14T12:26:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.872+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc413df0 0x5628cc59b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.872+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc59b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.872+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592640 0x5628cc59bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f72833b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628cc59e510 con 0x5628cc592230 2024-05-14T12:26:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f72833b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5628cc419ad0 con 0x5628cc413df0 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f72833b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5628cc59e690 con 0x5628cc592640 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f72833b80 10 client.0 _ll_register_callbacks cb 0x5628cc447330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f61200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc413df0 0x5628cc59b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f53e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc59b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f53e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc59b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54038/0 (socket says 172.21.15.47:54038) 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f53e00700 1 -- 172.21.15.47:0/2084394108 learned_addr learned my addr 172.21.15.47:0/2084394108 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f61c00700 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592640 0x5628cc59bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f53e00700 1 -- 172.21.15.47:0/2084394108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592640 msgr2=0x5628cc59bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.873+0000 7f4f53e00700 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592640 0x5628cc59bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f53e00700 1 -- 172.21.15.47:0/2084394108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc413df0 msgr2=0x5628cc59b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f53e00700 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc413df0 0x5628cc59b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f53e00700 1 -- 172.21.15.47:0/2084394108 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628cc4793d0 con 0x5628cc592230 2024-05-14T12:26:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f61200700 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc413df0 0x5628cc59b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:00.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f53e00700 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc59b810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f44012d20 tx=0x7f4f4400f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706372e5608c625e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:00.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f4aa00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:26:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f4aa00700 1 -- 172.21.15.47:0/2084394108 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400fb80 con 0x5628cc592230 2024-05-14T12:26:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f4aa00700 1 -- 172.21.15.47:0/2084394108 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4f4400fd20 con 0x5628cc592230 2024-05-14T12:26:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.874+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f4c0b33e0 con 0x5628cc592230 2024-05-14T12:26:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f4aa00700 1 -- 172.21.15.47:0/2084394108 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f44004050 con 0x5628cc592230 2024-05-14T12:26:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f72833b80 10 client.15177 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628cc5a90d0 con 0x5628cc592230 2024-05-14T12:26:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f4aa00700 1 -- 172.21.15.47:0/2084394108 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c0b33e0 con 0x5628cc592230 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f4aa00700 1 -- 172.21.15.47:0/2084394108 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4f44010430 con 0x5628cc592230 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f72833b80 10 client.15177 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f72833b80 10 client.15177 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f72833b80 20 client.15177 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.875+0000 7f4f72833b80 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc5ab6f0 0x5628cc5acb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.876+0000 7f4f72833b80 4 client.15177 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.876+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628cc55e020 con 0x5628cc5ab6f0 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.876+0000 7f4f61200700 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc5ab6f0 0x5628cc5acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.876+0000 7f4f61200700 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc5ab6f0 0x5628cc5acb60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1fc1368d108ff4 server_cookie=98acf1b421afa3d4 in_seq=0 out_seq=0 2024-05-14T12:26:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.876+0000 7f4f4aa00700 10 client.15177 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.877+0000 7f4f4aa00700 1 -- 172.21.15.47:0/2084394108 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5628cc55e020 con 0x5628cc5ab6f0 2024-05-14T12:26:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.877+0000 7f4f4aa00700 10 client.15177 handle_command_reply: tid=0 2024-05-14T12:26:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.877+0000 7f4f72833b80 1 client.15177 shutdown 2024-05-14T12:26:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 msgr2=0x5628cc59b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc59b810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f44012d20 tx=0x7f4f4400f6a0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 shutdown_connections 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc5ab6f0 0x5628cc5acb60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592640 0x5628cc59bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc413df0 0x5628cc59b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 --2- 172.21.15.47:0/2084394108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc59b810 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 >> 172.21.15.47:0/2084394108 conn(0x5628cc452a30 msgr2=0x5628cc5906b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f4aa00700 0 client.15177 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 shutdown_connections 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 1 -- 172.21.15.47:0/2084394108 wait complete. 2024-05-14T12:26:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.878+0000 7f4f72833b80 20 client.15177 trim_cache size 0 max 16384 2024-05-14T12:26:00.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.901+0000 7f4f72833b80 1 Processor -- start 2024-05-14T12:26:00.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f72833b80 1 -- start start 2024-05-14T12:26:00.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc5a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592640 0x5628cc596630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f72833b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628cc5aaea0 con 0x5628cc592230 2024-05-14T12:26:00.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f72833b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5628cc5ab570 con 0x5628cc592640 2024-05-14T12:26:00.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f72833b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5628cc5abc40 con 0x5628cc413df0 2024-05-14T12:26:00.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f53e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc5a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f61200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f53e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc5a78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54052/0 (socket says 172.21.15.47:54052) 2024-05-14T12:26:00.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f53e00700 1 -- 172.21.15.47:0/526370452 learned_addr learned my addr 172.21.15.47:0/526370452 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:00.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.902+0000 7f4f61c00700 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592640 0x5628cc596630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.903+0000 7f4f61200700 1 -- 172.21.15.47:0/526370452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592640 msgr2=0x5628cc596630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.903+0000 7f4f61200700 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592640 0x5628cc596630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.903+0000 7f4f61200700 1 -- 172.21.15.47:0/526370452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 msgr2=0x5628cc5a78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.903+0000 7f4f61200700 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc5a78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.903+0000 7f4f61200700 1 -- 172.21.15.47:0/526370452 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628cc5ab390 con 0x5628cc413df0 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.903+0000 7f4f53e00700 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc5a78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.903+0000 7f4f61200700 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0098e0 tx=0x7f4f4c01a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c18866213db3bf8b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.904+0000 7f4f51600700 1 -- 172.21.15.47:0/526370452 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0094b0 con 0x5628cc413df0 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.904+0000 7f4f51600700 1 -- 172.21.15.47:0/526370452 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c0aa870 con 0x5628cc413df0 2024-05-14T12:26:00.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.904+0000 7f4f51600700 1 -- 172.21.15.47:0/526370452 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c090b80 con 0x5628cc413df0 2024-05-14T12:26:00.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 -- 172.21.15.47:0/526370452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 msgr2=0x5628cc591cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0098e0 tx=0x7f4f4c01a040 comp rx=0 tx=0).stop 2024-05-14T12:26:00.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 -- 172.21.15.47:0/526370452 shutdown_connections 2024-05-14T12:26:00.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc592640 0x5628cc596630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc413df0 0x5628cc591cd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 --2- 172.21.15.47:0/526370452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592230 0x5628cc5a78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 -- 172.21.15.47:0/526370452 >> 172.21.15.47:0/526370452 conn(0x5628cc452a30 msgr2=0x5628cc599bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:00.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 -- 172.21.15.47:0/526370452 shutdown_connections 2024-05-14T12:26:00.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 -- 172.21.15.47:0/526370452 wait complete. 2024-05-14T12:26:00.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.905+0000 7f4f72833b80 1 -- start start 2024-05-14T12:26:00.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 1 Processor -- start 2024-05-14T12:26:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592230 0x5628cc5aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc5af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc5b6750 0x5628cc5afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5628cc5ac9e0 con 0x5628cc592640 2024-05-14T12:26:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5628cc5ac310 con 0x5628cc5b6750 2024-05-14T12:26:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5628cc5ad0b0 con 0x5628cc592230 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.906+0000 7f4f72833b80 10 client.0 _ll_register_callbacks cb 0x5628cc447330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f53e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc5af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f61200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592230 0x5628cc5aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f61200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592230 0x5628cc5aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56408/0 (socket says 172.21.15.47:56408) 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f61200700 1 -- 172.21.15.47:0/1001145341 learned_addr learned my addr 172.21.15.47:0/1001145341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f61c00700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc5b6750 0x5628cc5afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f53e00700 1 -- 172.21.15.47:0/1001145341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592230 msgr2=0x5628cc5aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f53e00700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592230 0x5628cc5aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f53e00700 1 -- 172.21.15.47:0/1001145341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc5b6750 msgr2=0x5628cc5afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f53e00700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc5b6750 0x5628cc5afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f53e00700 1 -- 172.21.15.47:0/1001145341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628cc614d10 con 0x5628cc592640 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f61200700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592230 0x5628cc5aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.907+0000 7f4f61c00700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc5b6750 0x5628cc5afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:00.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f53e00700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc5af4c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009340 tx=0x7f4f440106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab00236880346c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:00.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f4aa00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:26:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f4aa00700 1 -- 172.21.15.47:0/1001145341 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44036020 con 0x5628cc592640 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f4aa00700 1 -- 172.21.15.47:0/1001145341 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4f4400fd90 con 0x5628cc592640 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f4c0aa870 con 0x5628cc592640 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f4aa00700 1 -- 172.21.15.47:0/1001145341 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f44000e60 con 0x5628cc592640 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f72833b80 10 client.15183 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.908+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628cc615f90 con 0x5628cc592640 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f4aa00700 1 -- 172.21.15.47:0/1001145341 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f4c0aa870 con 0x5628cc592640 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f4aa00700 1 -- 172.21.15.47:0/1001145341 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4f4403b070 con 0x5628cc592640 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f72833b80 10 client.15183 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f72833b80 10 client.15183 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f72833b80 20 client.15183 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc618290 0x5628cc619700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f72833b80 4 client.15183 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T12:26:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "status"}) -- 0x5628cc4c13b0 con 0x5628cc618290 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.909+0000 7f4f61200700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc618290 0x5628cc619700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.910+0000 7f4f61200700 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc618290 0x5628cc619700 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b84ca1737cc7901f server_cookie=5ae54fac9e0ff2d8 in_seq=0 out_seq=0 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.910+0000 7f4f4aa00700 10 client.15183 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.910+0000 7f4f4aa00700 1 -- 172.21.15.47:0/1001145341 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5628cc4c13b0 con 0x5628cc618290 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.910+0000 7f4f4aa00700 10 client.15183 handle_command_reply: tid=0 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.910+0000 7f4f72833b80 1 client.15183 shutdown 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 msgr2=0x5628cc5af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc5af4c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009340 tx=0x7f4f440106e0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 shutdown_connections 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5628cc618290 0x5628cc619700 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628cc5b6750 0x5628cc5afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628cc592230 0x5628cc5aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 --2- 172.21.15.47:0/1001145341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5628cc592640 0x5628cc5af4c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 >> 172.21.15.47:0/1001145341 conn(0x5628cc452a30 msgr2=0x5628cc5997c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:00.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f4aa00700 0 client.15183 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:00.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 shutdown_connections 2024-05-14T12:26:00.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 1 -- 172.21.15.47:0/1001145341 wait complete. 2024-05-14T12:26:00.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.911+0000 7f4f72833b80 20 client.15183 trim_cache size 0 max 16384 2024-05-14T12:26:00.914 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:26:00.914 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "e5959f02-11ea-11ef-bc98-c7b262605968", 2024-05-14T12:26:00.914 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-14T12:26:00.914 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24535, 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 298.23592146099998, 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 29, 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 84, 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 84, 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 323.90536701799999 2024-05-14T12:26:00.915 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f3c0b2900 msgr2=0x7f4f3c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f3c0b2900 0x7f4f3c0b4e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5628cc592ad0 tx=0x7f4f54009750 comp rx=0 tx=0).stop 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c075d30 msgr2=0x7f4f5c19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c075d30 0x7f4f5c19ce80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c000c00 tx=0x7f4f4c0057c0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 shutdown_connections 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4f3c0b2900 0x7f4f3c0b4e10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f5c1109b0 0x7f4f5c1a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f5c075d30 0x7f4f5c19ce80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 --2- 172.21.15.47:0/1152099075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f5c076680 0x7f4f5c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 >> 172.21.15.47:0/1152099075 conn(0x7f4f5c079d10 msgr2=0x7f4f5c100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 shutdown_connections 2024-05-14T12:26:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:00.912+0000 7f4f62600700 1 -- 172.21.15.47:0/1152099075 wait complete. 2024-05-14T12:26:01.894 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-14T12:26:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:01 smithi047 ceph-mon[31254]: pgmap v475: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:26:02.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:01 smithi073 ceph-mon[35809]: pgmap v475: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:26:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:01 smithi066 ceph-mon[35981]: pgmap v475: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:26:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 -- 172.21.15.47:0/2012461374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f686810bc00 msgr2=0x7f686810e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 --2- 172.21.15.47:0/2012461374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f686810bc00 0x7f686810e020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6860009ca0 tx=0x7f686002a8b0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 -- 172.21.15.47:0/2012461374 shutdown_connections 2024-05-14T12:26:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 --2- 172.21.15.47:0/2012461374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f686810bc00 0x7f686810e020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 --2- 172.21.15.47:0/2012461374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6868106f00 0x7f6868107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 --2- 172.21.15.47:0/2012461374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6868105cc0 0x7f68681069c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 -- 172.21.15.47:0/2012461374 >> 172.21.15.47:0/2012461374 conn(0x7f6868100ed0 msgr2=0x7f6868103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 -- 172.21.15.47:0/2012461374 shutdown_connections 2024-05-14T12:26:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.770+0000 7f686d400640 1 -- 172.21.15.47:0/2012461374 wait complete. 2024-05-14T12:26:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 Processor -- start 2024-05-14T12:26:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 -- start start 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6868105cc0 0x7f686819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6868106f00 0x7f686819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f686810bc00 0x7f68681a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68681118c0 con 0x7f6868106f00 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6868111740 con 0x7f686810bc00 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.772+0000 7f686d400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6868111a40 con 0x7f6868105cc0 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f686810bc00 0x7f68681a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f686810bc00 0x7f68681a37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:46576/0 (socket says 172.21.15.47:46576) 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 -- 172.21.15.47:0/275527852 learned_addr learned my addr 172.21.15.47:0/275527852 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f6867400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6868106f00 0x7f686819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f6867e00640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6868105cc0 0x7f686819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 -- 172.21.15.47:0/275527852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6868105cc0 msgr2=0x7f686819c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6868105cc0 0x7f686819c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 -- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6868106f00 msgr2=0x7f686819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6868106f00 0x7f686819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f686ca00640 1 -- 172.21.15.47:0/275527852 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68681a3e20 con 0x7f686810bc00 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.773+0000 7f6867400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6868106f00 0x7f686819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.774+0000 7f686ca00640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f686810bc00 0x7f68681a37b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f68600307a0 tx=0x7f6860003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.774+0000 7f6864c00640 1 -- 172.21.15.47:0/275527852 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860004240 con 0x7f686810bc00 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.774+0000 7f6864c00640 1 -- 172.21.15.47:0/275527852 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6860040070 con 0x7f686810bc00 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.774+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68681a40b0 con 0x7f686810bc00 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.774+0000 7f6864c00640 1 -- 172.21.15.47:0/275527852 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860045c00 con 0x7f686810bc00 2024-05-14T12:26:03.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.774+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68681a4650 con 0x7f686810bc00 2024-05-14T12:26:03.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.779+0000 7f6875a2f740 1 Processor -- start 2024-05-14T12:26:03.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.779+0000 7f6864c00640 1 -- 172.21.15.47:0/275527852 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6860045470 con 0x7f686810bc00 2024-05-14T12:26:03.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.779+0000 7f6875a2f740 1 -- start start 2024-05-14T12:26:03.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e229d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1ed22f0 0x55f0e229d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6875a2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f0e2201550 con 0x55f0e1efb1b0 2024-05-14T12:26:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6875a2f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f0e21a6bc0 con 0x55f0e1eda4d0 2024-05-14T12:26:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6875a2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f0e21fd510 con 0x55f0e1ed22f0 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6867e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1ed22f0 0x55f0e229d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6867400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e229d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6867e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1ed22f0 0x55f0e229d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56442/0 (socket says 172.21.15.47:56442) 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.780+0000 7f6867e00640 1 -- 172.21.15.47:0/4217000714 learned_addr learned my addr 172.21.15.47:0/4217000714 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867400640 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867e00640 1 -- 172.21.15.47:0/4217000714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eda4d0 msgr2=0x55f0e22a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867e00640 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867e00640 1 -- 172.21.15.47:0/4217000714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 msgr2=0x55f0e229d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867e00640 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e229d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867e00640 1 -- 172.21.15.47:0/4217000714 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e1f13210 con 0x55f0e1ed22f0 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867400640 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6864c00640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f684c0b2920 0x7f684c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867e00640 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1ed22f0 0x55f0e229d880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f685800bc70 tx=0x7f68580107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12c087ddf12e350f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6864c00640 1 -- 172.21.15.47:0/275527852 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6860103680 con 0x7f686810bc00 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f6867400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f684c0b2920 0x7f684c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.781+0000 7f685d200640 1 -- 172.21.15.47:0/4217000714 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858004220 con 0x55f0e1ed22f0 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.782+0000 7f685d200640 1 -- 172.21.15.47:0/4217000714 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685800be20 con 0x55f0e1ed22f0 2024-05-14T12:26:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.782+0000 7f685d200640 1 -- 172.21.15.47:0/4217000714 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858004c90 con 0x55f0e1ed22f0 2024-05-14T12:26:03.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.782+0000 7f6875a2f740 1 -- 172.21.15.47:0/4217000714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1ed22f0 msgr2=0x55f0e229d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.782+0000 7f6867400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f684c0b2920 0x7f684c0b4e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55f0e229e4d0 tx=0x7f6854005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.782+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1ed22f0 0x55f0e229d880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f685800bc70 tx=0x7f68580107a0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 -- 172.21.15.47:0/4217000714 shutdown_connections 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1ed22f0 0x55f0e229d880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4217000714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e229d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 -- 172.21.15.47:0/4217000714 >> 172.21.15.47:0/4217000714 conn(0x55f0e1eef300 msgr2=0x55f0e2298c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 -- 172.21.15.47:0/4217000714 shutdown_connections 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 -- 172.21.15.47:0/4217000714 wait complete. 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.783+0000 7f6875a2f740 1 -- start start 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 1 Processor -- start 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e22a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e22ae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f0e22a51d0 con 0x55f0e1efb1b0 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f0e21ba660 con 0x55f0e1ed22f0 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f0e22a5350 con 0x55f0e1eda4d0 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6875a2f740 10 client.0 _ll_register_callbacks cb 0x55f0e2184400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f686ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e22ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.784+0000 7f6867400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f686ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e22ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54106/0 (socket says 172.21.15.47:54106) 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f686ca00640 1 -- 172.21.15.47:0/82998785 learned_addr learned my addr 172.21.15.47:0/82998785 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6867e00640 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e22a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6867400640 1 -- 172.21.15.47:0/82998785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 msgr2=0x55f0e22a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6867400640 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e22a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6867400640 1 -- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 msgr2=0x55f0e22ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6867400640 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e22ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6867400640 1 -- 172.21.15.47:0/82998785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e1fdf620 con 0x55f0e1eda4d0 2024-05-14T12:26:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f686ca00640 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e22ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6867400640 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a7300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f686819d380 tx=0x7f6854004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b57b3aa284b4105 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.785+0000 7f6851600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:26:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.786+0000 7f6851600640 1 -- 172.21.15.47:0/82998785 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6854012bd0 con 0x55f0e1eda4d0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.786+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f685800be20 con 0x55f0e1eda4d0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.786+0000 7f6851600640 1 -- 172.21.15.47:0/82998785 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6854012d70 con 0x55f0e1eda4d0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.786+0000 7f6851600640 1 -- 172.21.15.47:0/82998785 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6854010430 con 0x55f0e1eda4d0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.786+0000 7f6875a2f740 10 client.25330 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.786+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f0e22b12b0 con 0x55f0e1eda4d0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.786+0000 7f6851600640 1 -- 172.21.15.47:0/82998785 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685800be20 con 0x55f0e1eda4d0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6851600640 1 -- 172.21.15.47:0/82998785 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6854023540 con 0x55f0e1eda4d0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6875a2f740 10 client.25330 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6875a2f740 10 client.25330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6875a2f740 20 client.25330 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6875a2f740 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1eb9d80 0x55f0e22b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6875a2f740 4 client.25330 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0e220f160 con 0x55f0e1eb9d80 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.787+0000 7f6867e00640 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1eb9d80 0x55f0e22b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.788+0000 7f6867e00640 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1eb9d80 0x55f0e22b4a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=236fbd9f6c55d49b server_cookie=b8b189ab3cc758b7 in_seq=0 out_seq=0 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.788+0000 7f6851600640 10 client.25330 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6851600640 1 -- 172.21.15.47:0/82998785 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f0e220f160 con 0x55f0e1eb9d80 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6851600640 10 client.25330 handle_command_reply: tid=0 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 client.25330 shutdown 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 msgr2=0x55f0e22a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a7300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f686819d380 tx=0x7f6854004730 comp rx=0 tx=0).stop 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 shutdown_connections 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1eb9d80 0x55f0e22b4a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1efb1b0 0x55f0e22ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22a7300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 --2- 172.21.15.47:0/82998785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e22a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6851600640 0 client.25330 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 >> 172.21.15.47:0/82998785 conn(0x55f0e1eef300 msgr2=0x55f0e229bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 shutdown_connections 2024-05-14T12:26:03.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 1 -- 172.21.15.47:0/82998785 wait complete. 2024-05-14T12:26:03.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.789+0000 7f6875a2f740 20 client.25330 trim_cache size 0 max 16384 2024-05-14T12:26:03.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.806+0000 7f6875a2f740 1 Processor -- start 2024-05-14T12:26:03.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.806+0000 7f6875a2f740 1 -- start start 2024-05-14T12:26:03.806 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1eef300 0x55f0e2298300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e2298840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e2298d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6875a2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68681ad2b0 con 0x55f0e1eef300 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6875a2f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68681aedf0 con 0x55f0e1ed22f0 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6875a2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68681ad980 con 0x55f0e1eda4d0 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f686ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e2298d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6867400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e2298840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f686ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e2298d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56452/0 (socket says 172.21.15.47:56452) 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f686ca00640 1 -- 172.21.15.47:0/4040003859 learned_addr learned my addr 172.21.15.47:0/4040003859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f6867e00640 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1eef300 0x55f0e2298300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f686ca00640 1 -- 172.21.15.47:0/4040003859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 msgr2=0x55f0e2298840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f686ca00640 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e2298840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f686ca00640 1 -- 172.21.15.47:0/4040003859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1eef300 msgr2=0x55f0e2298300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.807+0000 7f686ca00640 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1eef300 0x55f0e2298300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.808+0000 7f686ca00640 1 -- 172.21.15.47:0/4040003859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e229e500 con 0x55f0e1eda4d0 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.808+0000 7f686ca00640 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e2298d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f68600c7200 tx=0x7f68600ca6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1069213c8a9dcae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.808+0000 7f6853e00640 1 -- 172.21.15.47:0/4040003859 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600d3410 con 0x55f0e1eda4d0 2024-05-14T12:26:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.808+0000 7f6853e00640 1 -- 172.21.15.47:0/4040003859 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6860036070 con 0x55f0e1eda4d0 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.808+0000 7f6853e00640 1 -- 172.21.15.47:0/4040003859 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600caec0 con 0x55f0e1eda4d0 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 -- 172.21.15.47:0/4040003859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 msgr2=0x55f0e2298d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e2298d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f68600c7200 tx=0x7f68600ca6c0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 -- 172.21.15.47:0/4040003859 shutdown_connections 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e2298d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1ed22f0 0x55f0e2298840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 --2- 172.21.15.47:0/4040003859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1eef300 0x55f0e2298300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 -- 172.21.15.47:0/4040003859 >> 172.21.15.47:0/4040003859 conn(0x55f0e22a0a90 msgr2=0x55f0e22a11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 -- 172.21.15.47:0/4040003859 shutdown_connections 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.809+0000 7f6875a2f740 1 -- 172.21.15.47:0/4040003859 wait complete. 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 -- start start 2024-05-14T12:26:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 Processor -- start 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1ed22f0 0x55f0e22abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eef300 0x55f0e22ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68681ae720 con 0x55f0e1ed22f0 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68681ae050 con 0x55f0e1eef300 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68681ab270 con 0x55f0e1eda4d0 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6875a2f740 10 client.0 _ll_register_callbacks cb 0x7f68540045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.810+0000 7f6867e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1ed22f0 0x55f0e22abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1ed22f0 0x55f0e22abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54118/0 (socket says 172.21.15.47:54118) 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 -- 172.21.15.47:0/986097509 learned_addr learned my addr 172.21.15.47:0/986097509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f686ca00640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eef300 0x55f0e22ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 -- 172.21.15.47:0/986097509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 msgr2=0x55f0e22ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 -- 172.21.15.47:0/986097509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eef300 msgr2=0x55f0e22ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eef300 0x55f0e22ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 -- 172.21.15.47:0/986097509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e22ad5c0 con 0x55f0e1ed22f0 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867400640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f686ca00640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eef300 0x55f0e22ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6867e00640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1ed22f0 0x55f0e22abb90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6858010ca0 tx=0x7f685800b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c469f05cfcc7594 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.811+0000 7f6851600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6851600640 1 -- 172.21.15.47:0/986097509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685802e020 con 0x55f0e1ed22f0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6851600640 1 -- 172.21.15.47:0/986097509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6858011850 con 0x55f0e1ed22f0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6860036070 con 0x55f0e1ed22f0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6851600640 1 -- 172.21.15.47:0/986097509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f685800b890 con 0x55f0e1ed22f0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6875a2f740 10 client.15201 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f0e22ae8c0 con 0x55f0e1ed22f0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6851600640 1 -- 172.21.15.47:0/986097509 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6860036070 con 0x55f0e1ed22f0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.812+0000 7f6851600640 1 -- 172.21.15.47:0/986097509 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f685801ba90 con 0x55f0e1ed22f0 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.813+0000 7f6875a2f740 10 client.15201 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.813+0000 7f6875a2f740 10 client.15201 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.813+0000 7f6875a2f740 20 client.15201 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.813+0000 7f6875a2f740 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1efb1b0 0x55f0e231ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.813+0000 7f6875a2f740 4 client.15201 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:26:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.813+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f0e2208fd0 con 0x55f0e1efb1b0 2024-05-14T12:26:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.813+0000 7f6867400640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1efb1b0 0x55f0e231ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.814+0000 7f6867400640 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1efb1b0 0x55f0e231ee30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1962ab0bd40cf129 server_cookie=1f024e41a4b6c68a in_seq=0 out_seq=0 2024-05-14T12:26:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.814+0000 7f6851600640 10 client.15201 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:03.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6851600640 1 -- 172.21.15.47:0/986097509 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f0e2208fd0 con 0x55f0e1efb1b0 2024-05-14T12:26:03.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6851600640 10 client.15201 handle_command_reply: tid=0 2024-05-14T12:26:03.818 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 client.15201 shutdown 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1ed22f0 msgr2=0x55f0e22abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1ed22f0 0x55f0e22abb90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6858010ca0 tx=0x7f685800b720 comp rx=0 tx=0).stop 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 shutdown_connections 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f0e1efb1b0 0x55f0e231ee30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0e1eef300 0x55f0e22ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f0e1eda4d0 0x55f0e22ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6851600640 0 client.15201 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 --2- 172.21.15.47:0/986097509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0e1ed22f0 0x55f0e22abb90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.818+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 >> 172.21.15.47:0/986097509 conn(0x55f0e22a0a90 msgr2=0x55f0e229ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.819+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 shutdown_connections 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.819+0000 7f6875a2f740 1 -- 172.21.15.47:0/986097509 wait complete. 2024-05-14T12:26:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.819+0000 7f6875a2f740 20 client.15201 trim_cache size 0 max 16384 2024-05-14T12:26:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:26:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:26:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:26:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:26:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.819+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f684c0b2920 msgr2=0x7f684c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.819+0000 7f686d400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f684c0b2920 0x7f684c0b4e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55f0e229e4d0 tx=0x7f6854005f90 comp rx=0 tx=0).stop 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.819+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f686810bc00 msgr2=0x7f68681a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.819+0000 7f686d400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f686810bc00 0x7f68681a37b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f68600307a0 tx=0x7f6860003b80 comp rx=0 tx=0).stop 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 shutdown_connections 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f684c0b2920 0x7f684c0b4e30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f686810bc00 0x7f68681a37b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6868106f00 0x7f686819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 --2- 172.21.15.47:0/275527852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6868105cc0 0x7f686819c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 >> 172.21.15.47:0/275527852 conn(0x7f6868100ed0 msgr2=0x7f68681032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 shutdown_connections 2024-05-14T12:26:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:03.820+0000 7f686d400640 1 -- 172.21.15.47:0/275527852 wait complete. 2024-05-14T12:26:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:03 smithi047 ceph-mon[31254]: pgmap v476: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:26:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:03 smithi073 ceph-mon[35809]: pgmap v476: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:26:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:03 smithi066 ceph-mon[35981]: pgmap v476: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T12:26:05.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:05 smithi047 ceph-mon[31254]: pgmap v477: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T12:26:06.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:05 smithi073 ceph-mon[35809]: pgmap v477: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T12:26:06.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:05 smithi066 ceph-mon[35981]: pgmap v477: 97 pgs: 97 active+clean; 664 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T12:26:07.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:07 smithi047 ceph-mon[31254]: pgmap v478: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:26:08.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:07 smithi073 ceph-mon[35809]: pgmap v478: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:26:08.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:07 smithi066 ceph-mon[35981]: pgmap v478: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:26:09.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:09 smithi047 ceph-mon[31254]: pgmap v479: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:10.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:09 smithi073 ceph-mon[35809]: pgmap v479: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:10.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:09 smithi066 ceph-mon[35981]: pgmap v479: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:11.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:11 smithi047 ceph-mon[31254]: pgmap v480: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:12.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:11 smithi073 ceph-mon[35809]: pgmap v480: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:12.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:11 smithi066 ceph-mon[35981]: pgmap v480: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:13 smithi047 ceph-mon[31254]: pgmap v481: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:14.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:13 smithi073 ceph-mon[35809]: pgmap v481: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:14.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:13 smithi066 ceph-mon[35981]: pgmap v481: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:15 smithi047 ceph-mon[31254]: pgmap v482: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:16.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:15 smithi073 ceph-mon[35809]: pgmap v482: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:16.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:15 smithi066 ceph-mon[35981]: pgmap v482: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:16.895 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.1 2024-05-14T12:26:16.896 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.054+0000 7fa036600640 1 -- 172.21.15.47:0/2628091106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 msgr2=0x7fa03010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.054+0000 7fa036600640 1 --2- 172.21.15.47:0/2628091106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 0x7fa03010bde0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa028009ca0 tx=0x7fa02802a8c0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.055+0000 7fa036600640 1 -- 172.21.15.47:0/2628091106 shutdown_connections 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.055+0000 7fa036600640 1 --2- 172.21.15.47:0/2628091106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 0x7fa03010bde0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.055+0000 7fa036600640 1 --2- 172.21.15.47:0/2628091106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030104cc0 0x7fa0301050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.055+0000 7fa036600640 1 --2- 172.21.15.47:0/2628091106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa030103a80 0x7fa030104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.055+0000 7fa036600640 1 -- 172.21.15.47:0/2628091106 >> 172.21.15.47:0/2628091106 conn(0x7fa0300fec70 msgr2=0x7fa030101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.055+0000 7fa036600640 1 -- 172.21.15.47:0/2628091106 shutdown_connections 2024-05-14T12:26:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.055+0000 7fa036600640 1 -- 172.21.15.47:0/2628091106 wait complete. 2024-05-14T12:26:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 Processor -- start 2024-05-14T12:26:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 -- start start 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030103a80 0x7fa03019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa030104cc0 0x7fa03019c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 0x7fa0301a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa03010f630 con 0x7fa030103a80 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa03010f4b0 con 0x7fa0301099c0 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.056+0000 7fa036600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa03010f7b0 con 0x7fa030104cc0 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa035200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030103a80 0x7fa03019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa035c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 0x7fa0301a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa027e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa030104cc0 0x7fa03019c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa035c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 0x7fa0301a37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:45994/0 (socket says 172.21.15.47:45994) 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa035200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030103a80 0x7fa03019c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60460/0 (socket says 172.21.15.47:60460) 2024-05-14T12:26:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa035c00640 1 -- 172.21.15.47:0/3426036747 learned_addr learned my addr 172.21.15.47:0/3426036747 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa027e00640 1 -- 172.21.15.47:0/3426036747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 msgr2=0x7fa0301a37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa027e00640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 0x7fa0301a37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa027e00640 1 -- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030103a80 msgr2=0x7fa03019c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa027e00640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030103a80 0x7fa03019c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.057+0000 7fa027e00640 1 -- 172.21.15.47:0/3426036747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0301a3e30 con 0x7fa030104cc0 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.058+0000 7fa027e00640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa030104cc0 0x7fa03019c830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa01800e9f0 tx=0x7fa01800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.058+0000 7fa02e000640 1 -- 172.21.15.47:0/3426036747 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01800ccc0 con 0x7fa030104cc0 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.058+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0301a4120 con 0x7fa030104cc0 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.058+0000 7fa02e000640 1 -- 172.21.15.47:0/3426036747 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0180108e0 con 0x7fa030104cc0 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.058+0000 7fa02e000640 1 -- 172.21.15.47:0/3426036747 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018018880 con 0x7fa030104cc0 2024-05-14T12:26:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.058+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0301a46c0 con 0x7fa030104cc0 2024-05-14T12:26:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.061+0000 7fa03ed76740 1 Processor -- start 2024-05-14T12:26:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa03ed76740 1 -- start start 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87991b0 0x563de8b3b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87702f0 0x563de8b3b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b42780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa03ed76740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563de8a9f550 con 0x563de87702f0 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa03ed76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563de8a44bc0 con 0x563de87991b0 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa03ed76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563de8a9b510 con 0x563de87784d0 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa02e000640 1 -- 172.21.15.47:0/3426036747 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa018018a20 con 0x7fa030104cc0 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa035200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87702f0 0x563de8b3b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa035c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87991b0 0x563de8b3b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa035200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87702f0 0x563de8b3b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60464/0 (socket says 172.21.15.47:60464) 2024-05-14T12:26:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.062+0000 7fa035200640 1 -- 172.21.15.47:0/599951179 learned_addr learned my addr 172.21.15.47:0/599951179 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa027e00640 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b42780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa035c00640 1 -- 172.21.15.47:0/599951179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 msgr2=0x563de8b42780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa035c00640 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b42780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa035c00640 1 -- 172.21.15.47:0/599951179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87702f0 msgr2=0x563de8b3b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa035c00640 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87702f0 0x563de8b3b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa035c00640 1 -- 172.21.15.47:0/599951179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de87b1210 con 0x563de87991b0 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa035200640 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87702f0 0x563de8b3b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.063+0000 7fa035c00640 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87991b0 0x563de8b3b300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa0280097b0 tx=0x7fa028009440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2535e01f5379acf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:17.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.064+0000 7fa026000640 1 -- 172.21.15.47:0/599951179 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028031650 con 0x563de87991b0 2024-05-14T12:26:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.064+0000 7fa026000640 1 -- 172.21.15.47:0/599951179 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa028036030 con 0x563de87991b0 2024-05-14T12:26:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.064+0000 7fa026000640 1 -- 172.21.15.47:0/599951179 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0280047d0 con 0x563de87991b0 2024-05-14T12:26:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.064+0000 7fa02e000640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa0140b28a0 0x7fa0140b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.064+0000 7fa02e000640 1 -- 172.21.15.47:0/3426036747 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa0180e2580 con 0x7fa030104cc0 2024-05-14T12:26:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa035200640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa0140b28a0 0x7fa0140b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 -- 172.21.15.47:0/599951179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87991b0 msgr2=0x563de8b3b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87991b0 0x563de8b3b300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa0280097b0 tx=0x7fa028009440 comp rx=0 tx=0).stop 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 -- 172.21.15.47:0/599951179 shutdown_connections 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b42780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87702f0 0x563de8b3b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 --2- 172.21.15.47:0/599951179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87991b0 0x563de8b3b300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 -- 172.21.15.47:0/599951179 >> 172.21.15.47:0/599951179 conn(0x563de878d300 msgr2=0x563de8b36c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 -- 172.21.15.47:0/599951179 shutdown_connections 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa03ed76740 1 -- 172.21.15.47:0/599951179 wait complete. 2024-05-14T12:26:17.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.065+0000 7fa035200640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa0140b28a0 0x7fa0140b4db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x563de8b37a20 tx=0x7fa020005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.066+0000 7fa03ed76740 1 -- start start 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.066+0000 7fa03ed76740 1 Processor -- start 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87702f0 0x563de8b44cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87784d0 0x563de8b451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa03ed76740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563de8b42ff0 con 0x563de87991b0 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa03ed76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563de8a58660 con 0x563de87784d0 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa03ed76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563de8b43170 con 0x563de87702f0 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa03ed76740 10 client.0 _ll_register_callbacks cb 0x563de8a22400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa035200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87702f0 0x563de8b44cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa035200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87702f0 0x563de8b44cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50154/0 (socket says 172.21.15.47:50154) 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa035200640 1 -- 172.21.15.47:0/711054483 learned_addr learned my addr 172.21.15.47:0/711054483 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa027e00640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87784d0 0x563de8b451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa035c00640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa035200640 1 -- 172.21.15.47:0/711054483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87784d0 msgr2=0x563de8b451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.067+0000 7fa035200640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87784d0 0x563de8b451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa035200640 1 -- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 msgr2=0x563de8b4c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa035200640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa035200640 1 -- 172.21.15.47:0/711054483 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de887d620 con 0x563de87702f0 2024-05-14T12:26:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa027e00640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87784d0 0x563de8b451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa035200640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87702f0 0x563de8b44cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa0200045e0 tx=0x7fa020004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33626dffb8be8402 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa01ea00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:26:17.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa01ea00640 1 -- 172.21.15.47:0/711054483 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02001e680 con 0x563de87702f0 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa028036030 con 0x563de87702f0 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.068+0000 7fa01ea00640 1 -- 172.21.15.47:0/711054483 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa02001e820 con 0x563de87702f0 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.069+0000 7fa01ea00640 1 -- 172.21.15.47:0/711054483 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa02001ea20 con 0x563de87702f0 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.069+0000 7fa03ed76740 10 client.25348 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.069+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563de8b4f1a0 con 0x563de87702f0 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.069+0000 7fa01ea00640 1 -- 172.21.15.47:0/711054483 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa028036030 con 0x563de87702f0 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.069+0000 7fa01ea00640 1 -- 172.21.15.47:0/711054483 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa020027070 con 0x563de87702f0 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.069+0000 7fa03ed76740 10 client.25348 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa03ed76740 10 client.25348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa03ed76740 20 client.25348 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa03ed76740 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de8757d80 0x563de8b52820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa03ed76740 4 client.25348 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563de8aad160 con 0x563de8757d80 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa027e00640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de8757d80 0x563de8b52820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa027e00640 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de8757d80 0x563de8b52820 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=861f74945dc1c3e6 server_cookie=4e80be39928fc03e in_seq=0 out_seq=0 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.070+0000 7fa01ea00640 10 client.25348 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.071+0000 7fa01ea00640 1 -- 172.21.15.47:0/711054483 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563de8aad160 con 0x563de8757d80 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.071+0000 7fa01ea00640 10 client.25348 handle_command_reply: tid=0 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.071+0000 7fa03ed76740 1 client.25348 shutdown 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87702f0 msgr2=0x563de8b44cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87702f0 0x563de8b44cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa0200045e0 tx=0x7fa020004730 comp rx=0 tx=0).stop 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 shutdown_connections 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de8757d80 0x563de8b52820 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa01ea00640 0 client.25348 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87784d0 0x563de8b451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 --2- 172.21.15.47:0/711054483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87702f0 0x563de8b44cb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 >> 172.21.15.47:0/711054483 conn(0x563de878d300 msgr2=0x563de8b35c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 shutdown_connections 2024-05-14T12:26:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 1 -- 172.21.15.47:0/711054483 wait complete. 2024-05-14T12:26:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.072+0000 7fa03ed76740 20 client.25348 trim_cache size 0 max 16384 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 Processor -- start 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 -- start start 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b44f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b4c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301ad2c0 con 0x563de87991b0 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301aee00 con 0x563de87702f0 2024-05-14T12:26:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.089+0000 7fa03ed76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301ad990 con 0x563de87784d0 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b44f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa027e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b4c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa027e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b4c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50164/0 (socket says 172.21.15.47:50164) 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b44f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:46028/0 (socket says 172.21.15.47:46028) 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035c00640 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa027e00640 1 -- 172.21.15.47:0/4133884285 learned_addr learned my addr 172.21.15.47:0/4133884285 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035200640 1 -- 172.21.15.47:0/4133884285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 msgr2=0x563de8b4c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035200640 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b4c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035200640 1 -- 172.21.15.47:0/4133884285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 msgr2=0x563de8b4c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035200640 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa035200640 1 -- 172.21.15.47:0/4133884285 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de8b324a0 con 0x563de87702f0 2024-05-14T12:26:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.090+0000 7fa027e00640 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b4c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.091+0000 7fa035200640 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b44f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa020029f80 tx=0x7fa020012fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914e41fe0c666e03 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.091+0000 7fa025600640 1 -- 172.21.15.47:0/4133884285 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02001e740 con 0x563de87702f0 2024-05-14T12:26:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.091+0000 7fa025600640 1 -- 172.21.15.47:0/4133884285 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0200054d0 con 0x563de87702f0 2024-05-14T12:26:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.091+0000 7fa025600640 1 -- 172.21.15.47:0/4133884285 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa020004b20 con 0x563de87702f0 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 -- 172.21.15.47:0/4133884285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 msgr2=0x563de8b44f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b44f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa020029f80 tx=0x7fa020012fb0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 -- 172.21.15.47:0/4133884285 shutdown_connections 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87991b0 0x563de8b4c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87784d0 0x563de8b4c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 --2- 172.21.15.47:0/4133884285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b44f90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 -- 172.21.15.47:0/4133884285 >> 172.21.15.47:0/4133884285 conn(0x563de878d300 msgr2=0x563de8b44880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 -- 172.21.15.47:0/4133884285 shutdown_connections 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.092+0000 7fa03ed76740 1 -- 172.21.15.47:0/4133884285 wait complete. 2024-05-14T12:26:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 -- start start 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 Processor -- start 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b4b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87784d0 0x563de8b4b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87991b0 0x563de8b4bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301ae730 con 0x563de87784d0 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301ae060 con 0x563de87702f0 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301ab280 con 0x563de87991b0 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.093+0000 7fa03ed76740 10 client.0 _ll_register_callbacks cb 0x7fa020009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa027e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87784d0 0x563de8b4b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b4b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b4b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:46042/0 (socket says 172.21.15.47:46042) 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa027e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87784d0 0x563de8b4b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60494/0 (socket says 172.21.15.47:60494) 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 -- 172.21.15.47:0/133118818 learned_addr learned my addr 172.21.15.47:0/133118818 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035c00640 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87991b0 0x563de8b4bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 -- 172.21.15.47:0/133118818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87991b0 msgr2=0x563de8b4bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87991b0 0x563de8b4bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 -- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87784d0 msgr2=0x563de8b4b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87784d0 0x563de8b4b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 -- 172.21.15.47:0/133118818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de8bb8cf0 con 0x563de87702f0 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa027e00640 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87784d0 0x563de8b4b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa035200640 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b4b2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa020012d20 tx=0x7fa0200056f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f32bea03c39069d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.094+0000 7fa01ea00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:26:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.095+0000 7fa01ea00640 1 -- 172.21.15.47:0/133118818 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa020029440 con 0x563de87702f0 2024-05-14T12:26:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.095+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0200054d0 con 0x563de87702f0 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.095+0000 7fa01ea00640 1 -- 172.21.15.47:0/133118818 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa0200295e0 con 0x563de87702f0 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.095+0000 7fa01ea00640 1 -- 172.21.15.47:0/133118818 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0200297e0 con 0x563de87702f0 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.095+0000 7fa03ed76740 10 client.25331 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.095+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563de8bb9f80 con 0x563de87702f0 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.095+0000 7fa01ea00640 1 -- 172.21.15.47:0/133118818 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0200054d0 con 0x563de87702f0 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa01ea00640 1 -- 172.21.15.47:0/133118818 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa020027040 con 0x563de87702f0 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa03ed76740 10 client.25331 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa03ed76740 10 client.25331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa03ed76740 20 client.25331 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa03ed76740 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de872d1c0 0x563de8bbc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa03ed76740 4 client.25331 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:26:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563de8aa6fd0 con 0x563de872d1c0 2024-05-14T12:26:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.096+0000 7fa027e00640 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de872d1c0 0x563de8bbc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.097+0000 7fa027e00640 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de872d1c0 0x563de8bbc8c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7dbe5dccc33a4bb server_cookie=92caef29c70e0242 in_seq=0 out_seq=0 2024-05-14T12:26:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.097+0000 7fa01ea00640 10 client.25331 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.105+0000 7fa01ea00640 1 -- 172.21.15.47:0/133118818 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563de8aa6fd0 con 0x563de872d1c0 2024-05-14T12:26:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.105+0000 7fa01ea00640 10 client.25331 handle_command_reply: tid=0 2024-05-14T12:26:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.105+0000 7fa03ed76740 1 client.25331 shutdown 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.105+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 msgr2=0x563de8b4b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.105+0000 7fa03ed76740 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b4b2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa020012d20 tx=0x7fa0200056f0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 shutdown_connections 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563de872d1c0 0x563de8bbc8c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563de87991b0 0x563de8b4bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563de87784d0 0x563de8b4b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 --2- 172.21.15.47:0/133118818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563de87702f0 0x563de8b4b2c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 >> 172.21.15.47:0/133118818 conn(0x563de878d300 msgr2=0x563de8b39a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa01ea00640 0 client.25331 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 shutdown_connections 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 1 -- 172.21.15.47:0/133118818 wait complete. 2024-05-14T12:26:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.106+0000 7fa03ed76740 20 client.25331 trim_cache size 0 max 16384 2024-05-14T12:26:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:26:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:26:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:26:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa0140b28a0 msgr2=0x7fa0140b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa0140b28a0 0x7fa0140b4db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x563de8b37a20 tx=0x7fa020005f90 comp rx=0 tx=0).stop 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa030104cc0 msgr2=0x7fa03019c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa030104cc0 0x7fa03019c830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa01800e9f0 tx=0x7fa01800eeb0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 shutdown_connections 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa0140b28a0 0x7fa0140b4db0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0301099c0 0x7fa0301a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa030104cc0 0x7fa03019c830 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 --2- 172.21.15.47:0/3426036747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030103a80 0x7fa03019c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 >> 172.21.15.47:0/3426036747 conn(0x7fa0300fec70 msgr2=0x7fa0300ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 shutdown_connections 2024-05-14T12:26:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:17.107+0000 7fa036600640 1 -- 172.21.15.47:0/3426036747 wait complete. 2024-05-14T12:26:17.370 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:26:17.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:17 smithi047 ceph-mon[31254]: pgmap v483: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T12:26:18.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:17 smithi073 ceph-mon[35809]: pgmap v483: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T12:26:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:17 smithi066 ceph-mon[35981]: pgmap v483: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T12:26:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 -- 172.21.15.47:0/3365518229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 msgr2=0x7fc354110fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 --2- 172.21.15.47:0/3365518229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 0x7fc354110fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009fc0 tx=0x7fc34c00b330 comp rx=0 tx=0).stop 2024-05-14T12:26:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 -- 172.21.15.47:0/3365518229 shutdown_connections 2024-05-14T12:26:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 --2- 172.21.15.47:0/3365518229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 0x7fc354110fe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 --2- 172.21.15.47:0/3365518229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354104400 0x7fc354104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 --2- 172.21.15.47:0/3365518229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354108d30 0x7fc354109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 -- 172.21.15.47:0/3365518229 >> 172.21.15.47:0/3365518229 conn(0x7fc354079d10 msgr2=0x7fc35407a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 -- 172.21.15.47:0/3365518229 shutdown_connections 2024-05-14T12:26:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.681+0000 7fc359a00700 1 -- 172.21.15.47:0/3365518229 wait complete. 2024-05-14T12:26:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 Processor -- start 2024-05-14T12:26:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 -- start start 2024-05-14T12:26:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354104400 0x7fc354075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354108d30 0x7fc354076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 0x7fc354076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc354114300 con 0x7fc354104400 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc354114180 con 0x7fc354108d30 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.683+0000 7fc359a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc354114480 con 0x7fc354109680 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354104400 0x7fc354075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354108d30 0x7fc354076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354108d30 0x7fc354076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40974/0 (socket says 172.21.15.47:40974) 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 -- 172.21.15.47:0/3098223603 learned_addr learned my addr 172.21.15.47:0/3098223603 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:19.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354104400 0x7fc354075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49960/0 (socket says 172.21.15.47:49960) 2024-05-14T12:26:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc359000700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 0x7fc354076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 -- 172.21.15.47:0/3098223603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 msgr2=0x7fc354076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 0x7fc354076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 -- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354104400 msgr2=0x7fc354075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354104400 0x7fc354075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.684+0000 7fc353400700 1 -- 172.21.15.47:0/3098223603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3541a9000 con 0x7fc354108d30 2024-05-14T12:26:19.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.685+0000 7fc353400700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354108d30 0x7fc354076000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc34000e9f0 tx=0x7fc34000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.685+0000 7fc350c00700 1 -- 172.21.15.47:0/3098223603 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34000c9c0 con 0x7fc354108d30 2024-05-14T12:26:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.685+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3541a92f0 con 0x7fc354108d30 2024-05-14T12:26:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.685+0000 7fc350c00700 1 -- 172.21.15.47:0/3098223603 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc34000cb60 con 0x7fc354108d30 2024-05-14T12:26:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.685+0000 7fc350c00700 1 -- 172.21.15.47:0/3098223603 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340018680 con 0x7fc354108d30 2024-05-14T12:26:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.685+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3541a9880 con 0x7fc354108d30 2024-05-14T12:26:19.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.687+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3541058b0 con 0x7fc354108d30 2024-05-14T12:26:19.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.689+0000 7fc350c00700 1 -- 172.21.15.47:0/3098223603 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc340010430 con 0x7fc354108d30 2024-05-14T12:26:19.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.691+0000 7fc350c00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc3380b2880 0x7fc3380b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.691+0000 7fc350c00700 1 -- 172.21.15.47:0/3098223603 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc3400e2380 con 0x7fc354108d30 2024-05-14T12:26:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.691+0000 7fc353e00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc3380b2880 0x7fc3380b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.692+0000 7fc353e00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc3380b2880 0x7fc3380b4d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc344009c60 tx=0x7fc344009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:19.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.696+0000 7fc350c00700 1 -- 172.21.15.47:0/3098223603 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3400aa060 con 0x7fc354108d30 2024-05-14T12:26:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.982+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3540512c0 con 0x7fc354108d30 2024-05-14T12:26:19.982 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:19 smithi047 ceph-mon[31254]: pgmap v484: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-14T12:26:19.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.983+0000 7fc350c00700 1 -- 172.21.15.47:0/3098223603 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11919 (secure 0 0 0) 0x7fc3400b20e0 con 0x7fc354108d30 2024-05-14T12:26:19.983 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:26:19.984 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:25:09.557616+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24535,24521,24517,24490,24502]},"id":1}]} 2024-05-14T12:26:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc3380b2880 msgr2=0x7fc3380b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc3380b2880 0x7fc3380b4d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc344009c60 tx=0x7fc344009260 comp rx=0 tx=0).stop 2024-05-14T12:26:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354108d30 msgr2=0x7fc354076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:19.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354108d30 0x7fc354076000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc34000e9f0 tx=0x7fc34000ed00 comp rx=0 tx=0).stop 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 shutdown_connections 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc3380b2880 0x7fc3380b4d90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc354109680 0x7fc354076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc354104400 0x7fc354075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 --2- 172.21.15.47:0/3098223603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc354108d30 0x7fc354076000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.987+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 >> 172.21.15.47:0/3098223603 conn(0x7fc354079d10 msgr2=0x7fc3541013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.988+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 shutdown_connections 2024-05-14T12:26:19.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:19.988+0000 7fc359a00700 1 -- 172.21.15.47:0/3098223603 wait complete. 2024-05-14T12:26:19.989 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-05-14T12:26:20.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:19 smithi073 ceph-mon[35809]: pgmap v484: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-14T12:26:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:19 smithi066 ceph-mon[35981]: pgmap v484: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-14T12:26:20.905 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 87.1 --await-for 42.0' 2024-05-14T12:26:20.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 87.1 --await-for 42.0 2024-05-14T12:26:20.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:20 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3098223603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:26:21.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:20 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3098223603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:26:21.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:20 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3098223603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:26:21.439 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:26:21.779 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:21 smithi047 ceph-mon[31254]: pgmap v485: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-05-14T12:26:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:21 smithi073 ceph-mon[35809]: pgmap v485: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-05-14T12:26:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:21 smithi066 ceph-mon[35981]: pgmap v485: 97 pgs: 97 active+clean; 674 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-05-14T12:26:23.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:22 smithi066 ceph-mon[35981]: pgmap v486: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-14T12:26:23.229 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:22 smithi047 ceph-mon[31254]: pgmap v486: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-14T12:26:23.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:22 smithi073 ceph-mon[35809]: pgmap v486: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-14T12:26:23.878 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:23 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:26:23.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.875+0000 7fa8d7000700 1 -- 172.21.15.47:0/3149382704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 msgr2=0x7fa8d0103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.875+0000 7fa8d7000700 1 --2- 172.21.15.47:0/3149382704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 0x7fa8d0103490 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009990 tx=0x7fa8c4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.876+0000 7fa8d7000700 1 -- 172.21.15.47:0/3149382704 shutdown_connections 2024-05-14T12:26:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.876+0000 7fa8d7000700 1 --2- 172.21.15.47:0/3149382704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01084d0 0x7fa8d01089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.876+0000 7fa8d7000700 1 --2- 172.21.15.47:0/3149382704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 0x7fa8d0103490 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.876+0000 7fa8d7000700 1 --2- 172.21.15.47:0/3149382704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d01039d0 0x7fa8d0107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.876+0000 7fa8d7000700 1 -- 172.21.15.47:0/3149382704 >> 172.21.15.47:0/3149382704 conn(0x7fa8d0078ac0 msgr2=0x7fa8d0078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.876+0000 7fa8d7000700 1 -- 172.21.15.47:0/3149382704 shutdown_connections 2024-05-14T12:26:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.878+0000 7fa8d7000700 1 -- 172.21.15.47:0/3149382704 wait complete. 2024-05-14T12:26:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.880+0000 7fa8d7000700 1 Processor -- start 2024-05-14T12:26:23.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.880+0000 7fa8d7000700 1 -- start start 2024-05-14T12:26:23.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d7000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 0x7fa8d01a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d7000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01039d0 0x7fa8d01a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d7000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d01084d0 0x7fa8d01a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d7000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d011a8b0 con 0x7fa8d0103080 2024-05-14T12:26:23.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d7000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d011a730 con 0x7fa8d01039d0 2024-05-14T12:26:23.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d7000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d011aa30 con 0x7fa8d01084d0 2024-05-14T12:26:23.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d5200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01039d0 0x7fa8d01a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d5200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01039d0 0x7fa8d01a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40992/0 (socket says 172.21.15.47:40992) 2024-05-14T12:26:23.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.881+0000 7fa8d5200700 1 -- 172.21.15.47:0/527988133 learned_addr learned my addr 172.21.15.47:0/527988133 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:23.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.882+0000 7fa8d5200700 1 -- 172.21.15.47:0/527988133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d01084d0 msgr2=0x7fa8d01a5ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T12:26:23.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.882+0000 7fa8d5200700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d01084d0 0x7fa8d01a5ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.882+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 0x7fa8d01a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.882+0000 7fa8d5200700 1 -- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 msgr2=0x7fa8d01a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.882+0000 7fa8d5200700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 0x7fa8d01a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.882+0000 7fa8d5200700 1 -- 172.21.15.47:0/527988133 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d01a6150 con 0x7fa8d01039d0 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.882+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 0x7fa8d01a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.883+0000 7fa8d5200700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01039d0 0x7fa8d01a1820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00eab0 tx=0x7fa8bc00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.883+0000 7fa8ce000700 1 -- 172.21.15.47:0/527988133 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00cc90 con 0x7fa8d01039d0 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.883+0000 7fa8ce000700 1 -- 172.21.15.47:0/527988133 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8bc0044d0 con 0x7fa8d01039d0 2024-05-14T12:26:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.883+0000 7fa8ce000700 1 -- 172.21.15.47:0/527988133 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc010430 con 0x7fa8d01039d0 2024-05-14T12:26:23.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.884+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d01a6440 con 0x7fa8d01039d0 2024-05-14T12:26:23.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.884+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d01add60 con 0x7fa8d01039d0 2024-05-14T12:26:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.890+0000 7fa8e710bb80 1 Processor -- start 2024-05-14T12:26:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.890+0000 7fa8ce000700 1 -- 172.21.15.47:0/527988133 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa8bc003680 con 0x7fa8d01039d0 2024-05-14T12:26:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.892+0000 7fa8ce000700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa8b80b2980 0x7fa8b80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.892+0000 7fa8ce000700 1 -- 172.21.15.47:0/527988133 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa8bc0e2480 con 0x7fa8d01039d0 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.892+0000 7fa8e710bb80 1 -- start start 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a737160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a73b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a73c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555c6a658bb0 con 0x555c6a73bea0 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555c6a5f68f0 con 0x555c6a5b8fd0 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555c6a654b70 con 0x555c6a7376a0 2024-05-14T12:26:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a737160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a737160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40994/0 (socket says 172.21.15.47:40994) 2024-05-14T12:26:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8d5c00700 1 -- 172.21.15.47:0/3844101603 learned_addr learned my addr 172.21.15.47:0/3844101603 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.893+0000 7fa8d6600700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa8b80b2980 0x7fa8b80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.894+0000 7fa8d6600700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa8b80b2980 0x7fa8b80b4e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009690 tx=0x7fa8c80095e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.894+0000 7fa8d6600700 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a73c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.895+0000 7fa8d5c00700 1 -- 172.21.15.47:0/3844101603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 msgr2=0x555c6a73b960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:26:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.895+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a73b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.895+0000 7fa8d5c00700 1 -- 172.21.15.47:0/3844101603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 msgr2=0x555c6a73c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.895+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a73c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.895+0000 7fa8d5c00700 1 -- 172.21.15.47:0/3844101603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6a5a5a60 con 0x555c6a5b8fd0 2024-05-14T12:26:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.896+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a737160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400b2e0 tx=0x7fa8c4005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d3571722a827d57 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:23.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.896+0000 7fa8c2a00700 1 -- 172.21.15.47:0/3844101603 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4009510 con 0x555c6a5b8fd0 2024-05-14T12:26:23.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.896+0000 7fa8c2a00700 1 -- 172.21.15.47:0/3844101603 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c400bbb0 con 0x555c6a5b8fd0 2024-05-14T12:26:23.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.896+0000 7fa8c2a00700 1 -- 172.21.15.47:0/3844101603 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003d70 con 0x555c6a5b8fd0 2024-05-14T12:26:23.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.897+0000 7fa8e710bb80 1 -- 172.21.15.47:0/3844101603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 msgr2=0x555c6a737160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.897+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a737160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400b2e0 tx=0x7fa8c4005ec0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.897+0000 7fa8e710bb80 1 -- 172.21.15.47:0/3844101603 shutdown_connections 2024-05-14T12:26:23.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.897+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a73c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.897+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a737160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.897+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/3844101603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a73b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.898+0000 7fa8e710bb80 1 -- 172.21.15.47:0/3844101603 >> 172.21.15.47:0/3844101603 conn(0x555c6a5f7c10 msgr2=0x555c6a731e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.898+0000 7fa8e710bb80 1 -- 172.21.15.47:0/3844101603 shutdown_connections 2024-05-14T12:26:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.898+0000 7fa8e710bb80 1 -- 172.21.15.47:0/3844101603 wait complete. 2024-05-14T12:26:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.899+0000 7fa8e710bb80 1 -- start start 2024-05-14T12:26:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.899+0000 7fa8e710bb80 1 Processor -- start 2024-05-14T12:26:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.900+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a5b8fd0 0x555c6a740bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.900+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a7376a0 0x555c6a741130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.900+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a741670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a5b8fd0 0x555c6a740bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555c6a743df0 con 0x555c6a73bea0 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555c6a5becb0 con 0x555c6a7376a0 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555c6a743f70 con 0x555c6a5b8fd0 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a5b8fd0 0x555c6a740bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53278/0 (socket says 172.21.15.47:53278) 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8d5c00700 1 -- 172.21.15.47:0/564439059 learned_addr learned my addr 172.21.15.47:0/564439059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8e710bb80 10 client.0 _ll_register_callbacks cb 0x555c6a5ec510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8d5200700 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a7376a0 0x555c6a741130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.901+0000 7fa8d6600700 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a741670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.902+0000 7fa8d5200700 1 -- 172.21.15.47:0/564439059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a5b8fd0 msgr2=0x555c6a740bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.902+0000 7fa8d5200700 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a5b8fd0 0x555c6a740bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.902+0000 7fa8d5200700 1 -- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 msgr2=0x555c6a741670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.902+0000 7fa8d5200700 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a741670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.902+0000 7fa8d5200700 1 -- 172.21.15.47:0/564439059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6a61e5b0 con 0x555c6a7376a0 2024-05-14T12:26:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.903+0000 7fa8d5200700 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a7376a0 0x555c6a741130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x555c6a7335a0 tx=0x7fa8bc009940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6406a32e5202c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:23.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.903+0000 7fa8b7400700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:26:23.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.903+0000 7fa8b7400700 1 -- 172.21.15.47:0/564439059 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0a9a60 con 0x555c6a7376a0 2024-05-14T12:26:23.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.903+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c400bbb0 con 0x555c6a7376a0 2024-05-14T12:26:23.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.903+0000 7fa8b7400700 1 -- 172.21.15.47:0/564439059 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa8bc0b2430 con 0x555c6a7376a0 2024-05-14T12:26:23.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.904+0000 7fa8b7400700 1 -- 172.21.15.47:0/564439059 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa8bc0ade10 con 0x555c6a7376a0 2024-05-14T12:26:23.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.904+0000 7fa8e710bb80 10 client.25349 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:23.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.904+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c6a74eb00 con 0x555c6a7376a0 2024-05-14T12:26:23.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8b7400700 1 -- 172.21.15.47:0/564439059 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c400bbb0 con 0x555c6a7376a0 2024-05-14T12:26:23.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8b7400700 1 -- 172.21.15.47:0/564439059 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa8bc0cc0e0 con 0x555c6a7376a0 2024-05-14T12:26:23.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8e710bb80 10 client.25349 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:23.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8e710bb80 10 client.25349 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:26:23.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8e710bb80 20 client.25349 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:23.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a751090 0x555c6a7534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8e710bb80 4 client.25349 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:23.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.905+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c6a703200 con 0x555c6a751090 2024-05-14T12:26:23.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.906+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a751090 0x555c6a7534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.907+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a751090 0x555c6a7534b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60af37539c24863 server_cookie=3f28a74e0f5e4c47 in_seq=0 out_seq=0 2024-05-14T12:26:23.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.907+0000 7fa8b7400700 10 client.25349 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:23.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8b7400700 1 -- 172.21.15.47:0/564439059 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555c6a703200 con 0x555c6a751090 2024-05-14T12:26:23.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8b7400700 10 client.25349 handle_command_reply: tid=0 2024-05-14T12:26:23.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 client.25349 shutdown 2024-05-14T12:26:23.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a7376a0 msgr2=0x555c6a741130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a7376a0 0x555c6a741130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x555c6a7335a0 tx=0x7fa8bc009940 comp rx=0 tx=0).stop 2024-05-14T12:26:23.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 shutdown_connections 2024-05-14T12:26:23.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a751090 0x555c6a7534b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a741670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a5b8fd0 0x555c6a740bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/564439059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a7376a0 0x555c6a741130 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8b7400700 0 client.25349 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:23.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.909+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 >> 172.21.15.47:0/564439059 conn(0x555c6a5f7c10 msgr2=0x555c6a731ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:23.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.910+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 shutdown_connections 2024-05-14T12:26:23.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.910+0000 7fa8e710bb80 1 -- 172.21.15.47:0/564439059 wait complete. 2024-05-14T12:26:23.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.910+0000 7fa8e710bb80 20 client.25349 trim_cache size 0 max 16384 2024-05-14T12:26:23.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.932+0000 7fa8e710bb80 1 Processor -- start 2024-05-14T12:26:23.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8e710bb80 1 -- start start 2024-05-14T12:26:23.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a7368c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a7414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a7429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01b5110 con 0x555c6a73bea0 2024-05-14T12:26:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01b6c50 con 0x555c6a5b8fd0 2024-05-14T12:26:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01b57e0 con 0x555c6a7376a0 2024-05-14T12:26:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.933+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a7368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a7368c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41014/0 (socket says 172.21.15.47:41014) 2024-05-14T12:26:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5c00700 1 -- 172.21.15.47:0/2747814956 learned_addr learned my addr 172.21.15.47:0/2747814956 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5200700 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a7414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d6600700 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a7429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5c00700 1 -- 172.21.15.47:0/2747814956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 msgr2=0x555c6a7414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:23.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a7414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5c00700 1 -- 172.21.15.47:0/2747814956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 msgr2=0x555c6a7429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:23.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a7429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d5c00700 1 -- 172.21.15.47:0/2747814956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6a733640 con 0x555c6a5b8fd0 2024-05-14T12:26:23.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.934+0000 7fa8d6600700 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a7429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:26:23.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.935+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a7368c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4006010 tx=0x7fa8c4019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3298d2d7d41231a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:23.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.935+0000 7fa8c2000700 1 -- 172.21.15.47:0/2747814956 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400bb30 con 0x555c6a5b8fd0 2024-05-14T12:26:23.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.935+0000 7fa8c2000700 1 -- 172.21.15.47:0/2747814956 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4033070 con 0x555c6a5b8fd0 2024-05-14T12:26:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.935+0000 7fa8c2000700 1 -- 172.21.15.47:0/2747814956 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003d20 con 0x555c6a5b8fd0 2024-05-14T12:26:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 -- 172.21.15.47:0/2747814956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 msgr2=0x555c6a7368c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a7368c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4006010 tx=0x7fa8c4019040 comp rx=0 tx=0).stop 2024-05-14T12:26:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 -- 172.21.15.47:0/2747814956 shutdown_connections 2024-05-14T12:26:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a73bea0 0x555c6a7429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a5b8fd0 0x555c6a7368c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/2747814956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a7414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 -- 172.21.15.47:0/2747814956 >> 172.21.15.47:0/2747814956 conn(0x555c6a5f7c10 msgr2=0x555c6a7422a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 -- 172.21.15.47:0/2747814956 shutdown_connections 2024-05-14T12:26:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.936+0000 7fa8e710bb80 1 -- 172.21.15.47:0/2747814956 wait complete. 2024-05-14T12:26:23.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 -- start start 2024-05-14T12:26:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 Processor -- start 2024-05-14T12:26:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a5b8fd0 0x555c6a758460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a7589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a73bea0 0x555c6a758ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01b6580 con 0x555c6a5b8fd0 2024-05-14T12:26:23.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01b5eb0 con 0x555c6a73bea0 2024-05-14T12:26:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.937+0000 7fa8e710bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01b3090 con 0x555c6a7376a0 2024-05-14T12:26:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8e710bb80 10 client.0 _ll_register_callbacks cb 0x555c6a5ec510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a5b8fd0 0x555c6a758460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a5b8fd0 0x555c6a758460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50014/0 (socket says 172.21.15.47:50014) 2024-05-14T12:26:23.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 -- 172.21.15.47:0/1871475727 learned_addr learned my addr 172.21.15.47:0/1871475727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 -- 172.21.15.47:0/1871475727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 msgr2=0x555c6a7589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a7589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 -- 172.21.15.47:0/1871475727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a73bea0 msgr2=0x555c6a758ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:26:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a73bea0 0x555c6a758ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.938+0000 7fa8d5c00700 1 -- 172.21.15.47:0/1871475727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6a7ba800 con 0x555c6a5b8fd0 2024-05-14T12:26:23.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.939+0000 7fa8d5c00700 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a5b8fd0 0x555c6a758460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009750 tx=0x7fa8c400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231ba74bcc9aa5a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.939+0000 7fa8b7400700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:26:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.939+0000 7fa8b7400700 1 -- 172.21.15.47:0/1871475727 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4005390 con 0x555c6a5b8fd0 2024-05-14T12:26:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.939+0000 7fa8b7400700 1 -- 172.21.15.47:0/1871475727 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa8c401d040 con 0x555c6a5b8fd0 2024-05-14T12:26:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.939+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c4033070 con 0x555c6a5b8fd0 2024-05-14T12:26:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.940+0000 7fa8b7400700 1 -- 172.21.15.47:0/1871475727 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa8c4003840 con 0x555c6a5b8fd0 2024-05-14T12:26:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.940+0000 7fa8e710bb80 10 client.15240 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.940+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c6a7bb9c0 con 0x555c6a5b8fd0 2024-05-14T12:26:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.940+0000 7fa8b7400700 1 -- 172.21.15.47:0/1871475727 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4033070 con 0x555c6a5b8fd0 2024-05-14T12:26:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.941+0000 7fa8b7400700 1 -- 172.21.15.47:0/1871475727 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa8c40039e0 con 0x555c6a5b8fd0 2024-05-14T12:26:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.941+0000 7fa8e710bb80 10 client.15240 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.941+0000 7fa8e710bb80 10 client.15240 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:26:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.941+0000 7fa8e710bb80 20 client.15240 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.941+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a7bbc30 0x555c6a7be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.941+0000 7fa8e710bb80 4 client.15240 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.1, "await_for": 42.0}] 2024-05-14T12:26:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.941+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.1, "await_for": 42.0}) -- 0x555c6a666590 con 0x555c6a7bbc30 2024-05-14T12:26:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.942+0000 7fa8d5200700 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a7bbc30 0x555c6a7be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.944+0000 7fa8d5200700 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a7bbc30 0x555c6a7be050 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22fb79becc2ab0f server_cookie=336cdb4711ad6f92 in_seq=0 out_seq=0 2024-05-14T12:26:23.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.944+0000 7fa8b7400700 10 client.15240 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:23.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.964+0000 7fa8b7400700 1 -- 172.21.15.47:0/1871475727 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x555c6a666590 con 0x555c6a7bbc30 2024-05-14T12:26:23.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.964+0000 7fa8b7400700 10 client.15240 handle_command_reply: tid=0 2024-05-14T12:26:23.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.964+0000 7fa8e710bb80 1 client.15240 shutdown 2024-05-14T12:26:23.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.964+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a5b8fd0 msgr2=0x555c6a758460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.964+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a5b8fd0 0x555c6a758460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009750 tx=0x7fa8c400bd40 comp rx=0 tx=0).stop 2024-05-14T12:26:23.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 shutdown_connections 2024-05-14T12:26:23.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555c6a7bbc30 0x555c6a7be050 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555c6a73bea0 0x555c6a758ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c6a5b8fd0 0x555c6a758460 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 --2- 172.21.15.47:0/1871475727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555c6a7376a0 0x555c6a7589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 >> 172.21.15.47:0/1871475727 conn(0x555c6a5f7c10 msgr2=0x555c6a736620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8b7400700 0 client.15240 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 shutdown_connections 2024-05-14T12:26:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 1 -- 172.21.15.47:0/1871475727 wait complete. 2024-05-14T12:26:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.965+0000 7fa8e710bb80 20 client.15240 trim_cache size 0 max 16384 2024-05-14T12:26:23.968 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:26:23.968 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-05-14T12:26:23.968 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:26:23.968 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 2, 2024-05-14T12:26:23.968 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:26:23.969 INFO:teuthology.orchestra.run.smithi047.stdout: "c0b64b7d": { 2024-05-14T12:26:23.969 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 2, 2024-05-14T12:26:23.969 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:26:23.969 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:26:23.969 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:26:23.969 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 87.1, 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:26:23.970 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:26:23.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:23.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:23.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:23.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:23.971 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:23.971 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.966+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa8b80b2980 msgr2=0x7fa8b80b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.966+0000 7fa8d7000700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa8b80b2980 0x7fa8b80b4e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009690 tx=0x7fa8c80095e0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01039d0 msgr2=0x7fa8d01a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01039d0 0x7fa8d01a1820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00eab0 tx=0x7fa8bc00ee70 comp rx=0 tx=0).stop 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 shutdown_connections 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa8b80b2980 0x7fa8b80b4e90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d01084d0 0x7fa8d01a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8d0103080 0x7fa8d01a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 --2- 172.21.15.47:0/527988133 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8d01039d0 0x7fa8d01a1820 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 >> 172.21.15.47:0/527988133 conn(0x7fa8d0078ac0 msgr2=0x7fa8d0105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 shutdown_connections 2024-05-14T12:26:23.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:23.967+0000 7fa8d7000700 1 -- 172.21.15.47:0/527988133 wait complete. 2024-05-14T12:26:24.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:23 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:26:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:23 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:26:25.004 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c0b64b7d', quiesce took 8.1 seconds. Will release after: 27.1 2024-05-14T12:26:25.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:24 smithi066 ceph-mon[35981]: pgmap v487: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T12:26:25.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:24 smithi047 ceph-mon[31254]: pgmap v487: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T12:26:25.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:24 smithi073 ceph-mon[35809]: pgmap v487: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T12:26:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:26:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:26:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:26:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:26:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:26:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:26:26.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:26:26.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:26:26.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:26:27.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:26 smithi066 ceph-mon[35981]: pgmap v488: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-14T12:26:27.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:26 smithi047 ceph-mon[31254]: pgmap v488: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-14T12:26:27.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:26 smithi073 ceph-mon[35809]: pgmap v488: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-14T12:26:29.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:29 smithi047 ceph-mon[31254]: pgmap v489: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-14T12:26:29.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:29 smithi073 ceph-mon[35809]: pgmap v489: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-14T12:26:29.778 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:29 smithi066 ceph-mon[35981]: pgmap v489: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-14T12:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 -- 172.21.15.47:0/4103601986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0410bc00 msgr2=0x7f2b0410e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 --2- 172.21.15.47:0/4103601986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0410bc00 0x7f2b0410e020 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009be0 tx=0x7f2afc02a6c0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 -- 172.21.15.47:0/4103601986 shutdown_connections 2024-05-14T12:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 --2- 172.21.15.47:0/4103601986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0410bc00 0x7f2b0410e020 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 --2- 172.21.15.47:0/4103601986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b04106f00 0x7f2b04107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 --2- 172.21.15.47:0/4103601986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b04105cc0 0x7f2b041069c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 -- 172.21.15.47:0/4103601986 >> 172.21.15.47:0/4103601986 conn(0x7f2b04100ed0 msgr2=0x7f2b04103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 -- 172.21.15.47:0/4103601986 shutdown_connections 2024-05-14T12:26:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.334+0000 7f2b09400640 1 -- 172.21.15.47:0/4103601986 wait complete. 2024-05-14T12:26:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.336+0000 7f2b09400640 1 Processor -- start 2024-05-14T12:26:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.336+0000 7f2b09400640 1 -- start start 2024-05-14T12:26:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b09400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b04105cc0 0x7f2b0419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b09400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b04106f00 0x7f2b0419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b09400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0410bc00 0x7f2b041a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b09400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04111890 con 0x7f2b04106f00 2024-05-14T12:26:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b09400640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04111710 con 0x7f2b04105cc0 2024-05-14T12:26:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b09400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04111a10 con 0x7f2b0410bc00 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b04106f00 0x7f2b0419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b04106f00 0x7f2b0419c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37872/0 (socket says 172.21.15.47:37872) 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 -- 172.21.15.47:0/3283078485 learned_addr learned my addr 172.21.15.47:0/3283078485 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b04105cc0 0x7f2b0419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b08a00640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0410bc00 0x7f2b041a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 -- 172.21.15.47:0/3283078485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0410bc00 msgr2=0x7f2b041a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0410bc00 0x7f2b041a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 -- 172.21.15.47:0/3283078485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b04105cc0 msgr2=0x7f2b0419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b04105cc0 0x7f2b0419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.337+0000 7f2b03400640 1 -- 172.21.15.47:0/3283078485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b041a3eb0 con 0x7f2b04106f00 2024-05-14T12:26:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.338+0000 7f2b03400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b04106f00 0x7f2b0419c8b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e9c0 tx=0x7f2af000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.338+0000 7f2b00c00640 1 -- 172.21.15.47:0/3283078485 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af000cde0 con 0x7f2b04106f00 2024-05-14T12:26:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.338+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b041a41a0 con 0x7f2b04106f00 2024-05-14T12:26:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.338+0000 7f2b00c00640 1 -- 172.21.15.47:0/3283078485 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2af00035f0 con 0x7f2b04106f00 2024-05-14T12:26:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.338+0000 7f2b00c00640 1 -- 172.21.15.47:0/3283078485 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0010690 con 0x7f2b04106f00 2024-05-14T12:26:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.338+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b041a4740 con 0x7f2b04106f00 2024-05-14T12:26:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.341+0000 7f2b11b65740 1 Processor -- start 2024-05-14T12:26:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b11b65740 1 -- start start 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95d91b0 0x55e1b997b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b997b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9982780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b11b65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e1b98df550 con 0x55e1b95b02f0 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b11b65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e1b9884bc0 con 0x55e1b95b84d0 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b11b65740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e1b98db510 con 0x55e1b95d91b0 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b08a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95d91b0 0x55e1b997b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b08a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95d91b0 0x55e1b997b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:37942/0 (socket says 172.21.15.47:37942) 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.342+0000 7f2b08a00640 1 -- 172.21.15.47:0/3370039755 learned_addr learned my addr 172.21.15.47:0/3370039755 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b997b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b08a00640 1 -- 172.21.15.47:0/3370039755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 msgr2=0x55e1b9982780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:26:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b08a00640 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9982780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b08a00640 1 -- 172.21.15.47:0/3370039755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 msgr2=0x55e1b997b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b08a00640 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b997b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b08a00640 1 -- 172.21.15.47:0/3370039755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b95f1210 con 0x55e1b95d91b0 2024-05-14T12:26:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b00c00640 1 -- 172.21.15.47:0/3283078485 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2af0004020 con 0x7f2b04106f00 2024-05-14T12:26:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.343+0000 7f2b08a00640 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95d91b0 0x55e1b997b300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009be0 tx=0x7f2afc005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f03a7bcd5e660b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:30.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.344+0000 7f2af9200640 1 -- 172.21.15.47:0/3370039755 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc041030 con 0x55e1b95d91b0 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.344+0000 7f2af9200640 1 -- 172.21.15.47:0/3370039755 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2afc030530 con 0x55e1b95d91b0 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.344+0000 7f2af9200640 1 -- 172.21.15.47:0/3370039755 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc036040 con 0x55e1b95d91b0 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 -- 172.21.15.47:0/3370039755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95d91b0 msgr2=0x55e1b997b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95d91b0 0x55e1b997b300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009be0 tx=0x7f2afc005fd0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 -- 172.21.15.47:0/3370039755 shutdown_connections 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9982780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b997b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3370039755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95d91b0 0x55e1b997b300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 -- 172.21.15.47:0/3370039755 >> 172.21.15.47:0/3370039755 conn(0x55e1b95cd300 msgr2=0x55e1b9976c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 -- 172.21.15.47:0/3370039755 shutdown_connections 2024-05-14T12:26:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b11b65740 1 -- 172.21.15.47:0/3370039755 wait complete. 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b00c00640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2ae80b27b0 0x7f2ae80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.345+0000 7f2b00c00640 1 -- 172.21.15.47:0/3283078485 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2af00e2580 con 0x7f2b04106f00 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.346+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2ae80b27b0 0x7f2ae80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.346+0000 7f2b11b65740 1 -- start start 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.346+0000 7f2b11b65740 1 Processor -- start 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.346+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b02f0 0x55e1b9984dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.346+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2ae80b27b0 0x7f2ae80b4cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55e1b9977a20 tx=0x7f2af4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.346+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9985310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b998c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b11b65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e1b9983170 con 0x55e1b95d91b0 2024-05-14T12:26:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b11b65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e1b9898660 con 0x55e1b95b84d0 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b11b65740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e1b99832f0 con 0x55e1b95b02f0 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b11b65740 10 client.0 _ll_register_callbacks cb 0x55e1b9862400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9985310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9985310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50688/0 (socket says 172.21.15.47:50688) 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 -- 172.21.15.47:0/4003821248 learned_addr learned my addr 172.21.15.47:0/4003821248 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03e00640 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b02f0 0x55e1b9984dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b08a00640 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b998c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 -- 172.21.15.47:0/4003821248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b02f0 msgr2=0x55e1b9984dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b02f0 0x55e1b9984dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 -- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 msgr2=0x55e1b998c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b998c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.347+0000 7f2b03400640 1 -- 172.21.15.47:0/4003821248 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b96bd620 con 0x55e1b95b84d0 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2b03400640 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9985310 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2af00a5be0 tx=0x7f2af00a53e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b93d0d91c9a0950 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2aed600640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2aed600640 1 -- 172.21.15.47:0/4003821248 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af00c3060 con 0x55e1b95b84d0 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2aed600640 1 -- 172.21.15.47:0/4003821248 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2af00037a0 con 0x55e1b95b84d0 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2afc030530 con 0x55e1b95b84d0 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2aed600640 1 -- 172.21.15.47:0/4003821248 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2af00c4250 con 0x55e1b95b84d0 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2b11b65740 10 client.25361 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e1b998f2c0 con 0x55e1b95b84d0 2024-05-14T12:26:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.348+0000 7f2aed600640 1 -- 172.21.15.47:0/4003821248 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2afc030530 con 0x55e1b95b84d0 2024-05-14T12:26:30.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2aed600640 1 -- 172.21.15.47:0/4003821248 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2af00e2110 con 0x55e1b95b84d0 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2b11b65740 10 client.25361 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2b11b65740 10 client.25361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2b11b65740 20 client.25361 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2b11b65740 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b9597d80 0x55e1b99928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2b11b65740 4 client.25361 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1b98ed160 con 0x55e1b9597d80 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.349+0000 7f2b03e00640 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b9597d80 0x55e1b99928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.350+0000 7f2aed600640 10 client.25361 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.350+0000 7f2b03e00640 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b9597d80 0x55e1b99928e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba0afbf56638280 server_cookie=e1edaf8a6f8c15c5 in_seq=0 out_seq=0 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2aed600640 1 -- 172.21.15.47:0/4003821248 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e1b98ed160 con 0x55e1b9597d80 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2aed600640 10 client.25361 handle_command_reply: tid=0 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 client.25361 shutdown 2024-05-14T12:26:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 msgr2=0x55e1b9985310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9985310 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2af00a5be0 tx=0x7f2af00a53e0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 shutdown_connections 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b9597d80 0x55e1b99928e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b998c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b84d0 0x55e1b9985310 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 --2- 172.21.15.47:0/4003821248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b02f0 0x55e1b9984dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2aed600640 0 client.25361 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.351+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 >> 172.21.15.47:0/4003821248 conn(0x55e1b95cd300 msgr2=0x55e1b9975c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.352+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 shutdown_connections 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.352+0000 7f2b11b65740 1 -- 172.21.15.47:0/4003821248 wait complete. 2024-05-14T12:26:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.352+0000 7f2b11b65740 20 client.25361 trim_cache size 0 max 16384 2024-05-14T12:26:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.384+0000 7f2b11b65740 1 Processor -- start 2024-05-14T12:26:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.384+0000 7f2b11b65740 1 -- start start 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b02f0 0x55e1b9997040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b9997580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b11b65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041ad320 con 0x55e1b95d91b0 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b11b65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041aee60 con 0x55e1b95b02f0 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b11b65740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041ad9f0 con 0x55e1b95b84d0 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b08a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b9997580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b08a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b9997580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37904/0 (socket says 172.21.15.47:37904) 2024-05-14T12:26:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b08a00640 1 -- 172.21.15.47:0/3805942767 learned_addr learned my addr 172.21.15.47:0/3805942767 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b02f0 0x55e1b9997040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.385+0000 7f2b03400640 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2b03e00640 1 -- 172.21.15.47:0/3805942767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 msgr2=0x55e1b998c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2b03e00640 1 -- 172.21.15.47:0/3805942767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 msgr2=0x55e1b9997580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b9997580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2b03e00640 1 -- 172.21.15.47:0/3805942767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b9982610 con 0x55e1b95b02f0 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2b08a00640 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b9997580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2b03e00640 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b02f0 0x55e1b9997040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55e1b9992fc0 tx=0x7f2af4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9516d79fc9282ab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2aefe00640 1 -- 172.21.15.47:0/3805942767 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4030070 con 0x55e1b95b02f0 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2aefe00640 1 -- 172.21.15.47:0/3805942767 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2af401ddb0 con 0x55e1b95b02f0 2024-05-14T12:26:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.386+0000 7f2aefe00640 1 -- 172.21.15.47:0/3805942767 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af402b320 con 0x55e1b95b02f0 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 -- 172.21.15.47:0/3805942767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b02f0 msgr2=0x55e1b9997040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b02f0 0x55e1b9997040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55e1b9992fc0 tx=0x7f2af4019000 comp rx=0 tx=0).stop 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 -- 172.21.15.47:0/3805942767 shutdown_connections 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95d91b0 0x55e1b9997580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 --2- 172.21.15.47:0/3805942767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95b02f0 0x55e1b9997040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 -- 172.21.15.47:0/3805942767 >> 172.21.15.47:0/3805942767 conn(0x55e1b95cd300 msgr2=0x55e1b997f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 -- 172.21.15.47:0/3805942767 shutdown_connections 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 -- 172.21.15.47:0/3805942767 wait complete. 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.388+0000 7f2b11b65740 1 -- start start 2024-05-14T12:26:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.389+0000 7f2b11b65740 1 Processor -- start 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.389+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b9989d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.389+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.389+0000 7f2b11b65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95d91b0 0x55e1b998b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.389+0000 7f2b11b65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041ae790 con 0x55e1b95b02f0 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.389+0000 7f2b11b65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041ae0c0 con 0x55e1b95d91b0 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.389+0000 7f2b11b65740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041ab2e0 con 0x55e1b95b84d0 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b11b65740 10 client.0 _ll_register_callbacks cb 0x7f2af0003d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b9989d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b9989d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37920/0 (socket says 172.21.15.47:37920) 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 -- 172.21.15.47:0/1571761939 learned_addr learned my addr 172.21.15.47:0/1571761939 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03400640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b08a00640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95d91b0 0x55e1b998b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 -- 172.21.15.47:0/1571761939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 msgr2=0x55e1b998a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 -- 172.21.15.47:0/1571761939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95d91b0 msgr2=0x55e1b998b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95d91b0 0x55e1b998b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b03e00640 1 -- 172.21.15.47:0/1571761939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b998b770 con 0x55e1b95b02f0 2024-05-14T12:26:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.390+0000 7f2b08a00640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95d91b0 0x55e1b998b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2b03e00640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b9989d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2af402b000 tx=0x7f2af401d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc6ad31d2126a70 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2aed600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2aed600640 1 -- 172.21.15.47:0/1571761939 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4039060 con 0x55e1b95b02f0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2af401ddb0 con 0x55e1b95b02f0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2aed600640 1 -- 172.21.15.47:0/1571761939 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2af4005480 con 0x55e1b95b02f0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2aed600640 1 -- 172.21.15.47:0/1571761939 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2af4030040 con 0x55e1b95b02f0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2b11b65740 10 client.15258 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.391+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e1b99faf30 con 0x55e1b95b02f0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2aed600640 1 -- 172.21.15.47:0/1571761939 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2af401ddb0 con 0x55e1b95b02f0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2aed600640 1 -- 172.21.15.47:0/1571761939 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2af403e070 con 0x55e1b95b02f0 2024-05-14T12:26:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2b11b65740 10 client.15258 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2b11b65740 10 client.15258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2b11b65740 20 client.15258 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2b11b65740 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b956d1c0 0x55e1b99fd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2b11b65740 4 client.15258 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e1b98e6fd0 con 0x55e1b956d1c0 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.392+0000 7f2b03400640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b956d1c0 0x55e1b99fd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.393+0000 7f2aed600640 10 client.15258 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.393+0000 7f2b03400640 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b956d1c0 0x55e1b99fd920 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8b16426898a6773 server_cookie=aeb9313245b7d083 in_seq=0 out_seq=0 2024-05-14T12:26:30.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2aed600640 1 -- 172.21.15.47:0/1571761939 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e1b98e6fd0 con 0x55e1b956d1c0 2024-05-14T12:26:30.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2aed600640 10 client.15258 handle_command_reply: tid=0 2024-05-14T12:26:30.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 client.15258 shutdown 2024-05-14T12:26:30.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 msgr2=0x55e1b9989d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b9989d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2af402b000 tx=0x7f2af401d510 comp rx=0 tx=0).stop 2024-05-14T12:26:30.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 shutdown_connections 2024-05-14T12:26:30.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e1b956d1c0 0x55e1b99fd920 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e1b95d91b0 0x55e1b998b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e1b95b84d0 0x55e1b998a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 --2- 172.21.15.47:0/1571761939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e1b95b02f0 0x55e1b9989d40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 >> 172.21.15.47:0/1571761939 conn(0x55e1b95cd300 msgr2=0x55e1b9979a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2aed600640 0 client.15258 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 shutdown_connections 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 1 -- 172.21.15.47:0/1571761939 wait complete. 2024-05-14T12:26:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.400+0000 7f2b11b65740 20 client.15258 trim_cache size 0 max 16384 2024-05-14T12:26:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:26:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:26:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:26:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2ae80b27b0 msgr2=0x7f2ae80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2ae80b27b0 0x7f2ae80b4cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55e1b9977a20 tx=0x7f2af4005f90 comp rx=0 tx=0).stop 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b04106f00 msgr2=0x7f2b0419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b04106f00 0x7f2b0419c8b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e9c0 tx=0x7f2af000ee80 comp rx=0 tx=0).stop 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 shutdown_connections 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2ae80b27b0 0x7f2ae80b4cc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0410bc00 0x7f2b041a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b04106f00 0x7f2b0419c8b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 --2- 172.21.15.47:0/3283078485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b04105cc0 0x7f2b0419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 >> 172.21.15.47:0/3283078485 conn(0x7f2b04100ed0 msgr2=0x7f2b04107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 shutdown_connections 2024-05-14T12:26:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:30.401+0000 7f2b09400640 1 -- 172.21.15.47:0/3283078485 wait complete. 2024-05-14T12:26:31.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:31 smithi047 ceph-mon[31254]: pgmap v490: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T12:26:31.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:31 smithi073 ceph-mon[35809]: pgmap v490: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T12:26:31.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:31 smithi066 ceph-mon[35981]: pgmap v490: 97 pgs: 97 active+clean; 675 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T12:26:33.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:33 smithi047 ceph-mon[31254]: pgmap v491: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:26:33.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:33 smithi073 ceph-mon[35809]: pgmap v491: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:26:33.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:33 smithi066 ceph-mon[35981]: pgmap v491: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-14T12:26:35.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:35 smithi047 ceph-mon[31254]: pgmap v492: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-14T12:26:35.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:35 smithi073 ceph-mon[35809]: pgmap v492: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-14T12:26:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:35 smithi066 ceph-mon[35981]: pgmap v492: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-14T12:26:37.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:37 smithi073 ceph-mon[35809]: pgmap v493: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:26:37.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:37 smithi066 ceph-mon[35981]: pgmap v493: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:26:37.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:37 smithi047 ceph-mon[31254]: pgmap v493: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:26:39.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:39 smithi073 ceph-mon[35809]: pgmap v494: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T12:26:39.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:39 smithi066 ceph-mon[35981]: pgmap v494: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T12:26:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:39 smithi047 ceph-mon[31254]: pgmap v494: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T12:26:41.752 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:41 smithi073 ceph-mon[35809]: pgmap v495: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T12:26:41.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:41 smithi066 ceph-mon[35981]: pgmap v495: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T12:26:41.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:41 smithi047 ceph-mon[31254]: pgmap v495: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T12:26:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 -- 172.21.15.47:0/2637707205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870103ab0 msgr2=0x7f48701047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 --2- 172.21.15.47:0/2637707205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870103ab0 0x7f48701047b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4860009900 tx=0x7f486002a3f0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 -- 172.21.15.47:0/2637707205 shutdown_connections 2024-05-14T12:26:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 --2- 172.21.15.47:0/2637707205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48701099f0 0x7f487010be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 --2- 172.21.15.47:0/2637707205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870104cf0 0x7f4870105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 --2- 172.21.15.47:0/2637707205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870103ab0 0x7f48701047b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 -- 172.21.15.47:0/2637707205 >> 172.21.15.47:0/2637707205 conn(0x7f48700fecc0 msgr2=0x7f4870101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 -- 172.21.15.47:0/2637707205 shutdown_connections 2024-05-14T12:26:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.656+0000 7f486fe00640 1 -- 172.21.15.47:0/2637707205 wait complete. 2024-05-14T12:26:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.658+0000 7f486fe00640 1 Processor -- start 2024-05-14T12:26:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.658+0000 7f486fe00640 1 -- start start 2024-05-14T12:26:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.658+0000 7f486fe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870103ab0 0x7f487019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.658+0000 7f486fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870104cf0 0x7f487019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48701099f0 0x7f48701a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f487010f680 con 0x7f48701099f0 2024-05-14T12:26:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486fe00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f487010f500 con 0x7f4870103ab0 2024-05-14T12:26:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f487010f800 con 0x7f4870104cf0 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870103ab0 0x7f487019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870103ab0 0x7f487019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35424/0 (socket says 172.21.15.47:35424) 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 -- 172.21.15.47:0/961828747 learned_addr learned my addr 172.21.15.47:0/961828747 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486f400640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48701099f0 0x7f48701a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486e000640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870104cf0 0x7f487019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 -- 172.21.15.47:0/961828747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870104cf0 msgr2=0x7f487019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870104cf0 0x7f487019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 -- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48701099f0 msgr2=0x7f48701a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48701099f0 0x7f48701a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486ea00640 1 -- 172.21.15.47:0/961828747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48701a1d00 con 0x7f4870103ab0 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.659+0000 7f486e000640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870104cf0 0x7f487019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.660+0000 7f486ea00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870103ab0 0x7f487019a1c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4860031440 tx=0x7f4860003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.660+0000 7f4867400640 1 -- 172.21.15.47:0/961828747 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486003f070 con 0x7f4870103ab0 2024-05-14T12:26:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.660+0000 7f4867400640 1 -- 172.21.15.47:0/961828747 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4860031c50 con 0x7f4870103ab0 2024-05-14T12:26:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.660+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4870074f00 con 0x7f4870103ab0 2024-05-14T12:26:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.660+0000 7f4867400640 1 -- 172.21.15.47:0/961828747 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860035030 con 0x7f4870103ab0 2024-05-14T12:26:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.660+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4870075440 con 0x7f4870103ab0 2024-05-14T12:26:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.665+0000 7f487c76e740 1 Processor -- start 2024-05-14T12:26:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.665+0000 7f487c76e740 1 -- start start 2024-05-14T12:26:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.665+0000 7f487c76e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24be81b0 0x563a24f8a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.665+0000 7f487c76e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bbf2f0 0x563a24f8a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f487c76e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bc74d0 0x563a24f91780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f487c76e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563a24eee550 con 0x563a24bbf2f0 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f487c76e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563a24e93bc0 con 0x563a24bc74d0 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f487c76e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563a24eea510 con 0x563a24be81b0 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f4867400640 1 -- 172.21.15.47:0/961828747 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4860042070 con 0x7f4870103ab0 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f486f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24be81b0 0x563a24f8a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f486f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24be81b0 0x563a24f8a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:58636/0 (socket says 172.21.15.47:58636) 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f486f400640 1 -- 172.21.15.47:0/402392783 learned_addr learned my addr 172.21.15.47:0/402392783 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f486e000640 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bc74d0 0x563a24f91780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.666+0000 7f486ea00640 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bbf2f0 0x563a24f8a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f486e000640 1 -- 172.21.15.47:0/402392783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24be81b0 msgr2=0x563a24f8a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f486e000640 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24be81b0 0x563a24f8a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f486e000640 1 -- 172.21.15.47:0/402392783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bbf2f0 msgr2=0x563a24f8a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f486e000640 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bbf2f0 0x563a24f8a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f486e000640 1 -- 172.21.15.47:0/402392783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a24c00210 con 0x563a24bc74d0 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f486f400640 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24be81b0 0x563a24f8a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f486e000640 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bc74d0 0x563a24f91780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f485c009c00 tx=0x7f485c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adad48f9e072cc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f485b400640 1 -- 172.21.15.47:0/402392783 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c012450 con 0x563a24bc74d0 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f485b400640 1 -- 172.21.15.47:0/402392783 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f485c012aa0 con 0x563a24bc74d0 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.667+0000 7f485b400640 1 -- 172.21.15.47:0/402392783 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c00fad0 con 0x563a24bc74d0 2024-05-14T12:26:43.669 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.668+0000 7f4867400640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f48540b2920 0x7f48540b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.668+0000 7f4867400640 1 -- 172.21.15.47:0/961828747 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4860102ad0 con 0x7f4870103ab0 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.668+0000 7f486f400640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f48540b2920 0x7f48540b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.668+0000 7f487c76e740 1 -- 172.21.15.47:0/402392783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bc74d0 msgr2=0x563a24f91780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.668+0000 7f487c76e740 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bc74d0 0x563a24f91780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f485c009c00 tx=0x7f485c0117b0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.669+0000 7f487c76e740 1 -- 172.21.15.47:0/402392783 shutdown_connections 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.669+0000 7f487c76e740 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bc74d0 0x563a24f91780 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.669+0000 7f487c76e740 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bbf2f0 0x563a24f8a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.669+0000 7f487c76e740 1 --2- 172.21.15.47:0/402392783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24be81b0 0x563a24f8a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.669+0000 7f487c76e740 1 -- 172.21.15.47:0/402392783 >> 172.21.15.47:0/402392783 conn(0x563a24bdc300 msgr2=0x563a24f85c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.669+0000 7f487c76e740 1 -- 172.21.15.47:0/402392783 shutdown_connections 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.669+0000 7f487c76e740 1 -- 172.21.15.47:0/402392783 wait complete. 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.670+0000 7f486f400640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f48540b2920 0x7f48540b4e30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x563a24f8b4d0 tx=0x7f48680097e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.670+0000 7f487c76e740 1 -- start start 2024-05-14T12:26:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.670+0000 7f487c76e740 1 Processor -- start 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f487c76e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bbf2f0 0x563a24f93e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f487c76e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bc74d0 0x563a24f94360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f487c76e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24be81b0 0x563a24f9b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f487c76e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563a24f921d0 con 0x563a24be81b0 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f487c76e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563a24ea7660 con 0x563a24bbf2f0 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f487c76e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563a24f92350 con 0x563a24bc74d0 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f487c76e740 10 client.0 _ll_register_callbacks cb 0x563a24e71400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f486f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24be81b0 0x563a24f9b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f486f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24be81b0 0x563a24f9b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56228/0 (socket says 172.21.15.47:56228) 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f486f400640 1 -- 172.21.15.47:0/4068972930 learned_addr learned my addr 172.21.15.47:0/4068972930 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.671+0000 7f486ea00640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bbf2f0 0x563a24f93e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486e000640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bc74d0 0x563a24f94360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486ea00640 1 -- 172.21.15.47:0/4068972930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bc74d0 msgr2=0x563a24f94360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486ea00640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bc74d0 0x563a24f94360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486ea00640 1 -- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24be81b0 msgr2=0x563a24f9b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486ea00640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24be81b0 0x563a24f9b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486ea00640 1 -- 172.21.15.47:0/4068972930 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a24ccc620 con 0x563a24bbf2f0 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486f400640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24be81b0 0x563a24f9b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f486ea00640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bbf2f0 0x563a24f93e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x563a24f8b6e0 tx=0x7f48600c9e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f5d10c63088dc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.672+0000 7f484fe00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.673+0000 7f484fe00640 1 -- 172.21.15.47:0/4068972930 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860049070 con 0x563a24bbf2f0 2024-05-14T12:26:43.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.673+0000 7f484fe00640 1 -- 172.21.15.47:0/4068972930 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f48600ce0b0 con 0x563a24bbf2f0 2024-05-14T12:26:43.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.673+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f485c012aa0 con 0x563a24bbf2f0 2024-05-14T12:26:43.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.673+0000 7f484fe00640 1 -- 172.21.15.47:0/4068972930 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4860031e00 con 0x563a24bbf2f0 2024-05-14T12:26:43.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.673+0000 7f487c76e740 10 client.25379 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:43.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.673+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a24f9e1f0 con 0x563a24bbf2f0 2024-05-14T12:26:43.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.673+0000 7f484fe00640 1 -- 172.21.15.47:0/4068972930 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f485c012aa0 con 0x563a24bbf2f0 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.674+0000 7f484fe00640 1 -- 172.21.15.47:0/4068972930 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f486003b460 con 0x563a24bbf2f0 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.674+0000 7f487c76e740 10 client.25379 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.675+0000 7f487c76e740 10 client.25379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.675+0000 7f487c76e740 20 client.25379 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.675+0000 7f487c76e740 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24ba6d80 0x563a24fa1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.675+0000 7f487c76e740 4 client.25379 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.675+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a24efc160 con 0x563a24ba6d80 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.675+0000 7f486e000640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24ba6d80 0x563a24fa1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.676+0000 7f486e000640 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24ba6d80 0x563a24fa1900 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d58989a51b34a438 server_cookie=6a0672ce729e9031 in_seq=0 out_seq=0 2024-05-14T12:26:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.676+0000 7f484fe00640 10 client.25379 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f484fe00640 1 -- 172.21.15.47:0/4068972930 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563a24efc160 con 0x563a24ba6d80 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f484fe00640 10 client.25379 handle_command_reply: tid=0 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 client.25379 shutdown 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bbf2f0 msgr2=0x563a24f93e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bbf2f0 0x563a24f93e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x563a24f8b6e0 tx=0x7f48600c9e80 comp rx=0 tx=0).stop 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 shutdown_connections 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24ba6d80 0x563a24fa1900 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24be81b0 0x563a24f9b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bc74d0 0x563a24f94360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f484fe00640 0 client.25379 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 --2- 172.21.15.47:0/4068972930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24bbf2f0 0x563a24f93e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.677+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 >> 172.21.15.47:0/4068972930 conn(0x563a24bdc300 msgr2=0x563a24f84c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.678+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 shutdown_connections 2024-05-14T12:26:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.678+0000 7f487c76e740 1 -- 172.21.15.47:0/4068972930 wait complete. 2024-05-14T12:26:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.678+0000 7f487c76e740 20 client.25379 trim_cache size 0 max 16384 2024-05-14T12:26:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.694+0000 7f487c76e740 1 Processor -- start 2024-05-14T12:26:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.694+0000 7f487c76e740 1 -- start start 2024-05-14T12:26:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.694+0000 7f487c76e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f93400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.694+0000 7f487c76e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f93940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f487c76e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f93e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f487c76e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48701ad450 con 0x563a24bc74d0 2024-05-14T12:26:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f487c76e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f48701aef90 con 0x563a24be81b0 2024-05-14T12:26:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f487c76e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48701adb20 con 0x563a24bbf2f0 2024-05-14T12:26:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f93400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f93940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f93400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:58662/0 (socket says 172.21.15.47:58662) 2024-05-14T12:26:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 -- 172.21.15.47:0/2570632141 learned_addr learned my addr 172.21.15.47:0/2570632141 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486f400640 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f93e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 -- 172.21.15.47:0/2570632141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 msgr2=0x563a24f93e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f93e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 -- 172.21.15.47:0/2570632141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 msgr2=0x563a24f93940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f93940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.695+0000 7f486ea00640 1 -- 172.21.15.47:0/2570632141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a24f8b0f0 con 0x563a24bbf2f0 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.696+0000 7f486ea00640 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f93400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4860006010 tx=0x7f48600c6550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68327b04738c8fed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.696+0000 7f485aa00640 1 -- 172.21.15.47:0/2570632141 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860049030 con 0x563a24bbf2f0 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.696+0000 7f485aa00640 1 -- 172.21.15.47:0/2570632141 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48600ce460 con 0x563a24bbf2f0 2024-05-14T12:26:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.696+0000 7f485aa00640 1 -- 172.21.15.47:0/2570632141 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486003b460 con 0x563a24bbf2f0 2024-05-14T12:26:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 -- 172.21.15.47:0/2570632141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 msgr2=0x563a24f93400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f93400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4860006010 tx=0x7f48600c6550 comp rx=0 tx=0).stop 2024-05-14T12:26:43.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 -- 172.21.15.47:0/2570632141 shutdown_connections 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f93e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f93940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 --2- 172.21.15.47:0/2570632141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f93400 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 -- 172.21.15.47:0/2570632141 >> 172.21.15.47:0/2570632141 conn(0x563a24bdc300 msgr2=0x563a24f8e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.697+0000 7f487c76e740 1 -- 172.21.15.47:0/2570632141 shutdown_connections 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.698+0000 7f487c76e740 1 -- 172.21.15.47:0/2570632141 wait complete. 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.698+0000 7f487c76e740 1 -- start start 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.698+0000 7f487c76e740 1 Processor -- start 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f487c76e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f99280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f487c76e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f997c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f487c76e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f99d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f487c76e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48701ae8c0 con 0x563a24bc74d0 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f487c76e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f48701ae1f0 con 0x563a24be81b0 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f487c76e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48701ab410 con 0x563a24bbf2f0 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f487c76e740 10 client.0 _ll_register_callbacks cb 0x7f4860106040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f486f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f99d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f486ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f99280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f486f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f99d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35462/0 (socket says 172.21.15.47:35462) 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f486f400640 1 -- 172.21.15.47:0/4033827105 learned_addr learned my addr 172.21.15.47:0/4033827105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.699+0000 7f486e000640 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f486f400640 1 -- 172.21.15.47:0/4033827105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 msgr2=0x563a24f99280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f486f400640 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f99280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f486f400640 1 -- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 msgr2=0x563a24f997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f486f400640 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f486f400640 1 -- 172.21.15.47:0/4033827105 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a25007ca0 con 0x563a24be81b0 2024-05-14T12:26:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f486f400640 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f99d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4868010d70 tx=0x7f4868004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235ed48c402dbc0c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f484fe00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:26:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f484fe00640 1 -- 172.21.15.47:0/4033827105 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486802e060 con 0x563a24be81b0 2024-05-14T12:26:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48600ce460 con 0x563a24be81b0 2024-05-14T12:26:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.700+0000 7f484fe00640 1 -- 172.21.15.47:0/4033827105 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f486801fd30 con 0x563a24be81b0 2024-05-14T12:26:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.701+0000 7f484fe00640 1 -- 172.21.15.47:0/4033827105 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f486801c400 con 0x563a24be81b0 2024-05-14T12:26:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.701+0000 7f487c76e740 10 client.25385 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.701+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a25009030 con 0x563a24be81b0 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.701+0000 7f484fe00640 1 -- 172.21.15.47:0/4033827105 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48600ce460 con 0x563a24be81b0 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f484fe00640 1 -- 172.21.15.47:0/4033827105 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4868033070 con 0x563a24be81b0 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f487c76e740 10 client.25385 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f487c76e740 10 client.25385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f487c76e740 20 client.25385 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f487c76e740 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24b7c1c0 0x563a2500ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f487c76e740 4 client.25385 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a24ef5fd0 con 0x563a24b7c1c0 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.702+0000 7f486ea00640 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24b7c1c0 0x563a2500ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.703+0000 7f486ea00640 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24b7c1c0 0x563a2500ba00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12eb2d2fd045c84 server_cookie=b81fb9a5752e2465 in_seq=0 out_seq=0 2024-05-14T12:26:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.703+0000 7f484fe00640 10 client.25385 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.707+0000 7f484fe00640 1 -- 172.21.15.47:0/4033827105 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a24ef5fd0 con 0x563a24b7c1c0 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.707+0000 7f484fe00640 10 client.25385 handle_command_reply: tid=0 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.707+0000 7f487c76e740 1 client.25385 shutdown 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 msgr2=0x563a24f99d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f99d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4868010d70 tx=0x7f4868004a40 comp rx=0 tx=0).stop 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 shutdown_connections 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563a24b7c1c0 0x563a2500ba00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563a24be81b0 0x563a24f99d00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a24bc74d0 0x563a24f997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 --2- 172.21.15.47:0/4033827105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a24bbf2f0 0x563a24f99280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f484fe00640 0 client.25385 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 >> 172.21.15.47:0/4033827105 conn(0x563a24bdc300 msgr2=0x563a24f88b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 shutdown_connections 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 1 -- 172.21.15.47:0/4033827105 wait complete. 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.708+0000 7f487c76e740 20 client.25385 trim_cache size 0 max 16384 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:26:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:26:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f48540b2920 msgr2=0x7f48540b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f48540b2920 0x7f48540b4e30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x563a24f8b4d0 tx=0x7f48680097e0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870103ab0 msgr2=0x7f487019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870103ab0 0x7f487019a1c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4860031440 tx=0x7f4860003c10 comp rx=0 tx=0).stop 2024-05-14T12:26:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 shutdown_connections 2024-05-14T12:26:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f48540b2920 0x7f48540b4e30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48701099f0 0x7f48701a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4870104cf0 0x7f487019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 --2- 172.21.15.47:0/961828747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4870103ab0 0x7f487019a1c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 >> 172.21.15.47:0/961828747 conn(0x7f48700fecc0 msgr2=0x7f48701059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 shutdown_connections 2024-05-14T12:26:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:43.709+0000 7f486fe00640 1 -- 172.21.15.47:0/961828747 wait complete. 2024-05-14T12:26:43.751 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:43 smithi073 ceph-mon[35809]: pgmap v496: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:26:43.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:43 smithi066 ceph-mon[35981]: pgmap v496: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:26:43.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:43 smithi047 ceph-mon[31254]: pgmap v496: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-14T12:26:45.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:45 smithi066 ceph-mon[35981]: pgmap v497: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T12:26:45.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:45 smithi047 ceph-mon[31254]: pgmap v497: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T12:26:46.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:45 smithi073 ceph-mon[35809]: pgmap v497: 97 pgs: 97 active+clean; 676 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T12:26:47.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:47 smithi066 ceph-mon[35981]: pgmap v498: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-14T12:26:47.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:47 smithi047 ceph-mon[31254]: pgmap v498: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-14T12:26:48.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:47 smithi073 ceph-mon[35809]: pgmap v498: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-14T12:26:49.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:49 smithi066 ceph-mon[35981]: pgmap v499: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:49 smithi047 ceph-mon[31254]: pgmap v499: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:50.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:49 smithi073 ceph-mon[35809]: pgmap v499: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:51.787 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:51 smithi047 ceph-mon[31254]: pgmap v500: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:51.804 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:51 smithi073 ceph-mon[35809]: pgmap v500: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:51.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:51 smithi066 ceph-mon[35981]: pgmap v500: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:26:52.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:26:52.759 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:26:53.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:53 smithi047 ceph-mon[31254]: pgmap v501: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:26:53.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:53 smithi066 ceph-mon[35981]: pgmap v501: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:26:54.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:53 smithi073 ceph-mon[35809]: pgmap v501: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:26:55.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 -- 172.21.15.47:0/133086958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce81034c0 msgr2=0x7f0ce81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:55.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 --2- 172.21.15.47:0/133086958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce81034c0 0x7f0ce81038d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009920 tx=0x7f0cdc009c30 comp rx=0 tx=0).stop 2024-05-14T12:26:55.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 -- 172.21.15.47:0/133086958 shutdown_connections 2024-05-14T12:26:55.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 --2- 172.21.15.47:0/133086958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ce8108740 0x7f0ce81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 --2- 172.21.15.47:0/133086958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce81034c0 0x7f0ce81038d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 --2- 172.21.15.47:0/133086958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8107df0 0x7f0ce8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 -- 172.21.15.47:0/133086958 >> 172.21.15.47:0/133086958 conn(0x7f0ce80fedc0 msgr2=0x7f0ce81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:55.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 -- 172.21.15.47:0/133086958 shutdown_connections 2024-05-14T12:26:55.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.117+0000 7f0cefa00700 1 -- 172.21.15.47:0/133086958 wait complete. 2024-05-14T12:26:55.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.119+0000 7f0cefa00700 1 Processor -- start 2024-05-14T12:26:55.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.119+0000 7f0cefa00700 1 -- start start 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0cefa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ce81034c0 0x7f0ce80ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0cefa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce8107df0 0x7f0ce80ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0cefa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8108740 0x7f0ce80ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0cefa00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8113370 con 0x7f0ce81034c0 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0cefa00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81131f0 con 0x7f0ce8108740 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0cefa00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81134f0 con 0x7f0ce8107df0 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0ce7e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce8107df0 0x7f0ce80ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0ce7e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce8107df0 0x7f0ce80ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56312/0 (socket says 172.21.15.47:56312) 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0ce7e00700 1 -- 172.21.15.47:0/3482310140 learned_addr learned my addr 172.21.15.47:0/3482310140 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:55.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0ced000700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ce81034c0 0x7f0ce80ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:55.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.120+0000 7f0ceda00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8108740 0x7f0ce80ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:55.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.121+0000 7f0ceda00700 1 -- 172.21.15.47:0/3482310140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce8107df0 msgr2=0x7f0ce80ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:55.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.121+0000 7f0ceda00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce8107df0 0x7f0ce80ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.121+0000 7f0ceda00700 1 -- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ce81034c0 msgr2=0x7f0ce80ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:55.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.121+0000 7f0ceda00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ce81034c0 0x7f0ce80ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.121+0000 7f0ceda00700 1 -- 172.21.15.47:0/3482310140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce81a91d0 con 0x7f0ce8108740 2024-05-14T12:26:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.121+0000 7f0ceda00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8108740 0x7f0ce80ffd20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000efc0 tx=0x7f0ce000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.122+0000 7f0ce5600700 1 -- 172.21.15.47:0/3482310140 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00092e0 con 0x7f0ce8108740 2024-05-14T12:26:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.122+0000 7f0ce5600700 1 -- 172.21.15.47:0/3482310140 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ce0004bb0 con 0x7f0ce8108740 2024-05-14T12:26:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.122+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce81a9460 con 0x7f0ce8108740 2024-05-14T12:26:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.122+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce81a9890 con 0x7f0ce8108740 2024-05-14T12:26:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.122+0000 7f0ce5600700 1 -- 172.21.15.47:0/3482310140 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0004020 con 0x7f0ce8108740 2024-05-14T12:26:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.123+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce80512c0 con 0x7f0ce8108740 2024-05-14T12:26:55.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.127+0000 7f0ce5600700 1 -- 172.21.15.47:0/3482310140 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0ce001b030 con 0x7f0ce8108740 2024-05-14T12:26:55.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.129+0000 7f0ce5600700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cd00b2880 0x7f0cd00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:55.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.129+0000 7f0ce5600700 1 -- 172.21.15.47:0/3482310140 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0ce00e1c80 con 0x7f0ce8108740 2024-05-14T12:26:55.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.129+0000 7f0ced000700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cd00b2880 0x7f0cd00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:55.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.130+0000 7f0ced000700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cd00b2880 0x7f0cd00b4d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc005f40 tx=0x7f0cdc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:55.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.133+0000 7f0ce5600700 1 -- 172.21.15.47:0/3482310140 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0ce0022020 con 0x7f0ce8108740 2024-05-14T12:26:55.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.562+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ce802e5f0 con 0x7f0ce8108740 2024-05-14T12:26:55.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.563+0000 7f0ce5600700 1 -- 172.21.15.47:0/3482310140 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11919 (secure 0 0 0) 0x7f0ce0010040 con 0x7f0ce8108740 2024-05-14T12:26:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:26:55.563 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:25:09.557616+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24535,24521,24517,24490,24502]},"id":1}]} 2024-05-14T12:26:55.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.566+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cd00b2880 msgr2=0x7f0cd00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:55.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.566+0000 7f0cefa00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cd00b2880 0x7f0cd00b4d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc005f40 tx=0x7f0cdc019040 comp rx=0 tx=0).stop 2024-05-14T12:26:55.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.566+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8108740 msgr2=0x7f0ce80ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:55.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.566+0000 7f0cefa00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8108740 0x7f0ce80ffd20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000efc0 tx=0x7f0ce000c3a0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 shutdown_connections 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0cd00b2880 0x7f0cd00b4d90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8108740 0x7f0ce80ffd20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ce81034c0 0x7f0ce80ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 --2- 172.21.15.47:0/3482310140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ce8107df0 0x7f0ce80ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 >> 172.21.15.47:0/3482310140 conn(0x7f0ce80fedc0 msgr2=0x7f0ce806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 shutdown_connections 2024-05-14T12:26:55.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:55.567+0000 7f0cefa00700 1 -- 172.21.15.47:0/3482310140 wait complete. 2024-05-14T12:26:55.568 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 29 2024-05-14T12:26:55.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:55 smithi066 ceph-mon[35981]: pgmap v502: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:55.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:55 smithi047 ceph-mon[31254]: pgmap v502: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:56.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:55 smithi073 ceph-mon[35809]: pgmap v502: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:26:56.428 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id c0b64b7d --release --await' 2024-05-14T12:26:56.428 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id c0b64b7d --release --await 2024-05-14T12:26:56.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:56 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3482310140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:26:56.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:56 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3482310140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:26:56.879 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:26:57.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:56 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3482310140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:26:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.041+0000 7f36d0800640 1 -- 172.21.15.47:0/662341243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c810bc30 msgr2=0x7f36c810e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.041+0000 7f36d0800640 1 --2- 172.21.15.47:0/662341243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c810bc30 0x7f36c810e050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009be0 tx=0x7f36c402a6d0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.041+0000 7f36d0800640 1 -- 172.21.15.47:0/662341243 shutdown_connections 2024-05-14T12:26:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.041+0000 7f36d0800640 1 --2- 172.21.15.47:0/662341243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c810bc30 0x7f36c810e050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.041+0000 7f36d0800640 1 --2- 172.21.15.47:0/662341243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 0x7f36c810b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.041+0000 7f36d0800640 1 --2- 172.21.15.47:0/662341243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c8076170 0x7f36c8076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.041+0000 7f36d0800640 1 -- 172.21.15.47:0/662341243 >> 172.21.15.47:0/662341243 conn(0x7f36c80fee30 msgr2=0x7f36c8101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.042+0000 7f36d0800640 1 -- 172.21.15.47:0/662341243 shutdown_connections 2024-05-14T12:26:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.042+0000 7f36d0800640 1 -- 172.21.15.47:0/662341243 wait complete. 2024-05-14T12:26:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.043+0000 7f36d0800640 1 Processor -- start 2024-05-14T12:26:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.043+0000 7f36d0800640 1 -- start start 2024-05-14T12:26:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.043+0000 7f36d0800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c8076170 0x7f36c81a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.043+0000 7f36d0800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 0x7f36c81a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36d0800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c810bc30 0x7f36c81a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36d0800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36c81042d0 con 0x7f36c8076170 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36d0800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36c8104150 con 0x7f36c8076ac0 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36d0800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f36c8104450 con 0x7f36c810bc30 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36cd400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 0x7f36c81a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36cde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c8076170 0x7f36c81a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36cd400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 0x7f36c81a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41276/0 (socket says 172.21.15.47:41276) 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36cd400640 1 -- 172.21.15.47:0/1115888116 learned_addr learned my addr 172.21.15.47:0/1115888116 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.044+0000 7f36ce800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c810bc30 0x7f36c81a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36cd400640 1 -- 172.21.15.47:0/1115888116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c810bc30 msgr2=0x7f36c81a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36cd400640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c810bc30 0x7f36c81a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36cd400640 1 -- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c8076170 msgr2=0x7f36c81a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36cd400640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c8076170 0x7f36c81a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36cd400640 1 -- 172.21.15.47:0/1115888116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c81a8370 con 0x7f36c8076ac0 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36cde00640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c8076170 0x7f36c81a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36cd400640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 0x7f36c81a0d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f36b800d950 tx=0x7f36b800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36c2a00640 1 -- 172.21.15.47:0/1115888116 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8017070 con 0x7f36c8076ac0 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36c2a00640 1 -- 172.21.15.47:0/1115888116 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36b8009c30 con 0x7f36c8076ac0 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.045+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c81a8660 con 0x7f36c8076ac0 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.046+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c81a8c00 con 0x7f36c8076ac0 2024-05-14T12:26:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.046+0000 7f36c2a00640 1 -- 172.21.15.47:0/1115888116 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b800f620 con 0x7f36c8076ac0 2024-05-14T12:26:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.050+0000 7f36d77c4740 1 Processor -- start 2024-05-14T12:26:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.050+0000 7f36d77c4740 1 -- start start 2024-05-14T12:26:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.051+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30e3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d182f0 0x55cef30e3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d204d0 0x55cef30ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36d77c4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cef3047550 con 0x55cef2d182f0 2024-05-14T12:26:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36c2a00640 1 -- 172.21.15.47:0/1115888116 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f36b800f7c0 con 0x7f36c8076ac0 2024-05-14T12:26:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36ce800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36d77c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cef2fecbc0 con 0x55cef2d411b0 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36cde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d182f0 0x55cef30e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36d77c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cef3043510 con 0x55cef2d204d0 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36cde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d182f0 0x55cef30e3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53818/0 (socket says 172.21.15.47:53818) 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36cde00640 1 -- 172.21.15.47:0/1006073986 learned_addr learned my addr 172.21.15.47:0/1006073986 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.052+0000 7f36ce800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30e3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41280/0 (socket says 172.21.15.47:41280) 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.053+0000 7f36cde00640 1 -- 172.21.15.47:0/1006073986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d204d0 msgr2=0x55cef30ea580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.053+0000 7f36cde00640 1 --2- 172.21.15.47:0/1006073986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d204d0 0x55cef30ea580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.053+0000 7f36cde00640 1 -- 172.21.15.47:0/1006073986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 msgr2=0x55cef30e3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.053+0000 7f36cde00640 1 --2- 172.21.15.47:0/1006073986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30e3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.053+0000 7f36cde00640 1 -- 172.21.15.47:0/1006073986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cef2d59210 con 0x55cef2d182f0 2024-05-14T12:26:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.053+0000 7f36cde00640 1 --2- 172.21.15.47:0/1006073986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d182f0 0x55cef30e3680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0114f0 tx=0x7f36bc0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af874be1f8f35691 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.054+0000 7f36b7000640 1 -- 172.21.15.47:0/1006073986 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc005020 con 0x55cef2d182f0 2024-05-14T12:26:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.054+0000 7f36b7000640 1 -- 172.21.15.47:0/1006073986 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36bc0047a0 con 0x55cef2d182f0 2024-05-14T12:26:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.054+0000 7f36b7000640 1 -- 172.21.15.47:0/1006073986 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc005020 con 0x55cef2d182f0 2024-05-14T12:26:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.054+0000 7f36c2a00640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f36b00b2920 0x7f36b00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.055+0000 7f36c2a00640 1 -- 172.21.15.47:0/1115888116 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f36b80e1d60 con 0x7f36c8076ac0 2024-05-14T12:26:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.055+0000 7f36ce800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f36b00b2920 0x7f36b00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.055+0000 7f36d77c4740 1 -- 172.21.15.47:0/1006073986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d182f0 msgr2=0x55cef30e3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.055+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1006073986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d182f0 0x55cef30e3680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0114f0 tx=0x7f36bc0119b0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.055+0000 7f36d77c4740 1 -- 172.21.15.47:0/1006073986 shutdown_connections 2024-05-14T12:26:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.055+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1006073986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d204d0 0x55cef30ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.056+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1006073986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d182f0 0x55cef30e3680 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.056+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1006073986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.056+0000 7f36d77c4740 1 -- 172.21.15.47:0/1006073986 >> 172.21.15.47:0/1006073986 conn(0x55cef2d35300 msgr2=0x55cef30dea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.056+0000 7f36d77c4740 1 -- 172.21.15.47:0/1006073986 shutdown_connections 2024-05-14T12:26:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.056+0000 7f36ce800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f36b00b2920 0x7f36b00b4e30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006010 tx=0x7f36c4030970 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.056+0000 7f36d77c4740 1 -- 172.21.15.47:0/1006073986 wait complete. 2024-05-14T12:26:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.056+0000 7f36d77c4740 1 -- start start 2024-05-14T12:26:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 1 Processor -- start 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30ed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cef30eafd0 con 0x55cef2d204d0 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cef3000660 con 0x55cef2d411b0 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55cef30eb150 con 0x55cef2d182f0 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.057+0000 7f36d77c4740 10 client.0 _ll_register_callbacks cb 0x55cef2fca400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41288/0 (socket says 172.21.15.47:41288) 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 -- 172.21.15.47:0/20382880 learned_addr learned my addr 172.21.15.47:0/20382880 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36cd400640 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36cde00640 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 -- 172.21.15.47:0/20382880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 msgr2=0x55cef30ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 -- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 msgr2=0x55cef30ed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30ed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.058+0000 7f36ce800640 1 -- 172.21.15.47:0/20382880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cef2e25620 con 0x55cef2d411b0 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.059+0000 7f36ce800640 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30f40d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36c4033000 tx=0x7f36c402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb1a2a59b9673b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.059+0000 7f36ab400640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.059+0000 7f36ab400640 1 -- 172.21.15.47:0/20382880 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c404f020 con 0x55cef2d411b0 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.059+0000 7f36ab400640 1 -- 172.21.15.47:0/20382880 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f36c4003cf0 con 0x55cef2d411b0 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.059+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36bc0047a0 con 0x55cef2d411b0 2024-05-14T12:26:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.059+0000 7f36ab400640 1 -- 172.21.15.47:0/20382880 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36c4036040 con 0x55cef2d411b0 2024-05-14T12:26:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.060+0000 7f36d77c4740 10 client.25403 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.060+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cef30f7070 con 0x55cef2d411b0 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.060+0000 7f36ab400640 1 -- 172.21.15.47:0/20382880 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36bc0047a0 con 0x55cef2d411b0 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36ab400640 1 -- 172.21.15.47:0/20382880 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f36c404b6e0 con 0x55cef2d411b0 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36d77c4740 10 client.25403 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36d77c4740 10 client.25403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36d77c4740 20 client.25403 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36d77c4740 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cffd80 0x55cef30fa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36d77c4740 4 client.25403 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cef3055160 con 0x55cef2cffd80 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.061+0000 7f36cde00640 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cffd80 0x55cef30fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.062+0000 7f36cde00640 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cffd80 0x55cef30fa820 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e2826a363628f00 server_cookie=f6ecc3e488b25cf8 in_seq=0 out_seq=0 2024-05-14T12:26:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.062+0000 7f36ab400640 10 client.25403 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.062+0000 7f36ab400640 1 -- 172.21.15.47:0/20382880 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cef3055160 con 0x55cef2cffd80 2024-05-14T12:26:57.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36ab400640 10 client.25403 handle_command_reply: tid=0 2024-05-14T12:26:57.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 client.25403 shutdown 2024-05-14T12:26:57.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 msgr2=0x55cef30f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30f40d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36c4033000 tx=0x7f36c402a6d0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 shutdown_connections 2024-05-14T12:26:57.065 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cffd80 0x55cef30fa820 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d411b0 0x55cef30f40d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 --2- 172.21.15.47:0/20382880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 >> 172.21.15.47:0/20382880 conn(0x55cef2d35300 msgr2=0x55cef30e19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:57.066 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36ab400640 0 client.25403 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 shutdown_connections 2024-05-14T12:26:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 1 -- 172.21.15.47:0/20382880 wait complete. 2024-05-14T12:26:57.067 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.063+0000 7f36d77c4740 20 client.25403 trim_cache size 0 max 16384 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 Processor -- start 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 -- start start 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d204d0 0x55cef30dd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d411b0 0x55cef30dda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac00e480 con 0x55cef2d411b0 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac00ffc0 con 0x55cef2d204d0 2024-05-14T12:26:57.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.087+0000 7f36d77c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac00eb50 con 0x55cef2d182f0 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36ce800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d411b0 0x55cef30dda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36cde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36ce800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d411b0 0x55cef30dda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53830/0 (socket says 172.21.15.47:53830) 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36ce800640 1 -- 172.21.15.47:0/163274835 learned_addr learned my addr 172.21.15.47:0/163274835 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36cd400640 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d204d0 0x55cef30dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36cde00640 1 -- 172.21.15.47:0/163274835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d204d0 msgr2=0x55cef30dd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36cde00640 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d204d0 0x55cef30dd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36cde00640 1 -- 172.21.15.47:0/163274835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d411b0 msgr2=0x55cef30dda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36cde00640 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d411b0 0x55cef30dda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.088+0000 7f36cde00640 1 -- 172.21.15.47:0/163274835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cef30e4290 con 0x55cef2d182f0 2024-05-14T12:26:57.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.089+0000 7f36cde00640 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30dd000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55cef30df820 tx=0x7f36bc0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a84a3c49a251c38f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:57.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.089+0000 7f36b6600640 1 -- 172.21.15.47:0/163274835 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc02d020 con 0x55cef2d182f0 2024-05-14T12:26:57.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.089+0000 7f36b6600640 1 -- 172.21.15.47:0/163274835 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36bc004770 con 0x55cef2d182f0 2024-05-14T12:26:57.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.089+0000 7f36b6600640 1 -- 172.21.15.47:0/163274835 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc029990 con 0x55cef2d182f0 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 -- 172.21.15.47:0/163274835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 msgr2=0x55cef30dd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30dd000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55cef30df820 tx=0x7f36bc0119b0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 -- 172.21.15.47:0/163274835 shutdown_connections 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d411b0 0x55cef30dda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d204d0 0x55cef30dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 --2- 172.21.15.47:0/163274835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d182f0 0x55cef30dd000 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 -- 172.21.15.47:0/163274835 >> 172.21.15.47:0/163274835 conn(0x55cef2d35300 msgr2=0x55cef30e7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 -- 172.21.15.47:0/163274835 shutdown_connections 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.090+0000 7f36d77c4740 1 -- 172.21.15.47:0/163274835 wait complete. 2024-05-14T12:26:57.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.091+0000 7f36d77c4740 1 -- start start 2024-05-14T12:26:57.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.091+0000 7f36d77c4740 1 Processor -- start 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d182f0 0x55cef30f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36d77c4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d411b0 0x55cef3160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36d77c4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac00f8f0 con 0x55cef2d204d0 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36d77c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac00f220 con 0x55cef2d182f0 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36d77c4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac00c440 con 0x55cef2d411b0 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36d77c4740 10 client.0 _ll_register_callbacks cb 0x7f36c4042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36ce800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d411b0 0x55cef3160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36ce800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d411b0 0x55cef3160bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56360/0 (socket says 172.21.15.47:56360) 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36ce800640 1 -- 172.21.15.47:0/1086772732 learned_addr learned my addr 172.21.15.47:0/1086772732 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.092+0000 7f36cd400640 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36cde00640 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d182f0 0x55cef30f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ce800640 1 -- 172.21.15.47:0/1086772732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d182f0 msgr2=0x55cef30f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ce800640 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d182f0 0x55cef30f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ce800640 1 -- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 msgr2=0x55cef30f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ce800640 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ce800640 1 -- 172.21.15.47:0/1086772732 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cef3161100 con 0x55cef2d411b0 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ce800640 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d411b0 0x55cef3160bc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36c404bbd0 tx=0x7f36c4009480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8bae27c27ee4a3b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ab400640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.093+0000 7f36ab400640 1 -- 172.21.15.47:0/1086772732 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4063020 con 0x55cef2d411b0 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36ab400640 1 -- 172.21.15.47:0/1086772732 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f36c40318d0 con 0x55cef2d411b0 2024-05-14T12:26:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36bc004770 con 0x55cef2d411b0 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36ab400640 1 -- 172.21.15.47:0/1086772732 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f36c404f040 con 0x55cef2d411b0 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36d77c4740 10 client.25426 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cef31623d0 con 0x55cef2d411b0 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36ab400640 1 -- 172.21.15.47:0/1086772732 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36bc004770 con 0x55cef2d411b0 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36ab400640 1 -- 172.21.15.47:0/1086772732 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f36c403ec70 con 0x55cef2d411b0 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36d77c4740 10 client.25426 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.094+0000 7f36d77c4740 10 client.25426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.095+0000 7f36d77c4740 20 client.25426 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.095+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cd51c0 0x55cef3164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.095+0000 7f36d77c4740 4 client.25426 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:26:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.095+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cef304efd0 con 0x55cef2cd51c0 2024-05-14T12:26:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.095+0000 7f36cde00640 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cd51c0 0x55cef3164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.096+0000 7f36cde00640 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cd51c0 0x55cef3164df0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7200da4c63f5fccc server_cookie=a92d303686be8dfa in_seq=0 out_seq=0 2024-05-14T12:26:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.096+0000 7f36ab400640 10 client.25426 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:57.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36ab400640 1 -- 172.21.15.47:0/1086772732 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cef304efd0 con 0x55cef2cd51c0 2024-05-14T12:26:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36ab400640 10 client.25426 handle_command_reply: tid=0 2024-05-14T12:26:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 client.25426 shutdown 2024-05-14T12:26:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d411b0 msgr2=0x55cef3160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d411b0 0x55cef3160bc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36c404bbd0 tx=0x7f36c4009480 comp rx=0 tx=0).stop 2024-05-14T12:26:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 shutdown_connections 2024-05-14T12:26:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55cef2cd51c0 0x55cef3164df0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cef2d411b0 0x55cef3160bc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cef2d204d0 0x55cef30f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 --2- 172.21.15.47:0/1086772732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cef2d182f0 0x55cef30f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 >> 172.21.15.47:0/1086772732 conn(0x55cef2d35300 msgr2=0x55cef30dd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.101+0000 7f36ab400640 0 client.25426 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.102+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 shutdown_connections 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.102+0000 7f36d77c4740 1 -- 172.21.15.47:0/1086772732 wait complete. 2024-05-14T12:26:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.102+0000 7f36d77c4740 20 client.25426 trim_cache size 0 max 16384 2024-05-14T12:26:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:26:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:26:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:26:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.103+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f36b00b2920 msgr2=0x7f36b00b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.103+0000 7f36d0800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f36b00b2920 0x7f36b00b4e30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006010 tx=0x7f36c4030970 comp rx=0 tx=0).stop 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.103+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 msgr2=0x7f36c81a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.103+0000 7f36d0800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 0x7f36c81a0d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f36b800d950 tx=0x7f36b800de10 comp rx=0 tx=0).stop 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 shutdown_connections 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f36b00b2920 0x7f36b00b4e30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36c810bc30 0x7f36c81a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36c8076ac0 0x7f36c81a0d70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 --2- 172.21.15.47:0/1115888116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36c8076170 0x7f36c81a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 >> 172.21.15.47:0/1115888116 conn(0x7f36c80fee30 msgr2=0x7f36c80ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 shutdown_connections 2024-05-14T12:26:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:26:57.104+0000 7f36d0800640 1 -- 172.21.15.47:0/1115888116 wait complete. 2024-05-14T12:26:57.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:57 smithi047 ceph-mon[31254]: pgmap v503: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:26:57.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:57 smithi066 ceph-mon[35981]: pgmap v503: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:26:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:57 smithi073 ceph-mon[35809]: pgmap v503: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:26:59.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.243+0000 7f1a4b200700 1 -- 172.21.15.47:0/4042380103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a441052c0 msgr2=0x7f1a441056d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.243+0000 7f1a4b200700 1 --2- 172.21.15.47:0/4042380103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a441052c0 0x7f1a441056d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009990 tx=0x7f1a38009ca0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.244+0000 7f1a4b200700 1 -- 172.21.15.47:0/4042380103 shutdown_connections 2024-05-14T12:26:59.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.244+0000 7f1a4b200700 1 --2- 172.21.15.47:0/4042380103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a4410e730 0x7f1a44110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.244+0000 7f1a4b200700 1 --2- 172.21.15.47:0/4042380103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a441052c0 0x7f1a441056d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.244+0000 7f1a4b200700 1 --2- 172.21.15.47:0/4042380103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a44105c10 0x7f1a4410e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.244+0000 7f1a4b200700 1 -- 172.21.15.47:0/4042380103 >> 172.21.15.47:0/4042380103 conn(0x7f1a44078bf0 msgr2=0x7f1a44079030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:59.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.244+0000 7f1a4b200700 1 -- 172.21.15.47:0/4042380103 shutdown_connections 2024-05-14T12:26:59.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.244+0000 7f1a4b200700 1 -- 172.21.15.47:0/4042380103 wait complete. 2024-05-14T12:26:59.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.246+0000 7f1a4b200700 1 Processor -- start 2024-05-14T12:26:59.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.246+0000 7f1a4b200700 1 -- start start 2024-05-14T12:26:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.246+0000 7f1a4b200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a441052c0 0x7f1a441a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.246+0000 7f1a4b200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a44105c10 0x7f1a441a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a4b200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a4410e730 0x7f1a4419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a4b200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441142d0 con 0x7f1a441052c0 2024-05-14T12:26:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a4b200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44114150 con 0x7f1a4410e730 2024-05-14T12:26:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a4b200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44114450 con 0x7f1a44105c10 2024-05-14T12:26:59.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a49e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a441052c0 0x7f1a441a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a49e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a441052c0 0x7f1a441a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39102/0 (socket says 172.21.15.47:39102) 2024-05-14T12:26:59.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a49e00700 1 -- 172.21.15.47:0/3973806954 learned_addr learned my addr 172.21.15.47:0/3973806954 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a4a800700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a4410e730 0x7f1a4419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.247+0000 7f1a49400700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a44105c10 0x7f1a441a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.248+0000 7f1a4a800700 1 -- 172.21.15.47:0/3973806954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a44105c10 msgr2=0x7f1a441a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.248+0000 7f1a4a800700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a44105c10 0x7f1a441a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.248+0000 7f1a4a800700 1 -- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a441052c0 msgr2=0x7f1a441a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.248+0000 7f1a4a800700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a441052c0 0x7f1a441a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.248+0000 7f1a4a800700 1 -- 172.21.15.47:0/3973806954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4419b160 con 0x7f1a4410e730 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.248+0000 7f1a49e00700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a441052c0 0x7f1a441a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:26:59.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.248+0000 7f1a4a800700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a4410e730 0x7f1a4419aab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a40007e90 tx=0x7f1a4000f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:59.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.249+0000 7f1a3ea00700 1 -- 172.21.15.47:0/3973806954 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40009e20 con 0x7f1a4410e730 2024-05-14T12:26:59.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.249+0000 7f1a3ea00700 1 -- 172.21.15.47:0/3973806954 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a4000fcf0 con 0x7f1a4410e730 2024-05-14T12:26:59.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.249+0000 7f1a3ea00700 1 -- 172.21.15.47:0/3973806954 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40005020 con 0x7f1a4410e730 2024-05-14T12:26:59.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.249+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4419b450 con 0x7f1a4410e730 2024-05-14T12:26:59.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.249+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a44102ee0 con 0x7f1a4410e730 2024-05-14T12:26:59.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.253+0000 7f1a3ea00700 1 -- 172.21.15.47:0/3973806954 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1a4001a420 con 0x7f1a4410e730 2024-05-14T12:26:59.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.255+0000 7f1a3ea00700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a2c0b2880 0x7f1a2c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.256+0000 7f1a49e00700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a2c0b2880 0x7f1a2c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.256+0000 7f1a5b319b80 1 Processor -- start 2024-05-14T12:26:59.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.257+0000 7f1a5b319b80 1 -- start start 2024-05-14T12:26:59.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.257+0000 7f1a3ea00700 1 -- 172.21.15.47:0/3973806954 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1a400e5b40 con 0x7f1a4410e730 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.257+0000 7f1a49e00700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a2c0b2880 0x7f1a2c0b4d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006010 tx=0x7f1a3800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.257+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x5621510877c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510923f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x562151094940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562150fa1b20 con 0x562151087d00 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562150f3f860 con 0x562150f01f40 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562150f9dae0 con 0x562151088110 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x562151094940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x562151094940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52994/0 (socket says 172.21.15.47:52994) 2024-05-14T12:26:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 -- 172.21.15.47:0/890276757 learned_addr learned my addr 172.21.15.47:0/890276757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a49400700 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510923f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 -- 172.21.15.47:0/890276757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 msgr2=0x5621510877c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:26:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x5621510877c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 -- 172.21.15.47:0/890276757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 msgr2=0x5621510923f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510923f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.258+0000 7f1a4a800700 1 -- 172.21.15.47:0/890276757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562150eee9d0 con 0x562151088110 2024-05-14T12:26:59.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.259+0000 7f1a49400700 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510923f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:26:59.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.259+0000 7f1a4a800700 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x562151094940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a400a91a0 tx=0x7f1a400ad820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be24783da0154c27 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:59.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.259+0000 7f1a33400700 1 -- 172.21.15.47:0/890276757 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400b5f80 con 0x562151088110 2024-05-14T12:26:59.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.259+0000 7f1a33400700 1 -- 172.21.15.47:0/890276757 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a40004ad0 con 0x562151088110 2024-05-14T12:26:59.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.259+0000 7f1a33400700 1 -- 172.21.15.47:0/890276757 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400ad380 con 0x562151088110 2024-05-14T12:26:59.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.260+0000 7f1a5b319b80 1 -- 172.21.15.47:0/890276757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 msgr2=0x562151094940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.260+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x562151094940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a400a91a0 tx=0x7f1a400ad820 comp rx=0 tx=0).stop 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.261+0000 7f1a5b319b80 1 -- 172.21.15.47:0/890276757 shutdown_connections 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.261+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x562151094940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.261+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x5621510877c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.261+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/890276757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510923f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.261+0000 7f1a5b319b80 1 -- 172.21.15.47:0/890276757 >> 172.21.15.47:0/890276757 conn(0x562150f47070 msgr2=0x56215107ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.261+0000 7f1a5b319b80 1 -- 172.21.15.47:0/890276757 shutdown_connections 2024-05-14T12:26:59.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.261+0000 7f1a5b319b80 1 -- 172.21.15.47:0/890276757 wait complete. 2024-05-14T12:26:59.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.262+0000 7f1a5b319b80 1 -- start start 2024-05-14T12:26:59.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.262+0000 7f1a5b319b80 1 Processor -- start 2024-05-14T12:26:59.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562150f01f40 0x56215108ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x56215108f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562151088110 0x562151094800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a49e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562150f01f40 0x56215108ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56215107cbe0 con 0x562151087d00 2024-05-14T12:26:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562150f07c20 con 0x562151088110 2024-05-14T12:26:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56215107cd60 con 0x562150f01f40 2024-05-14T12:26:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a49e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562150f01f40 0x56215108ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53002/0 (socket says 172.21.15.47:53002) 2024-05-14T12:26:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a49e00700 1 -- 172.21.15.47:0/1774654394 learned_addr learned my addr 172.21.15.47:0/1774654394 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a5b319b80 10 client.0 _ll_register_callbacks cb 0x562150f48d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.263+0000 7f1a49400700 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x56215108f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.264+0000 7f1a4a800700 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562151088110 0x562151094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.264+0000 7f1a49400700 1 -- 172.21.15.47:0/1774654394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562150f01f40 msgr2=0x56215108ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.264+0000 7f1a49400700 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562150f01f40 0x56215108ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.264+0000 7f1a49400700 1 -- 172.21.15.47:0/1774654394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562151088110 msgr2=0x562151094800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.264+0000 7f1a49400700 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562151088110 0x562151094800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.264+0000 7f1a49400700 1 -- 172.21.15.47:0/1774654394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562150f67520 con 0x562151087d00 2024-05-14T12:26:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.265+0000 7f1a49400700 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x56215108f070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56215107c150 tx=0x7f1a34012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce62e6a044c04b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.265+0000 7f1a27e00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:26:59.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.265+0000 7f1a27e00700 1 -- 172.21.15.47:0/1774654394 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004460 con 0x562151087d00 2024-05-14T12:26:59.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.265+0000 7f1a27e00700 1 -- 172.21.15.47:0/1774654394 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1a34003680 con 0x562151087d00 2024-05-14T12:26:59.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.265+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a40004ad0 con 0x562151087d00 2024-05-14T12:26:59.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.266+0000 7f1a27e00700 1 -- 172.21.15.47:0/1774654394 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1a34009e10 con 0x562151087d00 2024-05-14T12:26:59.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.266+0000 7f1a5b319b80 10 client.15309 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:59.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.266+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5621510a87c0 con 0x562151087d00 2024-05-14T12:26:59.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.266+0000 7f1a27e00700 1 -- 172.21.15.47:0/1774654394 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a40004ad0 con 0x562151087d00 2024-05-14T12:26:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.267+0000 7f1a27e00700 1 -- 172.21.15.47:0/1774654394 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f1a34019020 con 0x562151087d00 2024-05-14T12:26:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.267+0000 7f1a5b319b80 10 client.15309 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.267+0000 7f1a5b319b80 10 client.15309 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:26:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.267+0000 7f1a5b319b80 20 client.15309 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.267+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5621510aae00 0x5621510ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.267+0000 7f1a5b319b80 4 client.15309 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:26:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.267+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56215104c2c0 con 0x5621510aae00 2024-05-14T12:26:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.268+0000 7f1a49e00700 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5621510aae00 0x5621510ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.269+0000 7f1a49e00700 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5621510aae00 0x5621510ad250 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a1e6565bae5176 server_cookie=6d5b56ce59d47b9c in_seq=0 out_seq=0 2024-05-14T12:26:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.269+0000 7f1a27e00700 10 client.15309 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.270+0000 7f1a27e00700 1 -- 172.21.15.47:0/1774654394 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56215104c2c0 con 0x5621510aae00 2024-05-14T12:26:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.270+0000 7f1a27e00700 10 client.15309 handle_command_reply: tid=0 2024-05-14T12:26:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.270+0000 7f1a5b319b80 1 client.15309 shutdown 2024-05-14T12:26:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 msgr2=0x56215108f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x56215108f070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56215107c150 tx=0x7f1a34012a30 comp rx=0 tx=0).stop 2024-05-14T12:26:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 shutdown_connections 2024-05-14T12:26:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5621510aae00 0x5621510ad250 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a27e00700 0 client.15309 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562151088110 0x562151094800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562150f01f40 0x56215108ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/1774654394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x56215108f070 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.271+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 >> 172.21.15.47:0/1774654394 conn(0x562150f47070 msgr2=0x5621510892d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.272+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 shutdown_connections 2024-05-14T12:26:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.272+0000 7f1a5b319b80 1 -- 172.21.15.47:0/1774654394 wait complete. 2024-05-14T12:26:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.273+0000 7f1a5b319b80 20 client.15309 trim_cache size 0 max 16384 2024-05-14T12:26:59.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 Processor -- start 2024-05-14T12:26:59.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 -- start start 2024-05-14T12:26:59.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x56215108f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510941e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510897a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441ac940 con 0x562151087d00 2024-05-14T12:26:59.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441ae480 con 0x562150f01f40 2024-05-14T12:26:59.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.315+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441ad010 con 0x562151088110 2024-05-14T12:26:59.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a49e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x56215108f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a49e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x56215108f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60320/0 (socket says 172.21.15.47:60320) 2024-05-14T12:26:59.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a49e00700 1 -- 172.21.15.47:0/4072456807 learned_addr learned my addr 172.21.15.47:0/4072456807 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:59.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a4a800700 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a4a800700 1 -- 172.21.15.47:0/4072456807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 msgr2=0x56215108f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a4a800700 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x56215108f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a49400700 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510941e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a4a800700 1 -- 172.21.15.47:0/4072456807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 msgr2=0x5621510941e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a4a800700 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510941e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a4a800700 1 -- 172.21.15.47:0/4072456807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56215107a990 con 0x562151088110 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.316+0000 7f1a49400700 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510941e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.317+0000 7f1a4a800700 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510897a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a400ad0b0 tx=0x7f1a400acef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c96f577e33f82388 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:59.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.317+0000 7f1a32a00700 1 -- 172.21.15.47:0/4072456807 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400b5f80 con 0x562151088110 2024-05-14T12:26:59.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.317+0000 7f1a32a00700 1 -- 172.21.15.47:0/4072456807 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a4005a170 con 0x562151088110 2024-05-14T12:26:59.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.317+0000 7f1a32a00700 1 -- 172.21.15.47:0/4072456807 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400ad380 con 0x562151088110 2024-05-14T12:26:59.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.318+0000 7f1a5b319b80 1 -- 172.21.15.47:0/4072456807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 msgr2=0x5621510897a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.318+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510897a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a400ad0b0 tx=0x7f1a400acef0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 -- 172.21.15.47:0/4072456807 shutdown_connections 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510897a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x56215108f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/4072456807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510941e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 -- 172.21.15.47:0/4072456807 >> 172.21.15.47:0/4072456807 conn(0x562150f47070 msgr2=0x562151089090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 -- 172.21.15.47:0/4072456807 shutdown_connections 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 -- 172.21.15.47:0/4072456807 wait complete. 2024-05-14T12:26:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.319+0000 7f1a5b319b80 1 -- start start 2024-05-14T12:26:59.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.320+0000 7f1a5b319b80 1 Processor -- start 2024-05-14T12:26:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.321+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x5621510be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.321+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.321+0000 7f1a5b319b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.322+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441addb0 con 0x562151087d00 2024-05-14T12:26:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.322+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441ad6e0 con 0x562150f01f40 2024-05-14T12:26:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.322+0000 7f1a5b319b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441aa8c0 con 0x562151088110 2024-05-14T12:26:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.322+0000 7f1a4a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.322+0000 7f1a4a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510bb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53028/0 (socket says 172.21.15.47:53028) 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.322+0000 7f1a4a800700 1 -- 172.21.15.47:0/3150214002 learned_addr learned my addr 172.21.15.47:0/3150214002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.322+0000 7f1a5b319b80 10 client.0 _ll_register_callbacks cb 0x562150f48d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a49e00700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x5621510be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a49400700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a4a800700 1 -- 172.21.15.47:0/3150214002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 msgr2=0x5621510be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a4a800700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x5621510be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a4a800700 1 -- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 msgr2=0x5621510bacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a4a800700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510bacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a4a800700 1 -- 172.21.15.47:0/3150214002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621510bba50 con 0x562151088110 2024-05-14T12:26:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a49400700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510bacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:26:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.323+0000 7f1a4a800700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510bb2b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a40007e60 tx=0x7f1a400b1590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7caf10fda04eab90 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:26:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.324+0000 7f1a27e00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:26:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.324+0000 7f1a27e00700 1 -- 172.21.15.47:0/3150214002 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400b5f80 con 0x562151088110 2024-05-14T12:26:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.324+0000 7f1a27e00700 1 -- 172.21.15.47:0/3150214002 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1a400b1170 con 0x562151088110 2024-05-14T12:26:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.324+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a4005a170 con 0x562151088110 2024-05-14T12:26:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.324+0000 7f1a27e00700 1 -- 172.21.15.47:0/3150214002 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1a40057230 con 0x562151088110 2024-05-14T12:26:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.324+0000 7f1a5b319b80 10 client.25444 fetch_fsmap learned FSMap version 29 2024-05-14T12:26:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.324+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5621511161a0 con 0x562151088110 2024-05-14T12:26:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a27e00700 1 -- 172.21.15.47:0/3150214002 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a4005a170 con 0x562151088110 2024-05-14T12:26:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a27e00700 1 -- 172.21.15.47:0/3150214002 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f1a400a8b90 con 0x562151088110 2024-05-14T12:26:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a5b319b80 10 client.25444 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:26:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a5b319b80 10 client.25444 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:26:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a5b319b80 20 client.25444 populate_metadata read hostname 'smithi047' 2024-05-14T12:26:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562151116370 0x562151118790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:26:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a5b319b80 4 client.25444 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c0b64b7d", "release": true, "await": true}] 2024-05-14T12:26:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.325+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c0b64b7d", "release": true, "await": true}) -- 0x562150faf500 con 0x562151116370 2024-05-14T12:26:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.326+0000 7f1a49e00700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562151116370 0x562151118790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:26:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.328+0000 7f1a49e00700 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562151116370 0x562151118790 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c66a6fced1fe5934 server_cookie=52c9708602d07440 in_seq=0 out_seq=0 2024-05-14T12:26:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.328+0000 7f1a27e00700 10 client.25444 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.332+0000 7f1a27e00700 1 -- 172.21.15.47:0/3150214002 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x562150faf500 con 0x562151116370 2024-05-14T12:26:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.332+0000 7f1a27e00700 10 client.25444 handle_command_reply: tid=0 2024-05-14T12:26:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.332+0000 7f1a5b319b80 1 client.25444 shutdown 2024-05-14T12:26:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 msgr2=0x5621510bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510bb2b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a40007e60 tx=0x7f1a400b1590 comp rx=0 tx=0).stop 2024-05-14T12:26:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 shutdown_connections 2024-05-14T12:26:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562151116370 0x562151118790 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562151088110 0x5621510bb2b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562150f01f40 0x5621510be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 --2- 172.21.15.47:0/3150214002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562151087d00 0x5621510bacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a27e00700 0 client.25444 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:26:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.333+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 >> 172.21.15.47:0/3150214002 conn(0x562150f47070 msgr2=0x56215108d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.334+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 shutdown_connections 2024-05-14T12:26:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.334+0000 7f1a5b319b80 1 -- 172.21.15.47:0/3150214002 wait complete. 2024-05-14T12:26:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.334+0000 7f1a5b319b80 20 client.25444 trim_cache size 0 max 16384 2024-05-14T12:26:59.334 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 29, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 4, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "c0b64b7d": { 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 4, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 87.1, 2024-05-14T12:26:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:26:59.336 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:26:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a2c0b2880 msgr2=0x7f1a2c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a2c0b2880 0x7f1a2c0b4d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006010 tx=0x7f1a3800b280 comp rx=0 tx=0).stop 2024-05-14T12:26:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a4410e730 msgr2=0x7f1a4419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:26:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a4410e730 0x7f1a4419aab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a40007e90 tx=0x7f1a4000f740 comp rx=0 tx=0).stop 2024-05-14T12:26:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 shutdown_connections 2024-05-14T12:26:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1a2c0b2880 0x7f1a2c0b4d90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a4410e730 0x7f1a4419aab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a441052c0 0x7f1a441a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 --2- 172.21.15.47:0/3973806954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a44105c10 0x7f1a441a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:26:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 >> 172.21.15.47:0/3973806954 conn(0x7f1a44078bf0 msgr2=0x7f1a44101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:26:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 shutdown_connections 2024-05-14T12:26:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:26:59.337+0000 7f1a4b200700 1 -- 172.21.15.47:0/3973806954 wait complete. 2024-05-14T12:26:59.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:26:59 smithi047 ceph-mon[31254]: pgmap v504: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:26:59.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:26:59 smithi066 ceph-mon[35981]: pgmap v504: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:27:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:26:59 smithi073 ceph-mon[35809]: pgmap v504: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T12:27:00.371 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c0b64b7d', seconds elapsed: 43.5 2024-05-14T12:27:01.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:01 smithi066 ceph-mon[35981]: pgmap v505: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-14T12:27:01.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:01 smithi047 ceph-mon[31254]: pgmap v505: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-14T12:27:02.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:01 smithi073 ceph-mon[35809]: pgmap v505: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-14T12:27:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:03 smithi066 ceph-mon[35981]: pgmap v506: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:27:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:03 smithi047 ceph-mon[31254]: pgmap v506: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:27:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:03 smithi073 ceph-mon[35809]: pgmap v506: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:27:05.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:05 smithi066 ceph-mon[35981]: pgmap v507: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:05.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:05 smithi047 ceph-mon[31254]: pgmap v507: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:06.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:05 smithi073 ceph-mon[35809]: pgmap v507: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:07.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:07 smithi066 ceph-mon[35981]: pgmap v508: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:27:07.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:07 smithi047 ceph-mon[31254]: pgmap v508: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:27:08.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:07 smithi073 ceph-mon[35809]: pgmap v508: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-14T12:27:09.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:09 smithi066 ceph-mon[35981]: pgmap v509: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:09.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:09 smithi047 ceph-mon[31254]: pgmap v509: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:10.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:09 smithi073 ceph-mon[35809]: pgmap v509: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 -- 172.21.15.47:0/780329517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc103c40 msgr2=0x7f37cc104940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 --2- 172.21.15.47:0/780329517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc103c40 0x7f37cc104940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009900 tx=0x7f37bc02a3f0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 -- 172.21.15.47:0/780329517 shutdown_connections 2024-05-14T12:27:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 --2- 172.21.15.47:0/780329517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37cc109b80 0x7f37cc10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 --2- 172.21.15.47:0/780329517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37cc104e80 0x7f37cc105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 --2- 172.21.15.47:0/780329517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc103c40 0x7f37cc104940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 -- 172.21.15.47:0/780329517 >> 172.21.15.47:0/780329517 conn(0x7f37cc0fee30 msgr2=0x7f37cc1012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 -- 172.21.15.47:0/780329517 shutdown_connections 2024-05-14T12:27:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.320+0000 7f37d1200640 1 -- 172.21.15.47:0/780329517 wait complete. 2024-05-14T12:27:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.321+0000 7f37d1200640 1 Processor -- start 2024-05-14T12:27:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.321+0000 7f37d1200640 1 -- start start 2024-05-14T12:27:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.321+0000 7f37d1200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37cc103c40 0x7f37cc19c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.321+0000 7f37d1200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37cc104e80 0x7f37cc19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37d1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc109b80 0x7f37cc1a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37d1200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc10f740 con 0x7f37cc109b80 2024-05-14T12:27:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37d1200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc10f5c0 con 0x7f37cc103c40 2024-05-14T12:27:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37d1200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc10f8c0 con 0x7f37cc104e80 2024-05-14T12:27:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37cc103c40 0x7f37cc19c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37ca800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc109b80 0x7f37cc1a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37cc103c40 0x7f37cc19c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40906/0 (socket says 172.21.15.47:40906) 2024-05-14T12:27:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37c9e00640 1 -- 172.21.15.47:0/1143760854 learned_addr learned my addr 172.21.15.47:0/1143760854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37c9400640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37cc104e80 0x7f37cc19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37ca800640 1 -- 172.21.15.47:0/1143760854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37cc104e80 msgr2=0x7f37cc19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37ca800640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37cc104e80 0x7f37cc19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37ca800640 1 -- 172.21.15.47:0/1143760854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37cc103c40 msgr2=0x7f37cc19c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37ca800640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37cc103c40 0x7f37cc19c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37ca800640 1 -- 172.21.15.47:0/1143760854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc1a4030 con 0x7f37cc109b80 2024-05-14T12:27:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.322+0000 7f37c9400640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37cc104e80 0x7f37cc19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:27:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.323+0000 7f37ca800640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc109b80 0x7f37cc1a39c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009fd0 tx=0x7f37c400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.323+0000 7f37c2a00640 1 -- 172.21.15.47:0/1143760854 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c400ce20 con 0x7f37cc109b80 2024-05-14T12:27:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.323+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37cc1a4320 con 0x7f37cc109b80 2024-05-14T12:27:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.323+0000 7f37c2a00640 1 -- 172.21.15.47:0/1143760854 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37c4005020 con 0x7f37cc109b80 2024-05-14T12:27:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.323+0000 7f37c2a00640 1 -- 172.21.15.47:0/1143760854 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4010690 con 0x7f37cc109b80 2024-05-14T12:27:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.323+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37cc1a4820 con 0x7f37cc109b80 2024-05-14T12:27:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.326+0000 7f37d81da740 1 Processor -- start 2024-05-14T12:27:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.327+0000 7f37c2a00640 1 -- 172.21.15.47:0/1143760854 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f37c4010830 con 0x7f37cc109b80 2024-05-14T12:27:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.327+0000 7f37d81da740 1 -- start start 2024-05-14T12:27:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37d81da740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592400201b0 0x5592403c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37d81da740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403c2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37d81da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923ffff4d0 0x5592403c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37d81da740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559240326550 con 0x5592400201b0 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37d81da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5592402cbbc0 con 0x55923ffff4d0 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37d81da740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559240322510 con 0x55923fff72f0 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37c9400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592400201b0 0x5592403c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403c2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:60208/0 (socket says 172.21.15.47:60208) 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.328+0000 7f37c9e00640 1 -- 172.21.15.47:0/3937841256 learned_addr learned my addr 172.21.15.47:0/3937841256 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9400640 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923ffff4d0 0x5592403c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9e00640 1 -- 172.21.15.47:0/3937841256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923ffff4d0 msgr2=0x5592403c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9e00640 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923ffff4d0 0x5592403c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9e00640 1 -- 172.21.15.47:0/3937841256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592400201b0 msgr2=0x5592403c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9e00640 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592400201b0 0x5592403c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9e00640 1 -- 172.21.15.47:0/3937841256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559240038210 con 0x55923fff72f0 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9400640 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592400201b0 0x5592403c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c2a00640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f37b00b28a0 0x7f37b00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9e00640 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403c2680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37bc006010 tx=0x7f37bc031b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1764a782c4d0ce84 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c2a00640 1 -- 172.21.15.47:0/1143760854 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f37c40e28f0 con 0x7f37cc109b80 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37c9400640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f37b00b28a0 0x7f37b00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.329+0000 7f37b7400640 1 -- 172.21.15.47:0/3937841256 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc035030 con 0x55923fff72f0 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.330+0000 7f37b7400640 1 -- 172.21.15.47:0/3937841256 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37bc040070 con 0x55923fff72f0 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.330+0000 7f37b7400640 1 -- 172.21.15.47:0/3937841256 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc003a10 con 0x55923fff72f0 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 -- 172.21.15.47:0/3937841256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 msgr2=0x5592403c2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37c9400640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f37b00b28a0 0x7f37b00b4db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5592403c32d0 tx=0x7f37b8009be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403c2680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37bc006010 tx=0x7f37bc031b10 comp rx=0 tx=0).stop 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 -- 172.21.15.47:0/3937841256 shutdown_connections 2024-05-14T12:27:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923ffff4d0 0x5592403c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403c2680 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 --2- 172.21.15.47:0/3937841256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5592400201b0 0x5592403c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 -- 172.21.15.47:0/3937841256 >> 172.21.15.47:0/3937841256 conn(0x559240014300 msgr2=0x5592403bda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 -- 172.21.15.47:0/3937841256 shutdown_connections 2024-05-14T12:27:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 -- 172.21.15.47:0/3937841256 wait complete. 2024-05-14T12:27:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.331+0000 7f37d81da740 1 -- start start 2024-05-14T12:27:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 1 Processor -- start 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923fff72f0 0x5592403cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592400201b0 0x5592403d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5592403c9f70 con 0x55923ffff4d0 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5592402df660 con 0x55923fff72f0 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5592403ca0f0 con 0x5592400201b0 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37d81da740 10 client.0 _ll_register_callbacks cb 0x5592402a9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923fff72f0 0x5592403cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.332+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923fff72f0 0x5592403cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40916/0 (socket says 172.21.15.47:40916) 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9e00640 1 -- 172.21.15.47:0/3610168649 learned_addr learned my addr 172.21.15.47:0/3610168649 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37ca800640 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592400201b0 0x5592403d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9400640 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9e00640 1 -- 172.21.15.47:0/3610168649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592400201b0 msgr2=0x5592403d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9e00640 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592400201b0 0x5592403d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9e00640 1 -- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 msgr2=0x5592403cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9e00640 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9e00640 1 -- 172.21.15.47:0/3610168649 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559240104620 con 0x55923fff72f0 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37c9e00640 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923fff72f0 0x5592403cbb90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37bc031440 tx=0x7f37bc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917d1f1015128b67 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.333+0000 7f37abe00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.334+0000 7f37abe00640 1 -- 172.21.15.47:0/3610168649 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc053060 con 0x55923fff72f0 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.334+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37bc040070 con 0x55923fff72f0 2024-05-14T12:27:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.334+0000 7f37abe00640 1 -- 172.21.15.47:0/3610168649 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f37bc003790 con 0x55923fff72f0 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.334+0000 7f37abe00640 1 -- 172.21.15.47:0/3610168649 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f37bc035070 con 0x55923fff72f0 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.334+0000 7f37d81da740 10 client.25436 fetch_fsmap learned FSMap version 29 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.334+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592403d5f60 con 0x55923fff72f0 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.334+0000 7f37abe00640 1 -- 172.21.15.47:0/3610168649 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37bc040070 con 0x55923fff72f0 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37abe00640 1 -- 172.21.15.47:0/3610168649 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f37bc058070 con 0x55923fff72f0 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37d81da740 10 client.25436 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37d81da740 10 client.25436 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37d81da740 20 client.25436 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37d81da740 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffded80 0x5592403d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37d81da740 4 client.25436 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559240334160 con 0x55923ffded80 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.335+0000 7f37c9400640 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffded80 0x5592403d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.336+0000 7f37c9400640 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffded80 0x5592403d92c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7642e1e8694aca server_cookie=f421a370c85fde38 in_seq=0 out_seq=0 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.336+0000 7f37abe00640 10 client.25436 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.336+0000 7f37abe00640 1 -- 172.21.15.47:0/3610168649 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559240334160 con 0x55923ffded80 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.336+0000 7f37abe00640 10 client.25436 handle_command_reply: tid=0 2024-05-14T12:27:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 client.25436 shutdown 2024-05-14T12:27:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923fff72f0 msgr2=0x5592403cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923fff72f0 0x5592403cbb90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f37bc031440 tx=0x7f37bc004270 comp rx=0 tx=0).stop 2024-05-14T12:27:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 shutdown_connections 2024-05-14T12:27:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffded80 0x5592403d92c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5592400201b0 0x5592403d3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 --2- 172.21.15.47:0/3610168649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55923fff72f0 0x5592403cbb90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37abe00640 0 client.25436 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 >> 172.21.15.47:0/3610168649 conn(0x559240014300 msgr2=0x5592403c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 shutdown_connections 2024-05-14T12:27:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 1 -- 172.21.15.47:0/3610168649 wait complete. 2024-05-14T12:27:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.337+0000 7f37d81da740 20 client.25436 trim_cache size 0 max 16384 2024-05-14T12:27:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 Processor -- start 2024-05-14T12:27:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 -- start start 2024-05-14T12:27:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1ad500 con 0x55923ffff4d0 2024-05-14T12:27:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1af040 con 0x5592400201b0 2024-05-14T12:27:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37d81da740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1adbd0 con 0x55923fff72f0 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37c9400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:60230/0 (socket says 172.21.15.47:60230) 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37c9400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403bd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60634/0 (socket says 172.21.15.47:60634) 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37c9e00640 1 -- 172.21.15.47:0/1920697085 learned_addr learned my addr 172.21.15.47:0/1920697085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.354+0000 7f37ca800640 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.355+0000 7f37c9e00640 1 -- 172.21.15.47:0/1920697085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 msgr2=0x5592403d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.355+0000 7f37c9e00640 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.355+0000 7f37c9e00640 1 -- 172.21.15.47:0/1920697085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 msgr2=0x5592403bd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.355+0000 7f37c9e00640 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403bd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.355+0000 7f37c9e00640 1 -- 172.21.15.47:0/1920697085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592403ccc00 con 0x55923fff72f0 2024-05-14T12:27:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.355+0000 7f37c9e00640 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403cc190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37bc02a910 tx=0x7f37bc02a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32870b90b5f5420b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.355+0000 7f37b6a00640 1 -- 172.21.15.47:0/1920697085 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc05e030 con 0x55923fff72f0 2024-05-14T12:27:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.356+0000 7f37b6a00640 1 -- 172.21.15.47:0/1920697085 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37bc040040 con 0x55923fff72f0 2024-05-14T12:27:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.356+0000 7f37b6a00640 1 -- 172.21.15.47:0/1920697085 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc053070 con 0x55923fff72f0 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.356+0000 7f37d81da740 1 -- 172.21.15.47:0/1920697085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 msgr2=0x5592403cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.356+0000 7f37d81da740 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403cc190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37bc02a910 tx=0x7f37bc02a3f0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 -- 172.21.15.47:0/1920697085 shutdown_connections 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923ffff4d0 0x5592403bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 --2- 172.21.15.47:0/1920697085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923fff72f0 0x5592403cc190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 -- 172.21.15.47:0/1920697085 >> 172.21.15.47:0/1920697085 conn(0x559240014300 msgr2=0x5592403bd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 -- 172.21.15.47:0/1920697085 shutdown_connections 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 -- 172.21.15.47:0/1920697085 wait complete. 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 -- start start 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.357+0000 7f37d81da740 1 Processor -- start 2024-05-14T12:27:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37d81da740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923fff72f0 0x5592403d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37d81da740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923ffff4d0 0x5592403d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37d81da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37d81da740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1ae970 con 0x55923fff72f0 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37d81da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1ae2a0 con 0x5592400201b0 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37d81da740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1ab4c0 con 0x55923ffff4d0 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37d81da740 10 client.0 _ll_register_callbacks cb 0x7f37b8009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923fff72f0 0x5592403d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923fff72f0 0x5592403d3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60646/0 (socket says 172.21.15.47:60646) 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9e00640 1 -- 172.21.15.47:0/1038673753 learned_addr learned my addr 172.21.15.47:0/1038673753 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9400640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923ffff4d0 0x5592403d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37ca800640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9400640 1 -- 172.21.15.47:0/1038673753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 msgr2=0x5592403d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9400640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9400640 1 -- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923fff72f0 msgr2=0x5592403d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.358+0000 7f37c9400640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923fff72f0 0x5592403d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37c9400640 1 -- 172.21.15.47:0/1038673753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924043f590 con 0x55923ffff4d0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37c9e00640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923fff72f0 0x5592403d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37c9400640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923ffff4d0 0x5592403d0380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5592403d9900 tx=0x7f37b8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550ed873af0f4b61 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37abe00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37abe00640 1 -- 172.21.15.47:0/1038673753 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8005020 con 0x55923ffff4d0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37bc040040 con 0x55923ffff4d0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37abe00640 1 -- 172.21.15.47:0/1038673753 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f37b80051c0 con 0x55923ffff4d0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37abe00640 1 -- 172.21.15.47:0/1038673753 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f37b803b050 con 0x55923ffff4d0 2024-05-14T12:27:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37d81da740 10 client.25462 fetch_fsmap learned FSMap version 29 2024-05-14T12:27:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.359+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559240440870 con 0x55923ffff4d0 2024-05-14T12:27:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37abe00640 1 -- 172.21.15.47:0/1038673753 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37bc040040 con 0x55923ffff4d0 2024-05-14T12:27:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37abe00640 1 -- 172.21.15.47:0/1038673753 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f37b802cce0 con 0x55923ffff4d0 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37d81da740 10 client.25462 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37d81da740 10 client.25462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37d81da740 20 client.25462 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37d81da740 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffb41c0 0x559240443210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37d81da740 4 client.25462 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55924032dfd0 con 0x55923ffb41c0 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.360+0000 7f37c9e00640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffb41c0 0x559240443210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.361+0000 7f37c9e00640 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffb41c0 0x559240443210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c58f0e5f4fb81f98 server_cookie=8c8439cb47cdf15b in_seq=0 out_seq=0 2024-05-14T12:27:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.361+0000 7f37abe00640 10 client.25462 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.365+0000 7f37abe00640 1 -- 172.21.15.47:0/1038673753 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55924032dfd0 con 0x55923ffb41c0 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.365+0000 7f37abe00640 10 client.25462 handle_command_reply: tid=0 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 client.25462 shutdown 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923ffff4d0 msgr2=0x5592403d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923ffff4d0 0x5592403d0380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5592403d9900 tx=0x7f37b8017000 comp rx=0 tx=0).stop 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 shutdown_connections 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55923ffb41c0 0x559240443210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592400201b0 0x5592403d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55923ffff4d0 0x5592403d0380 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 --2- 172.21.15.47:0/1038673753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55923fff72f0 0x5592403d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37abe00640 0 client.25462 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 >> 172.21.15.47:0/1038673753 conn(0x559240014300 msgr2=0x5592403c12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 shutdown_connections 2024-05-14T12:27:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 1 -- 172.21.15.47:0/1038673753 wait complete. 2024-05-14T12:27:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.366+0000 7f37d81da740 20 client.25462 trim_cache size 0 max 16384 2024-05-14T12:27:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:27:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:27:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:27:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f37b00b28a0 msgr2=0x7f37b00b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f37b00b28a0 0x7f37b00b4db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5592403c32d0 tx=0x7f37b8009be0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc109b80 msgr2=0x7f37cc1a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc109b80 0x7f37cc1a39c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009fd0 tx=0x7f37c400ef10 comp rx=0 tx=0).stop 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 shutdown_connections 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f37b00b28a0 0x7f37b00b4db0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37cc109b80 0x7f37cc1a39c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37cc104e80 0x7f37cc19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 --2- 172.21.15.47:0/1143760854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37cc103c40 0x7f37cc19c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 >> 172.21.15.47:0/1143760854 conn(0x7f37cc0fee30 msgr2=0x7f37cc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 shutdown_connections 2024-05-14T12:27:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:10.367+0000 7f37d1200640 1 -- 172.21.15.47:0/1143760854 wait complete. 2024-05-14T12:27:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:11 smithi066 ceph-mon[35981]: pgmap v510: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:27:11.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:11 smithi047 ceph-mon[31254]: pgmap v510: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:27:12.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:11 smithi073 ceph-mon[35809]: pgmap v510: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-14T12:27:13.192 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 55% (6809/12271) Updating files: 56% (6872/12271) Updating files: 57% (6995/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 92% (11366/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-14T12:27:13.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:13 smithi066 ceph-mon[35981]: pgmap v511: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-14T12:27:13.885 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to 'e2b755a64f0d72176b57299d02e880cf0620d780'. 2024-05-14T12:27:13.885 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-05-14T12:27:13.886 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-14T12:27:13.887 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-14T12:27:13.887 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-14T12:27:13.887 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at e2b755a64f0 Merge PR #53755 into wip-vshankar-testing-20240509.053109-debug 2024-05-14T12:27:13.901 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-14T12:27:13.958 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-14T12:27:13.964 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-14T12:27:13.964 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-14T12:27:13.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:13 smithi047 ceph-mon[31254]: pgmap v511: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-14T12:27:14.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:13 smithi073 ceph-mon[35809]: pgmap v511: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-14T12:27:14.820 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-14T12:27:14.929 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-14T12:27:15.021 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-14T12:27:15.027 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-14T12:27:15.027 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-14T12:27:15.116 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-14T12:27:15.126 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:27:15.126 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-14T12:27:15.182 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-05-14T12:27:15.183 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-05-14T12:27:15.183 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e2b755a64f0d72176b57299d02e880cf0620d780 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-05-14T12:27:15.260 INFO:tasks.workunit.client.0.smithi047.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-05-14T12:27:15.262 INFO:tasks.workunit.client.0.smithi047.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-05-14T12:27:15.262 INFO:tasks.workunit.client.0.smithi047.stderr:+ trap -- retry EXIT 2024-05-14T12:27:15.262 INFO:tasks.workunit.client.0.smithi047.stderr:+ rm -rf ffsb 2024-05-14T12:27:15.264 INFO:tasks.workunit.client.0.smithi047.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-05-14T12:27:15.273 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into 'ffsb'... 2024-05-14T12:27:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:15 smithi066 ceph-mon[35981]: pgmap v512: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:15 smithi047 ceph-mon[31254]: pgmap v512: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:16.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:15 smithi073 ceph-mon[35809]: pgmap v512: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-14T12:27:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:17 smithi066 ceph-mon[35981]: pgmap v513: 97 pgs: 97 active+clean; 814 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-05-14T12:27:17.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:17 smithi047 ceph-mon[31254]: pgmap v513: 97 pgs: 97 active+clean; 814 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-05-14T12:27:18.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:17 smithi073 ceph-mon[35809]: pgmap v513: 97 pgs: 97 active+clean; 814 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-05-14T12:27:18.083 INFO:tasks.workunit.client.0.smithi047.stderr:+ trap - EXIT 2024-05-14T12:27:18.083 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd ffsb 2024-05-14T12:27:18.083 INFO:tasks.workunit.client.0.smithi047.stderr:+ ./configure 2024-05-14T12:27:18.460 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-14T12:27:19.491 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether build environment is sane... yes 2024-05-14T12:27:19.527 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-14T12:27:19.528 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gawk... gawk 2024-05-14T12:27:19.575 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether make sets $(MAKE)... yes 2024-05-14T12:27:19.681 INFO:tasks.workunit.client.0.smithi047.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-14T12:27:19.681 INFO:tasks.workunit.client.0.smithi047.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-14T12:27:19.706 INFO:tasks.workunit.client.0.smithi047.stdout:checking for style of include used by make... GNU 2024-05-14T12:27:19.714 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... gcc 2024-05-14T12:27:19.850 INFO:tasks.workunit.client.0.smithi047.stdout:checking for C compiler default output file name... a.out 2024-05-14T12:27:19.858 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether the C compiler works... yes 2024-05-14T12:27:19.862 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are cross compiling... no 2024-05-14T12:27:19.944 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of executables... 2024-05-14T12:27:19.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:19 smithi047 ceph-mon[31254]: pgmap v514: 97 pgs: 97 active+clean; 814 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-05-14T12:27:20.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:19 smithi073 ceph-mon[35809]: pgmap v514: 97 pgs: 97 active+clean; 814 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-05-14T12:27:20.036 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of object files... o 2024-05-14T12:27:20.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:19 smithi066 ceph-mon[35981]: pgmap v514: 97 pgs: 97 active+clean; 814 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-05-14T12:27:20.124 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... yes 2024-05-14T12:27:20.224 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... yes 2024-05-14T12:27:20.386 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-14T12:27:20.714 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... gcc3 2024-05-14T12:27:20.850 INFO:tasks.workunit.client.0.smithi047.stdout:checking how to run the C preprocessor... gcc -E 2024-05-14T12:27:21.004 INFO:tasks.workunit.client.0.smithi047.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-14T12:27:21.010 INFO:tasks.workunit.client.0.smithi047.stdout:checking for egrep... /usr/bin/grep -E 2024-05-14T12:27:21.046 INFO:tasks.workunit.client.0.smithi047.stdout:checking for AIX... no 2024-05-14T12:27:21.083 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... (cached) gcc 2024-05-14T12:27:21.118 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-14T12:27:21.120 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-14T12:27:21.120 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-14T12:27:21.121 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-14T12:27:21.273 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lm... yes 2024-05-14T12:27:21.413 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lpthread... yes 2024-05-14T12:27:21.831 INFO:tasks.workunit.client.0.smithi047.stdout:checking for ANSI C header files... yes 2024-05-14T12:27:21.959 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-14T12:27:21.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:21 smithi047 ceph-mon[31254]: pgmap v515: 97 pgs: 97 active+clean; 814 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-14T12:27:22.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:21 smithi073 ceph-mon[35809]: pgmap v515: 97 pgs: 97 active+clean; 814 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-14T12:27:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:21 smithi066 ceph-mon[35981]: pgmap v515: 97 pgs: 97 active+clean; 814 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-14T12:27:22.109 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/types.h... yes 2024-05-14T12:27:22.234 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/stat.h... yes 2024-05-14T12:27:22.361 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdlib.h... yes 2024-05-14T12:27:22.495 INFO:tasks.workunit.client.0.smithi047.stdout:checking for string.h... yes 2024-05-14T12:27:22.656 INFO:tasks.workunit.client.0.smithi047.stdout:checking for memory.h... yes 2024-05-14T12:27:22.765 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strings.h... yes 2024-05-14T12:27:22.892 INFO:tasks.workunit.client.0.smithi047.stdout:checking for inttypes.h... yes 2024-05-14T12:27:23.029 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... yes 2024-05-14T12:27:23.172 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... yes 2024-05-14T12:27:23.329 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h usability... yes 2024-05-14T12:27:23.397 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h presence... yes 2024-05-14T12:27:23.399 INFO:tasks.workunit.client.0.smithi047.stdout:checking for pthread.h... yes 2024-05-14T12:27:23.537 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h usability... yes 2024-05-14T12:27:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 -- 172.21.15.47:0/1893379244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 msgr2=0x7fbde4106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 --2- 172.21.15.47:0/1893379244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde4106b40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009860 tx=0x7fbdd802a340 comp rx=0 tx=0).stop 2024-05-14T12:27:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 -- 172.21.15.47:0/1893379244 shutdown_connections 2024-05-14T12:27:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 --2- 172.21.15.47:0/1893379244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbde41099e0 0x7fbde410be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 --2- 172.21.15.47:0/1893379244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbde4107080 0x7fbde41094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 --2- 172.21.15.47:0/1893379244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde4106b40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 -- 172.21.15.47:0/1893379244 >> 172.21.15.47:0/1893379244 conn(0x7fbde40fdd60 msgr2=0x7fbde41001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 -- 172.21.15.47:0/1893379244 shutdown_connections 2024-05-14T12:27:23.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.586+0000 7fbdec400640 1 -- 172.21.15.47:0/1893379244 wait complete. 2024-05-14T12:27:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 Processor -- start 2024-05-14T12:27:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 -- start start 2024-05-14T12:27:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde419c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbde4107080 0x7fbde419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbde41099e0 0x7fbde41a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbde410f730 con 0x7fbde4107080 2024-05-14T12:27:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbde410f5b0 con 0x7fbde4104720 2024-05-14T12:27:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbdec400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbde410f8b0 con 0x7fbde41099e0 2024-05-14T12:27:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbde9a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde419c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbde9a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde419c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33582/0 (socket says 172.21.15.47:33582) 2024-05-14T12:27:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.588+0000 7fbde9a00640 1 -- 172.21.15.47:0/260992118 learned_addr learned my addr 172.21.15.47:0/260992118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbdea400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbde41099e0 0x7fbde41a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbde9000640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbde4107080 0x7fbde419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbde9a00640 1 -- 172.21.15.47:0/260992118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbde41099e0 msgr2=0x7fbde41a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbde9a00640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbde41099e0 0x7fbde41a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbde9a00640 1 -- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbde4107080 msgr2=0x7fbde419ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbde9a00640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbde4107080 0x7fbde419ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbde9a00640 1 -- 172.21.15.47:0/260992118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde41a4020 con 0x7fbde4104720 2024-05-14T12:27:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.589+0000 7fbde9a00640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde419c4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8000c00 tx=0x7fbdd8032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.590+0000 7fbde2000640 1 -- 172.21.15.47:0/260992118 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8040020 con 0x7fbde4104720 2024-05-14T12:27:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.590+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde41a42b0 con 0x7fbde4104720 2024-05-14T12:27:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.590+0000 7fbde2000640 1 -- 172.21.15.47:0/260992118 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd8030e10 con 0x7fbde4104720 2024-05-14T12:27:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.590+0000 7fbde2000640 1 -- 172.21.15.47:0/260992118 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8037040 con 0x7fbde4104720 2024-05-14T12:27:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.590+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde41a47f0 con 0x7fbde4104720 2024-05-14T12:27:23.594 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h presence... yes 2024-05-14T12:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 Processor -- start 2024-05-14T12:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 -- start start 2024-05-14T12:27:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743fd2f0 0x561e747c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.596 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fcntl.h... yes 2024-05-14T12:27:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744054d0 0x561e747cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561e7472c550 con 0x561e744054d0 2024-05-14T12:27:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561e746d1bc0 con 0x561e744261b0 2024-05-14T12:27:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.595+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561e74728510 con 0x561e743fd2f0 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744054d0 0x561e747cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744054d0 0x561e747cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53066/0 (socket says 172.21.15.47:53066) 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 -- 172.21.15.47:0/3055797108 learned_addr learned my addr 172.21.15.47:0/3055797108 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbdea400640 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 -- 172.21.15.47:0/3055797108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743fd2f0 msgr2=0x561e747c8680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743fd2f0 0x561e747c8680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 -- 172.21.15.47:0/3055797108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 msgr2=0x561e747c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbde9000640 1 -- 172.21.15.47:0/3055797108 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e7443e210 con 0x561e744054d0 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.596+0000 7fbdea400640 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.597+0000 7fbde9000640 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744054d0 0x561e747cf580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009c80 tx=0x7fbdd0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986336c4d1b70bcd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.597+0000 7fbdd6a00640 1 -- 172.21.15.47:0/3055797108 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0004220 con 0x561e744054d0 2024-05-14T12:27:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.597+0000 7fbdd6a00640 1 -- 172.21.15.47:0/3055797108 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd00043c0 con 0x561e744054d0 2024-05-14T12:27:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.597+0000 7fbdd6a00640 1 -- 172.21.15.47:0/3055797108 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0019790 con 0x561e744054d0 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.598+0000 7fbdf33fd740 1 -- 172.21.15.47:0/3055797108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744054d0 msgr2=0x561e747cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.598+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744054d0 0x561e747cf580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009c80 tx=0x7fbdd0011810 comp rx=0 tx=0).stop 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.598+0000 7fbdf33fd740 1 -- 172.21.15.47:0/3055797108 shutdown_connections 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.598+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744054d0 0x561e747cf580 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.598+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743fd2f0 0x561e747c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.598+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/3055797108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.598+0000 7fbdf33fd740 1 -- 172.21.15.47:0/3055797108 >> 172.21.15.47:0/3055797108 conn(0x561e7441a300 msgr2=0x561e747c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.599+0000 7fbde2000640 1 -- 172.21.15.47:0/260992118 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbdd8043020 con 0x7fbde4104720 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.599+0000 7fbdf33fd740 1 -- 172.21.15.47:0/3055797108 shutdown_connections 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.599+0000 7fbdf33fd740 1 -- 172.21.15.47:0/3055797108 wait complete. 2024-05-14T12:27:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.599+0000 7fbdf33fd740 1 -- start start 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.600+0000 7fbdf33fd740 1 Processor -- start 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.600+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.600+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744261b0 0x561e747d2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.600+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743e4d80 0x561e747d9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.600+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561e747cffd0 con 0x561e744261b0 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.600+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561e746e5660 con 0x561e744054d0 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.600+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561e747d0150 con 0x561e743e4d80 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbdf33fd740 10 client.0 _ll_register_callbacks cb 0x561e746af400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbdea400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743e4d80 0x561e747d9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744261b0 0x561e747d2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743e4d80 0x561e747d9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49996/0 (socket says 172.21.15.47:49996) 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbdea400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33598/0 (socket says 172.21.15.47:33598) 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 -- 172.21.15.47:0/1552532750 learned_addr learned my addr 172.21.15.47:0/1552532750 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 -- 172.21.15.47:0/1552532750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 msgr2=0x561e747d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde2000640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbdcc0b27b0 0x7fbdcc0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 -- 172.21.15.47:0/1552532750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744261b0 msgr2=0x561e747d2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744261b0 0x561e747d2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.601+0000 7fbde9000640 1 -- 172.21.15.47:0/1552532750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e7450a620 con 0x561e743e4d80 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.602+0000 7fbde2000640 1 -- 172.21.15.47:0/260992118 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbdd8102080 con 0x7fbde4104720 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.602+0000 7fbdea400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbdcc0b27b0 0x7fbdcc0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.602+0000 7fbde9000640 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743e4d80 0x561e747d9280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009c50 tx=0x7fbdd0003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a23a66b8c774ce6d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.602+0000 7fbdcb400640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.602+0000 7fbdcb400640 1 -- 172.21.15.47:0/1552532750 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0029020 con 0x561e743e4d80 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.602+0000 7fbdcb400640 1 -- 172.21.15.47:0/1552532750 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbdd0005240 con 0x561e743e4d80 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.602+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdd00043c0 con 0x561e743e4d80 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdea400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbdcc0b27b0 0x7fbdcc0b4cc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561e747c92d0 tx=0x7fbddc009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdcb400640 1 -- 172.21.15.47:0/1552532750 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbdd0009890 con 0x561e743e4d80 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 10 client.25471 fetch_fsmap learned FSMap version 30 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e747dc1b0 con 0x561e743e4d80 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdcb400640 1 -- 172.21.15.47:0/1552532750 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd00043c0 con 0x561e743e4d80 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdcb400640 1 -- 172.21.15.47:0/1552532750 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fbdd0019510 con 0x561e743e4d80 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 10 client.25471 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 10 client.25471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 20 client.25471 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e743ba1c0 0x561e747df6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 4 client.25471 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:27:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.603+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e7473a160 con 0x561e743ba1c0 2024-05-14T12:27:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.606+0000 7fbde9a00640 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e743ba1c0 0x561e747df6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.607+0000 7fbde9a00640 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e743ba1c0 0x561e747df6a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e78fc64182069318 server_cookie=1fb60c2fd2dc780e in_seq=0 out_seq=0 2024-05-14T12:27:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.607+0000 7fbdcb400640 10 client.25471 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.608+0000 7fbdcb400640 1 -- 172.21.15.47:0/1552532750 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561e7473a160 con 0x561e743ba1c0 2024-05-14T12:27:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.608+0000 7fbdcb400640 10 client.25471 handle_command_reply: tid=0 2024-05-14T12:27:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.608+0000 7fbdf33fd740 1 client.25471 shutdown 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743e4d80 msgr2=0x561e747d9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743e4d80 0x561e747d9280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009c50 tx=0x7fbdd0003820 comp rx=0 tx=0).stop 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 shutdown_connections 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e743ba1c0 0x561e747df6a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e743e4d80 0x561e747d9280 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdcb400640 0 client.25471 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e744261b0 0x561e747d2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1552532750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 >> 172.21.15.47:0/1552532750 conn(0x561e7441a300 msgr2=0x561e747c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 shutdown_connections 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1552532750 wait complete. 2024-05-14T12:27:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.609+0000 7fbdf33fd740 20 client.25471 trim_cache size 0 max 16384 2024-05-14T12:27:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.632+0000 7fbdf33fd740 1 Processor -- start 2024-05-14T12:27:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.632+0000 7fbdf33fd740 1 -- start start 2024-05-14T12:27:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744261b0 0x561e747cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbde41ad600 con 0x561e743e4d80 2024-05-14T12:27:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbde41af170 con 0x561e744054d0 2024-05-14T12:27:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbde41adcd0 con 0x561e744261b0 2024-05-14T12:27:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdea400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744261b0 0x561e747cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbde9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdea400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744261b0 0x561e747cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49998/0 (socket says 172.21.15.47:49998) 2024-05-14T12:27:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbde9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53080/0 (socket says 172.21.15.47:53080) 2024-05-14T12:27:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.633+0000 7fbdea400640 1 -- 172.21.15.47:0/1058395304 learned_addr learned my addr 172.21.15.47:0/1058395304 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbde9000640 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbdea400640 1 -- 172.21.15.47:0/1058395304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 msgr2=0x561e747cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbdea400640 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbdea400640 1 -- 172.21.15.47:0/1058395304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 msgr2=0x561e747cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbdea400640 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbdea400640 1 -- 172.21.15.47:0/1058395304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e747cfeb0 con 0x561e744261b0 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbde9a00640 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.634+0000 7fbdea400640 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744261b0 0x561e747cc720 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00f9b0 tx=0x7fbddc019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87dde8a454338250 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.635+0000 7fbdd6000640 1 -- 172.21.15.47:0/1058395304 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc01db10 con 0x561e744261b0 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.635+0000 7fbdd6000640 1 -- 172.21.15.47:0/1058395304 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbddc02c070 con 0x561e744261b0 2024-05-14T12:27:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.635+0000 7fbdd6000640 1 -- 172.21.15.47:0/1058395304 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc01b620 con 0x561e744261b0 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1058395304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744261b0 msgr2=0x561e747cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744261b0 0x561e747cc720 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00f9b0 tx=0x7fbddc019000 comp rx=0 tx=0).stop 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1058395304 shutdown_connections 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744261b0 0x561e747cc720 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744054d0 0x561e747cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/1058395304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1058395304 >> 172.21.15.47:0/1058395304 conn(0x561e7441a300 msgr2=0x561e747d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1058395304 shutdown_connections 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 -- 172.21.15.47:0/1058395304 wait complete. 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.636+0000 7fbdf33fd740 1 -- start start 2024-05-14T12:27:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 1 Processor -- start 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747d5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744054d0 0x561e747d60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747d7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbde41aea70 con 0x561e743e4d80 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbde41ae3a0 con 0x561e744261b0 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbde41ab5c0 con 0x561e744054d0 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdf33fd740 10 client.0 _ll_register_callbacks cb 0x7fbddc009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbde9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747d5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbde9000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744054d0 0x561e747d60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbde9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747d5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53094/0 (socket says 172.21.15.47:53094) 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbde9a00640 1 -- 172.21.15.47:0/332856116 learned_addr learned my addr 172.21.15.47:0/332856116 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.637+0000 7fbdea400640 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747d7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbde9000640 1 -- 172.21.15.47:0/332856116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 msgr2=0x561e747d7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbde9000640 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747d7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbde9000640 1 -- 172.21.15.47:0/332856116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 msgr2=0x561e747d5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbde9000640 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747d5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbde9000640 1 -- 172.21.15.47:0/332856116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e747d75d0 con 0x561e744054d0 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbde9000640 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744054d0 0x561e747d60e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0006010 tx=0x7fbdd001af80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e117c64e3c7d75 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbdcb400640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbdcb400640 1 -- 172.21.15.47:0/332856116 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0019630 con 0x561e744054d0 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbdcb400640 1 -- 172.21.15.47:0/332856116 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbdd0005040 con 0x561e744054d0 2024-05-14T12:27:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.638+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbddc02c070 con 0x561e744054d0 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdcb400640 1 -- 172.21.15.47:0/332856116 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbdd0009870 con 0x561e744054d0 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 10 client.25477 fetch_fsmap learned FSMap version 30 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e747d8860 con 0x561e744054d0 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdcb400640 1 -- 172.21.15.47:0/332856116 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbddc02c070 con 0x561e744054d0 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdcb400640 1 -- 172.21.15.47:0/332856116 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fbdd0037070 con 0x561e744054d0 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 10 client.25477 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 10 client.25477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 20 client.25477 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e74847e40 0x561e7484a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 4 client.25477 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.639+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e747cbcf0 con 0x561e74847e40 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.640+0000 7fbde9a00640 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e74847e40 0x561e7484a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.640+0000 7fbde9a00640 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e74847e40 0x561e7484a260 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb9773ad5a2666b server_cookie=702275558c02667b in_seq=0 out_seq=0 2024-05-14T12:27:23.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.640+0000 7fbdcb400640 10 client.25477 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:23.711 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h usability... yes 2024-05-14T12:27:23.764 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h presence... yes 2024-05-14T12:27:23.766 INFO:tasks.workunit.client.0.smithi047.stdout:checking for limits.h... yes 2024-05-14T12:27:23.803 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... (cached) yes 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdcb400640 1 -- 172.21.15.47:0/332856116 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e747cbcf0 con 0x561e74847e40 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdcb400640 10 client.25477 handle_command_reply: tid=0 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 client.25477 shutdown 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744054d0 msgr2=0x561e747d60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744054d0 0x561e747d60e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0006010 tx=0x7fbdd001af80 comp rx=0 tx=0).stop 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 shutdown_connections 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561e74847e40 0x561e7484a260 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e744261b0 0x561e747d7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e744054d0 0x561e747d60e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 --2- 172.21.15.47:0/332856116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561e743e4d80 0x561e747d5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdcb400640 0 client.25477 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 >> 172.21.15.47:0/332856116 conn(0x561e7441a300 msgr2=0x561e747d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 shutdown_connections 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.890+0000 7fbdf33fd740 1 -- 172.21.15.47:0/332856116 wait complete. 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.891+0000 7fbdf33fd740 20 client.25477 trim_cache size 0 max 16384 2024-05-14T12:27:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:27:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:27:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:27:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:27:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.891+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbdcc0b27b0 msgr2=0x7fbdcc0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.891+0000 7fbdec400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbdcc0b27b0 0x7fbdcc0b4cc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561e747c92d0 tx=0x7fbddc009500 comp rx=0 tx=0).stop 2024-05-14T12:27:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.891+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 msgr2=0x7fbde419c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.891+0000 7fbdec400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde419c4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8000c00 tx=0x7fbdd8032d50 comp rx=0 tx=0).stop 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 shutdown_connections 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbdcc0b27b0 0x7fbdcc0b4cc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbde41099e0 0x7fbde41a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbde4107080 0x7fbde419ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 --2- 172.21.15.47:0/260992118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde4104720 0x7fbde419c4e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 >> 172.21.15.47:0/260992118 conn(0x7fbde40fdd60 msgr2=0x7fbde4108810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 shutdown_connections 2024-05-14T12:27:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:23.892+0000 7fbdec400640 1 -- 172.21.15.47:0/260992118 wait complete. 2024-05-14T12:27:23.937 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h usability... yes 2024-05-14T12:27:23.978 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h presence... yes 2024-05-14T12:27:23.979 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/time.h... yes 2024-05-14T12:27:23.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:23 smithi047 ceph-mon[31254]: pgmap v516: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 208 KiB/s wr, 30 op/s 2024-05-14T12:27:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:23 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:27:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:23 smithi073 ceph-mon[35809]: pgmap v516: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 208 KiB/s wr, 30 op/s 2024-05-14T12:27:24.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:23 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:27:24.007 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... (cached) yes 2024-05-14T12:27:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:23 smithi066 ceph-mon[35981]: pgmap v516: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 208 KiB/s wr, 30 op/s 2024-05-14T12:27:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:23 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:27:24.114 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h usability... yes 2024-05-14T12:27:24.176 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h presence... yes 2024-05-14T12:27:24.178 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/vfs.h... yes 2024-05-14T12:27:24.297 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h usability... no 2024-05-14T12:27:24.365 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h presence... no 2024-05-14T12:27:24.368 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/limits.h... no 2024-05-14T12:27:24.472 INFO:tasks.workunit.client.0.smithi047.stdout:checking for an ANSI C-conforming const... yes 2024-05-14T12:27:24.568 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-14T12:27:24.572 INFO:tasks.workunit.client.0.smithi047.stdout:checking for function prototypes... yes 2024-05-14T12:27:24.663 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether setvbuf arguments are reversed... no 2024-05-14T12:27:24.883 INFO:tasks.workunit.client.0.smithi047.stdout:checking for system... yes 2024-05-14T12:27:25.042 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gettimeofday... yes 2024-05-14T12:27:25.189 INFO:tasks.workunit.client.0.smithi047.stdout:checking for mkdir... yes 2024-05-14T12:27:25.313 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strerror... yes 2024-05-14T12:27:25.449 INFO:tasks.workunit.client.0.smithi047.stdout:checking for open64... yes 2024-05-14T12:27:25.585 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stat64... yes 2024-05-14T12:27:25.726 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fseeko64... yes 2024-05-14T12:27:25.858 INFO:tasks.workunit.client.0.smithi047.stdout:checking for lrand48_r... yes 2024-05-14T12:27:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:25 smithi047 ceph-mon[31254]: pgmap v517: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 232 KiB/s wr, 37 op/s 2024-05-14T12:27:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:25 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:27:25.998 INFO:tasks.workunit.client.0.smithi047.stdout:checking for srand48_r... yes 2024-05-14T12:27:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:25 smithi073 ceph-mon[35809]: pgmap v517: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 232 KiB/s wr, 37 op/s 2024-05-14T12:27:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:25 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:27:26.068 INFO:tasks.workunit.client.0.smithi047.stdout:configure: creating ./config.status 2024-05-14T12:27:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:25 smithi066 ceph-mon[35981]: pgmap v517: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 232 KiB/s wr, 37 op/s 2024-05-14T12:27:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:25 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:27:26.367 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating Makefile 2024-05-14T12:27:26.401 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating config.h 2024-05-14T12:27:26.442 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing depfiles commands 2024-05-14T12:27:26.566 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing default commands 2024-05-14T12:27:26.685 INFO:tasks.workunit.client.0.smithi047.stderr:+ make 2024-05-14T12:27:26.700 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-05-14T12:27:26.707 INFO:tasks.workunit.client.0.smithi047.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-05-14T12:27:26.710 INFO:tasks.workunit.client.0.smithi047.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-05-14T12:27:26.710 INFO:tasks.workunit.client.0.smithi047.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-05-14T12:27:26.710 INFO:tasks.workunit.client.0.smithi047.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-05-14T12:27:26.710 INFO:tasks.workunit.client.0.smithi047.stderr: any GNU archive site. 2024-05-14T12:27:26.717 INFO:tasks.workunit.client.0.smithi047.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-05-14T12:27:26.721 INFO:tasks.workunit.client.0.smithi047.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-05-14T12:27:26.724 INFO:tasks.workunit.client.0.smithi047.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-05-14T12:27:26.724 INFO:tasks.workunit.client.0.smithi047.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-05-14T12:27:26.724 INFO:tasks.workunit.client.0.smithi047.stderr: You might want to install the `Automake' and `Perl' packages. 2024-05-14T12:27:26.724 INFO:tasks.workunit.client.0.smithi047.stderr: Grab them from any GNU archive site. 2024-05-14T12:27:26.848 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-05-14T12:27:26.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:27:26.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:27:26.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:27:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:27:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:27:27.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:27:27.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:27:27.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:27:27.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:27:27.405 INFO:tasks.workunit.client.0.smithi047.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-14T12:27:27.406 INFO:tasks.workunit.client.0.smithi047.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-14T12:27:27.406 INFO:tasks.workunit.client.0.smithi047.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-14T12:27:27.406 INFO:tasks.workunit.client.0.smithi047.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-14T12:27:27.630 INFO:tasks.workunit.client.0.smithi047.stdout:/bin/sh ./config.status --recheck 2024-05-14T12:27:27.823 INFO:tasks.workunit.client.0.smithi047.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-05-14T12:27:27.885 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:27 smithi047 ceph-mon[31254]: pgmap v518: 97 pgs: 97 active+clean; 4.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 363 KiB/s wr, 88 op/s 2024-05-14T12:27:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:27 smithi073 ceph-mon[35809]: pgmap v518: 97 pgs: 97 active+clean; 4.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 363 KiB/s wr, 88 op/s 2024-05-14T12:27:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:27 smithi066 ceph-mon[35981]: pgmap v518: 97 pgs: 97 active+clean; 4.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 363 KiB/s wr, 88 op/s 2024-05-14T12:27:28.119 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-14T12:27:28.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:28 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:27:29.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:28 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:27:29.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:28 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:27:29.144 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether build environment is sane... yes 2024-05-14T12:27:29.162 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-14T12:27:29.163 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gawk... gawk 2024-05-14T12:27:29.205 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether make sets $(MAKE)... yes 2024-05-14T12:27:29.306 INFO:tasks.workunit.client.0.smithi047.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-14T12:27:29.306 INFO:tasks.workunit.client.0.smithi047.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-14T12:27:29.330 INFO:tasks.workunit.client.0.smithi047.stdout:checking for style of include used by make... GNU 2024-05-14T12:27:29.338 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... gcc 2024-05-14T12:27:29.518 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether the C compiler works... yes 2024-05-14T12:27:29.518 INFO:tasks.workunit.client.0.smithi047.stdout:checking for C compiler default output file name... a.out 2024-05-14T12:27:29.608 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of executables... 2024-05-14T12:27:29.695 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are cross compiling... no 2024-05-14T12:27:29.786 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of object files... o 2024-05-14T12:27:29.846 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... yes 2024-05-14T12:27:29.922 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... yes 2024-05-14T12:27:29.976 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:29 smithi066 ceph-mon[35981]: pgmap v519: 97 pgs: 97 active+clean; 4.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 361 KiB/s wr, 102 op/s 2024-05-14T12:27:29.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:29 smithi047 ceph-mon[31254]: pgmap v519: 97 pgs: 97 active+clean; 4.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 361 KiB/s wr, 102 op/s 2024-05-14T12:27:30.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:29 smithi073 ceph-mon[35809]: pgmap v519: 97 pgs: 97 active+clean; 4.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 361 KiB/s wr, 102 op/s 2024-05-14T12:27:30.011 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-14T12:27:30.342 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... gcc3 2024-05-14T12:27:30.456 INFO:tasks.workunit.client.0.smithi047.stdout:checking how to run the C preprocessor... gcc -E 2024-05-14T12:27:30.619 INFO:tasks.workunit.client.0.smithi047.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-14T12:27:30.624 INFO:tasks.workunit.client.0.smithi047.stdout:checking for egrep... /usr/bin/grep -E 2024-05-14T12:27:30.930 INFO:tasks.workunit.client.0.smithi047.stdout:checking for ANSI C header files... yes 2024-05-14T12:27:31.021 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/types.h... yes 2024-05-14T12:27:31.114 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/stat.h... yes 2024-05-14T12:27:31.211 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdlib.h... yes 2024-05-14T12:27:31.381 INFO:tasks.workunit.client.0.smithi047.stdout:checking for string.h... yes 2024-05-14T12:27:31.479 INFO:tasks.workunit.client.0.smithi047.stdout:checking for memory.h... yes 2024-05-14T12:27:31.572 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strings.h... yes 2024-05-14T12:27:31.670 INFO:tasks.workunit.client.0.smithi047.stdout:checking for inttypes.h... yes 2024-05-14T12:27:31.769 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... yes 2024-05-14T12:27:31.863 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... yes 2024-05-14T12:27:31.983 INFO:tasks.workunit.client.0.smithi047.stdout:checking minix/config.h usability... no 2024-05-14T12:27:31.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:31 smithi047 ceph-mon[31254]: pgmap v520: 97 pgs: 97 active+clean; 4.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 379 KiB/s wr, 113 op/s 2024-05-14T12:27:32.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:31 smithi073 ceph-mon[35809]: pgmap v520: 97 pgs: 97 active+clean; 4.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 379 KiB/s wr, 113 op/s 2024-05-14T12:27:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:31 smithi066 ceph-mon[35981]: pgmap v520: 97 pgs: 97 active+clean; 4.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 379 KiB/s wr, 113 op/s 2024-05-14T12:27:32.104 INFO:tasks.workunit.client.0.smithi047.stdout:checking minix/config.h presence... no 2024-05-14T12:27:32.104 INFO:tasks.workunit.client.0.smithi047.stdout:checking for minix/config.h... no 2024-05-14T12:27:32.214 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-05-14T12:27:32.214 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... (cached) gcc 2024-05-14T12:27:32.297 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-14T12:27:32.297 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-14T12:27:32.297 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-14T12:27:32.298 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-14T12:27:32.380 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lm... yes 2024-05-14T12:27:32.474 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lpthread... yes 2024-05-14T12:27:32.478 INFO:tasks.workunit.client.0.smithi047.stdout:checking for ANSI C header files... (cached) yes 2024-05-14T12:27:32.574 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-14T12:27:32.713 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h usability... yes 2024-05-14T12:27:32.762 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h presence... yes 2024-05-14T12:27:32.763 INFO:tasks.workunit.client.0.smithi047.stdout:checking for pthread.h... yes 2024-05-14T12:27:32.872 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h usability... yes 2024-05-14T12:27:32.923 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h presence... yes 2024-05-14T12:27:32.924 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fcntl.h... yes 2024-05-14T12:27:33.049 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h usability... yes 2024-05-14T12:27:33.097 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h presence... yes 2024-05-14T12:27:33.097 INFO:tasks.workunit.client.0.smithi047.stdout:checking for limits.h... yes 2024-05-14T12:27:33.132 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... (cached) yes 2024-05-14T12:27:33.223 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h usability... yes 2024-05-14T12:27:33.264 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h presence... yes 2024-05-14T12:27:33.265 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/time.h... yes 2024-05-14T12:27:33.296 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... (cached) yes 2024-05-14T12:27:33.378 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h usability... yes 2024-05-14T12:27:33.437 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h presence... yes 2024-05-14T12:27:33.437 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/vfs.h... yes 2024-05-14T12:27:33.574 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h usability... no 2024-05-14T12:27:33.649 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h presence... no 2024-05-14T12:27:33.650 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/limits.h... no 2024-05-14T12:27:33.723 INFO:tasks.workunit.client.0.smithi047.stdout:checking for an ANSI C-conforming const... yes 2024-05-14T12:27:33.798 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-14T12:27:33.941 INFO:tasks.workunit.client.0.smithi047.stdout:checking for system... yes 2024-05-14T12:27:33.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:33 smithi047 ceph-mon[31254]: pgmap v521: 97 pgs: 97 active+clean; 6.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 530 KiB/s wr, 127 op/s 2024-05-14T12:27:34.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:33 smithi073 ceph-mon[35809]: pgmap v521: 97 pgs: 97 active+clean; 6.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 530 KiB/s wr, 127 op/s 2024-05-14T12:27:34.074 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gettimeofday... yes 2024-05-14T12:27:34.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:33 smithi066 ceph-mon[35981]: pgmap v521: 97 pgs: 97 active+clean; 6.1 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 530 KiB/s wr, 127 op/s 2024-05-14T12:27:34.216 INFO:tasks.workunit.client.0.smithi047.stdout:checking for mkdir... yes 2024-05-14T12:27:34.361 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strerror... yes 2024-05-14T12:27:34.499 INFO:tasks.workunit.client.0.smithi047.stdout:checking for open64... yes 2024-05-14T12:27:34.632 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stat64... yes 2024-05-14T12:27:34.772 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fseeko64... yes 2024-05-14T12:27:34.906 INFO:tasks.workunit.client.0.smithi047.stdout:checking for lrand48_r... yes 2024-05-14T12:27:35.037 INFO:tasks.workunit.client.0.smithi047.stdout:checking for srand48_r... yes 2024-05-14T12:27:35.095 INFO:tasks.workunit.client.0.smithi047.stdout:configure: creating ./config.status 2024-05-14T12:27:35.277 INFO:tasks.workunit.client.0.smithi047.stdout: /bin/sh ./config.status 2024-05-14T12:27:35.439 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating Makefile 2024-05-14T12:27:35.476 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating config.h 2024-05-14T12:27:35.533 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing depfiles commands 2024-05-14T12:27:35.591 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing default commands 2024-05-14T12:27:35.673 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-05-14T12:27:35.968 INFO:tasks.workunit.client.0.smithi047.stdout:rm -f stamp-h1 2024-05-14T12:27:35.974 INFO:tasks.workunit.client.0.smithi047.stdout:touch config.h.in 2024-05-14T12:27:35.979 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh ./config.status config.h 2024-05-14T12:27:35.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:35 smithi047 ceph-mon[31254]: pgmap v522: 97 pgs: 97 active+clean; 6.4 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 367 KiB/s wr, 114 op/s 2024-05-14T12:27:36.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:35 smithi073 ceph-mon[35809]: pgmap v522: 97 pgs: 97 active+clean; 6.4 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 367 KiB/s wr, 114 op/s 2024-05-14T12:27:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:35 smithi066 ceph-mon[35981]: pgmap v522: 97 pgs: 97 active+clean; 6.4 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 367 KiB/s wr, 114 op/s 2024-05-14T12:27:36.101 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating config.h 2024-05-14T12:27:36.195 INFO:tasks.workunit.client.0.smithi047.stdout:make all-am 2024-05-14T12:27:36.223 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-14T12:27:36.224 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-05-14T12:27:36.536 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-05-14T12:27:36.543 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-05-14T12:27:36.715 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-05-14T12:27:36.722 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-05-14T12:27:36.867 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-05-14T12:27:36.874 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-05-14T12:27:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 -- 172.21.15.47:0/4067608000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 msgr2=0x7efff810b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 --2- 172.21.15.47:0/4067608000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 0x7efff810b720 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7effe0009900 tx=0x7effe002a3f0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 -- 172.21.15.47:0/4067608000 shutdown_connections 2024-05-14T12:27:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 --2- 172.21.15.47:0/4067608000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff8110010 0x7efff8112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 --2- 172.21.15.47:0/4067608000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 0x7efff810b720 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 --2- 172.21.15.47:0/4067608000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff810a0d0 0x7efff810add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 -- 172.21.15.47:0/4067608000 >> 172.21.15.47:0/4067608000 conn(0x7efff8078ce0 msgr2=0x7efff8107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 -- 172.21.15.47:0/4067608000 shutdown_connections 2024-05-14T12:27:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.120+0000 7efff7e00640 1 -- 172.21.15.47:0/4067608000 wait complete. 2024-05-14T12:27:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.121+0000 7efff7e00640 1 Processor -- start 2024-05-14T12:27:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff7e00640 1 -- start start 2024-05-14T12:27:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff810a0d0 0x7efff81a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff7e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 0x7efff81a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff8110010 0x7efff81a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efff8115ce0 con 0x7efff810a0d0 2024-05-14T12:27:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff7e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efff8115b60 con 0x7efff810b310 2024-05-14T12:27:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff7e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efff8115e60 con 0x7efff8110010 2024-05-14T12:27:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff810a0d0 0x7efff81a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff810a0d0 0x7efff81a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36356/0 (socket says 172.21.15.47:36356) 2024-05-14T12:27:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7effee000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 0x7efff81a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.122+0000 7efff6a00640 1 -- 172.21.15.47:0/2391990696 learned_addr learned my addr 172.21.15.47:0/2391990696 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7efff7400640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff8110010 0x7efff81a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7efff6a00640 1 -- 172.21.15.47:0/2391990696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff8110010 msgr2=0x7efff81a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7efff6a00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff8110010 0x7efff81a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7efff6a00640 1 -- 172.21.15.47:0/2391990696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 msgr2=0x7efff81a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7efff6a00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 0x7efff81a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7efff6a00640 1 -- 172.21.15.47:0/2391990696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff81a82f0 con 0x7efff810a0d0 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7effee000640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 0x7efff81a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.123+0000 7efff6a00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff810a0d0 0x7efff81a07b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effe800e9f0 tx=0x7effe800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.124+0000 7effefe00640 1 -- 172.21.15.47:0/2391990696 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe800ccc0 con 0x7efff810a0d0 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.124+0000 7effefe00640 1 -- 172.21.15.47:0/2391990696 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe80035f0 con 0x7efff810a0d0 2024-05-14T12:27:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.124+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff81a85e0 con 0x7efff810a0d0 2024-05-14T12:27:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.124+0000 7effefe00640 1 -- 172.21.15.47:0/2391990696 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe800ce60 con 0x7efff810a0d0 2024-05-14T12:27:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.124+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff81a8ab0 con 0x7efff810a0d0 2024-05-14T12:27:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.127+0000 7f00047ab740 1 Processor -- start 2024-05-14T12:27:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.127+0000 7f00047ab740 1 -- start start 2024-05-14T12:27:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.127+0000 7f00047ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b531b0 0x555717ef5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.127+0000 7f00047ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717ef5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.127+0000 7f00047ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b324d0 0x555717efc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7f00047ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555717e59550 con 0x555717b531b0 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7f00047ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555717dfebc0 con 0x555717b2a2f0 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7f00047ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555717e55510 con 0x555717b324d0 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b531b0 0x555717ef5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b531b0 0x555717ef5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36368/0 (socket says 172.21.15.47:36368) 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 -- 172.21.15.47:0/1688613316 learned_addr learned my addr 172.21.15.47:0/1688613316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7effee000640 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b324d0 0x555717efc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7effefe00640 1 -- 172.21.15.47:0/2391990696 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7effe8004000 con 0x7efff810a0d0 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 -- 172.21.15.47:0/1688613316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b324d0 msgr2=0x555717efc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b324d0 0x555717efc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 -- 172.21.15.47:0/1688613316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 msgr2=0x555717ef5880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717ef5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.128+0000 7efff7400640 1 -- 172.21.15.47:0/1688613316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555717b6b210 con 0x555717b531b0 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.129+0000 7efff7400640 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b531b0 0x555717ef5300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efff0011440 tx=0x7efff0011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a325e8f3908dc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.129+0000 7effe7e00640 1 -- 172.21.15.47:0/1688613316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0003c30 con 0x555717b531b0 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.129+0000 7effe7e00640 1 -- 172.21.15.47:0/1688613316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efff0003dd0 con 0x555717b531b0 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.129+0000 7effe7e00640 1 -- 172.21.15.47:0/1688613316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff000fa40 con 0x555717b531b0 2024-05-14T12:27:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 -- 172.21.15.47:0/1688613316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b531b0 msgr2=0x555717ef5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b531b0 0x555717ef5300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efff0011440 tx=0x7efff0011900 comp rx=0 tx=0).stop 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7effefe00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effdc0b28a0 0x7effdc0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 -- 172.21.15.47:0/1688613316 shutdown_connections 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b324d0 0x555717efc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717ef5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 --2- 172.21.15.47:0/1688613316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b531b0 0x555717ef5300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 -- 172.21.15.47:0/1688613316 >> 172.21.15.47:0/1688613316 conn(0x555717b47300 msgr2=0x555717ef0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7effefe00640 1 -- 172.21.15.47:0/2391990696 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7effe80e2600 con 0x7efff810a0d0 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7efff6a00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effdc0b28a0 0x7effdc0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 -- 172.21.15.47:0/1688613316 shutdown_connections 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.130+0000 7f00047ab740 1 -- 172.21.15.47:0/1688613316 wait complete. 2024-05-14T12:27:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.131+0000 7f00047ab740 1 -- start start 2024-05-14T12:27:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.131+0000 7efff6a00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effdc0b28a0 0x7effdc0b4db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7effe8003fd0 tx=0x7effe80045f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.131+0000 7f00047ab740 1 Processor -- start 2024-05-14T12:27:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7f00047ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717efee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7f00047ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717eff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7f00047ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f06290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7f00047ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555717efd1d0 con 0x555717b324d0 2024-05-14T12:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7f00047ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555717e12660 con 0x555717b2a2f0 2024-05-14T12:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7f00047ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555717efd350 con 0x555717b531b0 2024-05-14T12:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7f00047ab740 10 client.0 _ll_register_callbacks cb 0x555717ddc400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7effee000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717eff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7efff7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f06290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7efff7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f06290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:47326/0 (socket says 172.21.15.47:47326) 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7efff7400640 1 -- 172.21.15.47:0/2406317601 learned_addr learned my addr 172.21.15.47:0/2406317601 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.132+0000 7efff7400640 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717efee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7efff7400640 1 -- 172.21.15.47:0/2406317601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 msgr2=0x555717f06290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7efff7400640 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f06290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7efff7400640 1 -- 172.21.15.47:0/2406317601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 msgr2=0x555717eff3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7efff7400640 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717eff3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7efff7400640 1 -- 172.21.15.47:0/2406317601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555717c37620 con 0x555717b2a2f0 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7efff7400640 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717efee60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efff0009fd0 tx=0x7efff0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0970f9798c1d1f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7effe4c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.133+0000 7effe4c00640 1 -- 172.21.15.47:0/2406317601 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff000fd30 con 0x555717b2a2f0 2024-05-14T12:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.134+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efff0003dd0 con 0x555717b2a2f0 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.134+0000 7effe4c00640 1 -- 172.21.15.47:0/2406317601 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efff0004050 con 0x555717b2a2f0 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.134+0000 7effe4c00640 1 -- 172.21.15.47:0/2406317601 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efff0004250 con 0x555717b2a2f0 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.134+0000 7f00047ab740 10 client.25469 fetch_fsmap learned FSMap version 31 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.134+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555717f091c0 con 0x555717b2a2f0 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.134+0000 7effe4c00640 1 -- 172.21.15.47:0/2406317601 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efff0003dd0 con 0x555717b2a2f0 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7effe4c00640 1 -- 172.21.15.47:0/2406317601 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7efff0025040 con 0x555717b2a2f0 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7f00047ab740 10 client.25469 fetch_fsmap finished waiting for FSMap version 31 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7f00047ab740 10 client.25469 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7f00047ab740 20 client.25469 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7f00047ab740 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717b11d80 0x555717f0c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7f00047ab740 4 client.25469 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555717e67160 con 0x555717b11d80 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.135+0000 7effee000640 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717b11d80 0x555717f0c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.136+0000 7effee000640 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717b11d80 0x555717f0c7d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18f5e4e80b373e51 server_cookie=2aaf584990ddd0d4 in_seq=0 out_seq=0 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.136+0000 7effe4c00640 10 client.25469 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.136+0000 7effe4c00640 1 -- 172.21.15.47:0/2406317601 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555717e67160 con 0x555717b11d80 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.136+0000 7effe4c00640 10 client.25469 handle_command_reply: tid=0 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 client.25469 shutdown 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 msgr2=0x555717efee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717efee60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efff0009fd0 tx=0x7efff0005fd0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 shutdown_connections 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717b11d80 0x555717f0c7d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f06290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717eff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7effe4c00640 0 client.25469 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 --2- 172.21.15.47:0/2406317601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717efee60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 >> 172.21.15.47:0/2406317601 conn(0x555717b47300 msgr2=0x555717eefc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 shutdown_connections 2024-05-14T12:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 1 -- 172.21.15.47:0/2406317601 wait complete. 2024-05-14T12:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.137+0000 7f00047ab740 20 client.25469 trim_cache size 0 max 16384 2024-05-14T12:27:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 Processor -- start 2024-05-14T12:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 -- start start 2024-05-14T12:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b2a2f0 0x555717ef98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b324d0 0x555717ef41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717ef46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b1740 con 0x555717b2a2f0 2024-05-14T12:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b3340 con 0x555717b324d0 2024-05-14T12:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7f00047ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b1e10 con 0x555717b531b0 2024-05-14T12:27:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.157+0000 7efff7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b2a2f0 0x555717ef98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7effee000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b324d0 0x555717ef41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7efff7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b2a2f0 0x555717ef98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36388/0 (socket says 172.21.15.47:36388) 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7efff7400640 1 -- 172.21.15.47:0/1350144229 learned_addr learned my addr 172.21.15.47:0/1350144229 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7effee000640 1 -- 172.21.15.47:0/1350144229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 msgr2=0x555717ef46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7effee000640 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717ef46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7effee000640 1 -- 172.21.15.47:0/1350144229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b2a2f0 msgr2=0x555717ef98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7effee000640 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b2a2f0 0x555717ef98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7effee000640 1 -- 172.21.15.47:0/1350144229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555717efff00 con 0x555717b324d0 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7efff7400640 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b2a2f0 0x555717ef98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.158+0000 7effee000640 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b324d0 0x555717ef41a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effe002a9e0 tx=0x7effe00314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f2f2e3ea86a323 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.159+0000 7effe7400640 1 -- 172.21.15.47:0/1350144229 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0035040 con 0x555717b324d0 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.159+0000 7effe7400640 1 -- 172.21.15.47:0/1350144229 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe0048e50 con 0x555717b324d0 2024-05-14T12:27:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.159+0000 7effe7400640 1 -- 172.21.15.47:0/1350144229 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0031800 con 0x555717b324d0 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.159+0000 7f00047ab740 1 -- 172.21.15.47:0/1350144229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b324d0 msgr2=0x555717ef41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.159+0000 7f00047ab740 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b324d0 0x555717ef41a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effe002a9e0 tx=0x7effe00314a0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 -- 172.21.15.47:0/1350144229 shutdown_connections 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717ef46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b324d0 0x555717ef41a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 --2- 172.21.15.47:0/1350144229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b2a2f0 0x555717ef98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 -- 172.21.15.47:0/1350144229 >> 172.21.15.47:0/1350144229 conn(0x555717b47300 msgr2=0x555717ef3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 -- 172.21.15.47:0/1350144229 shutdown_connections 2024-05-14T12:27:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 -- 172.21.15.47:0/1350144229 wait complete. 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 -- start start 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.160+0000 7f00047ab740 1 Processor -- start 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7f00047ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717f059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7f00047ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717f05ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7f00047ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f72b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7f00047ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b2bb0 con 0x555717b324d0 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7f00047ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efff81b24e0 con 0x555717b2a2f0 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7f00047ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efff81af700 con 0x555717b531b0 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7f00047ab740 10 client.0 _ll_register_callbacks cb 0x7efff0009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7effee000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717f05ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7effee000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717f05ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36394/0 (socket says 172.21.15.47:36394) 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7effee000640 1 -- 172.21.15.47:0/2325412608 learned_addr learned my addr 172.21.15.47:0/2325412608 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7efff7400640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717f059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.161+0000 7efff7400640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f72b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effee000640 1 -- 172.21.15.47:0/2325412608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 msgr2=0x555717f72b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effee000640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f72b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effee000640 1 -- 172.21.15.47:0/2325412608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 msgr2=0x555717f059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effee000640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717f059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effee000640 1 -- 172.21.15.47:0/2325412608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555717f73070 con 0x555717b324d0 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7efff7400640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f72b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effee000640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717f05ef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effe002a9b0 tx=0x7effe0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e08333be09932b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effe4c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effe4c00640 1 -- 172.21.15.47:0/2325412608 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0035040 con 0x555717b324d0 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe0048e50 con 0x555717b324d0 2024-05-14T12:27:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.162+0000 7effe4c00640 1 -- 172.21.15.47:0/2325412608 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7effe00038c0 con 0x555717b324d0 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7effe4c00640 1 -- 172.21.15.47:0/2325412608 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7effe0003ac0 con 0x555717b324d0 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 10 client.15363 fetch_fsmap learned FSMap version 31 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555717f74230 con 0x555717b324d0 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7effe4c00640 1 -- 172.21.15.47:0/2325412608 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe0048e50 con 0x555717b324d0 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7effe4c00640 1 -- 172.21.15.47:0/2325412608 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7effe003c440 con 0x555717b324d0 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 10 client.15363 fetch_fsmap finished waiting for FSMap version 31 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 10 client.15363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 20 client.15363 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717ae71c0 0x555717f76c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 4 client.15363 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:27:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.163+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555717e60fd0 con 0x555717ae71c0 2024-05-14T12:27:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.164+0000 7efff7400640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717ae71c0 0x555717f76c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.164+0000 7efff7400640 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717ae71c0 0x555717f76c60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f15abbee3268e680 server_cookie=ab7627ad8677fdb8 in_seq=0 out_seq=0 2024-05-14T12:27:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.164+0000 7effe4c00640 10 client.15363 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7effe4c00640 1 -- 172.21.15.47:0/2325412608 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555717e60fd0 con 0x555717ae71c0 2024-05-14T12:27:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7effe4c00640 10 client.15363 handle_command_reply: tid=0 2024-05-14T12:27:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 client.15363 shutdown 2024-05-14T12:27:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 msgr2=0x555717f05ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717f05ef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effe002a9b0 tx=0x7effe0005f30 comp rx=0 tx=0).stop 2024-05-14T12:27:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 shutdown_connections 2024-05-14T12:27:37.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555717ae71c0 0x555717f76c60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555717b531b0 0x555717f72b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555717b324d0 0x555717f05ef0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 --2- 172.21.15.47:0/2325412608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555717b2a2f0 0x555717f059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7effe4c00640 0 client.15363 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:37.222 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 >> 172.21.15.47:0/2325412608 conn(0x555717b47300 msgr2=0x555717ef44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:37.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 shutdown_connections 2024-05-14T12:27:37.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.220+0000 7f00047ab740 1 -- 172.21.15.47:0/2325412608 wait complete. 2024-05-14T12:27:37.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7f00047ab740 20 client.15363 trim_cache size 0 max 16384 2024-05-14T12:27:37.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:27:37.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:27:37.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:27:37.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:27:37.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effdc0b28a0 msgr2=0x7effdc0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effdc0b28a0 0x7effdc0b4db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7effe8003fd0 tx=0x7effe80045f0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff810a0d0 msgr2=0x7efff81a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:37.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff810a0d0 0x7efff81a07b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effe800e9f0 tx=0x7effe800edf0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 shutdown_connections 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effdc0b28a0 0x7effdc0b4db0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efff8110010 0x7efff81a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff810b310 0x7efff81a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 --2- 172.21.15.47:0/2391990696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efff810a0d0 0x7efff81a07b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.221+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 >> 172.21.15.47:0/2391990696 conn(0x7efff8078ce0 msgr2=0x7efff810bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.222+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 shutdown_connections 2024-05-14T12:27:37.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:37.222+0000 7efff7e00640 1 -- 172.21.15.47:0/2391990696 wait complete. 2024-05-14T12:27:37.324 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-05-14T12:27:37.332 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-05-14T12:27:37.589 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-05-14T12:27:37.596 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-05-14T12:27:37.692 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-05-14T12:27:37.699 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-05-14T12:27:37.784 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-05-14T12:27:37.792 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-05-14T12:27:37.883 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-05-14T12:27:37.891 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-05-14T12:27:37.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:37 smithi047 ceph-mon[31254]: pgmap v523: 97 pgs: 97 active+clean; 6.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 382 KiB/s wr, 122 op/s 2024-05-14T12:27:38.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:37 smithi073 ceph-mon[35809]: pgmap v523: 97 pgs: 97 active+clean; 6.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 382 KiB/s wr, 122 op/s 2024-05-14T12:27:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:37 smithi066 ceph-mon[35981]: pgmap v523: 97 pgs: 97 active+clean; 6.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 382 KiB/s wr, 122 op/s 2024-05-14T12:27:38.172 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-05-14T12:27:38.179 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-05-14T12:27:38.386 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-05-14T12:27:38.393 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-05-14T12:27:38.607 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-05-14T12:27:38.614 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-05-14T12:27:38.736 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-05-14T12:27:38.744 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-05-14T12:27:38.865 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-05-14T12:27:38.872 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-05-14T12:27:39.033 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-05-14T12:27:39.041 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr:In file included from parser.h:22, 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr: from parser.c:25: 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘init_filesys’: 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.100 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.101 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.102 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.103 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-14T12:27:39.104 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘init_tg_stats’: 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-14T12:27:39.105 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.106 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.107 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-05-14T12:27:39.108 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-14T12:27:39.109 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.164 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘get_optstr’: 2024-05-14T12:27:39.164 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-05-14T12:27:39.165 INFO:tasks.workunit.client.0.smithi047.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-05-14T12:27:39.165 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.165 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:200:14: note: source object declared here 2024-05-14T12:27:39.165 INFO:tasks.workunit.client.0.smithi047.stderr: 200 | char temp[BUFSIZE]; 2024-05-14T12:27:39.165 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~ 2024-05-14T12:27:39.172 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘size64_convert’: 2024-05-14T12:27:39.172 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-05-14T12:27:39.172 INFO:tasks.workunit.client.0.smithi047.stderr: 119 | memcpy(unit, "\0", 3); 2024-05-14T12:27:39.172 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-14T12:27:39.533 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-05-14T12:27:39.540 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-05-14T12:27:39.641 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-05-14T12:27:39.648 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-05-14T12:27:39.792 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-05-14T12:27:39.800 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-05-14T12:27:39.872 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-05-14T12:27:39.881 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-05-14T12:27:39.943 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-14T12:27:39.944 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd .. 2024-05-14T12:27:39.944 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir tmp 2024-05-14T12:27:39.953 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd tmp 2024-05-14T12:27:39.953 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in $mydir/*.ffsb 2024-05-14T12:27:39.953 INFO:tasks.workunit.client.0.smithi047.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-05-14T12:27:39.956 INFO:tasks.workunit.client.0.smithi047.stdout:FFSB version 6.0-RC2 started 2024-05-14T12:27:39.956 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.964 INFO:tasks.workunit.client.0.smithi047.stdout:benchmark time = 300 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout:ThreadGroup 0 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout:================ 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: num_threads = 32 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: read_random = off 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: read_size = 0 (0B) 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: read_blocksize = 0 (0B) 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: read_skip = off 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: read_skipsize = 0 (0B) 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: write_random = on 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: write_size = 5242880 (5MB) 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: fsync_file = 0 2024-05-14T12:27:39.965 INFO:tasks.workunit.client.0.smithi047.stdout: write_blocksize = 4096 (4KB) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: wait time = 0 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: op weights 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: read = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: readall = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: write = 1 (100.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: create = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: append = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: delete = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: metaop = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: createdir = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: stat = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: writeall = 0 (0.00%) 2024-05-14T12:27:39.966 INFO:tasks.workunit.client.0.smithi047.stdout: writeall_fsync = 0 (0.00%) 2024-05-14T12:27:39.967 INFO:tasks.workunit.client.0.smithi047.stdout: open_close = 0 (0.00%) 2024-05-14T12:27:39.967 INFO:tasks.workunit.client.0.smithi047.stdout: write_fsync = 0 (0.00%) 2024-05-14T12:27:39.967 INFO:tasks.workunit.client.0.smithi047.stdout: create_fsync = 0 (0.00%) 2024-05-14T12:27:39.969 INFO:tasks.workunit.client.0.smithi047.stdout: append_fsync = 0 (0.00%) 2024-05-14T12:27:39.969 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.969 INFO:tasks.workunit.client.0.smithi047.stdout:FileSystem . 2024-05-14T12:27:39.969 INFO:tasks.workunit.client.0.smithi047.stdout:========== 2024-05-14T12:27:39.969 INFO:tasks.workunit.client.0.smithi047.stdout: num_dirs = 0 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: starting files = 128 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: min file size = 104857600 (100MB) 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: max file size = 104857600 (100MB) 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: directio = off 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: alignedio = on 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: bufferedio = off 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: aging is off 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: current utilization = 0.00% 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:27:39.970 INFO:tasks.workunit.client.0.smithi047.stdout:checking existing fs: . 2024-05-14T12:27:39.971 INFO:tasks.workunit.client.0.smithi047.stdout:recreating new fileset 2024-05-14T12:27:39.971 INFO:tasks.workunit.client.0.smithi047.stderr:opendir: No such file or directory 2024-05-14T12:27:39.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:39 smithi047 ceph-mon[31254]: pgmap v524: 97 pgs: 97 active+clean; 7.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 355 KiB/s wr, 82 op/s 2024-05-14T12:27:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:39 smithi073 ceph-mon[35809]: pgmap v524: 97 pgs: 97 active+clean; 7.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 355 KiB/s wr, 82 op/s 2024-05-14T12:27:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:39 smithi066 ceph-mon[35981]: pgmap v524: 97 pgs: 97 active+clean; 7.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 355 KiB/s wr, 82 op/s 2024-05-14T12:27:41.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:41 smithi047 ceph-mon[31254]: pgmap v525: 97 pgs: 97 active+clean; 7.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 356 KiB/s wr, 84 op/s 2024-05-14T12:27:42.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:41 smithi073 ceph-mon[35809]: pgmap v525: 97 pgs: 97 active+clean; 7.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 356 KiB/s wr, 84 op/s 2024-05-14T12:27:42.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:41 smithi066 ceph-mon[35981]: pgmap v525: 97 pgs: 97 active+clean; 7.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 356 KiB/s wr, 84 op/s 2024-05-14T12:27:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:43 smithi047 ceph-mon[31254]: pgmap v526: 97 pgs: 97 active+clean; 25 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 2.1 MiB/s wr, 98 op/s 2024-05-14T12:27:44.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:43 smithi073 ceph-mon[35809]: pgmap v526: 97 pgs: 97 active+clean; 25 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 2.1 MiB/s wr, 98 op/s 2024-05-14T12:27:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:43 smithi066 ceph-mon[35981]: pgmap v526: 97 pgs: 97 active+clean; 25 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 2.1 MiB/s wr, 98 op/s 2024-05-14T12:27:45.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:45 smithi047 ceph-mon[31254]: pgmap v527: 97 pgs: 97 active+clean; 33 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.6 MiB/s wr, 87 op/s 2024-05-14T12:27:46.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:45 smithi073 ceph-mon[35809]: pgmap v527: 97 pgs: 97 active+clean; 33 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.6 MiB/s wr, 87 op/s 2024-05-14T12:27:46.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:45 smithi066 ceph-mon[35981]: pgmap v527: 97 pgs: 97 active+clean; 33 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.6 MiB/s wr, 87 op/s 2024-05-14T12:27:47.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:47 smithi047 ceph-mon[31254]: pgmap v528: 97 pgs: 97 active+clean; 58 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 4.7 MiB/s wr, 97 op/s 2024-05-14T12:27:48.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:47 smithi073 ceph-mon[35809]: pgmap v528: 97 pgs: 97 active+clean; 58 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 4.7 MiB/s wr, 97 op/s 2024-05-14T12:27:48.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:47 smithi066 ceph-mon[35981]: pgmap v528: 97 pgs: 97 active+clean; 58 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 4.7 MiB/s wr, 97 op/s 2024-05-14T12:27:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:49 smithi047 ceph-mon[31254]: pgmap v529: 97 pgs: 97 active+clean; 58 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.7 MiB/s wr, 96 op/s 2024-05-14T12:27:50.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:49 smithi073 ceph-mon[35809]: pgmap v529: 97 pgs: 97 active+clean; 58 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.7 MiB/s wr, 96 op/s 2024-05-14T12:27:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:49 smithi066 ceph-mon[35981]: pgmap v529: 97 pgs: 97 active+clean; 58 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.7 MiB/s wr, 96 op/s 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 -- 172.21.15.47:0/3173816647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e0103aa0 msgr2=0x7fe4e01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3173816647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e0103aa0 0x7fe4e01047a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009900 tx=0x7fe4d402a400 comp rx=0 tx=0).stop 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 -- 172.21.15.47:0/3173816647 shutdown_connections 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3173816647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4e01099e0 0x7fe4e010be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3173816647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104ce0 0x7fe4e01050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3173816647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e0103aa0 0x7fe4e01047a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 -- 172.21.15.47:0/3173816647 >> 172.21.15.47:0/3173816647 conn(0x7fe4e00fecb0 msgr2=0x7fe4e0101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 -- 172.21.15.47:0/3173816647 shutdown_connections 2024-05-14T12:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.510+0000 7fe4e6400640 1 -- 172.21.15.47:0/3173816647 wait complete. 2024-05-14T12:27:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 Processor -- start 2024-05-14T12:27:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 -- start start 2024-05-14T12:27:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4e0103aa0 0x7fe4e019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104ce0 0x7fe4e019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e01099e0 0x7fe4e01a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e010f670 con 0x7fe4e0104ce0 2024-05-14T12:27:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e010f4f0 con 0x7fe4e0103aa0 2024-05-14T12:27:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.512+0000 7fe4e6400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e010f7f0 con 0x7fe4e01099e0 2024-05-14T12:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.513+0000 7fe4e5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e01099e0 0x7fe4e01a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.513+0000 7fe4dfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104ce0 0x7fe4e019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.513+0000 7fe4e5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e01099e0 0x7fe4e01a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50532/0 (socket says 172.21.15.47:50532) 2024-05-14T12:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.513+0000 7fe4e5a00640 1 -- 172.21.15.47:0/3410938077 learned_addr learned my addr 172.21.15.47:0/3410938077 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.513+0000 7fe4e5000640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4e0103aa0 0x7fe4e019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.514+0000 7fe4e5a00640 1 -- 172.21.15.47:0/3410938077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4e0103aa0 msgr2=0x7fe4e019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.514+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4e0103aa0 0x7fe4e019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.514+0000 7fe4e5a00640 1 -- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104ce0 msgr2=0x7fe4e019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.514+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104ce0 0x7fe4e019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.514+0000 7fe4e5a00640 1 -- 172.21.15.47:0/3410938077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e0075000 con 0x7fe4e01099e0 2024-05-14T12:27:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.514+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e01099e0 0x7fe4e01a1710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800efd0 tx=0x7fe4d800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.514+0000 7fe4dd600640 1 -- 172.21.15.47:0/3410938077 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8003b70 con 0x7fe4e01099e0 2024-05-14T12:27:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.515+0000 7fe4dd600640 1 -- 172.21.15.47:0/3410938077 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d8003d10 con 0x7fe4e01099e0 2024-05-14T12:27:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.515+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e00752f0 con 0x7fe4e01099e0 2024-05-14T12:27:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.515+0000 7fe4dd600640 1 -- 172.21.15.47:0/3410938077 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80108a0 con 0x7fe4e01099e0 2024-05-14T12:27:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.515+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e0075840 con 0x7fe4e01099e0 2024-05-14T12:27:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.521+0000 7fe4dd600640 1 -- 172.21.15.47:0/3410938077 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe4d8004000 con 0x7fe4e01099e0 2024-05-14T12:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.522+0000 7fe4eeb87740 1 Processor -- start 2024-05-14T12:27:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4dd600640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4c80b29a0 0x7fe4c80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4eeb87740 1 -- start start 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4dd600640 1 -- 172.21.15.47:0/3410938077 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe4d80e6060 con 0x7fe4e01099e0 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a3075f6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a30722b2f0 0x55a3075f6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 0x55a3075fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a30755a550 con 0x55a3072541b0 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a3074ffbc0 con 0x55a3072334d0 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a307556510 con 0x55a30722b2f0 2024-05-14T12:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.523+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4c80b29a0 0x7fe4c80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a30722b2f0 0x55a3075f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a30722b2f0 0x55a3075f6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50542/0 (socket says 172.21.15.47:50542) 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 -- 172.21.15.47:0/570739618 learned_addr learned my addr 172.21.15.47:0/570739618 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 0x55a3075fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4e5000640 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a3075f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 -- 172.21.15.47:0/570739618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 msgr2=0x55a3075fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 0x55a3075fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 -- 172.21.15.47:0/570739618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 msgr2=0x55a3075f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a3075f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4dfe00640 1 -- 172.21.15.47:0/570739618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a30726c210 con 0x55a30722b2f0 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.524+0000 7fe4e5000640 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a3075f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.525+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a30722b2f0 0x55a3075f6880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc013a20 tx=0x7fe4cc013ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810975e524129319 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.525+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4c80b29a0 0x7fe4c80b4eb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00f850 tx=0x7fe4cc011000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.525+0000 7fe4d2000640 1 -- 172.21.15.47:0/570739618 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc023070 con 0x55a30722b2f0 2024-05-14T12:27:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.525+0000 7fe4d2000640 1 -- 172.21.15.47:0/570739618 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4cc013240 con 0x55a30722b2f0 2024-05-14T12:27:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.525+0000 7fe4d2000640 1 -- 172.21.15.47:0/570739618 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc004a80 con 0x55a30722b2f0 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 -- 172.21.15.47:0/570739618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a30722b2f0 msgr2=0x55a3075f6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a30722b2f0 0x55a3075f6880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc013a20 tx=0x7fe4cc013ee0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 -- 172.21.15.47:0/570739618 shutdown_connections 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 0x55a3075fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a30722b2f0 0x55a3075f6880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/570739618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a3075f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 -- 172.21.15.47:0/570739618 >> 172.21.15.47:0/570739618 conn(0x55a307248300 msgr2=0x55a3075f1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 -- 172.21.15.47:0/570739618 shutdown_connections 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.526+0000 7fe4eeb87740 1 -- 172.21.15.47:0/570739618 wait complete. 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.527+0000 7fe4eeb87740 1 -- start start 2024-05-14T12:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.527+0000 7fe4eeb87740 1 Processor -- start 2024-05-14T12:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a30722b2f0 0x55a3076085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 0x55a307608ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a30760f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a307606980 con 0x55a30722b2f0 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a307513660 con 0x55a3072334d0 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a307606b00 con 0x55a3072541b0 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4eeb87740 10 client.0 _ll_register_callbacks cb 0x55a3074dd400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a30760f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a30760f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50546/0 (socket says 172.21.15.47:50546) 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5a00640 1 -- 172.21.15.47:0/2416973526 learned_addr learned my addr 172.21.15.47:0/2416973526 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5a00640 1 -- 172.21.15.47:0/2416973526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 msgr2=0x55a307608ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 0x55a307608ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5a00640 1 -- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a30722b2f0 msgr2=0x55a3076085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5000640 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a30722b2f0 0x55a3076085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.528+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a30722b2f0 0x55a3076085a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.529+0000 7fe4e5a00640 1 -- 172.21.15.47:0/2416973526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a307338620 con 0x55a3072541b0 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.529+0000 7fe4e5000640 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a30722b2f0 0x55a3076085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:27:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.529+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a30760f9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80df700 tx=0x7fe4d80a90b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62be3c4be40c010 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.529+0000 7fe4c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.529+0000 7fe4c6a00640 1 -- 172.21.15.47:0/2416973526 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80c2020 con 0x55a3072541b0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.529+0000 7fe4c6a00640 1 -- 172.21.15.47:0/2416973526 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe4d80ad170 con 0x55a3072541b0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.530+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4cc013240 con 0x55a3072541b0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.530+0000 7fe4c6a00640 1 -- 172.21.15.47:0/2416973526 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe4d80a8d30 con 0x55a3072541b0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.530+0000 7fe4eeb87740 10 client.25504 fetch_fsmap learned FSMap version 31 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.530+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a307600880 con 0x55a3072541b0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.531+0000 7fe4c6a00640 1 -- 172.21.15.47:0/2416973526 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4cc013240 con 0x55a3072541b0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.531+0000 7fe4c6a00640 1 -- 172.21.15.47:0/2416973526 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fe4d80b1bf0 con 0x55a3072541b0 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.531+0000 7fe4eeb87740 10 client.25504 fetch_fsmap finished waiting for FSMap version 31 2024-05-14T12:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.531+0000 7fe4eeb87740 10 client.25504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.531+0000 7fe4eeb87740 20 client.25504 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.532+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a307212d80 0x55a307604140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.532+0000 7fe4eeb87740 4 client.25504 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:27:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.532+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a307568160 con 0x55a307212d80 2024-05-14T12:27:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.532+0000 7fe4e5000640 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a307212d80 0x55a307604140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.534+0000 7fe4e5000640 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a307212d80 0x55a307604140 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3bec84275a3a678 server_cookie=2b440fb055b48a33 in_seq=0 out_seq=0 2024-05-14T12:27:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.534+0000 7fe4c6a00640 10 client.25504 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.539+0000 7fe4c6a00640 1 -- 172.21.15.47:0/2416973526 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a307568160 con 0x55a307212d80 2024-05-14T12:27:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.539+0000 7fe4c6a00640 10 client.25504 handle_command_reply: tid=0 2024-05-14T12:27:50.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.539+0000 7fe4eeb87740 1 client.25504 shutdown 2024-05-14T12:27:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.541+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 msgr2=0x55a30760f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.541+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a30760f9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80df700 tx=0x7fe4d80a90b0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.544+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 shutdown_connections 2024-05-14T12:27:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.544+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a307212d80 0x55a307604140 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.545+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a30760f9d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.545+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a3072334d0 0x55a307608ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.545+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/2416973526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a30722b2f0 0x55a3076085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.545+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 >> 172.21.15.47:0/2416973526 conn(0x55a307248300 msgr2=0x55a3075f4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.545+0000 7fe4c6a00640 0 client.25504 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.546+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 shutdown_connections 2024-05-14T12:27:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.546+0000 7fe4eeb87740 1 -- 172.21.15.47:0/2416973526 wait complete. 2024-05-14T12:27:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.546+0000 7fe4eeb87740 20 client.25504 trim_cache size 0 max 16384 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.564+0000 7fe4eeb87740 1 Processor -- start 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.565+0000 7fe4eeb87740 1 -- start start 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.565+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a3075f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.565+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072334d0 0x55a30760f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.565+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a3075f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.565+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01a90f0 con 0x55a3072334d0 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.565+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01aacf0 con 0x55a30722b2f0 2024-05-14T12:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.565+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01a97c0 con 0x55a3072541b0 2024-05-14T12:27:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a3075f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a3075f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41292/0 (socket says 172.21.15.47:41292) 2024-05-14T12:27:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 -- 172.21.15.47:0/3255618901 learned_addr learned my addr 172.21.15.47:0/3255618901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a3075f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 -- 172.21.15.47:0/3255618901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 msgr2=0x55a3075f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a3075f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 -- 172.21.15.47:0/3255618901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072334d0 msgr2=0x55a30760f8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072334d0 0x55a30760f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 -- 172.21.15.47:0/3255618901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3075ed4a0 con 0x55a30722b2f0 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.566+0000 7fe4e5000640 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a3075f1a70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4000c00 tx=0x7fe4d40314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f58f316141d3700 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.567+0000 7fe4d1600640 1 -- 172.21.15.47:0/3255618901 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4035070 con 0x55a30722b2f0 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.567+0000 7fe4d1600640 1 -- 172.21.15.47:0/3255618901 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d404a070 con 0x55a30722b2f0 2024-05-14T12:27:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.567+0000 7fe4d1600640 1 -- 172.21.15.47:0/3255618901 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4003970 con 0x55a30722b2f0 2024-05-14T12:27:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.568+0000 7fe4eeb87740 1 -- 172.21.15.47:0/3255618901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 msgr2=0x55a3075f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.568+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a3075f1a70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4000c00 tx=0x7fe4d40314a0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 -- 172.21.15.47:0/3255618901 shutdown_connections 2024-05-14T12:27:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072541b0 0x55a3075f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072334d0 0x55a30760f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/3255618901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a3075f1a70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 -- 172.21.15.47:0/3255618901 >> 172.21.15.47:0/3255618901 conn(0x55a307248300 msgr2=0x55a3075f1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 -- 172.21.15.47:0/3255618901 shutdown_connections 2024-05-14T12:27:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 -- 172.21.15.47:0/3255618901 wait complete. 2024-05-14T12:27:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.569+0000 7fe4eeb87740 1 -- start start 2024-05-14T12:27:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.570+0000 7fe4eeb87740 1 Processor -- start 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.570+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a30760a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.570+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072334d0 0x55a30760ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.570+0000 7fe4eeb87740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a307684ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.570+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01aa560 con 0x55a3072541b0 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.570+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01a9e90 con 0x55a30722b2f0 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4eeb87740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01a70b0 con 0x55a3072334d0 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4eeb87740 10 client.0 _ll_register_callbacks cb 0x7fe4d80e3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a30760a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a30760a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41294/0 (socket says 172.21.15.47:41294) 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 -- 172.21.15.47:0/741113207 learned_addr learned my addr 172.21.15.47:0/741113207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072334d0 0x55a30760ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 -- 172.21.15.47:0/741113207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072334d0 msgr2=0x55a30760ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5a00640 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a307684ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072334d0 0x55a30760ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 -- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 msgr2=0x55a307684ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a307684ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.571+0000 7fe4e5000640 1 -- 172.21.15.47:0/741113207 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a30760b300 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.572+0000 7fe4e5000640 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a30760a750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4d402a920 tx=0x7fe4d4004370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a020e04b1c50930 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.572+0000 7fe4c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.572+0000 7fe4c6a00640 1 -- 172.21.15.47:0/741113207 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4052070 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.572+0000 7fe4c6a00640 1 -- 172.21.15.47:0/741113207 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe4d40455e0 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.572+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d404a070 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.573+0000 7fe4c6a00640 1 -- 172.21.15.47:0/741113207 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe4d405c050 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.573+0000 7fe4eeb87740 10 client.25490 fetch_fsmap learned FSMap version 31 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.573+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a307686110 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.573+0000 7fe4c6a00640 1 -- 172.21.15.47:0/741113207 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d404a070 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.573+0000 7fe4c6a00640 1 -- 172.21.15.47:0/741113207 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fe4d40315a0 con 0x55a30722b2f0 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.573+0000 7fe4eeb87740 10 client.25490 fetch_fsmap finished waiting for FSMap version 31 2024-05-14T12:27:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.574+0000 7fe4eeb87740 10 client.25490 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:27:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.574+0000 7fe4eeb87740 20 client.25490 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.574+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a3071e81c0 0x55a307688bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.574+0000 7fe4eeb87740 4 client.25490 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:27:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.574+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a307561fd0 con 0x55a3071e81c0 2024-05-14T12:27:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.574+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a3071e81c0 0x55a307688bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.575+0000 7fe4dfe00640 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a3071e81c0 0x55a307688bd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f0ea48e9876d49 server_cookie=8fd030f19b3c195e in_seq=0 out_seq=0 2024-05-14T12:27:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.575+0000 7fe4c6a00640 10 client.25490 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.670+0000 7fe4c6a00640 1 -- 172.21.15.47:0/741113207 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a307561fd0 con 0x55a3071e81c0 2024-05-14T12:27:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.670+0000 7fe4c6a00640 10 client.25490 handle_command_reply: tid=0 2024-05-14T12:27:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.671+0000 7fe4eeb87740 1 client.25490 shutdown 2024-05-14T12:27:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.671+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 msgr2=0x55a30760a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.671+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a30760a750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4d402a920 tx=0x7fe4d4004370 comp rx=0 tx=0).stop 2024-05-14T12:27:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 shutdown_connections 2024-05-14T12:27:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a3071e81c0 0x55a307688bd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3072541b0 0x55a307684ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3072334d0 0x55a30760ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 --2- 172.21.15.47:0/741113207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a30722b2f0 0x55a30760a750 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4c6a00640 0 client.25490 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 >> 172.21.15.47:0/741113207 conn(0x55a307248300 msgr2=0x55a3075f1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 shutdown_connections 2024-05-14T12:27:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.673+0000 7fe4eeb87740 1 -- 172.21.15.47:0/741113207 wait complete. 2024-05-14T12:27:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.674+0000 7fe4eeb87740 20 client.25490 trim_cache size 0 max 16384 2024-05-14T12:27:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:27:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:27:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:27:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4c80b29a0 msgr2=0x7fe4c80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4c80b29a0 0x7fe4c80b4eb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00f850 tx=0x7fe4cc011000 comp rx=0 tx=0).stop 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e01099e0 msgr2=0x7fe4e01a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e01099e0 0x7fe4e01a1710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800efd0 tx=0x7fe4d800c6a0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 shutdown_connections 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe4c80b29a0 0x7fe4c80b4eb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e01099e0 0x7fe4e01a1710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e0104ce0 0x7fe4e019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 --2- 172.21.15.47:0/3410938077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4e0103aa0 0x7fe4e019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 >> 172.21.15.47:0/3410938077 conn(0x7fe4e00fecb0 msgr2=0x7fe4e01059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 shutdown_connections 2024-05-14T12:27:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:27:50.675+0000 7fe4e6400640 1 -- 172.21.15.47:0/3410938077 wait complete. 2024-05-14T12:27:50.700 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-14T12:27:50.700 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.5 2024-05-14T12:27:50.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:27:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:27:51.920 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:51 smithi047 ceph-mon[31254]: pgmap v530: 97 pgs: 97 active+clean; 326 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 92 op/s 2024-05-14T12:27:52.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:51 smithi073 ceph-mon[35809]: pgmap v530: 97 pgs: 97 active+clean; 326 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 92 op/s 2024-05-14T12:27:52.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:51 smithi066 ceph-mon[35981]: pgmap v530: 97 pgs: 97 active+clean; 326 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 92 op/s 2024-05-14T12:27:53.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:53 smithi047 ceph-mon[31254]: pgmap v531: 97 pgs: 97 active+clean; 886 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 74 MiB/s wr, 106 op/s 2024-05-14T12:27:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:53 smithi073 ceph-mon[35809]: pgmap v531: 97 pgs: 97 active+clean; 886 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 74 MiB/s wr, 106 op/s 2024-05-14T12:27:54.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:53 smithi066 ceph-mon[35981]: pgmap v531: 97 pgs: 97 active+clean; 886 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 74 MiB/s wr, 106 op/s 2024-05-14T12:27:54.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.342+0000 7f0781c00700 1 -- 172.21.15.47:0/2918712293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c10b520 msgr2=0x7f077c07bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:54.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.342+0000 7f0781c00700 1 --2- 172.21.15.47:0/2918712293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c10b520 0x7f077c07bae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f077400d960 tx=0x7f077400dc70 comp rx=0 tx=0).stop 2024-05-14T12:27:54.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.343+0000 7f0781c00700 1 -- 172.21.15.47:0/2918712293 shutdown_connections 2024-05-14T12:27:54.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.343+0000 7f0781c00700 1 --2- 172.21.15.47:0/2918712293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c10b520 0x7f077c07bae0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.343+0000 7f0781c00700 1 --2- 172.21.15.47:0/2918712293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f077c110db0 0x7f077c10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.343+0000 7f0781c00700 1 --2- 172.21.15.47:0/2918712293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077c111250 0x7f077c10ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.343+0000 7f0781c00700 1 -- 172.21.15.47:0/2918712293 >> 172.21.15.47:0/2918712293 conn(0x7f077c06f4d0 msgr2=0x7f077c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:54.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.344+0000 7f0781c00700 1 -- 172.21.15.47:0/2918712293 shutdown_connections 2024-05-14T12:27:54.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.345+0000 7f0781c00700 1 -- 172.21.15.47:0/2918712293 wait complete. 2024-05-14T12:27:54.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.347+0000 7f0781c00700 1 Processor -- start 2024-05-14T12:27:54.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.348+0000 7f0781c00700 1 -- start start 2024-05-14T12:27:54.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.348+0000 7f0781c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077c110db0 0x7f077c084db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:54.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.348+0000 7f0781c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f077c111250 0x7f077c085310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:54.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.348+0000 7f0781c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c07ef20 0x7f077c07f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:54.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.348+0000 7f0781c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f077c07dab0 con 0x7f077c111250 2024-05-14T12:27:54.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.348+0000 7f0781c00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f077c07d930 con 0x7f077c110db0 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.348+0000 7f0781c00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f077c07dc30 con 0x7f077c07ef20 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.349+0000 7f0772000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f077c111250 0x7f077c085310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.350+0000 7f077aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077c110db0 0x7f077c084db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.350+0000 7f0772000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f077c111250 0x7f077c085310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38558/0 (socket says 172.21.15.47:38558) 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.350+0000 7f0772000700 1 -- 172.21.15.47:0/887291187 learned_addr learned my addr 172.21.15.47:0/887291187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.350+0000 7f077b400700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c07ef20 0x7f077c07f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.351+0000 7f077aa00700 1 -- 172.21.15.47:0/887291187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c07ef20 msgr2=0x7f077c07f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.351+0000 7f077aa00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c07ef20 0x7f077c07f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.351+0000 7f077aa00700 1 -- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f077c111250 msgr2=0x7f077c085310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.351+0000 7f077aa00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f077c111250 0x7f077c085310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.352+0000 7f077aa00700 1 -- 172.21.15.47:0/887291187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c07fae0 con 0x7f077c110db0 2024-05-14T12:27:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.354+0000 7f077aa00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077c110db0 0x7f077c084db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f076c007ee0 tx=0x7f076c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.355+0000 7f0773e00700 1 -- 172.21.15.47:0/887291187 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c00ddd0 con 0x7f077c110db0 2024-05-14T12:27:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.355+0000 7f0773e00700 1 -- 172.21.15.47:0/887291187 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f076c0158b0 con 0x7f077c110db0 2024-05-14T12:27:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.355+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c1cf810 con 0x7f077c110db0 2024-05-14T12:27:54.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.355+0000 7f0773e00700 1 -- 172.21.15.47:0/887291187 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c0145e0 con 0x7f077c110db0 2024-05-14T12:27:54.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.356+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c1cfc60 con 0x7f077c110db0 2024-05-14T12:27:54.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.361+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c10c070 con 0x7f077c110db0 2024-05-14T12:27:54.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.369+0000 7f0773e00700 1 -- 172.21.15.47:0/887291187 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f076c014780 con 0x7f077c110db0 2024-05-14T12:27:54.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.374+0000 7f0773e00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07600b2980 0x7f07600b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:54.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.375+0000 7f0773e00700 1 -- 172.21.15.47:0/887291187 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f076c0e1ac0 con 0x7f077c110db0 2024-05-14T12:27:54.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.375+0000 7f0772000700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07600b2980 0x7f07600b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:54.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.377+0000 7f0772000700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07600b2980 0x7f07600b4e90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f076400afd0 tx=0x7f0764011040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:54.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.377+0000 7f0773e00700 1 -- 172.21.15.47:0/887291187 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f076c010070 con 0x7f077c110db0 2024-05-14T12:27:54.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.909+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f077c1cfec0 con 0x7f077c110db0 2024-05-14T12:27:54.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.911+0000 7f0773e00700 1 -- 172.21.15.47:0/887291187 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11926 (secure 0 0 0) 0x7f076c0a97a0 con 0x7f077c110db0 2024-05-14T12:27:54.913 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:27:54.913 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:27:27.022249+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24521,24535,24517,24502,24490]},"id":1}]} 2024-05-14T12:27:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.917+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07600b2980 msgr2=0x7f07600b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.917+0000 7f0781c00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07600b2980 0x7f07600b4e90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f076400afd0 tx=0x7f0764011040 comp rx=0 tx=0).stop 2024-05-14T12:27:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.917+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077c110db0 msgr2=0x7f077c084db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.917+0000 7f0781c00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077c110db0 0x7f077c084db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f076c007ee0 tx=0x7f076c00d3b0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 shutdown_connections 2024-05-14T12:27:54.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07600b2980 0x7f07600b4e90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f077c07ef20 0x7f077c07f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077c110db0 0x7f077c084db0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 --2- 172.21.15.47:0/887291187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f077c111250 0x7f077c085310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:54.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 >> 172.21.15.47:0/887291187 conn(0x7f077c06f4d0 msgr2=0x7f077c10e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 shutdown_connections 2024-05-14T12:27:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:54.918+0000 7f0781c00700 1 -- 172.21.15.47:0/887291187 wait complete. 2024-05-14T12:27:54.921 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 31 2024-05-14T12:27:55.981 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 87.5 --await-for 42.0' 2024-05-14T12:27:55.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 87.5 --await-for 42.0 2024-05-14T12:27:55.991 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:55 smithi047 ceph-mon[31254]: pgmap v532: 97 pgs: 97 active+clean; 1022 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 83 MiB/s wr, 86 op/s 2024-05-14T12:27:55.991 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:55 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/887291187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:27:56.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:55 smithi073 ceph-mon[35809]: pgmap v532: 97 pgs: 97 active+clean; 1022 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 83 MiB/s wr, 86 op/s 2024-05-14T12:27:56.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:55 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/887291187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:27:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:55 smithi066 ceph-mon[35981]: pgmap v532: 97 pgs: 97 active+clean; 1022 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 83 MiB/s wr, 86 op/s 2024-05-14T12:27:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:55 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/887291187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:27:56.589 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:27:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:57 smithi047 ceph-mon[31254]: pgmap v533: 97 pgs: 97 active+clean; 1.8 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 MiB/s wr, 102 op/s 2024-05-14T12:27:58.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:57 smithi073 ceph-mon[35809]: pgmap v533: 97 pgs: 97 active+clean; 1.8 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 MiB/s wr, 102 op/s 2024-05-14T12:27:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:57 smithi066 ceph-mon[35981]: pgmap v533: 97 pgs: 97 active+clean; 1.8 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 MiB/s wr, 102 op/s 2024-05-14T12:27:58.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:27:58 smithi047 ceph-mon[31254]: pgmap v534: 97 pgs: 97 active+clean; 2.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 191 MiB/s wr, 106 op/s 2024-05-14T12:27:59.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:27:58 smithi066 ceph-mon[35981]: pgmap v534: 97 pgs: 97 active+clean; 2.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 191 MiB/s wr, 106 op/s 2024-05-14T12:27:59.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:27:58 smithi073 ceph-mon[35809]: pgmap v534: 97 pgs: 97 active+clean; 2.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 191 MiB/s wr, 106 op/s 2024-05-14T12:27:59.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.253+0000 7f145a800700 1 -- 172.21.15.47:0/1721224171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14541054c0 msgr2=0x7f14541058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.253+0000 7f145a800700 1 --2- 172.21.15.47:0/1721224171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14541054c0 0x7f14541058d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f144400b0a0 tx=0x7f144400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.253+0000 7f145a800700 1 -- 172.21.15.47:0/1721224171 shutdown_connections 2024-05-14T12:27:59.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.253+0000 7f145a800700 1 --2- 172.21.15.47:0/1721224171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f145410e8f0 0x7f1454110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.253+0000 7f145a800700 1 --2- 172.21.15.47:0/1721224171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14541054c0 0x7f14541058d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.253+0000 7f145a800700 1 --2- 172.21.15.47:0/1721224171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1454105e10 0x7f145410e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.253+0000 7f145a800700 1 -- 172.21.15.47:0/1721224171 >> 172.21.15.47:0/1721224171 conn(0x7f14540fedc0 msgr2=0x7f14541011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:59.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.254+0000 7f145a800700 1 -- 172.21.15.47:0/1721224171 shutdown_connections 2024-05-14T12:27:59.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.255+0000 7f145a800700 1 -- 172.21.15.47:0/1721224171 wait complete. 2024-05-14T12:27:59.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 Processor -- start 2024-05-14T12:27:59.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 -- start start 2024-05-14T12:27:59.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14541054c0 0x7f14541031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454105e10 0x7f14541036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f145410e8f0 0x7f1454103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14541144b0 con 0x7f14541054c0 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1454114330 con 0x7f1454105e10 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.256+0000 7f145a800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1454114630 con 0x7f145410e8f0 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f1453400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14541054c0 0x7f14541031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454105e10 0x7f14541036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454105e10 0x7f14541036f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60352/0 (socket says 172.21.15.47:60352) 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f1453400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14541054c0 0x7f14541031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56214/0 (socket says 172.21.15.47:56214) 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 -- 172.21.15.47:0/3264835197 learned_addr learned my addr 172.21.15.47:0/3264835197 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:59.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f1453e00700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f145410e8f0 0x7f1454103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 -- 172.21.15.47:0/3264835197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f145410e8f0 msgr2=0x7f1454103c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f145410e8f0 0x7f1454103c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 -- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14541054c0 msgr2=0x7f14541031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14541054c0 0x7f14541031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.257+0000 7f144aa00700 1 -- 172.21.15.47:0/3264835197 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14541a9190 con 0x7f1454105e10 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.258+0000 7f144aa00700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454105e10 0x7f14541036f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e9a0 tx=0x7f143c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.258+0000 7f1450c00700 1 -- 172.21.15.47:0/3264835197 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c00ca10 con 0x7f1454105e10 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.258+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14541a9480 con 0x7f1454105e10 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.258+0000 7f1450c00700 1 -- 172.21.15.47:0/3264835197 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f143c00cbb0 con 0x7f1454105e10 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.258+0000 7f1450c00700 1 -- 172.21.15.47:0/3264835197 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c018680 con 0x7f1454105e10 2024-05-14T12:27:59.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.258+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14541a9a10 con 0x7f1454105e10 2024-05-14T12:27:59.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.263+0000 7f146925bb80 1 Processor -- start 2024-05-14T12:27:59.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.263+0000 7f146925bb80 1 -- start start 2024-05-14T12:27:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.263+0000 7f146925bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.263+0000 7f146925bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.263+0000 7f146925bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f146925bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b74e3e7bb0 con 0x55b74e347fd0 2024-05-14T12:27:59.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f146925bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b74e3858f0 con 0x55b74e4c5aa0 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f146925bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b74e3e3b70 con 0x55b74e4c5690 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f1453e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f1453e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56226/0 (socket says 172.21.15.47:56226) 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f1453e00700 1 -- 172.21.15.47:0/3741117796 learned_addr learned my addr 172.21.15.47:0/3741117796 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f1453400700 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f1450c00700 1 -- 172.21.15.47:0/3264835197 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f143c018820 con 0x7f1454105e10 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f144aa00700 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f1453e00700 1 -- 172.21.15.47:0/3741117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 msgr2=0x55b74e4cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.264+0000 7f1453e00700 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f1453e00700 1 -- 172.21.15.47:0/3741117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 msgr2=0x55b74e4d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f1453e00700 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f1453e00700 1 -- 172.21.15.47:0/3741117796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e334a60 con 0x55b74e347fd0 2024-05-14T12:27:59.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f144aa00700 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:27:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f1453e00700 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4c5150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f144c009cb0 tx=0x7f144c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673cc966f2a39eea server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f1448c00700 1 -- 172.21.15.47:0/3741117796 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c011d80 con 0x55b74e347fd0 2024-05-14T12:27:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f1448c00700 1 -- 172.21.15.47:0/3741117796 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f144c0044e0 con 0x55b74e347fd0 2024-05-14T12:27:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.265+0000 7f1448c00700 1 -- 172.21.15.47:0/3741117796 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c019680 con 0x55b74e347fd0 2024-05-14T12:27:59.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.266+0000 7f1450c00700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f14380b2900 0x7f14380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.266+0000 7f1450c00700 1 -- 172.21.15.47:0/3264835197 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f143c0e2380 con 0x7f1454105e10 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.266+0000 7f1453400700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f14380b2900 0x7f14380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.266+0000 7f146925bb80 1 -- 172.21.15.47:0/3741117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 msgr2=0x55b74e4c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.266+0000 7f146925bb80 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4c5150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f144c009cb0 tx=0x7f144c011440 comp rx=0 tx=0).stop 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f146925bb80 1 -- 172.21.15.47:0/3741117796 shutdown_connections 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f146925bb80 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f146925bb80 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4c5150 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f146925bb80 1 --2- 172.21.15.47:0/3741117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f146925bb80 1 -- 172.21.15.47:0/3741117796 >> 172.21.15.47:0/3741117796 conn(0x55b74e386c10 msgr2=0x55b74e4c0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f146925bb80 1 -- 172.21.15.47:0/3741117796 shutdown_connections 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f146925bb80 1 -- 172.21.15.47:0/3741117796 wait complete. 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.267+0000 7f1453400700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f14380b2900 0x7f14380b4e10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f14440062a0 tx=0x7f1444006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.268+0000 7f146925bb80 1 -- start start 2024-05-14T12:27:59.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.268+0000 7f146925bb80 1 Processor -- start 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f146925bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e347fd0 0x55b74e4cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f146925bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f146925bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f146925bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b74e4d2c10 con 0x55b74e4c5690 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f146925bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b74e34dcb0 con 0x55b74e347fd0 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f146925bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b74e4d2d90 con 0x55b74e4c5aa0 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f146925bb80 10 client.0 _ll_register_callbacks cb 0x55b74e37b510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56234/0 (socket says 172.21.15.47:56234) 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 -- 172.21.15.47:0/2897678342 learned_addr learned my addr 172.21.15.47:0/2897678342 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f1453400700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e347fd0 0x55b74e4cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f1453e00700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 -- 172.21.15.47:0/2897678342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5aa0 msgr2=0x55b74e4d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 -- 172.21.15.47:0/2897678342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e347fd0 msgr2=0x55b74e4cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e347fd0 0x55b74e4cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f144aa00700 1 -- 172.21.15.47:0/2897678342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b74e3ad5b0 con 0x55b74e4c5690 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.269+0000 7f1453e00700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f144aa00700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f143c0a9660 tx=0x7f143c010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16392a28ad19834d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f1441600700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f1441600700 1 -- 172.21.15.47:0/2897678342 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c0a9470 con 0x55b74e4c5690 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f1441600700 1 -- 172.21.15.47:0/2897678342 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f143c0b2330 con 0x55b74e4c5690 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f144c0044e0 con 0x55b74e4c5690 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f1441600700 1 -- 172.21.15.47:0/2897678342 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f143c0aa060 con 0x55b74e4c5690 2024-05-14T12:27:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f146925bb80 10 client.15387 fetch_fsmap learned FSMap version 31 2024-05-14T12:27:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.270+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b74e4dd800 con 0x55b74e4c5690 2024-05-14T12:27:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f1441600700 1 -- 172.21.15.47:0/2897678342 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f144c0044e0 con 0x55b74e4c5690 2024-05-14T12:27:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f1441600700 1 -- 172.21.15.47:0/2897678342 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f143c0a52d0 con 0x55b74e4c5690 2024-05-14T12:27:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f146925bb80 10 client.15387 fetch_fsmap finished waiting for FSMap version 31 2024-05-14T12:27:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f146925bb80 10 client.15387 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f146925bb80 20 client.15387 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f146925bb80 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e4dfd90 0x55b74e4e21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f146925bb80 4 client.15387 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b74e492200 con 0x55b74e4dfd90 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.271+0000 7f1453400700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e4dfd90 0x55b74e4e21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.272+0000 7f1453400700 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e4dfd90 0x55b74e4e21b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa57015cc2db7627 server_cookie=942b9e3aa6960ff0 in_seq=0 out_seq=0 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.272+0000 7f1441600700 10 client.15387 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.273+0000 7f1441600700 1 -- 172.21.15.47:0/2897678342 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b74e492200 con 0x55b74e4dfd90 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.273+0000 7f1441600700 10 client.15387 handle_command_reply: tid=0 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.273+0000 7f146925bb80 1 client.15387 shutdown 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.273+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e4c5690 msgr2=0x55b74e4cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.273+0000 7f146925bb80 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f143c0a9660 tx=0x7f143c010c10 comp rx=0 tx=0).stop 2024-05-14T12:27:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.273+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 shutdown_connections 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.273+0000 7f146925bb80 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e4dfd90 0x55b74e4e21b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f146925bb80 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f146925bb80 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e347fd0 0x55b74e4cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f1441600700 0 client.15387 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f146925bb80 1 --2- 172.21.15.47:0/2897678342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e4c5690 0x55b74e4cfd00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 >> 172.21.15.47:0/2897678342 conn(0x55b74e386c10 msgr2=0x55b74e4c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 shutdown_connections 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f146925bb80 1 -- 172.21.15.47:0/2897678342 wait complete. 2024-05-14T12:27:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.274+0000 7f146925bb80 20 client.15387 trim_cache size 0 max 16384 2024-05-14T12:27:59.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.297+0000 7f146925bb80 1 Processor -- start 2024-05-14T12:27:59.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.297+0000 7f146925bb80 1 -- start start 2024-05-14T12:27:59.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.297+0000 7f146925bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f146925bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f146925bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f146925bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14541b0eb0 con 0x55b74e347fd0 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f146925bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14541b2ab0 con 0x55b74e4c5aa0 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f146925bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f14541b1580 con 0x55b74e4c5690 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f144aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f1453400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f1453e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f1453400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56240/0 (socket says 172.21.15.47:56240) 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f1453400700 1 -- 172.21.15.47:0/1960268474 learned_addr learned my addr 172.21.15.47:0/1960268474 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f144aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4dbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:35628/0 (socket says 172.21.15.47:35628) 2024-05-14T12:27:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f144aa00700 1 -- 172.21.15.47:0/1960268474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 msgr2=0x55b74e4e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f144aa00700 1 --2- 172.21.15.47:0/1960268474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4e79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f144aa00700 1 -- 172.21.15.47:0/1960268474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 msgr2=0x55b74e4d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f144aa00700 1 --2- 172.21.15.47:0/1960268474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.298+0000 7f144aa00700 1 -- 172.21.15.47:0/1960268474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e4dca10 con 0x55b74e4c5690 2024-05-14T12:27:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.299+0000 7f144aa00700 1 --2- 172.21.15.47:0/1960268474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4dbca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c510 tx=0x7f143c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668f70210bdb4ce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:59.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.299+0000 7f1443e00700 1 -- 172.21.15.47:0/1960268474 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c0a9960 con 0x55b74e4c5690 2024-05-14T12:27:59.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.299+0000 7f1443e00700 1 -- 172.21.15.47:0/1960268474 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f143c0add10 con 0x55b74e4c5690 2024-05-14T12:27:59.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.299+0000 7f1443e00700 1 -- 172.21.15.47:0/1960268474 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c0a89a0 con 0x55b74e4c5690 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.300+0000 7f146925bb80 1 -- 172.21.15.47:0/1960268474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 msgr2=0x55b74e4dbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.300+0000 7f146925bb80 1 --2- 172.21.15.47:0/1960268474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4dbca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c510 tx=0x7f143c01f000 comp rx=0 tx=0).stop 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.300+0000 7f146925bb80 1 -- 172.21.15.47:0/1960268474 shutdown_connections 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.300+0000 7f146925bb80 1 --2- 172.21.15.47:0/1960268474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.300+0000 7f146925bb80 1 --2- 172.21.15.47:0/1960268474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.300+0000 7f146925bb80 1 --2- 172.21.15.47:0/1960268474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4dbca0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.300+0000 7f146925bb80 1 -- 172.21.15.47:0/1960268474 >> 172.21.15.47:0/1960268474 conn(0x55b74e386c10 msgr2=0x55b74e4ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.301+0000 7f146925bb80 1 -- 172.21.15.47:0/1960268474 shutdown_connections 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.301+0000 7f146925bb80 1 -- 172.21.15.47:0/1960268474 wait complete. 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.301+0000 7f146925bb80 1 -- start start 2024-05-14T12:27:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.301+0000 7f146925bb80 1 Processor -- start 2024-05-14T12:27:59.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f146925bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f146925bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4d86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f146925bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f146925bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14541b2320 con 0x55b74e347fd0 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f146925bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14541b1c50 con 0x55b74e4c5aa0 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f146925bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f14541aee30 con 0x55b74e4c5690 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f146925bb80 10 client.0 _ll_register_callbacks cb 0x55b74e37b510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f144aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4d86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f144aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4d86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:35630/0 (socket says 172.21.15.47:35630) 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f144aa00700 1 -- 172.21.15.47:0/1280542059 learned_addr learned my addr 172.21.15.47:0/1280542059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f1453400700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.302+0000 7f1453e00700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f144aa00700 1 -- 172.21.15.47:0/1280542059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 msgr2=0x55b74e4d4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f144aa00700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f144aa00700 1 -- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 msgr2=0x55b74e4d8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f144aa00700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f144aa00700 1 -- 172.21.15.47:0/1280542059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b74e4d4db0 con 0x55b74e4c5690 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f1453400700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f144aa00700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4d86d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c2d0 tx=0x7f143c010c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d6aa939956df898 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f1441600700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f1441600700 1 -- 172.21.15.47:0/1280542059 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c0a9470 con 0x55b74e4c5690 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f143c0add10 con 0x55b74e4c5690 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f1441600700 1 -- 172.21.15.47:0/1280542059 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f143c0a8bc0 con 0x55b74e4c5690 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.303+0000 7f1441600700 1 -- 172.21.15.47:0/1280542059 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f143c0b27c0 con 0x55b74e4c5690 2024-05-14T12:27:59.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 10 client.25534 fetch_fsmap learned FSMap version 31 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b74e4d4db0 con 0x55b74e4c5690 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f1441600700 1 -- 172.21.15.47:0/1280542059 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f143c0add10 con 0x55b74e4c5690 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f1441600700 1 -- 172.21.15.47:0/1280542059 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f143c0c6070 con 0x55b74e4c5690 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 10 client.25534 fetch_fsmap finished waiting for FSMap version 31 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 10 client.25534 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 20 client.25534 populate_metadata read hostname 'smithi047' 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e54b410 0x55b74e54d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 4 client.25534 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.5, "await_for": 42.0}] 2024-05-14T12:27:59.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.304+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.5, "await_for": 42.0}) -- 0x55b74e3f5590 con 0x55b74e54b410 2024-05-14T12:27:59.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.305+0000 7f1453400700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e54b410 0x55b74e54d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:27:59.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.305+0000 7f1453400700 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e54b410 0x55b74e54d830 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b467e48153b455 server_cookie=b5921fa9c273ec94 in_seq=0 out_seq=0 2024-05-14T12:27:59.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.305+0000 7f1441600700 10 client.25534 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:59.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.775+0000 7f1441600700 1 -- 172.21.15.47:0/1280542059 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55b74e3f5590 con 0x55b74e54b410 2024-05-14T12:27:59.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.775+0000 7f1441600700 10 client.25534 handle_command_reply: tid=0 2024-05-14T12:27:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.775+0000 7f146925bb80 1 client.25534 shutdown 2024-05-14T12:27:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 msgr2=0x55b74e4d86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4d86d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c2d0 tx=0x7f143c010c10 comp rx=0 tx=0).stop 2024-05-14T12:27:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 shutdown_connections 2024-05-14T12:27:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b74e54b410 0x55b74e54d830 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b74e4c5aa0 0x55b74e4d4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b74e347fd0 0x55b74e4d8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 --2- 172.21.15.47:0/1280542059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b74e4c5690 0x55b74e4d86d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.777+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 >> 172.21.15.47:0/1280542059 conn(0x55b74e386c10 msgr2=0x55b74e4ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:59.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.778+0000 7f1441600700 0 client.25534 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:27:59.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.779+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 shutdown_connections 2024-05-14T12:27:59.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.780+0000 7f146925bb80 1 -- 172.21.15.47:0/1280542059 wait complete. 2024-05-14T12:27:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.781+0000 7f146925bb80 20 client.25534 trim_cache size 0 max 16384 2024-05-14T12:27:59.783 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:27:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 31, 2024-05-14T12:27:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:27:59.783 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 6, 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "840e5663": { 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 6, 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 87.5, 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:27:59.784 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:27:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:27:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:27:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:27:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:27:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:27:59.785 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:27:59.785 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:27:59.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.786+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f14380b2900 msgr2=0x7f14380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.786+0000 7f145a800700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f14380b2900 0x7f14380b4e10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f14440062a0 tx=0x7f1444006210 comp rx=0 tx=0).stop 2024-05-14T12:27:59.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.786+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454105e10 msgr2=0x7f14541036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.786+0000 7f145a800700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454105e10 0x7f14541036f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e9a0 tx=0x7f143c00ecb0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.787+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 shutdown_connections 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.787+0000 7f145a800700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f14380b2900 0x7f14380b4e10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.787+0000 7f145a800700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f145410e8f0 0x7f1454103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.787+0000 7f145a800700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14541054c0 0x7f14541031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.787+0000 7f145a800700 1 --2- 172.21.15.47:0/3264835197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1454105e10 0x7f14541036f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.787+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 >> 172.21.15.47:0/3264835197 conn(0x7f14540fedc0 msgr2=0x7f1454100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:27:59.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.787+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 shutdown_connections 2024-05-14T12:27:59.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:27:59.788+0000 7f145a800700 1 -- 172.21.15.47:0/3264835197 wait complete. 2024-05-14T12:28:01.074 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '840e5663', quiesce took 10.4 seconds. Will release after: 27.5 2024-05-14T12:28:01.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:01 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:28:01.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:01 smithi047 ceph-mon[31254]: pgmap v535: 97 pgs: 97 active+clean; 2.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 229 MiB/s wr, 104 op/s 2024-05-14T12:28:01.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:01 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:28:01.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:01 smithi073 ceph-mon[35809]: pgmap v535: 97 pgs: 97 active+clean; 2.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 229 MiB/s wr, 104 op/s 2024-05-14T12:28:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:01 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:28:01.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:01 smithi066 ceph-mon[35981]: pgmap v535: 97 pgs: 97 active+clean; 2.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 229 MiB/s wr, 104 op/s 2024-05-14T12:28:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:03 smithi066 ceph-mon[35981]: pgmap v536: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 272 MiB/s wr, 135 op/s 2024-05-14T12:28:03.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 -- 172.21.15.47:0/1089195370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b410a0d0 msgr2=0x7fd3b410add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1089195370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b410a0d0 0x7fd3b410add0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009900 tx=0x7fd3a402a410 comp rx=0 tx=0).stop 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 -- 172.21.15.47:0/1089195370 shutdown_connections 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1089195370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b4110010 0x7fd3b4112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1089195370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3b410b310 0x7fd3b410b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1089195370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b410a0d0 0x7fd3b410add0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 -- 172.21.15.47:0/1089195370 >> 172.21.15.47:0/1089195370 conn(0x7fd3b4078ce0 msgr2=0x7fd3b4107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 -- 172.21.15.47:0/1089195370 shutdown_connections 2024-05-14T12:28:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.898+0000 7fd3ba000640 1 -- 172.21.15.47:0/1089195370 wait complete. 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 Processor -- start 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 -- start start 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3b410a0d0 0x7fd3b41a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b410b310 0x7fd3b41a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b4110010 0x7fd3b41a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4115c60 con 0x7fd3b410b310 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4115ae0 con 0x7fd3b410a0d0 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.900+0000 7fd3ba000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4115de0 con 0x7fd3b4110010 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b410b310 0x7fd3b41a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b410b310 0x7fd3b41a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56272/0 (socket says 172.21.15.47:56272) 2024-05-14T12:28:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b8c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3b410a0d0 0x7fd3b41a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 -- 172.21.15.47:0/1940710862 learned_addr learned my addr 172.21.15.47:0/1940710862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b9600640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b4110010 0x7fd3b41a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 -- 172.21.15.47:0/1940710862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b4110010 msgr2=0x7fd3b41a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b4110010 0x7fd3b41a7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 -- 172.21.15.47:0/1940710862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3b410a0d0 msgr2=0x7fd3b41a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3b410a0d0 0x7fd3b41a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 -- 172.21.15.47:0/1940710862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b41a82e0 con 0x7fd3b410b310 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b410b310 0x7fd3b41a0ce0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009d50 tx=0x7fd3a000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.901+0000 7fd3b1600640 1 -- 172.21.15.47:0/1940710862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003b70 con 0x7fd3b410b310 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.902+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b41a85d0 con 0x7fd3b410b310 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.902+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b41a8b70 con 0x7fd3b410b310 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.902+0000 7fd3b1600640 1 -- 172.21.15.47:0/1940710862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3a0003d10 con 0x7fd3b410b310 2024-05-14T12:28:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.902+0000 7fd3b1600640 1 -- 172.21.15.47:0/1940710862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00107b0 con 0x7fd3b410b310 2024-05-14T12:28:03.906 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.905+0000 7fd3c259a740 1 Processor -- start 2024-05-14T12:28:03.906 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.905+0000 7fd3c259a740 1 -- start start 2024-05-14T12:28:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08147f1b0 0x55b081821300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b0814562f0 0x55b081821880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08145e4d0 0x55b081828780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3c259a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b081785550 con 0x55b0814562f0 2024-05-14T12:28:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3c259a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b08172abc0 con 0x55b08145e4d0 2024-05-14T12:28:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3c259a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b081781510 con 0x55b08147f1b0 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3b1600640 1 -- 172.21.15.47:0/1940710862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd3a0010950 con 0x7fd3b410b310 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3b8c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b0814562f0 0x55b081821880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3b9600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08147f1b0 0x55b081821300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3b8c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b0814562f0 0x55b081821880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56280/0 (socket says 172.21.15.47:56280) 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3b8c00640 1 -- 172.21.15.47:0/1608449201 learned_addr learned my addr 172.21.15.47:0/1608449201 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.906+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08145e4d0 0x55b081828780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b8c00640 1 -- 172.21.15.47:0/1608449201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08147f1b0 msgr2=0x55b081821300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08147f1b0 0x55b081821300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b8c00640 1 -- 172.21.15.47:0/1608449201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08145e4d0 msgr2=0x55b081828780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08145e4d0 0x55b081828780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b8c00640 1 -- 172.21.15.47:0/1608449201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b081497210 con 0x55b0814562f0 2024-05-14T12:28:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08145e4d0 0x55b081828780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:28:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b9600640 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08147f1b0 0x55b081821300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b0814562f0 0x55b081821880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009230 tx=0x7fd3a4009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6170064c7dc421b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3a9c00640 1 -- 172.21.15.47:0/1608449201 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4035030 con 0x55b0814562f0 2024-05-14T12:28:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3a9c00640 1 -- 172.21.15.47:0/1608449201 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3a4040070 con 0x55b0814562f0 2024-05-14T12:28:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.907+0000 7fd3a9c00640 1 -- 172.21.15.47:0/1608449201 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003970 con 0x55b0814562f0 2024-05-14T12:28:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3b1600640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd3980b28a0 0x7fd3980b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3b1600640 1 -- 172.21.15.47:0/1940710862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd3a00e28c0 con 0x7fd3b410b310 2024-05-14T12:28:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3b9600640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd3980b28a0 0x7fd3980b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 -- 172.21.15.47:0/1608449201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b0814562f0 msgr2=0x55b081821880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b0814562f0 0x55b081821880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009230 tx=0x7fd3a4009620 comp rx=0 tx=0).stop 2024-05-14T12:28:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 -- 172.21.15.47:0/1608449201 shutdown_connections 2024-05-14T12:28:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08145e4d0 0x55b081828780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b0814562f0 0x55b081821880 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 --2- 172.21.15.47:0/1608449201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08147f1b0 0x55b081821300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 -- 172.21.15.47:0/1608449201 >> 172.21.15.47:0/1608449201 conn(0x55b081473300 msgr2=0x55b08181cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.908+0000 7fd3c259a740 1 -- 172.21.15.47:0/1608449201 shutdown_connections 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.909+0000 7fd3c259a740 1 -- 172.21.15.47:0/1608449201 wait complete. 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.909+0000 7fd3b9600640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd3980b28a0 0x7fd3980b4db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b0818224d0 tx=0x7fd3ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.909+0000 7fd3c259a740 1 -- start start 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.909+0000 7fd3c259a740 1 Processor -- start 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b0814562f0 0x55b08182ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08145e4d0 0x55b08182b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08147f1b0 0x55b081832230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3c259a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b081829170 con 0x55b08145e4d0 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3c259a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b08173e660 con 0x55b08147f1b0 2024-05-14T12:28:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3c259a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b0818292f0 con 0x55b0814562f0 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3c259a740 10 client.0 _ll_register_callbacks cb 0x55b081708400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08145e4d0 0x55b08182b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b0814562f0 0x55b08182ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08145e4d0 0x55b08182b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56282/0 (socket says 172.21.15.47:56282) 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b3e00640 1 -- 172.21.15.47:0/3197888338 learned_addr learned my addr 172.21.15.47:0/3197888338 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b9600640 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08147f1b0 0x55b081832230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b3e00640 1 -- 172.21.15.47:0/3197888338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b0814562f0 msgr2=0x55b08182ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b0814562f0 0x55b08182ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b3e00640 1 -- 172.21.15.47:0/3197888338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08147f1b0 msgr2=0x55b081832230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.910+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08147f1b0 0x55b081832230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd3b3e00640 1 -- 172.21.15.47:0/3197888338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b081563620 con 0x55b08145e4d0 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd3b9600640 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08147f1b0 0x55b081832230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:28:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08145e4d0 0x55b08182b2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00a9e30 tx=0x7fd3a00a9700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ce4d63073c63bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd39e000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd39e000640 1 -- 172.21.15.47:0/3197888338 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00ae250 con 0x55b08145e4d0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd39e000640 1 -- 172.21.15.47:0/3197888338 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd3a00a6490 con 0x55b08145e4d0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a4040070 con 0x55b08145e4d0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd39e000640 1 -- 172.21.15.47:0/3197888338 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd3a00b2d00 con 0x55b08145e4d0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd3c259a740 10 client.15405 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b0818351a0 con 0x55b08145e4d0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.911+0000 7fd39e000640 1 -- 172.21.15.47:0/3197888338 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3a4040070 con 0x55b08145e4d0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd39e000640 1 -- 172.21.15.47:0/3197888338 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fd3a00c0020 con 0x55b08145e4d0 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd3c259a740 10 client.15405 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd3c259a740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd3c259a740 20 client.15405 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b08143dd80 0x55b081838970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd3c259a740 4 client.15405 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b081793160 con 0x55b08143dd80 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.912+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b08143dd80 0x55b081838970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.913+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b08143dd80 0x55b081838970 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83113a8fb3f4adf7 server_cookie=11e39f702662ba60 in_seq=0 out_seq=0 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.913+0000 7fd39e000640 10 client.15405 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd39e000640 1 -- 172.21.15.47:0/3197888338 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b081793160 con 0x55b08143dd80 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd39e000640 10 client.15405 handle_command_reply: tid=0 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 client.15405 shutdown 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08145e4d0 msgr2=0x55b08182b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08145e4d0 0x55b08182b2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00a9e30 tx=0x7fd3a00a9700 comp rx=0 tx=0).stop 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 shutdown_connections 2024-05-14T12:28:03.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b08143dd80 0x55b081838970 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b08147f1b0 0x55b081832230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08145e4d0 0x55b08182b2d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd39e000640 0 client.15405 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3197888338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b0814562f0 0x55b08182ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 >> 172.21.15.47:0/3197888338 conn(0x55b081473300 msgr2=0x55b08181fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 shutdown_connections 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 1 -- 172.21.15.47:0/3197888338 wait complete. 2024-05-14T12:28:03.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.914+0000 7fd3c259a740 20 client.15405 trim_cache size 0 max 16384 2024-05-14T12:28:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.930+0000 7fd3c259a740 1 Processor -- start 2024-05-14T12:28:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.930+0000 7fd3c259a740 1 -- start start 2024-05-14T12:28:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08181ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b081832150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b08181fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3c259a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd39400e430 con 0x55b08147f1b0 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3c259a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd394010060 con 0x55b0814562f0 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3c259a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd39400eb00 con 0x55b08145e4d0 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3b9600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b08181fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3b9600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b08181fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56286/0 (socket says 172.21.15.47:56286) 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3b9600640 1 -- 172.21.15.47:0/3530784146 learned_addr learned my addr 172.21.15.47:0/3530784146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08181ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.931+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b081832150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b9600640 1 -- 172.21.15.47:0/3530784146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 msgr2=0x55b081832150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b9600640 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b081832150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b9600640 1 -- 172.21.15.47:0/3530784146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 msgr2=0x55b08181ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b9600640 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08181ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b9600640 1 -- 172.21.15.47:0/3530784146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0818184a0 con 0x55b08147f1b0 2024-05-14T12:28:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b081832150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08181ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3b9600640 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b08181fa90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac004380 tx=0x7fd3ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578813c4ef74e654 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3a9200640 1 -- 172.21.15.47:0/3530784146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac004470 con 0x55b08147f1b0 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3a9200640 1 -- 172.21.15.47:0/3530784146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3ac0054d0 con 0x55b08147f1b0 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.932+0000 7fd3a9200640 1 -- 172.21.15.47:0/3530784146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac02a470 con 0x55b08147f1b0 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 -- 172.21.15.47:0/3530784146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 msgr2=0x55b08181fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b08181fa90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac004380 tx=0x7fd3ac017000 comp rx=0 tx=0).stop 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 -- 172.21.15.47:0/3530784146 shutdown_connections 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b08181fa90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b081832150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 --2- 172.21.15.47:0/3530784146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08181ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 -- 172.21.15.47:0/3530784146 >> 172.21.15.47:0/3530784146 conn(0x55b081473300 msgr2=0x55b08181c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 -- 172.21.15.47:0/3530784146 shutdown_connections 2024-05-14T12:28:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.933+0000 7fd3c259a740 1 -- 172.21.15.47:0/3530784146 wait complete. 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 -- start start 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 Processor -- start 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08182f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b08182fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b081830a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd39400f8d0 con 0x55b08147f1b0 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd39400f1d0 con 0x55b0814562f0 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd39400c3f0 con 0x55b08145e4d0 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.934+0000 7fd3c259a740 10 client.0 _ll_register_callbacks cb 0x7fd3a0009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b9600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b081830a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b08182fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b8c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08182f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b08182fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:35684/0 (socket says 172.21.15.47:35684) 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 -- 172.21.15.47:0/2517240338 learned_addr learned my addr 172.21.15.47:0/2517240338 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 -- 172.21.15.47:0/2517240338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 msgr2=0x55b08182f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08182f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 -- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 msgr2=0x55b081830a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b081830a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 -- 172.21.15.47:0/2517240338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b081830fc0 con 0x55b08145e4d0 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b9600640 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b081830a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd3b3e00640 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b08182fb40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00a9ba0 tx=0x7fd3a00a8500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83da6d1de2fbf5d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd39e000640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.935+0000 7fd39e000640 1 -- 172.21.15.47:0/2517240338 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00aa5a0 con 0x55b08145e4d0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd39e000640 1 -- 172.21.15.47:0/2517240338 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd3a00a6490 con 0x55b08145e4d0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3ac0054d0 con 0x55b08145e4d0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd39e000640 1 -- 172.21.15.47:0/2517240338 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd3a00ae250 con 0x55b08145e4d0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 10 client.25552 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b081832250 con 0x55b08145e4d0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd39e000640 1 -- 172.21.15.47:0/2517240338 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3ac0054d0 con 0x55b08145e4d0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd39e000640 1 -- 172.21.15.47:0/2517240338 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fd3a00c0070 con 0x55b08145e4d0 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 10 client.25552 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 10 client.25552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 20 client.25552 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b0814131c0 0x55b0818a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 4 client.25552 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:28:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.936+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b08178cfd0 con 0x55b0814131c0 2024-05-14T12:28:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.937+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b0814131c0 0x55b0818a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.937+0000 7fd3b8c00640 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b0814131c0 0x55b0818a3240 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd4e7edde3a2296 server_cookie=bca0c217c9cd319d in_seq=0 out_seq=0 2024-05-14T12:28:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.937+0000 7fd39e000640 10 client.25552 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd39e000640 1 -- 172.21.15.47:0/2517240338 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b08178cfd0 con 0x55b0814131c0 2024-05-14T12:28:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd39e000640 10 client.25552 handle_command_reply: tid=0 2024-05-14T12:28:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 client.25552 shutdown 2024-05-14T12:28:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 msgr2=0x55b08182fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b08182fb40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00a9ba0 tx=0x7fd3a00a8500 comp rx=0 tx=0).stop 2024-05-14T12:28:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 shutdown_connections 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b0814131c0 0x55b0818a3240 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b08147f1b0 0x55b081830a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd39e000640 0 client.25552 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08145e4d0 0x55b08182fb40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 --2- 172.21.15.47:0/2517240338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0814562f0 0x55b08182f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 >> 172.21.15.47:0/2517240338 conn(0x55b081473300 msgr2=0x55b08181fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 shutdown_connections 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 1 -- 172.21.15.47:0/2517240338 wait complete. 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.964+0000 7fd3c259a740 20 client.25552 trim_cache size 0 max 16384 2024-05-14T12:28:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:28:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:28:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:28:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:28:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd3980b28a0 msgr2=0x7fd3980b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd3980b28a0 0x7fd3980b4db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b0818224d0 tx=0x7fd3ac005f90 comp rx=0 tx=0).stop 2024-05-14T12:28:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b410b310 msgr2=0x7fd3b41a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b410b310 0x7fd3b41a0ce0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009d50 tx=0x7fd3a000c6a0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 shutdown_connections 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fd3980b28a0 0x7fd3980b4db0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3b4110010 0x7fd3b41a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3b410b310 0x7fd3b41a0ce0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 --2- 172.21.15.47:0/1940710862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3b410a0d0 0x7fd3b41a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 >> 172.21.15.47:0/1940710862 conn(0x7fd3b4078ce0 msgr2=0x7fd3b410bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 shutdown_connections 2024-05-14T12:28:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:03.965+0000 7fd3ba000640 1 -- 172.21.15.47:0/1940710862 wait complete. 2024-05-14T12:28:03.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:03 smithi047 ceph-mon[31254]: pgmap v536: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 272 MiB/s wr, 135 op/s 2024-05-14T12:28:04.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:03 smithi073 ceph-mon[35809]: pgmap v536: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 272 MiB/s wr, 135 op/s 2024-05-14T12:28:05.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:05 smithi066 ceph-mon[35981]: pgmap v537: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 242 MiB/s wr, 108 op/s 2024-05-14T12:28:05.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:05 smithi047 ceph-mon[31254]: pgmap v537: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 242 MiB/s wr, 108 op/s 2024-05-14T12:28:06.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:05 smithi073 ceph-mon[35809]: pgmap v537: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 242 MiB/s wr, 108 op/s 2024-05-14T12:28:07.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:07 smithi066 ceph-mon[35981]: pgmap v538: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 266 MiB/s wr, 116 op/s 2024-05-14T12:28:07.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:07 smithi047 ceph-mon[31254]: pgmap v538: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 266 MiB/s wr, 116 op/s 2024-05-14T12:28:08.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:07 smithi073 ceph-mon[35809]: pgmap v538: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 266 MiB/s wr, 116 op/s 2024-05-14T12:28:09.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:09 smithi066 ceph-mon[35981]: pgmap v539: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 223 MiB/s wr, 105 op/s 2024-05-14T12:28:09.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:09 smithi047 ceph-mon[31254]: pgmap v539: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 223 MiB/s wr, 105 op/s 2024-05-14T12:28:10.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:09 smithi073 ceph-mon[35809]: pgmap v539: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 223 MiB/s wr, 105 op/s 2024-05-14T12:28:11.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:11 smithi066 ceph-mon[35981]: pgmap v540: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 180 MiB/s wr, 88 op/s 2024-05-14T12:28:11.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:11 smithi047 ceph-mon[31254]: pgmap v540: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 180 MiB/s wr, 88 op/s 2024-05-14T12:28:12.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:11 smithi073 ceph-mon[35809]: pgmap v540: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 180 MiB/s wr, 88 op/s 2024-05-14T12:28:13.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:13 smithi066 ceph-mon[35981]: pgmap v541: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 142 MiB/s wr, 78 op/s 2024-05-14T12:28:13.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:13 smithi047 ceph-mon[31254]: pgmap v541: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 142 MiB/s wr, 78 op/s 2024-05-14T12:28:14.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:13 smithi073 ceph-mon[35809]: pgmap v541: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 142 MiB/s wr, 78 op/s 2024-05-14T12:28:15.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:15 smithi066 ceph-mon[35981]: pgmap v542: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 76 MiB/s wr, 40 op/s 2024-05-14T12:28:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:15 smithi047 ceph-mon[31254]: pgmap v542: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 76 MiB/s wr, 40 op/s 2024-05-14T12:28:16.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:15 smithi073 ceph-mon[35809]: pgmap v542: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 76 MiB/s wr, 40 op/s 2024-05-14T12:28:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 -- 172.21.15.47:0/2948720434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b880750c0 msgr2=0x7f1b880754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 --2- 172.21.15.47:0/2948720434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b880750c0 0x7f1b880754d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009900 tx=0x7f1b7802a3f0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 -- 172.21.15.47:0/2948720434 shutdown_connections 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 --2- 172.21.15.47:0/2948720434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b8810b9f0 0x7f1b8810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 --2- 172.21.15.47:0/2948720434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b88075a10 0x7f1b8810b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 --2- 172.21.15.47:0/2948720434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b880750c0 0x7f1b880754d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 -- 172.21.15.47:0/2948720434 >> 172.21.15.47:0/2948720434 conn(0x7f1b880fec70 msgr2=0x7f1b88101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 -- 172.21.15.47:0/2948720434 shutdown_connections 2024-05-14T12:28:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.192+0000 7f1b8d800640 1 -- 172.21.15.47:0/2948720434 wait complete. 2024-05-14T12:28:17.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.193+0000 7f1b8d800640 1 Processor -- start 2024-05-14T12:28:17.194 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.194+0000 7f1b8d800640 1 -- start start 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.194+0000 7f1b8d800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b880750c0 0x7f1b8819c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.194+0000 7f1b8d800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b88075a10 0x7f1b8819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.194+0000 7f1b8d800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b8810b9f0 0x7f1b881a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.194+0000 7f1b8d800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88111850 con 0x7f1b8810b9f0 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.194+0000 7f1b8d800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881116d0 con 0x7f1b880750c0 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.194+0000 7f1b8d800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881119d0 con 0x7f1b88075a10 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b880750c0 0x7f1b8819c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b880750c0 0x7f1b8819c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:48118/0 (socket says 172.21.15.47:48118) 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 -- 172.21.15.47:0/1141353427 learned_addr learned my addr 172.21.15.47:0/1141353427 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b8810b9f0 0x7f1b881a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b7f400640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b88075a10 0x7f1b8819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 -- 172.21.15.47:0/1141353427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b88075a10 msgr2=0x7f1b8819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b88075a10 0x7f1b8819c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 -- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b8810b9f0 msgr2=0x7f1b881a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b8810b9f0 0x7f1b881a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 -- 172.21.15.47:0/1141353427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b881a3f00 con 0x7f1b880750c0 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b8810b9f0 0x7f1b881a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:28:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.195+0000 7f1b87e00640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b880750c0 0x7f1b8819c3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b78006010 tx=0x7f1b78004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.196+0000 7f1b85600640 1 -- 172.21.15.47:0/1141353427 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7803f030 con 0x7f1b880750c0 2024-05-14T12:28:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.196+0000 7f1b85600640 1 -- 172.21.15.47:0/1141353427 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b78031910 con 0x7f1b880750c0 2024-05-14T12:28:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.196+0000 7f1b85600640 1 -- 172.21.15.47:0/1141353427 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78035070 con 0x7f1b880750c0 2024-05-14T12:28:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.196+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b881a4190 con 0x7f1b880750c0 2024-05-14T12:28:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.196+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b881a46d0 con 0x7f1b880750c0 2024-05-14T12:28:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.199+0000 7f1b95dea740 1 Processor -- start 2024-05-14T12:28:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.199+0000 7f1b95dea740 1 -- start start 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b95dea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555d00032550 con 0x555cffd0b4d0 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b95dea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555cfffd7bc0 con 0x555cffd2c1b0 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b95dea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555d0002e510 con 0x555cffd032f0 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b7f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b8ce00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b7f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40058/0 (socket says 172.21.15.47:40058) 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b7f400640 1 -- 172.21.15.47:0/4229561954 learned_addr learned my addr 172.21.15.47:0/4229561954 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.200+0000 7f1b85600640 1 -- 172.21.15.47:0/1141353427 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1b78042030 con 0x7f1b880750c0 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7f400640 1 -- 172.21.15.47:0/4229561954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 msgr2=0x555d000ce880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7f400640 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000ce880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7f400640 1 -- 172.21.15.47:0/4229561954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 msgr2=0x555d000ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7f400640 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7f400640 1 -- 172.21.15.47:0/4229561954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cffd44210 con 0x555cffd0b4d0 2024-05-14T12:28:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7f400640 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009c90 tx=0x7f1b70011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e006d3854039eb60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7d600640 1 -- 172.21.15.47:0/4229561954 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70005220 con 0x555cffd0b4d0 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7d600640 1 -- 172.21.15.47:0/4229561954 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b70004c50 con 0x555cffd0b4d0 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.201+0000 7f1b7d600640 1 -- 172.21.15.47:0/4229561954 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b700196d0 con 0x555cffd0b4d0 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b85600640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1b6c0b2920 0x7f1b6c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 -- 172.21.15.47:0/4229561954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 msgr2=0x555d000d5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009c90 tx=0x7f1b70011810 comp rx=0 tx=0).stop 2024-05-14T12:28:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 -- 172.21.15.47:0/4229561954 shutdown_connections 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d5780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 --2- 172.21.15.47:0/4229561954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 -- 172.21.15.47:0/4229561954 >> 172.21.15.47:0/4229561954 conn(0x555cffd20300 msgr2=0x555d000c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b85600640 1 -- 172.21.15.47:0/1141353427 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1b781025f0 con 0x7f1b880750c0 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.202+0000 7f1b95dea740 1 -- 172.21.15.47:0/4229561954 shutdown_connections 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.203+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1b6c0b2920 0x7f1b6c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.203+0000 7f1b95dea740 1 -- 172.21.15.47:0/4229561954 wait complete. 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.203+0000 7f1b95dea740 1 -- start start 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.203+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1b6c0b2920 0x7f1b6c0b4e30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x555d000cf4d0 tx=0x7f1b80009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 1 Processor -- start 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000d7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000df2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555d000d61d0 con 0x555cffd0b4d0 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555cfffeb660 con 0x555cffd2c1b0 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555d000d6350 con 0x555cffd032f0 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b95dea740 10 client.0 _ll_register_callbacks cb 0x555cfffb5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b7f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000d7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000d7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:47160/0 (socket says 172.21.15.47:47160) 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b87e00640 1 -- 172.21.15.47:0/3713446634 learned_addr learned my addr 172.21.15.47:0/3713446634 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.204+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000df2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b87e00640 1 -- 172.21.15.47:0/3713446634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 msgr2=0x555d000df2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b87e00640 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000df2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b87e00640 1 -- 172.21.15.47:0/3713446634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 msgr2=0x555d000d8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b87e00640 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b87e00640 1 -- 172.21.15.47:0/3713446634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cffe10620 con 0x555cffd032f0 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000df2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b87e00640 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000d7e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b78102890 tx=0x7f1b78031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b9a241d3b0ba21f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b76000640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:28:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b76000640 1 -- 172.21.15.47:0/3713446634 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78049040 con 0x555cffd032f0 2024-05-14T12:28:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b76000640 1 -- 172.21.15.47:0/3713446634 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1b780e41e0 con 0x555cffd032f0 2024-05-14T12:28:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b70004c50 con 0x555cffd032f0 2024-05-14T12:28:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.205+0000 7f1b76000640 1 -- 172.21.15.47:0/3713446634 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1b780ca2d0 con 0x555cffd032f0 2024-05-14T12:28:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 10 client.25561 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555d000d61d0 con 0x555cffd032f0 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b76000640 1 -- 172.21.15.47:0/3713446634 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b70004c50 con 0x555cffd032f0 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b76000640 1 -- 172.21.15.47:0/3713446634 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f1b780c5040 con 0x555cffd032f0 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 10 client.25561 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 10 client.25561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 20 client.25561 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcead80 0x555d000e5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 4 client.25561 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d00040160 con 0x555cffcead80 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.206+0000 7f1b7f400640 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcead80 0x555d000e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.207+0000 7f1b7f400640 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcead80 0x555d000e5830 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c5b2b16d98ed4a server_cookie=b73a97d9f2a73c27 in_seq=0 out_seq=0 2024-05-14T12:28:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.207+0000 7f1b76000640 10 client.25561 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b76000640 1 -- 172.21.15.47:0/3713446634 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555d00040160 con 0x555cffcead80 2024-05-14T12:28:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b76000640 10 client.25561 handle_command_reply: tid=0 2024-05-14T12:28:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 client.25561 shutdown 2024-05-14T12:28:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 msgr2=0x555d000d7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000d7e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b78102890 tx=0x7f1b78031400 comp rx=0 tx=0).stop 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 shutdown_connections 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcead80 0x555d000e5830 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd2c1b0 0x555d000df2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd0b4d0 0x555d000d8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 --2- 172.21.15.47:0/3713446634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000d7e30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b76000640 0 client.25561 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 >> 172.21.15.47:0/3713446634 conn(0x555cffd20300 msgr2=0x555d000c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 shutdown_connections 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.208+0000 7f1b95dea740 1 -- 172.21.15.47:0/3713446634 wait complete. 2024-05-14T12:28:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.209+0000 7f1b95dea740 20 client.25561 trim_cache size 0 max 16384 2024-05-14T12:28:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.225+0000 7f1b95dea740 1 Processor -- start 2024-05-14T12:28:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b95dea740 1 -- start start 2024-05-14T12:28:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd032f0 0x555d000d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd2c1b0 0x555d000df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b95dea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ad350 con 0x555cffd032f0 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b95dea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881aef80 con 0x555cffd0b4d0 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b95dea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ada20 con 0x555cffd2c1b0 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd032f0 0x555d000d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd032f0 0x555d000d70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40072/0 (socket says 172.21.15.47:40072) 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b87e00640 1 -- 172.21.15.47:0/2883275364 learned_addr learned my addr 172.21.15.47:0/2883275364 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd2c1b0 0x555d000df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.226+0000 7f1b7f400640 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b87e00640 1 -- 172.21.15.47:0/2883275364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd2c1b0 msgr2=0x555d000df7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b87e00640 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd2c1b0 0x555d000df7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b87e00640 1 -- 172.21.15.47:0/2883275364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 msgr2=0x555d000df260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b87e00640 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000df260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b87e00640 1 -- 172.21.15.47:0/2883275364 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d000c54a0 con 0x555cffd032f0 2024-05-14T12:28:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b87e00640 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd032f0 0x555d000d70e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1b780e6040 tx=0x7f1b780d2750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d884181aae883763 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b7cc00640 1 -- 172.21.15.47:0/2883275364 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78049070 con 0x555cffd032f0 2024-05-14T12:28:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b7cc00640 1 -- 172.21.15.47:0/2883275364 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b780cdf80 con 0x555cffd032f0 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.227+0000 7f1b7cc00640 1 -- 172.21.15.47:0/2883275364 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780c8e30 con 0x555cffd032f0 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 -- 172.21.15.47:0/2883275364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd032f0 msgr2=0x555d000d70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd032f0 0x555d000d70e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1b780e6040 tx=0x7f1b780d2750 comp rx=0 tx=0).stop 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 -- 172.21.15.47:0/2883275364 shutdown_connections 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd2c1b0 0x555d000df7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000df260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2883275364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd032f0 0x555d000d70e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 -- 172.21.15.47:0/2883275364 >> 172.21.15.47:0/2883275364 conn(0x555cffd20300 msgr2=0x555d000cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 -- 172.21.15.47:0/2883275364 shutdown_connections 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.228+0000 7f1b95dea740 1 -- 172.21.15.47:0/2883275364 wait complete. 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 -- start start 2024-05-14T12:28:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 Processor -- start 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000dc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000dce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd2c1b0 0x555d000ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ae7f0 con 0x555cffd2c1b0 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ae0f0 con 0x555cffd0b4d0 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ab310 con 0x555cffd032f0 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.229+0000 7f1b95dea740 10 client.0 _ll_register_callbacks cb 0x7f1b7803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd2c1b0 0x555d000ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd2c1b0 0x555d000ddd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40088/0 (socket says 172.21.15.47:40088) 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 -- 172.21.15.47:0/2320491725 learned_addr learned my addr 172.21.15.47:0/2320491725 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b7f400640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000dce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b87e00640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000dc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 -- 172.21.15.47:0/2320491725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 msgr2=0x555d000dc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000dc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 -- 172.21.15.47:0/2320491725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 msgr2=0x555d000dce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000dce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b8ce00640 1 -- 172.21.15.47:0/2320491725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d000de300 con 0x555cffd2c1b0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.230+0000 7f1b87e00640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000dc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b8ce00640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd2c1b0 0x555d000ddd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b80010f10 tx=0x7f1b80004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f885369b0176eadc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b76000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b76000640 1 -- 172.21.15.47:0/2320491725 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8002e060 con 0x555cffd2c1b0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b76000640 1 -- 172.21.15.47:0/2320491725 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1b8001c400 con 0x555cffd2c1b0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b780cdf80 con 0x555cffd2c1b0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b76000640 1 -- 172.21.15.47:0/2320491725 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1b8001c600 con 0x555cffd2c1b0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b95dea740 10 client.15429 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.231+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555d000df660 con 0x555cffd2c1b0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b76000640 1 -- 172.21.15.47:0/2320491725 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b780cdf80 con 0x555cffd2c1b0 2024-05-14T12:28:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b76000640 1 -- 172.21.15.47:0/2320491725 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f1b80033070 con 0x555cffd2c1b0 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b95dea740 10 client.15429 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b95dea740 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b95dea740 20 client.15429 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcc01c0 0x555d00150070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b95dea740 4 client.15429 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555d00039fd0 con 0x555cffcc01c0 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.232+0000 7f1b87e00640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcc01c0 0x555d00150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.233+0000 7f1b76000640 10 client.15429 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.233+0000 7f1b87e00640 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcc01c0 0x555d00150070 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3e69684dfb10bb4 server_cookie=c8d8c2417a1309f1 in_seq=0 out_seq=0 2024-05-14T12:28:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.249+0000 7f1b76000640 1 -- 172.21.15.47:0/2320491725 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555d00039fd0 con 0x555cffcc01c0 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.249+0000 7f1b76000640 10 client.15429 handle_command_reply: tid=0 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.249+0000 7f1b95dea740 1 client.15429 shutdown 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd2c1b0 msgr2=0x555d000ddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd2c1b0 0x555d000ddd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b80010f10 tx=0x7f1b80004ab0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 shutdown_connections 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cffcc01c0 0x555d00150070 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cffd2c1b0 0x555d000ddd40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cffd0b4d0 0x555d000dce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 --2- 172.21.15.47:0/2320491725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cffd032f0 0x555d000dc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b76000640 0 client.15429 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 >> 172.21.15.47:0/2320491725 conn(0x555cffd20300 msgr2=0x555d000cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 shutdown_connections 2024-05-14T12:28:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 1 -- 172.21.15.47:0/2320491725 wait complete. 2024-05-14T12:28:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.250+0000 7f1b95dea740 20 client.15429 trim_cache size 0 max 16384 2024-05-14T12:28:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:28:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:28:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:28:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1b6c0b2920 msgr2=0x7f1b6c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1b6c0b2920 0x7f1b6c0b4e30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x555d000cf4d0 tx=0x7f1b80009500 comp rx=0 tx=0).stop 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b880750c0 msgr2=0x7f1b8819c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b880750c0 0x7f1b8819c3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b78006010 tx=0x7f1b78004270 comp rx=0 tx=0).stop 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 shutdown_connections 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1b6c0b2920 0x7f1b6c0b4e30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b8810b9f0 0x7f1b881a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b88075a10 0x7f1b8819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 --2- 172.21.15.47:0/1141353427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b880750c0 0x7f1b8819c3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 >> 172.21.15.47:0/1141353427 conn(0x7f1b880fec70 msgr2=0x7f1b880ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 shutdown_connections 2024-05-14T12:28:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:17.251+0000 7f1b8d800640 1 -- 172.21.15.47:0/1141353427 wait complete. 2024-05-14T12:28:17.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:17 smithi066 ceph-mon[35981]: pgmap v543: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 59 MiB/s wr, 36 op/s 2024-05-14T12:28:17.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:17 smithi047 ceph-mon[31254]: pgmap v543: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 59 MiB/s wr, 36 op/s 2024-05-14T12:28:18.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:17 smithi073 ceph-mon[35809]: pgmap v543: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 59 MiB/s wr, 36 op/s 2024-05-14T12:28:19.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:19 smithi066 ceph-mon[35981]: pgmap v544: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-05-14T12:28:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:19 smithi047 ceph-mon[31254]: pgmap v544: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-05-14T12:28:20.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:19 smithi073 ceph-mon[35809]: pgmap v544: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 25 op/s 2024-05-14T12:28:21.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:21 smithi047 ceph-mon[31254]: pgmap v545: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2024-05-14T12:28:21.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:21 smithi066 ceph-mon[35981]: pgmap v545: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2024-05-14T12:28:22.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:21 smithi073 ceph-mon[35809]: pgmap v545: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2024-05-14T12:28:23.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:23 smithi066 ceph-mon[35981]: pgmap v546: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-05-14T12:28:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:23 smithi047 ceph-mon[31254]: pgmap v546: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-05-14T12:28:24.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:23 smithi073 ceph-mon[35809]: pgmap v546: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-05-14T12:28:25.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:25 smithi066 ceph-mon[35981]: pgmap v547: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-05-14T12:28:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:25 smithi047 ceph-mon[31254]: pgmap v547: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-05-14T12:28:26.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:25 smithi073 ceph-mon[35809]: pgmap v547: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-05-14T12:28:26.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:26 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:28:27.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:26 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:28:27.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:26 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:28:27.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:27 smithi047 ceph-mon[31254]: pgmap v548: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-05-14T12:28:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:27 smithi073 ceph-mon[35809]: pgmap v548: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-05-14T12:28:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:27 smithi066 ceph-mon[35981]: pgmap v548: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-05-14T12:28:28.575 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:28:29.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:28:29.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:28:29.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:28:29.013 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:28:29.013 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:28:29.013 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:28:29.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:28:29.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:28:29.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:28:29.324 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:28:29.774 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:29 smithi047 ceph-mon[31254]: pgmap v549: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-05-14T12:28:30.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:29 smithi073 ceph-mon[35809]: pgmap v549: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-05-14T12:28:30.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:29 smithi066 ceph-mon[35981]: pgmap v549: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.550+0000 7f722de00640 1 -- 172.21.15.47:0/3168892209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f722810f890 msgr2=0x7f7228111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.550+0000 7f722de00640 1 --2- 172.21.15.47:0/3168892209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f722810f890 0x7f7228111cb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7214009900 tx=0x7f721402a3f0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.554+0000 7f722de00640 1 -- 172.21.15.47:0/3168892209 shutdown_connections 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.554+0000 7f722de00640 1 --2- 172.21.15.47:0/3168892209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72281121f0 0x7f7228114690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.554+0000 7f722de00640 1 --2- 172.21.15.47:0/3168892209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f722810f890 0x7f7228111cb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.554+0000 7f722de00640 1 --2- 172.21.15.47:0/3168892209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f722810a0f0 0x7f722810a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.554+0000 7f722de00640 1 -- 172.21.15.47:0/3168892209 >> 172.21.15.47:0/3168892209 conn(0x7f7228070640 msgr2=0x7f7228072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.558+0000 7f722de00640 1 -- 172.21.15.47:0/3168892209 shutdown_connections 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.558+0000 7f722de00640 1 -- 172.21.15.47:0/3168892209 wait complete. 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.560+0000 7f722de00640 1 Processor -- start 2024-05-14T12:28:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.561+0000 7f722de00640 1 -- start start 2024-05-14T12:28:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.562+0000 7f722de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f722810a0f0 0x7f72281a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f7226a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f722810a0f0 0x7f72281a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f7226a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f722810a0f0 0x7f72281a2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39830/0 (socket says 172.21.15.47:39830) 2024-05-14T12:28:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f722de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f722810f890 0x7f72281a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f7226a00640 1 -- 172.21.15.47:0/2777852392 learned_addr learned my addr 172.21.15.47:0/2777852392 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f722de00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72281121f0 0x7f72281aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7228118050 con 0x7f722810f890 2024-05-14T12:28:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7228117ed0 con 0x7f72281121f0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.563+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f72281181d0 con 0x7f722810a0f0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.564+0000 7f7227400640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72281121f0 0x7f72281aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.564+0000 7f7226000640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f722810f890 0x7f72281a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.564+0000 7f7226a00640 1 -- 172.21.15.47:0/2777852392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72281121f0 msgr2=0x7f72281aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.564+0000 7f7226a00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72281121f0 0x7f72281aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.564+0000 7f7226a00640 1 -- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f722810f890 msgr2=0x7f72281a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.564+0000 7f7226a00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f722810f890 0x7f72281a30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.564+0000 7f7226a00640 1 -- 172.21.15.47:0/2777852392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72281aa600 con 0x7f722810a0f0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.565+0000 7f7227400640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72281121f0 0x7f72281aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.565+0000 7f7226a00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f722810a0f0 0x7f72281a2b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f721800c8c0 tx=0x7f721800cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.565+0000 7f722ca00640 1 -- 172.21.15.47:0/2777852392 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7218007bb0 con 0x7f722810a0f0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.565+0000 7f722ca00640 1 -- 172.21.15.47:0/2777852392 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7218007d50 con 0x7f722810a0f0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.565+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72281aa8f0 con 0x7f722810a0f0 2024-05-14T12:28:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.565+0000 7f722ca00640 1 -- 172.21.15.47:0/2777852392 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180187c0 con 0x7f722810a0f0 2024-05-14T12:28:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.565+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72281aae90 con 0x7f722810a0f0 2024-05-14T12:28:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.571+0000 7f7234e60740 1 Processor -- start 2024-05-14T12:28:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.574+0000 7f7234e60740 1 -- start start 2024-05-14T12:28:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.574+0000 7f722ca00640 1 -- 172.21.15.47:0/2777852392 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f721800f450 con 0x7f722810a0f0 2024-05-14T12:28:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.575+0000 7f7234e60740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3bd1b0 0x556f0e769f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.575+0000 7f7234e60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3942f0 0x556f0e76c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.575+0000 7f7234e60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e76eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.575+0000 7f7234e60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f0e6c3550 con 0x556f0e39c4d0 2024-05-14T12:28:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.575+0000 7f7234e60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556f0e668bc0 con 0x556f0e3942f0 2024-05-14T12:28:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.575+0000 7f7234e60740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556f0e6bf510 con 0x556f0e3bd1b0 2024-05-14T12:28:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.576+0000 7f7227400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3bd1b0 0x556f0e769f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.576+0000 7f7227400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3bd1b0 0x556f0e769f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39840/0 (socket says 172.21.15.47:39840) 2024-05-14T12:28:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.576+0000 7f7227400640 1 -- 172.21.15.47:0/2767895121 learned_addr learned my addr 172.21.15.47:0/2767895121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.577+0000 7f7226a00640 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3942f0 0x556f0e76c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.577+0000 7f7227400640 1 -- 172.21.15.47:0/2767895121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3942f0 msgr2=0x556f0e76c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.577+0000 7f7227400640 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3942f0 0x556f0e76c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.578+0000 7f7227400640 1 -- 172.21.15.47:0/2767895121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 msgr2=0x556f0e76eca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:28:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.578+0000 7f7227400640 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e76eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.578+0000 7f7227400640 1 -- 172.21.15.47:0/2767895121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0e3d5210 con 0x556f0e3bd1b0 2024-05-14T12:28:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.578+0000 7f7226a00640 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3942f0 0x556f0e76c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:28:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.579+0000 7f7227400640 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3bd1b0 0x556f0e769f60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f72200117e0 tx=0x7f7220011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ab6a77e308ed24 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.579+0000 7f7213e00640 1 -- 172.21.15.47:0/2767895121 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220011310 con 0x556f0e3bd1b0 2024-05-14T12:28:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.579+0000 7f7213e00640 1 -- 172.21.15.47:0/2767895121 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7220003e20 con 0x556f0e3bd1b0 2024-05-14T12:28:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.579+0000 7f7213e00640 1 -- 172.21.15.47:0/2767895121 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220004510 con 0x556f0e3bd1b0 2024-05-14T12:28:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.581+0000 7f7234e60740 1 -- 172.21.15.47:0/2767895121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3bd1b0 msgr2=0x556f0e769f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.581+0000 7f7234e60740 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3bd1b0 0x556f0e769f60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f72200117e0 tx=0x7f7220011ca0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.581+0000 7f7234e60740 1 -- 172.21.15.47:0/2767895121 shutdown_connections 2024-05-14T12:28:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.581+0000 7f7234e60740 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e76eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.581+0000 7f7234e60740 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3942f0 0x556f0e76c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.581+0000 7f7234e60740 1 --2- 172.21.15.47:0/2767895121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3bd1b0 0x556f0e769f60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.581+0000 7f7234e60740 1 -- 172.21.15.47:0/2767895121 >> 172.21.15.47:0/2767895121 conn(0x556f0e3b1300 msgr2=0x556f0e75aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.582+0000 7f7234e60740 1 -- 172.21.15.47:0/2767895121 shutdown_connections 2024-05-14T12:28:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.582+0000 7f7234e60740 1 -- 172.21.15.47:0/2767895121 wait complete. 2024-05-14T12:28:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.582+0000 7f722ca00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f720c0b28b0 0x7f720c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.582+0000 7f722ca00640 1 -- 172.21.15.47:0/2777852392 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f72180e2300 con 0x7f722810a0f0 2024-05-14T12:28:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.583+0000 7f7234e60740 1 -- start start 2024-05-14T12:28:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.583+0000 7f7226000640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f720c0b28b0 0x7f720c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.584+0000 7f7234e60740 1 Processor -- start 2024-05-14T12:28:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.585+0000 7f7226000640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f720c0b28b0 0x7f720c0b4dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7214006010 tx=0x7f7214031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7234e60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e3942f0 0x556f0e771380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7234e60740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e39c4d0 0x556f0e7718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7234e60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e778820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7234e60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f0e76f7c0 con 0x556f0e3942f0 2024-05-14T12:28:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7234e60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556f0e67c660 con 0x556f0e3bd1b0 2024-05-14T12:28:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7234e60740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556f0e76f940 con 0x556f0e39c4d0 2024-05-14T12:28:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7234e60740 10 client.0 _ll_register_callbacks cb 0x556f0e646400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.588+0000 7f7226000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e39c4d0 0x556f0e7718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.589+0000 7f7226000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e39c4d0 0x556f0e7718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39850/0 (socket says 172.21.15.47:39850) 2024-05-14T12:28:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.589+0000 7f7226000640 1 -- 172.21.15.47:0/3565731045 learned_addr learned my addr 172.21.15.47:0/3565731045 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.589+0000 7f7226a00640 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e3942f0 0x556f0e771380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.589+0000 7f7227400640 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e778820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.590+0000 7f7227400640 1 -- 172.21.15.47:0/3565731045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e39c4d0 msgr2=0x556f0e7718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:30.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.590+0000 7f7227400640 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e39c4d0 0x556f0e7718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.590+0000 7f7227400640 1 -- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e3942f0 msgr2=0x556f0e771380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.590+0000 7f7227400640 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e3942f0 0x556f0e771380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.590+0000 7f7227400640 1 -- 172.21.15.47:0/3565731045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0e4a1620 con 0x556f0e3bd1b0 2024-05-14T12:28:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.590+0000 7f7227400640 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e778820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7220006010 tx=0x7f7220011480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca3541be340c9ad3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.590+0000 7f7210c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:28:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.591+0000 7f7210c00640 1 -- 172.21.15.47:0/3565731045 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722002a060 con 0x556f0e3bd1b0 2024-05-14T12:28:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.591+0000 7f7210c00640 1 -- 172.21.15.47:0/3565731045 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f722000f9a0 con 0x556f0e3bd1b0 2024-05-14T12:28:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.591+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7220003e20 con 0x556f0e3bd1b0 2024-05-14T12:28:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.591+0000 7f7210c00640 1 -- 172.21.15.47:0/3565731045 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7220004e50 con 0x556f0e3bd1b0 2024-05-14T12:28:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.592+0000 7f7234e60740 10 client.25553 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.592+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556f0e761090 con 0x556f0e3bd1b0 2024-05-14T12:28:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.592+0000 7f7210c00640 1 -- 172.21.15.47:0/3565731045 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7220004700 con 0x556f0e3bd1b0 2024-05-14T12:28:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.593+0000 7f7210c00640 1 -- 172.21.15.47:0/3565731045 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f722002f070 con 0x556f0e3bd1b0 2024-05-14T12:28:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.594+0000 7f7234e60740 10 client.25553 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.594+0000 7f7234e60740 10 client.25553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.594+0000 7f7234e60740 20 client.25553 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.594+0000 7f7234e60740 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e37bd80 0x556f0e764670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.596+0000 7f7234e60740 4 client.25553 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:28:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.596+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7220003e20 con 0x556f0e37bd80 2024-05-14T12:28:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.596+0000 7f7226a00640 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e37bd80 0x556f0e764670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.597+0000 7f7226a00640 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e37bd80 0x556f0e764670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74ea745dc584784 server_cookie=4a6c52937192ac13 in_seq=0 out_seq=0 2024-05-14T12:28:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.597+0000 7f7210c00640 10 client.25553 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.600+0000 7f7210c00640 1 -- 172.21.15.47:0/3565731045 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f7220003e20 con 0x556f0e37bd80 2024-05-14T12:28:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.600+0000 7f7210c00640 10 client.25553 handle_command_reply: tid=0 2024-05-14T12:28:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.600+0000 7f7234e60740 1 client.25553 shutdown 2024-05-14T12:28:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.601+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 msgr2=0x556f0e778820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.601+0000 7f7234e60740 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e778820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7220006010 tx=0x7f7220011480 comp rx=0 tx=0).stop 2024-05-14T12:28:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.602+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 shutdown_connections 2024-05-14T12:28:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.602+0000 7f7234e60740 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e37bd80 0x556f0e764670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.602+0000 7f7234e60740 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e778820 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.602+0000 7f7234e60740 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e39c4d0 0x556f0e7718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.602+0000 7f7234e60740 1 --2- 172.21.15.47:0/3565731045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e3942f0 0x556f0e771380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.602+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 >> 172.21.15.47:0/3565731045 conn(0x556f0e3b1300 msgr2=0x556f0e759a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.603+0000 7f7210c00640 0 client.25553 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.604+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 shutdown_connections 2024-05-14T12:28:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.605+0000 7f7234e60740 1 -- 172.21.15.47:0/3565731045 wait complete. 2024-05-14T12:28:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.606+0000 7f7234e60740 20 client.25553 trim_cache size 0 max 16384 2024-05-14T12:28:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.628+0000 7f7234e60740 1 Processor -- start 2024-05-14T12:28:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.628+0000 7f7234e60740 1 -- start start 2024-05-14T12:28:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7234e60740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e771aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7234e60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e778740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7234e60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e78eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7234e60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b1920 con 0x556f0e39c4d0 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7234e60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b3550 con 0x556f0e3bd1b0 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7234e60740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b1ff0 con 0x556f0e3942f0 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7226a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e771aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7226000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e778740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7227400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e78eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7226a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e771aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39856/0 (socket says 172.21.15.47:39856) 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7227400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e78eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43736/0 (socket says 172.21.15.47:43736) 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.629+0000 7f7226a00640 1 -- 172.21.15.47:0/1683579270 learned_addr learned my addr 172.21.15.47:0/1683579270 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7226a00640 1 -- 172.21.15.47:0/1683579270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 msgr2=0x556f0e78eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7226a00640 1 --2- 172.21.15.47:0/1683579270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e78eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7226a00640 1 -- 172.21.15.47:0/1683579270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 msgr2=0x556f0e778740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7226a00640 1 --2- 172.21.15.47:0/1683579270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e778740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7226a00640 1 -- 172.21.15.47:0/1683579270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0e76fb10 con 0x556f0e3942f0 2024-05-14T12:28:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7226a00640 1 --2- 172.21.15.47:0/1683579270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e771aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f721800c890 tx=0x7f72180a5040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed4b041e7ace91db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7213400640 1 -- 172.21.15.47:0/1683579270 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180adc90 con 0x556f0e3942f0 2024-05-14T12:28:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7213400640 1 -- 172.21.15.47:0/1683579270 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f721808fe50 con 0x556f0e3942f0 2024-05-14T12:28:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.630+0000 7f7213400640 1 -- 172.21.15.47:0/1683579270 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721800f740 con 0x556f0e3942f0 2024-05-14T12:28:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.632+0000 7f7234e60740 1 -- 172.21.15.47:0/1683579270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 msgr2=0x556f0e771aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.632+0000 7f7234e60740 1 --2- 172.21.15.47:0/1683579270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e771aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f721800c890 tx=0x7f72180a5040 comp rx=0 tx=0).stop 2024-05-14T12:28:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.633+0000 7f7234e60740 1 -- 172.21.15.47:0/1683579270 shutdown_connections 2024-05-14T12:28:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.634+0000 7f7234e60740 1 --2- 172.21.15.47:0/1683579270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e78eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.634+0000 7f7234e60740 1 --2- 172.21.15.47:0/1683579270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e778740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.634+0000 7f7234e60740 1 --2- 172.21.15.47:0/1683579270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e771aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.634+0000 7f7234e60740 1 -- 172.21.15.47:0/1683579270 >> 172.21.15.47:0/1683579270 conn(0x556f0e3b1300 msgr2=0x556f0e771390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.635+0000 7f7234e60740 1 -- 172.21.15.47:0/1683579270 shutdown_connections 2024-05-14T12:28:30.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.635+0000 7f7234e60740 1 -- 172.21.15.47:0/1683579270 wait complete. 2024-05-14T12:28:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.636+0000 7f7234e60740 1 -- start start 2024-05-14T12:28:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.637+0000 7f7234e60740 1 Processor -- start 2024-05-14T12:28:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.640+0000 7f7234e60740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e777080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.640+0000 7f7234e60740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e7775c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7234e60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e777b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7234e60740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b2dc0 con 0x556f0e39c4d0 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7234e60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b26c0 con 0x556f0e3bd1b0 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7234e60740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f72281af8e0 con 0x556f0e3942f0 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7234e60740 10 client.0 _ll_register_callbacks cb 0x7f72200116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7226000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e7775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7226000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e7775c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39518/0 (socket says 172.21.15.47:39518) 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7226000640 1 -- 172.21.15.47:0/2133790254 learned_addr learned my addr 172.21.15.47:0/2133790254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.641+0000 7f7227400640 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e777b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7226000640 1 -- 172.21.15.47:0/2133790254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 msgr2=0x556f0e777080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7226000640 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e777080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7226000640 1 -- 172.21.15.47:0/2133790254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 msgr2=0x556f0e777b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7226000640 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e777b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7226000640 1 -- 172.21.15.47:0/2133790254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0e76c8a0 con 0x556f0e39c4d0 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7226000640 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e7775c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7214033000 tx=0x7f7214009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2ccf1f06f31957 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7210c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7210c00640 1 -- 172.21.15.47:0/2133790254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7214035050 con 0x556f0e39c4d0 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f721808fe50 con 0x556f0e39c4d0 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.642+0000 7f7210c00640 1 -- 172.21.15.47:0/2133790254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7214004e00 con 0x556f0e39c4d0 2024-05-14T12:28:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7210c00640 1 -- 172.21.15.47:0/2133790254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f72140035f0 con 0x556f0e39c4d0 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 10 client.15441 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556f0e7eeae0 con 0x556f0e39c4d0 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7210c00640 1 -- 172.21.15.47:0/2133790254 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f721808fe50 con 0x556f0e39c4d0 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7210c00640 1 -- 172.21.15.47:0/2133790254 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f7214051020 con 0x556f0e39c4d0 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 10 client.15441 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 20 client.15441 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e3511c0 0x556f0e7f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 4 client.15441 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:28:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.643+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556f0e6d1160 con 0x556f0e3511c0 2024-05-14T12:28:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.644+0000 7f7226a00640 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e3511c0 0x556f0e7f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.644+0000 7f7226a00640 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e3511c0 0x556f0e7f15c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b75484ed3e7a13e server_cookie=2e68fc06a350e048 in_seq=0 out_seq=0 2024-05-14T12:28:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.644+0000 7f7210c00640 10 client.15441 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7210c00640 1 -- 172.21.15.47:0/2133790254 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556f0e6d1160 con 0x556f0e3511c0 2024-05-14T12:28:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7210c00640 10 client.15441 handle_command_reply: tid=0 2024-05-14T12:28:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 client.15441 shutdown 2024-05-14T12:28:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 msgr2=0x556f0e7775c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e7775c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7214033000 tx=0x7f7214009260 comp rx=0 tx=0).stop 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 shutdown_connections 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x556f0e3511c0 0x556f0e7f15c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556f0e3bd1b0 0x556f0e777b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f0e39c4d0 0x556f0e7775c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 --2- 172.21.15.47:0/2133790254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f0e3942f0 0x556f0e777080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 >> 172.21.15.47:0/2133790254 conn(0x556f0e3b1300 msgr2=0x556f0e78dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7210c00640 0 client.15441 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 shutdown_connections 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.662+0000 7f7234e60740 1 -- 172.21.15.47:0/2133790254 wait complete. 2024-05-14T12:28:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f7234e60740 20 client.15441 trim_cache size 0 max 16384 2024-05-14T12:28:30.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:28:30.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:28:30.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:28:30.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:28:30.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f720c0b28b0 msgr2=0x7f720c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f720c0b28b0 0x7f720c0b4dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7214006010 tx=0x7f7214031400 comp rx=0 tx=0).stop 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f722810a0f0 msgr2=0x7f72281a2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f722810a0f0 0x7f72281a2b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f721800c8c0 tx=0x7f721800cd80 comp rx=0 tx=0).stop 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 shutdown_connections 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f720c0b28b0 0x7f720c0b4dc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72281121f0 0x7f72281aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f722810f890 0x7f72281a30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 --2- 172.21.15.47:0/2777852392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f722810a0f0 0x7f72281a2b70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.663+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 >> 172.21.15.47:0/2777852392 conn(0x7f7228070640 msgr2=0x7f7228110710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.664+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 shutdown_connections 2024-05-14T12:28:30.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:30.664+0000 7f722de00640 1 -- 172.21.15.47:0/2777852392 wait complete. 2024-05-14T12:28:31.876 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:31 smithi066 ceph-mon[35981]: pgmap v550: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-05-14T12:28:31.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:31 smithi047 ceph-mon[31254]: pgmap v550: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-05-14T12:28:32.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:31 smithi073 ceph-mon[35809]: pgmap v550: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-05-14T12:28:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.012+0000 7f8acb200700 1 -- 172.21.15.47:0/2572302263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac4103080 msgr2=0x7f8ac4103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.012+0000 7f8acb200700 1 --2- 172.21.15.47:0/2572302263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac4103080 0x7f8ac4103490 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009990 tx=0x7f8ab8009ca0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.013+0000 7f8acb200700 1 -- 172.21.15.47:0/2572302263 shutdown_connections 2024-05-14T12:28:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.013+0000 7f8acb200700 1 --2- 172.21.15.47:0/2572302263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac41084d0 0x7f8ac41089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.013+0000 7f8acb200700 1 --2- 172.21.15.47:0/2572302263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac4103080 0x7f8ac4103490 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.013+0000 7f8acb200700 1 --2- 172.21.15.47:0/2572302263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac41039d0 0x7f8ac4107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.013+0000 7f8acb200700 1 -- 172.21.15.47:0/2572302263 >> 172.21.15.47:0/2572302263 conn(0x7f8ac4078ac0 msgr2=0x7f8ac4078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:32.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.013+0000 7f8acb200700 1 -- 172.21.15.47:0/2572302263 shutdown_connections 2024-05-14T12:28:32.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.013+0000 7f8acb200700 1 -- 172.21.15.47:0/2572302263 wait complete. 2024-05-14T12:28:32.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.014+0000 7f8acb200700 1 Processor -- start 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.014+0000 7f8acb200700 1 -- start start 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8acb200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac4103080 0x7f8ac4117150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8acb200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac41039d0 0x7f8ac4117690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8acb200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac41084d0 0x7f8ac41122a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8acb200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac410a6d0 con 0x7f8ac41039d0 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8acb200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac410a550 con 0x7f8ac4103080 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8acb200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac410a850 con 0x7f8ac41084d0 2024-05-14T12:28:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8aca800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac41084d0 0x7f8ac41122a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:32.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8aca800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac41084d0 0x7f8ac41122a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39880/0 (socket says 172.21.15.47:39880) 2024-05-14T12:28:32.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.016+0000 7f8aca800700 1 -- 172.21.15.47:0/1467796838 learned_addr learned my addr 172.21.15.47:0/1467796838 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:32.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.016+0000 7f8ac9400700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac41039d0 0x7f8ac4117690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:32.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.015+0000 7f8ac9e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac4103080 0x7f8ac4117150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:32.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.016+0000 7f8aca800700 1 -- 172.21.15.47:0/1467796838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac4103080 msgr2=0x7f8ac4117150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:32.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.018+0000 7f8aca800700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac4103080 0x7f8ac4117150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.018+0000 7f8aca800700 1 -- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac41039d0 msgr2=0x7f8ac4117690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:32.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.018+0000 7f8aca800700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac41039d0 0x7f8ac4117690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.018+0000 7f8aca800700 1 -- 172.21.15.47:0/1467796838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4112ad0 con 0x7f8ac41084d0 2024-05-14T12:28:32.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.019+0000 7f8ac9400700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac41039d0 0x7f8ac4117690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:28:32.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.019+0000 7f8aca800700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac41084d0 0x7f8ac41122a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000ef30 tx=0x7f8ac000c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:32.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.019+0000 7f8abea00700 1 -- 172.21.15.47:0/1467796838 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00092e0 con 0x7f8ac41084d0 2024-05-14T12:28:32.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.020+0000 7f8abea00700 1 -- 172.21.15.47:0/1467796838 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ac0004bb0 con 0x7f8ac41084d0 2024-05-14T12:28:32.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.020+0000 7f8abea00700 1 -- 172.21.15.47:0/1467796838 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0004280 con 0x7f8ac41084d0 2024-05-14T12:28:32.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.020+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac4112d60 con 0x7f8ac41084d0 2024-05-14T12:28:32.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.020+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac406d1e0 con 0x7f8ac41084d0 2024-05-14T12:28:32.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.022+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac406bee0 con 0x7f8ac41084d0 2024-05-14T12:28:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.026+0000 7f8abea00700 1 -- 172.21.15.47:0/1467796838 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8ac001b030 con 0x7f8ac41084d0 2024-05-14T12:28:32.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.028+0000 7f8abea00700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8aac0b2900 0x7f8aac0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:32.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.028+0000 7f8abea00700 1 -- 172.21.15.47:0/1467796838 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8ac00e2e90 con 0x7f8ac41084d0 2024-05-14T12:28:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.029+0000 7f8abea00700 1 -- 172.21.15.47:0/1467796838 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ac0022020 con 0x7f8ac41084d0 2024-05-14T12:28:32.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.033+0000 7f8ac9e00700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8aac0b2900 0x7f8aac0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:32.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.034+0000 7f8ac9e00700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8aac0b2900 0x7f8aac0b4e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8006010 tx=0x7f8ab800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:32.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.354+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ac40512c0 con 0x7f8ac41084d0 2024-05-14T12:28:32.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.356+0000 7f8abea00700 1 -- 172.21.15.47:0/1467796838 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11927 (secure 0 0 0) 0x7f8ac0010040 con 0x7f8ac41084d0 2024-05-14T12:28:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:28:32.356 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:27:59.832298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8aac0b2900 msgr2=0x7f8aac0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8aac0b2900 0x7f8aac0b4e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8006010 tx=0x7f8ab800b260 comp rx=0 tx=0).stop 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac41084d0 msgr2=0x7f8ac41122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac41084d0 0x7f8ac41122a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000ef30 tx=0x7f8ac000c450 comp rx=0 tx=0).stop 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 shutdown_connections 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f8aac0b2900 0x7f8aac0b4e10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac41084d0 0x7f8ac41122a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac4103080 0x7f8ac4117150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 --2- 172.21.15.47:0/1467796838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac41039d0 0x7f8ac4117690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:32.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 >> 172.21.15.47:0/1467796838 conn(0x7f8ac4078ac0 msgr2=0x7f8ac4105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:32.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 shutdown_connections 2024-05-14T12:28:32.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:32.359+0000 7f8acb200700 1 -- 172.21.15.47:0/1467796838 wait complete. 2024-05-14T12:28:32.360 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 32 2024-05-14T12:28:32.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:32 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1467796838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:28:33.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:32 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1467796838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:28:33.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:32 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1467796838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:28:33.249 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id 840e5663 --release --await' 2024-05-14T12:28:33.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id 840e5663 --release --await 2024-05-14T12:28:33.782 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:28:33.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:33 smithi047 ceph-mon[31254]: pgmap v551: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 69 MiB/s wr, 30 op/s 2024-05-14T12:28:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:33 smithi073 ceph-mon[35809]: pgmap v551: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 69 MiB/s wr, 30 op/s 2024-05-14T12:28:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:33 smithi066 ceph-mon[35981]: pgmap v551: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 69 MiB/s wr, 30 op/s 2024-05-14T12:28:35.906 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:35 smithi047 ceph-mon[31254]: pgmap v552: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 85 MiB/s wr, 33 op/s 2024-05-14T12:28:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:35 smithi073 ceph-mon[35809]: pgmap v552: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 85 MiB/s wr, 33 op/s 2024-05-14T12:28:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:35 smithi066 ceph-mon[35981]: pgmap v552: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 85 MiB/s wr, 33 op/s 2024-05-14T12:28:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 -- 172.21.15.47:0/1422824922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870109850 msgr2=0x7ff8701111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 --2- 172.21.15.47:0/1422824922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870109850 0x7ff8701111b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff86800b0a0 tx=0x7ff86800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 -- 172.21.15.47:0/1422824922 shutdown_connections 2024-05-14T12:28:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 --2- 172.21.15.47:0/1422824922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870109850 0x7ff8701111b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 --2- 172.21.15.47:0/1422824922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8701045d0 0x7ff8701049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 --2- 172.21.15.47:0/1422824922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870108f00 0x7ff870109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 -- 172.21.15.47:0/1422824922 >> 172.21.15.47:0/1422824922 conn(0x7ff8700ffec0 msgr2=0x7ff870102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 -- 172.21.15.47:0/1422824922 shutdown_connections 2024-05-14T12:28:36.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.338+0000 7ff877000700 1 -- 172.21.15.47:0/1422824922 wait complete. 2024-05-14T12:28:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.339+0000 7ff877000700 1 Processor -- start 2024-05-14T12:28:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.340+0000 7ff877000700 1 -- start start 2024-05-14T12:28:36.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.340+0000 7ff877000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8701045d0 0x7ff87019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.340+0000 7ff877000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870108f00 0x7ff87019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.340+0000 7ff877000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870109850 0x7ff8701a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.340+0000 7ff877000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff870114480 con 0x7ff870109850 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.340+0000 7ff877000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff870114300 con 0x7ff870108f00 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.340+0000 7ff877000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff870114600 con 0x7ff8701045d0 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870108f00 0x7ff87019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870108f00 0x7ff87019d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43794/0 (socket says 172.21.15.47:43794) 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 -- 172.21.15.47:0/1476293604 learned_addr learned my addr 172.21.15.47:0/1476293604 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff86fe00700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8701045d0 0x7ff87019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff875000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870109850 0x7ff8701a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 -- 172.21.15.47:0/1476293604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8701045d0 msgr2=0x7ff87019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8701045d0 0x7ff87019cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 -- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870109850 msgr2=0x7ff8701a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870109850 0x7ff8701a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff867e00700 1 -- 172.21.15.47:0/1476293604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8701a1e60 con 0x7ff870108f00 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.341+0000 7ff86fe00700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8701045d0 0x7ff87019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.342+0000 7ff867e00700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870108f00 0x7ff87019d530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c5d0 tx=0x7ff85800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.342+0000 7ff86d600700 1 -- 172.21.15.47:0/1476293604 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85800ce40 con 0x7ff870108f00 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.342+0000 7ff86d600700 1 -- 172.21.15.47:0/1476293604 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff858004ce0 con 0x7ff870108f00 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.342+0000 7ff86d600700 1 -- 172.21.15.47:0/1476293604 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85801e690 con 0x7ff870108f00 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.342+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8701a2150 con 0x7ff870108f00 2024-05-14T12:28:36.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.342+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87010b160 con 0x7ff870108f00 2024-05-14T12:28:36.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.346+0000 7ff86d600700 1 -- 172.21.15.47:0/1476293604 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff858005120 con 0x7ff870108f00 2024-05-14T12:28:36.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.347+0000 7ff885b12b80 1 Processor -- start 2024-05-14T12:28:36.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.347+0000 7ff885b12b80 1 -- start start 2024-05-14T12:28:36.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f028cf40 0x5642f040a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040aa10 0x5642f0417210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff885b12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5642f032cb20 con 0x5642f040aa10 2024-05-14T12:28:36.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff885b12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5642f02ca860 con 0x5642f028cf40 2024-05-14T12:28:36.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff885b12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5642f0328ae0 con 0x5642f040a600 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff86fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff86fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39898/0 (socket says 172.21.15.47:39898) 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff86fe00700 1 -- 172.21.15.47:0/68183941 learned_addr learned my addr 172.21.15.47:0/68183941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff875000700 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f028cf40 0x5642f040a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff867e00700 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040aa10 0x5642f0417210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff86fe00700 1 -- 172.21.15.47:0/68183941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f028cf40 msgr2=0x5642f040a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.348+0000 7ff86d600700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8540b2900 0x7ff8540b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff86fe00700 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f028cf40 0x5642f040a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff86fe00700 1 -- 172.21.15.47:0/68183941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040aa10 msgr2=0x5642f0417210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff86fe00700 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040aa10 0x5642f0417210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff86fe00700 1 -- 172.21.15.47:0/68183941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642f02799d0 con 0x5642f040a600 2024-05-14T12:28:36.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff86fe00700 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff8600115f0 tx=0x7ff860011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33cac6ec3c693e4a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:36.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff86d600700 1 -- 172.21.15.47:0/1476293604 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff8580ea2f0 con 0x7ff870108f00 2024-05-14T12:28:36.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff875000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8540b2900 0x7ff8540b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff865600700 1 -- 172.21.15.47:0/68183941 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86001e070 con 0x5642f040a600 2024-05-14T12:28:36.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff865600700 1 -- 172.21.15.47:0/68183941 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff860019ae0 con 0x5642f040a600 2024-05-14T12:28:36.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.349+0000 7ff865600700 1 -- 172.21.15.47:0/68183941 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86000eae0 con 0x5642f040a600 2024-05-14T12:28:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff885b12b80 1 -- 172.21.15.47:0/68183941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 msgr2=0x5642f0414cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff875000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8540b2900 0x7ff8540b4e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5642f0406880 tx=0x7ff8680099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff885b12b80 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff8600115f0 tx=0x7ff860011900 comp rx=0 tx=0).stop 2024-05-14T12:28:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff885b12b80 1 -- 172.21.15.47:0/68183941 shutdown_connections 2024-05-14T12:28:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff885b12b80 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040aa10 0x5642f0417210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff885b12b80 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f028cf40 0x5642f040a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff885b12b80 1 --2- 172.21.15.47:0/68183941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.350+0000 7ff885b12b80 1 -- 172.21.15.47:0/68183941 >> 172.21.15.47:0/68183941 conn(0x5642f02cbb80 msgr2=0x5642f0405f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:36.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.351+0000 7ff885b12b80 1 -- 172.21.15.47:0/68183941 shutdown_connections 2024-05-14T12:28:36.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.351+0000 7ff885b12b80 1 -- 172.21.15.47:0/68183941 wait complete. 2024-05-14T12:28:36.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.351+0000 7ff885b12b80 1 -- start start 2024-05-14T12:28:36.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 1 Processor -- start 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f028cf40 0x5642f0414780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f040aa10 0x5642f0415200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5642f0417b80 con 0x5642f028cf40 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5642f0292c20 con 0x5642f040aa10 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5642f0417d00 con 0x5642f040a600 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.352+0000 7ff885b12b80 10 client.0 _ll_register_callbacks cb 0x5642f02c0480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff875000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f040aa10 0x5642f0415200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff86fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f028cf40 0x5642f0414780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39910/0 (socket says 172.21.15.47:39910) 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 -- 172.21.15.47:0/325942738 learned_addr learned my addr 172.21.15.47:0/325942738 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 -- 172.21.15.47:0/325942738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f040aa10 msgr2=0x5642f0415200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f040aa10 0x5642f0415200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 -- 172.21.15.47:0/325942738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f028cf40 msgr2=0x5642f0414780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f028cf40 0x5642f0414780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 -- 172.21.15.47:0/325942738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642f02f2520 con 0x5642f040a600 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff867e00700 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8580b1860 tx=0x7ff8580b1e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee9ab3a122a7166c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:36.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.353+0000 7ff85e000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff85e000700 1 -- 172.21.15.47:0/325942738 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8580b1220 con 0x5642f040a600 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff85e000700 1 -- 172.21.15.47:0/325942738 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff8580d2b80 con 0x5642f040a600 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff860019ae0 con 0x5642f040a600 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff85e000700 1 -- 172.21.15.47:0/325942738 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff8580ad060 con 0x5642f040a600 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff885b12b80 10 client.25600 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5642f04227e0 con 0x5642f040a600 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff85e000700 1 -- 172.21.15.47:0/325942738 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff860019ae0 con 0x5642f040a600 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.354+0000 7ff85e000700 1 -- 172.21.15.47:0/325942738 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7ff8580edb80 con 0x5642f040a600 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.355+0000 7ff885b12b80 10 client.25600 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.355+0000 7ff885b12b80 10 client.25600 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.355+0000 7ff885b12b80 20 client.25600 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.355+0000 7ff885b12b80 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f0424e10 0x5642f0427290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.355+0000 7ff885b12b80 4 client.25600 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:28:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.355+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642f03d7170 con 0x5642f0424e10 2024-05-14T12:28:36.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.355+0000 7ff86fe00700 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f0424e10 0x5642f0427290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.356+0000 7ff86fe00700 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f0424e10 0x5642f0427290 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12b9ca16fc1e8482 server_cookie=bcc0821f923ecc0e in_seq=0 out_seq=0 2024-05-14T12:28:36.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.356+0000 7ff85e000700 10 client.25600 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.356+0000 7ff85e000700 1 -- 172.21.15.47:0/325942738 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5642f03d7170 con 0x5642f0424e10 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff85e000700 10 client.25600 handle_command_reply: tid=0 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 client.25600 shutdown 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 msgr2=0x5642f0414cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8580b1860 tx=0x7ff8580b1e10 comp rx=0 tx=0).stop 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 shutdown_connections 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f0424e10 0x5642f0427290 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f040aa10 0x5642f0415200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f028cf40 0x5642f0414780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 --2- 172.21.15.47:0/325942738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f040a600 0x5642f0414cc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 >> 172.21.15.47:0/325942738 conn(0x5642f02cbb80 msgr2=0x5642f04051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:36.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff85e000700 0 client.25600 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:36.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 shutdown_connections 2024-05-14T12:28:36.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 1 -- 172.21.15.47:0/325942738 wait complete. 2024-05-14T12:28:36.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.357+0000 7ff885b12b80 20 client.25600 trim_cache size 0 max 16384 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 Processor -- start 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 -- start start 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0415170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f0416bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f042ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701aca60 con 0x5642f040a600 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701ae690 con 0x5642f02cbb80 2024-05-14T12:28:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.380+0000 7ff885b12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701ad130 con 0x5642f028cf40 2024-05-14T12:28:36.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff875000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f042ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff875000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f042ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39588/0 (socket says 172.21.15.47:39588) 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff875000700 1 -- 172.21.15.47:0/2260034684 learned_addr learned my addr 172.21.15.47:0/2260034684 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff86fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0415170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff867e00700 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f0416bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff86fe00700 1 -- 172.21.15.47:0/2260034684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 msgr2=0x5642f0416bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff86fe00700 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f0416bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff86fe00700 1 -- 172.21.15.47:0/2260034684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 msgr2=0x5642f042ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff86fe00700 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f042ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff86fe00700 1 -- 172.21.15.47:0/2260034684 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642f0407540 con 0x5642f02cbb80 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.381+0000 7ff875000700 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f042ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:36.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.382+0000 7ff86fe00700 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0415170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff8600115c0 tx=0x7ff86000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e48a470ed2fbcb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:36.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.382+0000 7ff864c00700 1 -- 172.21.15.47:0/2260034684 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86001e040 con 0x5642f02cbb80 2024-05-14T12:28:36.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.382+0000 7ff864c00700 1 -- 172.21.15.47:0/2260034684 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff86001f040 con 0x5642f02cbb80 2024-05-14T12:28:36.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.382+0000 7ff864c00700 1 -- 172.21.15.47:0/2260034684 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86000e790 con 0x5642f02cbb80 2024-05-14T12:28:36.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 -- 172.21.15.47:0/2260034684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 msgr2=0x5642f0415170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0415170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff8600115c0 tx=0x7ff86000e720 comp rx=0 tx=0).stop 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 -- 172.21.15.47:0/2260034684 shutdown_connections 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f042ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0415170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 --2- 172.21.15.47:0/2260034684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f0416bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 -- 172.21.15.47:0/2260034684 >> 172.21.15.47:0/2260034684 conn(0x5642f03ff150 msgr2=0x5642f040db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 -- 172.21.15.47:0/2260034684 shutdown_connections 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.383+0000 7ff885b12b80 1 -- 172.21.15.47:0/2260034684 wait complete. 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.384+0000 7ff885b12b80 1 -- start start 2024-05-14T12:28:36.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.384+0000 7ff885b12b80 1 Processor -- start 2024-05-14T12:28:36.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.384+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f041d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.384+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0419790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.384+0000 7ff885b12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f0419cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff885b12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701adf00 con 0x5642f040a600 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff885b12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701ad800 con 0x5642f02cbb80 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff885b12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff87010f2d0 con 0x5642f028cf40 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff885b12b80 10 client.0 _ll_register_callbacks cb 0x5642f02c0480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff875000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f0419cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff867e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0419790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff86fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f041d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff875000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f0419cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39602/0 (socket says 172.21.15.47:39602) 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff875000700 1 -- 172.21.15.47:0/567175271 learned_addr learned my addr 172.21.15.47:0/567175271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff86fe00700 1 -- 172.21.15.47:0/567175271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 msgr2=0x5642f0419790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff86fe00700 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0419790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff86fe00700 1 -- 172.21.15.47:0/567175271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 msgr2=0x5642f0419cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:36.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff86fe00700 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f0419cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff86fe00700 1 -- 172.21.15.47:0/567175271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642f041a370 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.385+0000 7ff867e00700 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0419790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff86fe00700 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f041d420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8600115c0 tx=0x7ff86000e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f2994cd092bf696 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff85e000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff85e000700 1 -- 172.21.15.47:0/567175271 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860035020 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff85e000700 1 -- 172.21.15.47:0/567175271 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff860005230 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff86001f040 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff85e000700 1 -- 172.21.15.47:0/567175271 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff86001e040 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff885b12b80 10 client.25606 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.386+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5642f0490480 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff85e000700 1 -- 172.21.15.47:0/567175271 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff86001f040 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff85e000700 1 -- 172.21.15.47:0/567175271 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7ff860024040 con 0x5642f028cf40 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff885b12b80 10 client.25606 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff885b12b80 10 client.25606 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:28:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff885b12b80 20 client.25606 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff885b12b80 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f040aa10 0x5642f0492aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff885b12b80 4 client.25606 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "840e5663", "release": true, "await": true}] 2024-05-14T12:28:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "840e5663", "release": true, "await": true}) -- 0x5642f033a500 con 0x5642f040aa10 2024-05-14T12:28:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.387+0000 7ff867e00700 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f040aa10 0x5642f0492aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:36.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.388+0000 7ff867e00700 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f040aa10 0x5642f0492aa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f199588bcea7066d server_cookie=ecf9bc35cb838d2d in_seq=0 out_seq=0 2024-05-14T12:28:36.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.388+0000 7ff85e000700 10 client.25606 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.401+0000 7ff85e000700 1 -- 172.21.15.47:0/567175271 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5642f033a500 con 0x5642f040aa10 2024-05-14T12:28:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.401+0000 7ff85e000700 10 client.25606 handle_command_reply: tid=0 2024-05-14T12:28:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.401+0000 7ff885b12b80 1 client.25606 shutdown 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 msgr2=0x5642f041d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f041d420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8600115c0 tx=0x7ff86000e530 comp rx=0 tx=0).stop 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 shutdown_connections 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642f040aa10 0x5642f0492aa0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642f040a600 0x5642f0419cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642f028cf40 0x5642f041d420 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff85e000700 0 client.25606 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 --2- 172.21.15.47:0/567175271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642f02cbb80 0x5642f0419790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 >> 172.21.15.47:0/567175271 conn(0x5642f03ff150 msgr2=0x5642f0414e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 shutdown_connections 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 1 -- 172.21.15.47:0/567175271 wait complete. 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.402+0000 7ff885b12b80 20 client.25606 trim_cache size 0 max 16384 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 32, 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 8, 2024-05-14T12:28:36.403 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "840e5663": { 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 8, 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 87.5, 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:28:36.405 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:28:36.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:36.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:36.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:36.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:36.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:36.405 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.403+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8540b2900 msgr2=0x7ff8540b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.403+0000 7ff877000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8540b2900 0x7ff8540b4e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5642f0406880 tx=0x7ff8680099e0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.403+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870108f00 msgr2=0x7ff87019d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.403+0000 7ff877000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870108f00 0x7ff87019d530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c5d0 tx=0x7ff85800c8e0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 shutdown_connections 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8540b2900 0x7ff8540b4e10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff870109850 0x7ff8701a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8701045d0 0x7ff87019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 --2- 172.21.15.47:0/1476293604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff870108f00 0x7ff87019d530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 >> 172.21.15.47:0/1476293604 conn(0x7ff8700ffec0 msgr2=0x7ff870110e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:36.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 shutdown_connections 2024-05-14T12:28:36.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:36.404+0000 7ff877000700 1 -- 172.21.15.47:0/1476293604 wait complete. 2024-05-14T12:28:37.285 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '840e5663', seconds elapsed: 46.6 2024-05-14T12:28:37.285 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.5 2024-05-14T12:28:37.285 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:28:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:28:37.903 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:37 smithi047 ceph-mon[31254]: pgmap v553: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 103 MiB/s wr, 40 op/s 2024-05-14T12:28:38.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:37 smithi073 ceph-mon[35809]: pgmap v553: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 103 MiB/s wr, 40 op/s 2024-05-14T12:28:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:37 smithi066 ceph-mon[35981]: pgmap v553: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 103 MiB/s wr, 40 op/s 2024-05-14T12:28:39.786 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:39 smithi047 ceph-mon[31254]: pgmap v554: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 109 MiB/s wr, 42 op/s 2024-05-14T12:28:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:39 smithi073 ceph-mon[35809]: pgmap v554: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 109 MiB/s wr, 42 op/s 2024-05-14T12:28:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:39 smithi066 ceph-mon[35981]: pgmap v554: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 109 MiB/s wr, 42 op/s 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.152+0000 7ff836600700 1 -- 172.21.15.47:0/482803893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff83010e8e0 msgr2=0x7ff830110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.152+0000 7ff836600700 1 --2- 172.21.15.47:0/482803893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff83010e8e0 0x7ff830110dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff82800b0a0 tx=0x7ff82800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.153+0000 7ff836600700 1 -- 172.21.15.47:0/482803893 shutdown_connections 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.153+0000 7ff836600700 1 --2- 172.21.15.47:0/482803893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff83010e8e0 0x7ff830110dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.153+0000 7ff836600700 1 --2- 172.21.15.47:0/482803893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830105500 0x7ff830105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.153+0000 7ff836600700 1 --2- 172.21.15.47:0/482803893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff830105e50 0x7ff83010e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.153+0000 7ff836600700 1 -- 172.21.15.47:0/482803893 >> 172.21.15.47:0/482803893 conn(0x7ff8300fedc0 msgr2=0x7ff8301011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.153+0000 7ff836600700 1 -- 172.21.15.47:0/482803893 shutdown_connections 2024-05-14T12:28:40.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.153+0000 7ff836600700 1 -- 172.21.15.47:0/482803893 wait complete. 2024-05-14T12:28:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.154+0000 7ff836600700 1 Processor -- start 2024-05-14T12:28:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.154+0000 7ff836600700 1 -- start start 2024-05-14T12:28:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff836600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830105500 0x7ff83019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff836600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff830105e50 0x7ff83019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff836600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff83010e8e0 0x7ff83019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff836600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff830114440 con 0x7ff830105500 2024-05-14T12:28:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff836600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff8301142c0 con 0x7ff830105e50 2024-05-14T12:28:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff836600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8301145c0 con 0x7ff83010e8e0 2024-05-14T12:28:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff82f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830105500 0x7ff83019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.155+0000 7ff82ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff830105e50 0x7ff83019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff830105e50 0x7ff83019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60756/0 (socket says 172.21.15.47:60756) 2024-05-14T12:28:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 -- 172.21.15.47:0/3374186717 learned_addr learned my addr 172.21.15.47:0/3374186717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830105500 0x7ff83019ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52312/0 (socket says 172.21.15.47:52312) 2024-05-14T12:28:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82fe00700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff83010e8e0 0x7ff83019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 -- 172.21.15.47:0/3374186717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff83010e8e0 msgr2=0x7ff83019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff83010e8e0 0x7ff83019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 -- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830105500 msgr2=0x7ff83019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830105500 0x7ff83019ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 -- 172.21.15.47:0/3374186717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83019fc40 con 0x7ff830105e50 2024-05-14T12:28:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82fe00700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff83010e8e0 0x7ff83019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:28:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.156+0000 7ff82ea00700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff830105e50 0x7ff83019b310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e9a0 tx=0x7ff81c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.157+0000 7ff827e00700 1 -- 172.21.15.47:0/3374186717 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00cbd0 con 0x7ff830105e50 2024-05-14T12:28:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.157+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83019ff30 con 0x7ff830105e50 2024-05-14T12:28:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.157+0000 7ff827e00700 1 -- 172.21.15.47:0/3374186717 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff81c00cd70 con 0x7ff830105e50 2024-05-14T12:28:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.157+0000 7ff827e00700 1 -- 172.21.15.47:0/3374186717 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c018680 con 0x7ff830105e50 2024-05-14T12:28:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.157+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8301a7850 con 0x7ff830105e50 2024-05-14T12:28:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.158+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8300512c0 con 0x7ff830105e50 2024-05-14T12:28:40.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.161+0000 7ff827e00700 1 -- 172.21.15.47:0/3374186717 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff81c010430 con 0x7ff830105e50 2024-05-14T12:28:40.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.163+0000 7ff827e00700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8140b2900 0x7ff8140b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:40.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.163+0000 7ff827e00700 1 -- 172.21.15.47:0/3374186717 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff81c0e2380 con 0x7ff830105e50 2024-05-14T12:28:40.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.163+0000 7ff82f400700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8140b2900 0x7ff8140b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:40.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.164+0000 7ff82f400700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8140b2900 0x7ff8140b4e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff820009c60 tx=0x7ff820009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:40.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.167+0000 7ff827e00700 1 -- 172.21.15.47:0/3374186717 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff81c0aa060 con 0x7ff830105e50 2024-05-14T12:28:40.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.457+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8301a7a20 con 0x7ff830105e50 2024-05-14T12:28:40.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.459+0000 7ff827e00700 1 -- 172.21.15.47:0/3374186717 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11927 (secure 0 0 0) 0x7ff81c0b20e0 con 0x7ff830105e50 2024-05-14T12:28:40.459 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:28:40.459 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:27:59.832298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8140b2900 msgr2=0x7ff8140b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8140b2900 0x7ff8140b4e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff820009c60 tx=0x7ff820009260 comp rx=0 tx=0).stop 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff830105e50 msgr2=0x7ff83019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff830105e50 0x7ff83019b310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e9a0 tx=0x7ff81c00ecb0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 shutdown_connections 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8140b2900 0x7ff8140b4e10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff83010e8e0 0x7ff83019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830105500 0x7ff83019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 --2- 172.21.15.47:0/3374186717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff830105e50 0x7ff83019b310 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:40.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.462+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 >> 172.21.15.47:0/3374186717 conn(0x7ff8300fedc0 msgr2=0x7ff830108480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:40.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.463+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 shutdown_connections 2024-05-14T12:28:40.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:40.463+0000 7ff836600700 1 -- 172.21.15.47:0/3374186717 wait complete. 2024-05-14T12:28:40.464 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 32 2024-05-14T12:28:40.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:40 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3374186717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:28:41.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:40 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3374186717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:28:41.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:40 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3374186717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:28:41.418 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 87.5 --await-for 42.0' 2024-05-14T12:28:41.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 87.5 --await-for 42.0 2024-05-14T12:28:41.868 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:28:41.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:41 smithi047 ceph-mon[31254]: pgmap v555: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 109 MiB/s wr, 43 op/s 2024-05-14T12:28:42.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:41 smithi073 ceph-mon[35809]: pgmap v555: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 109 MiB/s wr, 43 op/s 2024-05-14T12:28:42.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:41 smithi066 ceph-mon[35981]: pgmap v555: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 109 MiB/s wr, 43 op/s 2024-05-14T12:28:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 -- 172.21.15.47:0/1758887625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 msgr2=0x7fcb001069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 --2- 172.21.15.47:0/1758887625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb001069c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009900 tx=0x7fcaf402a3f0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 -- 172.21.15.47:0/1758887625 shutdown_connections 2024-05-14T12:28:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 --2- 172.21.15.47:0/1758887625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0010bc00 0x7fcb0010e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 --2- 172.21.15.47:0/1758887625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb00106f00 0x7fcb00107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 --2- 172.21.15.47:0/1758887625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb001069c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 -- 172.21.15.47:0/1758887625 >> 172.21.15.47:0/1758887625 conn(0x7fcb00100ed0 msgr2=0x7fcb00103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 -- 172.21.15.47:0/1758887625 shutdown_connections 2024-05-14T12:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.890+0000 7fcb06e00640 1 -- 172.21.15.47:0/1758887625 wait complete. 2024-05-14T12:28:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.891+0000 7fcb06e00640 1 Processor -- start 2024-05-14T12:28:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.891+0000 7fcb06e00640 1 -- start start 2024-05-14T12:28:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb06e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb0019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb06e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb00106f00 0x7fcb0019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb06e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb0010bc00 0x7fcb001a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb06e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00111840 con 0x7fcb00106f00 2024-05-14T12:28:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb06e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001116c0 con 0x7fcb00105cc0 2024-05-14T12:28:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb06e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001119c0 con 0x7fcb0010bc00 2024-05-14T12:28:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb05a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb0019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb05a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb0019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60786/0 (socket says 172.21.15.47:60786) 2024-05-14T12:28:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb05a00640 1 -- 172.21.15.47:0/175602178 learned_addr learned my addr 172.21.15.47:0/175602178 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb06400640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb0010bc00 0x7fcb001a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.892+0000 7fcb05000640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb00106f00 0x7fcb0019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcb05a00640 1 -- 172.21.15.47:0/175602178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb0010bc00 msgr2=0x7fcb001a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcb05a00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb0010bc00 0x7fcb001a3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcb05a00640 1 -- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb00106f00 msgr2=0x7fcb0019c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcb05a00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb00106f00 0x7fcb0019c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcb05a00640 1 -- 172.21.15.47:0/175602178 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb001a3ed0 con 0x7fcb00105cc0 2024-05-14T12:28:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcb05a00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb0019c390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006010 tx=0x7fcaf4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcafe000640 1 -- 172.21.15.47:0/175602178 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf403f030 con 0x7fcb00105cc0 2024-05-14T12:28:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcafe000640 1 -- 172.21.15.47:0/175602178 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaf4031910 con 0x7fcb00105cc0 2024-05-14T12:28:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb001a4160 con 0x7fcb00105cc0 2024-05-14T12:28:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.893+0000 7fcafe000640 1 -- 172.21.15.47:0/175602178 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4035070 con 0x7fcb00105cc0 2024-05-14T12:28:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.894+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001a4650 con 0x7fcb00105cc0 2024-05-14T12:28:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.897+0000 7fcb0f392740 1 Processor -- start 2024-05-14T12:28:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.897+0000 7fcb0f392740 1 -- start start 2024-05-14T12:28:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.897+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f5d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.897+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f5d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.897+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b9a4d0 0x55aa17f64780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb0f392740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aa17ec1550 con 0x55aa17b922f0 2024-05-14T12:28:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb0f392740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55aa17e66bc0 con 0x55aa17bbb1b0 2024-05-14T12:28:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb0f392740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55aa17ebd510 con 0x55aa17b9a4d0 2024-05-14T12:28:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcafe000640 1 -- 172.21.15.47:0/175602178 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcaf4042030 con 0x7fcb00105cc0 2024-05-14T12:28:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb06400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f5d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb05000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b9a4d0 0x55aa17f64780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb06400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f5d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60792/0 (socket says 172.21.15.47:60792) 2024-05-14T12:28:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb06400640 1 -- 172.21.15.47:0/417652681 learned_addr learned my addr 172.21.15.47:0/417652681 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb05a00640 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f5d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb05000640 1 -- 172.21.15.47:0/417652681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 msgr2=0x55aa17f5d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb05000640 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f5d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb05000640 1 -- 172.21.15.47:0/417652681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 msgr2=0x55aa17f5d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb05000640 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f5d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.898+0000 7fcb05000640 1 -- 172.21.15.47:0/417652681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa17bd3210 con 0x55aa17b9a4d0 2024-05-14T12:28:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.899+0000 7fcb05000640 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b9a4d0 0x55aa17f64780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009bf0 tx=0x7fcaec011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b500bb7db24f60b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.899+0000 7fcaf2a00640 1 -- 172.21.15.47:0/417652681 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec004050 con 0x55aa17b9a4d0 2024-05-14T12:28:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.899+0000 7fcaf2a00640 1 -- 172.21.15.47:0/417652681 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaec0054d0 con 0x55aa17b9a4d0 2024-05-14T12:28:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.899+0000 7fcaf2a00640 1 -- 172.21.15.47:0/417652681 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec004d10 con 0x55aa17b9a4d0 2024-05-14T12:28:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.900+0000 7fcafe000640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcae80b28a0 0x7fcae80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.900+0000 7fcafe000640 1 -- 172.21.15.47:0/175602178 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcaf4102590 con 0x7fcb00105cc0 2024-05-14T12:28:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.900+0000 7fcb0f392740 1 -- 172.21.15.47:0/417652681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b9a4d0 msgr2=0x55aa17f64780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.900+0000 7fcb0f392740 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b9a4d0 0x55aa17f64780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009bf0 tx=0x7fcaec011810 comp rx=0 tx=0).stop 2024-05-14T12:28:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 -- 172.21.15.47:0/417652681 shutdown_connections 2024-05-14T12:28:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b9a4d0 0x55aa17f64780 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f5d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 --2- 172.21.15.47:0/417652681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f5d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 -- 172.21.15.47:0/417652681 >> 172.21.15.47:0/417652681 conn(0x55aa17baf300 msgr2=0x55aa17f58c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb06400640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcae80b28a0 0x7fcae80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 -- 172.21.15.47:0/417652681 shutdown_connections 2024-05-14T12:28:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 -- 172.21.15.47:0/417652681 wait complete. 2024-05-14T12:28:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb06400640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcae80b28a0 0x7fcae80b4db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55aa17f5e4d0 tx=0x7fcaf8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.901+0000 7fcb0f392740 1 -- start start 2024-05-14T12:28:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 1 Processor -- start 2024-05-14T12:28:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b922f0 0x55aa17f66f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17bbb1b0 0x55aa17f67480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b79d80 0x55aa17f6e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aa17f651d0 con 0x55aa17b79d80 2024-05-14T12:28:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55aa17e7a660 con 0x55aa17b922f0 2024-05-14T12:28:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55aa17f65350 con 0x55aa17bbb1b0 2024-05-14T12:28:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb0f392740 10 client.0 _ll_register_callbacks cb 0x55aa17e44400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb05a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b922f0 0x55aa17f66f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb05a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b922f0 0x55aa17f66f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60796/0 (socket says 172.21.15.47:60796) 2024-05-14T12:28:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.902+0000 7fcb05a00640 1 -- 172.21.15.47:0/3989063741 learned_addr learned my addr 172.21.15.47:0/3989063741 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb06400640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b79d80 0x55aa17f6e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb05000640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17bbb1b0 0x55aa17f67480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb05a00640 1 -- 172.21.15.47:0/3989063741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17bbb1b0 msgr2=0x55aa17f67480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb05a00640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17bbb1b0 0x55aa17f67480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb05a00640 1 -- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b79d80 msgr2=0x55aa17f6e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb05a00640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b79d80 0x55aa17f6e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb05a00640 1 -- 172.21.15.47:0/3989063741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa17c9f620 con 0x55aa17b922f0 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb06400640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b79d80 0x55aa17f6e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcb05a00640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b922f0 0x55aa17f66f40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40c9bb0 tx=0x7fcaf40c5ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec82f1975f85d28 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.903+0000 7fcae7400640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.904+0000 7fcae7400640 1 -- 172.21.15.47:0/3989063741 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4049040 con 0x55aa17b922f0 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.904+0000 7fcae7400640 1 -- 172.21.15.47:0/3989063741 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcaf4105b00 con 0x55aa17b922f0 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.904+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaec0054d0 con 0x55aa17b922f0 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.904+0000 7fcae7400640 1 -- 172.21.15.47:0/3989063741 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcaf40c53b0 con 0x55aa17b922f0 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.904+0000 7fcb0f392740 10 client.25601 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.904+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55aa17f71310 con 0x55aa17b922f0 2024-05-14T12:28:43.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:43 smithi047 ceph-mon[31254]: pgmap v556: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 MiB/s wr, 54 op/s 2024-05-14T12:28:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.904+0000 7fcae7400640 1 -- 172.21.15.47:0/3989063741 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaec0054d0 con 0x55aa17b922f0 2024-05-14T12:28:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.905+0000 7fcae7400640 1 -- 172.21.15.47:0/3989063741 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fcaf40d2540 con 0x55aa17b922f0 2024-05-14T12:28:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.905+0000 7fcb0f392740 10 client.25601 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.905+0000 7fcb0f392740 10 client.25601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.905+0000 7fcb0f392740 20 client.25601 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.905+0000 7fcb0f392740 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17b4f1c0 0x55aa17f74ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.905+0000 7fcb0f392740 4 client.25601 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:28:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.905+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa17ecf160 con 0x55aa17b4f1c0 2024-05-14T12:28:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.906+0000 7fcb05000640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17b4f1c0 0x55aa17f74ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.906+0000 7fcae7400640 10 client.25601 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.906+0000 7fcb05000640 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17b4f1c0 0x55aa17f74ad0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4efe6cbe0732008c server_cookie=4b648c3abed3cc57 in_seq=0 out_seq=0 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.907+0000 7fcae7400640 1 -- 172.21.15.47:0/3989063741 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa17ecf160 con 0x55aa17b4f1c0 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.907+0000 7fcae7400640 10 client.25601 handle_command_reply: tid=0 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.907+0000 7fcb0f392740 1 client.25601 shutdown 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b922f0 msgr2=0x55aa17f66f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b922f0 0x55aa17f66f40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40c9bb0 tx=0x7fcaf40c5ba0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 shutdown_connections 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17b4f1c0 0x55aa17f74ad0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b79d80 0x55aa17f6e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17bbb1b0 0x55aa17f67480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 --2- 172.21.15.47:0/3989063741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b922f0 0x55aa17f66f40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcae7400640 0 client.25601 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 >> 172.21.15.47:0/3989063741 conn(0x55aa17baf300 msgr2=0x55aa17f57c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 shutdown_connections 2024-05-14T12:28:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 1 -- 172.21.15.47:0/3989063741 wait complete. 2024-05-14T12:28:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.908+0000 7fcb0f392740 20 client.25601 trim_cache size 0 max 16384 2024-05-14T12:28:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 Processor -- start 2024-05-14T12:28:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 -- start start 2024-05-14T12:28:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b79d80 0x55aa17f656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f65c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f66b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001ad350 con 0x55aa17b922f0 2024-05-14T12:28:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001aef80 con 0x55aa17bbb1b0 2024-05-14T12:28:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb0f392740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001ada20 con 0x55aa17b79d80 2024-05-14T12:28:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb05000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f65c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.925+0000 7fcb05a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b79d80 0x55aa17f656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f65c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52362/0 (socket says 172.21.15.47:52362) 2024-05-14T12:28:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05000640 1 -- 172.21.15.47:0/4215877701 learned_addr learned my addr 172.21.15.47:0/4215877701 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb06400640 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f66b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05a00640 1 -- 172.21.15.47:0/4215877701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 msgr2=0x55aa17f66b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05a00640 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f66b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05a00640 1 -- 172.21.15.47:0/4215877701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 msgr2=0x55aa17f65c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05a00640 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f65c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05a00640 1 -- 172.21.15.47:0/4215877701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa17f544a0 con 0x55aa17b79d80 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.926+0000 7fcb05a00640 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b79d80 0x55aa17f656f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40c6e90 tx=0x7fcaf40c5c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71a47a0d8401ed37 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.927+0000 7fcaf2000640 1 -- 172.21.15.47:0/4215877701 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4049070 con 0x55aa17b79d80 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.927+0000 7fcaf2000640 1 -- 172.21.15.47:0/4215877701 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaf40d2310 con 0x55aa17b79d80 2024-05-14T12:28:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.927+0000 7fcaf2000640 1 -- 172.21.15.47:0/4215877701 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40c5590 con 0x55aa17b79d80 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 -- 172.21.15.47:0/4215877701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b79d80 msgr2=0x55aa17f656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b79d80 0x55aa17f656f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40c6e90 tx=0x7fcaf40c5c10 comp rx=0 tx=0).stop 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 -- 172.21.15.47:0/4215877701 shutdown_connections 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17bbb1b0 0x55aa17f66b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17b922f0 0x55aa17f65c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 --2- 172.21.15.47:0/4215877701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b79d80 0x55aa17f656f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 -- 172.21.15.47:0/4215877701 >> 172.21.15.47:0/4215877701 conn(0x55aa17baf300 msgr2=0x55aa17f606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 -- 172.21.15.47:0/4215877701 shutdown_connections 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 -- 172.21.15.47:0/4215877701 wait complete. 2024-05-14T12:28:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.928+0000 7fcb0f392740 1 -- start start 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 1 Processor -- start 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b79d80 0x55aa17f6da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b922f0 0x55aa17f6a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17bbb1b0 0x55aa17f6ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001ae7f0 con 0x55aa17bbb1b0 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001ae0f0 con 0x55aa17b79d80 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001ab310 con 0x55aa17b922f0 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb0f392740 10 client.0 _ll_register_callbacks cb 0x7fcaf4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb06400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17bbb1b0 0x55aa17f6ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb05000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b922f0 0x55aa17f6a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb05a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b79d80 0x55aa17f6da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb06400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17bbb1b0 0x55aa17f6ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52366/0 (socket says 172.21.15.47:52366) 2024-05-14T12:28:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.929+0000 7fcb06400640 1 -- 172.21.15.47:0/1141810818 learned_addr learned my addr 172.21.15.47:0/1141810818 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb05a00640 1 -- 172.21.15.47:0/1141810818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b922f0 msgr2=0x55aa17f6a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb05a00640 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b922f0 0x55aa17f6a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb05a00640 1 -- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17bbb1b0 msgr2=0x55aa17f6ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb05a00640 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17bbb1b0 0x55aa17f6ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb05a00640 1 -- 172.21.15.47:0/1141810818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa17fdaea0 con 0x55aa17b79d80 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb06400640 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17bbb1b0 0x55aa17f6ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb05a00640 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b79d80 0x55aa17f6da50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4031440 tx=0x7fcaf40c5ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db30d22957cd05d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcae7400640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcae7400640 1 -- 172.21.15.47:0/1141810818 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4049050 con 0x55aa17b79d80 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aa17ec8fd0 con 0x55aa17b79d80 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.930+0000 7fcae7400640 1 -- 172.21.15.47:0/1141810818 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcaf40c9090 con 0x55aa17b79d80 2024-05-14T12:28:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcae7400640 1 -- 172.21.15.47:0/1141810818 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcaf40c9730 con 0x55aa17b79d80 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 10 client.25607 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55aa17fdaea0 con 0x55aa17b79d80 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcae7400640 1 -- 172.21.15.47:0/1141810818 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aa17ec8fd0 con 0x55aa17b79d80 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcae7400640 1 -- 172.21.15.47:0/1141810818 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fcaf40c88f0 con 0x55aa17b79d80 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 10 client.25607 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 10 client.25607 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 20 client.25607 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17fdc760 0x55aa17fdeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 4 client.25607 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa17e444b0 con 0x55aa17fdc760 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.931+0000 7fcb05000640 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17fdc760 0x55aa17fdeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.932+0000 7fcb05000640 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17fdc760 0x55aa17fdeb80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6de9812a4648fe server_cookie=5eaa9e02ac2e9d92 in_seq=0 out_seq=0 2024-05-14T12:28:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.932+0000 7fcae7400640 10 client.25607 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:43.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcae7400640 1 -- 172.21.15.47:0/1141810818 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa17e444b0 con 0x55aa17fdc760 2024-05-14T12:28:43.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcae7400640 10 client.25607 handle_command_reply: tid=0 2024-05-14T12:28:43.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 client.25607 shutdown 2024-05-14T12:28:43.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b79d80 msgr2=0x55aa17f6da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b79d80 0x55aa17f6da50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4031440 tx=0x7fcaf40c5ba0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 shutdown_connections 2024-05-14T12:28:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55aa17fdc760 0x55aa17fdeb80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa17bbb1b0 0x55aa17f6ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aa17b922f0 0x55aa17f6a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 --2- 172.21.15.47:0/1141810818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55aa17b79d80 0x55aa17f6da50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 >> 172.21.15.47:0/1141810818 conn(0x55aa17baf300 msgr2=0x55aa17f66b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcae7400640 0 client.25607 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:43.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 shutdown_connections 2024-05-14T12:28:43.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.952+0000 7fcb0f392740 1 -- 172.21.15.47:0/1141810818 wait complete. 2024-05-14T12:28:43.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb0f392740 20 client.25607 trim_cache size 0 max 16384 2024-05-14T12:28:43.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:28:43.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:28:43.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:28:43.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:28:43.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcae80b28a0 msgr2=0x7fcae80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcae80b28a0 0x7fcae80b4db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55aa17f5e4d0 tx=0x7fcaf8009500 comp rx=0 tx=0).stop 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 msgr2=0x7fcb0019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb0019c390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006010 tx=0x7fcaf4004270 comp rx=0 tx=0).stop 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 shutdown_connections 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcae80b28a0 0x7fcae80b4db0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb0010bc00 0x7fcb001a3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb00106f00 0x7fcb0019c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 --2- 172.21.15.47:0/175602178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb00105cc0 0x7fcb0019c390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.953+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 >> 172.21.15.47:0/175602178 conn(0x7fcb00100ed0 msgr2=0x7fcb00107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.954+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 shutdown_connections 2024-05-14T12:28:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:43.954+0000 7fcb06e00640 1 -- 172.21.15.47:0/175602178 wait complete. 2024-05-14T12:28:44.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:43 smithi073 ceph-mon[35809]: pgmap v556: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 MiB/s wr, 54 op/s 2024-05-14T12:28:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:43 smithi066 ceph-mon[35981]: pgmap v556: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 MiB/s wr, 54 op/s 2024-05-14T12:28:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.498+0000 7faab4600700 1 -- 172.21.15.47:0/1366583345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac110ba0 msgr2=0x7faaac113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.498+0000 7faab4600700 1 --2- 172.21.15.47:0/1366583345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac110ba0 0x7faaac113000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faaa400b0a0 tx=0x7faaa400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.498+0000 7faab4600700 1 -- 172.21.15.47:0/1366583345 shutdown_connections 2024-05-14T12:28:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.498+0000 7faab4600700 1 --2- 172.21.15.47:0/1366583345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac110ba0 0x7faaac113000 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.498+0000 7faab4600700 1 --2- 172.21.15.47:0/1366583345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaac075d30 0x7faaac076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.498+0000 7faab4600700 1 --2- 172.21.15.47:0/1366583345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaac076680 0x7faaac110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.498+0000 7faab4600700 1 -- 172.21.15.47:0/1366583345 >> 172.21.15.47:0/1366583345 conn(0x7faaac100040 msgr2=0x7faaac102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.501+0000 7faab4600700 1 -- 172.21.15.47:0/1366583345 shutdown_connections 2024-05-14T12:28:44.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.501+0000 7faab4600700 1 -- 172.21.15.47:0/1366583345 wait complete. 2024-05-14T12:28:44.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.504+0000 7faab4600700 1 Processor -- start 2024-05-14T12:28:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.504+0000 7faab4600700 1 -- start start 2024-05-14T12:28:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.505+0000 7faab4600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaac075d30 0x7faaac10a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.505+0000 7faab4600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac076680 0x7faaac10a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.505+0000 7faab4600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaac110ba0 0x7faaac10fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.505+0000 7faab4600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faaac116740 con 0x7faaac110ba0 2024-05-14T12:28:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.505+0000 7faab4600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1165c0 con 0x7faaac076680 2024-05-14T12:28:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.505+0000 7faab4600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1168c0 con 0x7faaac075d30 2024-05-14T12:28:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.506+0000 7faab1200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac076680 0x7faaac10a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.506+0000 7faab1c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaac075d30 0x7faaac10a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.506+0000 7faab1200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac076680 0x7faaac10a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60836/0 (socket says 172.21.15.47:60836) 2024-05-14T12:28:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.506+0000 7faab1200700 1 -- 172.21.15.47:0/2603883911 learned_addr learned my addr 172.21.15.47:0/2603883911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.507+0000 7faab2600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaac110ba0 0x7faaac10fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.507+0000 7faab1200700 1 -- 172.21.15.47:0/2603883911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaac075d30 msgr2=0x7faaac10a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.507+0000 7faab1200700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaac075d30 0x7faaac10a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.507+0000 7faab1200700 1 -- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaac110ba0 msgr2=0x7faaac10fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.508+0000 7faab1200700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaac110ba0 0x7faaac10fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.508+0000 7faab1200700 1 -- 172.21.15.47:0/2603883911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac110630 con 0x7faaac076680 2024-05-14T12:28:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.510+0000 7faab2600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaac110ba0 0x7faaac10fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:28:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.511+0000 7faab1200700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac076680 0x7faaac10a640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faaa000d950 tx=0x7faaa000dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.511+0000 7faaaa000700 1 -- 172.21.15.47:0/2603883911 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0016070 con 0x7faaac076680 2024-05-14T12:28:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.511+0000 7faaaa000700 1 -- 172.21.15.47:0/2603883911 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa0010460 con 0x7faaac076680 2024-05-14T12:28:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.511+0000 7faaaa000700 1 -- 172.21.15.47:0/2603883911 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa000f620 con 0x7faaac076680 2024-05-14T12:28:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.512+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac110920 con 0x7faaac076680 2024-05-14T12:28:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.513+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac105530 con 0x7faaac076680 2024-05-14T12:28:44.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.522+0000 7faaaa000700 1 -- 172.21.15.47:0/2603883911 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7faaa0019070 con 0x7faaac076680 2024-05-14T12:28:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.526+0000 7faaaa000700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faa940b29c0 0x7faa940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.526+0000 7faac307eb80 1 Processor -- start 2024-05-14T12:28:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.526+0000 7faaaa000700 1 -- 172.21.15.47:0/2603883911 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faaa00e1fd0 con 0x7faaac076680 2024-05-14T12:28:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.526+0000 7faab1c00700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faa940b29c0 0x7faa940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.528+0000 7faac307eb80 1 -- start start 2024-05-14T12:28:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.528+0000 7faab1c00700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faa940b29c0 0x7faa940b4ed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa9c006fd0 tx=0x7faa9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.529+0000 7faac307eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16dea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.529+0000 7faac307eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16dea690 0x55ed16df4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.529+0000 7faac307eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 0x55ed16df72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.529+0000 7faac307eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ed16d0cbb0 con 0x55ed16dea690 2024-05-14T12:28:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.529+0000 7faac307eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed16caa8f0 con 0x55ed16c6cfd0 2024-05-14T12:28:44.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.529+0000 7faac307eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ed16d08b70 con 0x55ed16deaaa0 2024-05-14T12:28:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16dea690 0x55ed16df4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16dea690 0x55ed16df4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52388/0 (socket says 172.21.15.47:52388) 2024-05-14T12:28:44.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 -- 172.21.15.47:0/983922500 learned_addr learned my addr 172.21.15.47:0/983922500 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1c00700 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16dea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 -- 172.21.15.47:0/983922500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 msgr2=0x55ed16df72a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 0x55ed16df72a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 -- 172.21.15.47:0/983922500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 msgr2=0x55ed16dea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16dea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.530+0000 7faab1200700 1 -- 172.21.15.47:0/983922500 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed16c59a60 con 0x55ed16dea690 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.531+0000 7faab1c00700 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16dea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.531+0000 7faab1200700 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16dea690 0x55ed16df4d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faaa00a6820 tx=0x7faaa00a9190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2739cb0d699d45f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.532+0000 7faa9aa00700 1 -- 172.21.15.47:0/983922500 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa00b2410 con 0x55ed16dea690 2024-05-14T12:28:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.532+0000 7faa9aa00700 1 -- 172.21.15.47:0/983922500 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa0010930 con 0x55ed16dea690 2024-05-14T12:28:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.533+0000 7faa9aa00700 1 -- 172.21.15.47:0/983922500 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa00b1f80 con 0x55ed16dea690 2024-05-14T12:28:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.533+0000 7faac307eb80 1 -- 172.21.15.47:0/983922500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16dea690 msgr2=0x55ed16df4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.533+0000 7faac307eb80 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16dea690 0x55ed16df4d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faaa00a6820 tx=0x7faaa00a9190 comp rx=0 tx=0).stop 2024-05-14T12:28:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.534+0000 7faac307eb80 1 -- 172.21.15.47:0/983922500 shutdown_connections 2024-05-14T12:28:44.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.534+0000 7faac307eb80 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 0x55ed16df72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.534+0000 7faac307eb80 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16dea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.534+0000 7faac307eb80 1 --2- 172.21.15.47:0/983922500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16dea690 0x55ed16df4d50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.534+0000 7faac307eb80 1 -- 172.21.15.47:0/983922500 >> 172.21.15.47:0/983922500 conn(0x55ed16cabc10 msgr2=0x55ed16de5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:44.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.535+0000 7faac307eb80 1 -- 172.21.15.47:0/983922500 shutdown_connections 2024-05-14T12:28:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.535+0000 7faac307eb80 1 -- 172.21.15.47:0/983922500 wait complete. 2024-05-14T12:28:44.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.536+0000 7faac307eb80 1 -- start start 2024-05-14T12:28:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.536+0000 7faac307eb80 1 Processor -- start 2024-05-14T12:28:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.537+0000 7faac307eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16df4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.537+0000 7faac307eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16dea690 0x55ed16df4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.537+0000 7faac307eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16df51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.537+0000 7faac307eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ed16df7c50 con 0x55ed16deaaa0 2024-05-14T12:28:44.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.537+0000 7faac307eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed16c72cb0 con 0x55ed16c6cfd0 2024-05-14T12:28:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.537+0000 7faac307eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ed16df7dd0 con 0x55ed16dea690 2024-05-14T12:28:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.537+0000 7faac307eb80 10 client.0 _ll_register_callbacks cb 0x55ed16ca0510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.538+0000 7faab1200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16dea690 0x55ed16df4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.538+0000 7faab1200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16dea690 0x55ed16df4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43314/0 (socket says 172.21.15.47:43314) 2024-05-14T12:28:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.538+0000 7faab1200700 1 -- 172.21.15.47:0/3923441216 learned_addr learned my addr 172.21.15.47:0/3923441216 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.538+0000 7faab1c00700 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16df4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.538+0000 7faab2600700 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16df51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.539+0000 7faab1200700 1 -- 172.21.15.47:0/3923441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 msgr2=0x55ed16df4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.539+0000 7faab1200700 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16df4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.539+0000 7faab1200700 1 -- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 msgr2=0x55ed16df51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.539+0000 7faab1200700 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16df51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.539+0000 7faab1200700 1 -- 172.21.15.47:0/3923441216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed16cd25b0 con 0x55ed16dea690 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.540+0000 7faab1200700 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16dea690 0x55ed16df4ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b2f0 tx=0x7faaa00a94b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cfeba7efb11a793 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:44.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.540+0000 7faa8f400700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:28:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.540+0000 7faa8f400700 1 -- 172.21.15.47:0/3923441216 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa00b2410 con 0x55ed16dea690 2024-05-14T12:28:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.540+0000 7faa8f400700 1 -- 172.21.15.47:0/3923441216 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faaa00b1f80 con 0x55ed16dea690 2024-05-14T12:28:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.541+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaa0010930 con 0x55ed16dea690 2024-05-14T12:28:44.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.542+0000 7faa8f400700 1 -- 172.21.15.47:0/3923441216 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faaa0088050 con 0x55ed16dea690 2024-05-14T12:28:44.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.542+0000 7faac307eb80 10 client.25639 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:44.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.542+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ed16df7c50 con 0x55ed16dea690 2024-05-14T12:28:44.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.542+0000 7faa8f400700 1 -- 172.21.15.47:0/3923441216 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaa0010930 con 0x55ed16dea690 2024-05-14T12:28:44.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.543+0000 7faa8f400700 1 -- 172.21.15.47:0/3923441216 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7faaa00b0ce0 con 0x55ed16dea690 2024-05-14T12:28:44.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.543+0000 7faac307eb80 10 client.25639 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:44.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.544+0000 7faac307eb80 10 client.25639 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:28:44.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.544+0000 7faac307eb80 20 client.25639 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:44.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.544+0000 7faac307eb80 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e04b20 0x55ed16e06f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.544+0000 7faac307eb80 4 client.25639 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:28:44.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.544+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed16db7200 con 0x55ed16e04b20 2024-05-14T12:28:44.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.547+0000 7faab1c00700 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e04b20 0x55ed16e06f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.549+0000 7faab1c00700 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e04b20 0x55ed16e06f40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c209a51d06845b server_cookie=4efe3a82ed6f4a7e in_seq=0 out_seq=0 2024-05-14T12:28:44.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.549+0000 7faa8f400700 10 client.25639 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:44.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.551+0000 7faa8f400700 1 -- 172.21.15.47:0/3923441216 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ed16db7200 con 0x55ed16e04b20 2024-05-14T12:28:44.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.551+0000 7faa8f400700 10 client.25639 handle_command_reply: tid=0 2024-05-14T12:28:44.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.551+0000 7faac307eb80 1 client.25639 shutdown 2024-05-14T12:28:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.552+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16dea690 msgr2=0x55ed16df4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.552+0000 7faac307eb80 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16dea690 0x55ed16df4ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b2f0 tx=0x7faaa00a94b0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.557+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 shutdown_connections 2024-05-14T12:28:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.557+0000 7faac307eb80 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e04b20 0x55ed16e06f40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.557+0000 7faac307eb80 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16df51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.557+0000 7faac307eb80 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16c6cfd0 0x55ed16df4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.557+0000 7faac307eb80 1 --2- 172.21.15.47:0/3923441216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16dea690 0x55ed16df4ca0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.557+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 >> 172.21.15.47:0/3923441216 conn(0x55ed16cabc10 msgr2=0x55ed16de5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.557+0000 7faa8f400700 0 client.25639 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.558+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 shutdown_connections 2024-05-14T12:28:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.558+0000 7faac307eb80 1 -- 172.21.15.47:0/3923441216 wait complete. 2024-05-14T12:28:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.559+0000 7faac307eb80 20 client.25639 trim_cache size 0 max 16384 2024-05-14T12:28:44.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.612+0000 7faac307eb80 1 Processor -- start 2024-05-14T12:28:44.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.614+0000 7faac307eb80 1 -- start start 2024-05-14T12:28:44.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faac307eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16c6cfd0 0x55ed16deffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faac307eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16df5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faac307eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 0x55ed16df19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faac307eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1bdc20 con 0x55ed16c6cfd0 2024-05-14T12:28:44.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faac307eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1bf850 con 0x55ed16dea690 2024-05-14T12:28:44.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faac307eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1be2f0 con 0x55ed16deaaa0 2024-05-14T12:28:44.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faab1c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16c6cfd0 0x55ed16deffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faab1c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16c6cfd0 0x55ed16deffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52408/0 (socket says 172.21.15.47:52408) 2024-05-14T12:28:44.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faab1c00700 1 -- 172.21.15.47:0/2231810613 learned_addr learned my addr 172.21.15.47:0/2231810613 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:44.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.615+0000 7faab1200700 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16df5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.616+0000 7faab1c00700 1 -- 172.21.15.47:0/2231810613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 msgr2=0x55ed16df19c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.616+0000 7faab1c00700 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 0x55ed16df19c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.616+0000 7faab1c00700 1 -- 172.21.15.47:0/2231810613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 msgr2=0x55ed16df5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.616+0000 7faab1c00700 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16df5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.616+0000 7faab1c00700 1 -- 172.21.15.47:0/2231810613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed16ddf3b0 con 0x55ed16c6cfd0 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.616+0000 7faab1c00700 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16c6cfd0 0x55ed16deffb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faa9c008010 tx=0x7faa9c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c187b812646fc234 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.617+0000 7faa9a000700 1 -- 172.21.15.47:0/2231810613 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c026150 con 0x55ed16c6cfd0 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.617+0000 7faa9a000700 1 -- 172.21.15.47:0/2231810613 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa9c0267a0 con 0x55ed16c6cfd0 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.617+0000 7faa9a000700 1 -- 172.21.15.47:0/2231810613 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c014730 con 0x55ed16c6cfd0 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.619+0000 7faac307eb80 1 -- 172.21.15.47:0/2231810613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16c6cfd0 msgr2=0x55ed16deffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.619+0000 7faac307eb80 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16c6cfd0 0x55ed16deffb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faa9c008010 tx=0x7faa9c013000 comp rx=0 tx=0).stop 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.619+0000 7faac307eb80 1 -- 172.21.15.47:0/2231810613 shutdown_connections 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.619+0000 7faac307eb80 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16deaaa0 0x55ed16df19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.619+0000 7faac307eb80 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16c6cfd0 0x55ed16deffb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.619+0000 7faac307eb80 1 --2- 172.21.15.47:0/2231810613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16df5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.619+0000 7faac307eb80 1 -- 172.21.15.47:0/2231810613 >> 172.21.15.47:0/2231810613 conn(0x55ed16cabc10 msgr2=0x55ed16dee440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.620+0000 7faac307eb80 1 -- 172.21.15.47:0/2231810613 shutdown_connections 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.620+0000 7faac307eb80 1 -- 172.21.15.47:0/2231810613 wait complete. 2024-05-14T12:28:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.620+0000 7faac307eb80 1 -- start start 2024-05-14T12:28:44.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.620+0000 7faac307eb80 1 Processor -- start 2024-05-14T12:28:44.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.621+0000 7faac307eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16c6cfd0 0x55ed16e09e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.621+0000 7faac307eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16e0a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.621+0000 7faac307eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16e083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.621+0000 7faac307eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1bf0c0 con 0x55ed16deaaa0 2024-05-14T12:28:44.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.621+0000 7faac307eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1be9c0 con 0x55ed16dea690 2024-05-14T12:28:44.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.621+0000 7faac307eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1bbb60 con 0x55ed16c6cfd0 2024-05-14T12:28:44.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.621+0000 7faac307eb80 10 client.0 _ll_register_callbacks cb 0x55ed16ca0510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:44.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16e0a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16e0a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:60888/0 (socket says 172.21.15.47:60888) 2024-05-14T12:28:44.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1200700 1 -- 172.21.15.47:0/832144661 learned_addr learned my addr 172.21.15.47:0/832144661 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1c00700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16c6cfd0 0x55ed16e09e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1200700 1 -- 172.21.15.47:0/832144661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16c6cfd0 msgr2=0x55ed16e09e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1200700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16c6cfd0 0x55ed16e09e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1200700 1 -- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 msgr2=0x55ed16e083d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab2600700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16e083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.622+0000 7faab1200700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16e083d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.623+0000 7faab1200700 1 -- 172.21.15.47:0/832144661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed16e08a10 con 0x55ed16dea690 2024-05-14T12:28:44.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.623+0000 7faab1c00700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16c6cfd0 0x55ed16e09e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:28:44.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.623+0000 7faab2600700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16e083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:28:44.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.623+0000 7faab1200700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16e0a3a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faaa00a5630 tx=0x7faaa0010f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=145f03e38274e0cf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:44.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.623+0000 7faa8f400700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:28:44.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.623+0000 7faa8f400700 1 -- 172.21.15.47:0/832144661 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0088050 con 0x55ed16dea690 2024-05-14T12:28:44.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.623+0000 7faa8f400700 1 -- 172.21.15.47:0/832144661 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faaa008fb20 con 0x55ed16dea690 2024-05-14T12:28:44.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.624+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa9c0267a0 con 0x55ed16dea690 2024-05-14T12:28:44.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.624+0000 7faa8f400700 1 -- 172.21.15.47:0/832144661 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faaa00a90c0 con 0x55ed16dea690 2024-05-14T12:28:44.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.624+0000 7faac307eb80 10 client.25622 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:44.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.624+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ed16e08a10 con 0x55ed16dea690 2024-05-14T12:28:44.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.625+0000 7faa8f400700 1 -- 172.21.15.47:0/832144661 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa9c0267a0 con 0x55ed16dea690 2024-05-14T12:28:44.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.625+0000 7faa8f400700 1 -- 172.21.15.47:0/832144661 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7faaa00b0ce0 con 0x55ed16dea690 2024-05-14T12:28:44.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.626+0000 7faac307eb80 10 client.25622 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:44.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.627+0000 7faac307eb80 10 client.25622 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:28:44.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.627+0000 7faac307eb80 20 client.25622 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:44.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.627+0000 7faac307eb80 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e6fe50 0x55ed16e72270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:44.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.627+0000 7faac307eb80 4 client.25622 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.5, "await_for": 42.0}] 2024-05-14T12:28:44.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.627+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.5, "await_for": 42.0}) -- 0x55ed16d1a590 con 0x55ed16e6fe50 2024-05-14T12:28:44.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.627+0000 7faab1c00700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e6fe50 0x55ed16e72270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:44.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.628+0000 7faab1c00700 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e6fe50 0x55ed16e72270 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8666feec8e3b0b45 server_cookie=a798832b7d3827e in_seq=0 out_seq=0 2024-05-14T12:28:44.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.628+0000 7faa8f400700 10 client.25622 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:44.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.873+0000 7faa8f400700 1 -- 172.21.15.47:0/832144661 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ed16d1a590 con 0x55ed16e6fe50 2024-05-14T12:28:44.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.873+0000 7faa8f400700 10 client.25622 handle_command_reply: tid=0 2024-05-14T12:28:44.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.874+0000 7faac307eb80 1 client.25622 shutdown 2024-05-14T12:28:44.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 msgr2=0x55ed16e0a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16e0a3a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faaa00a5630 tx=0x7faaa0010f70 comp rx=0 tx=0).stop 2024-05-14T12:28:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 shutdown_connections 2024-05-14T12:28:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ed16e6fe50 0x55ed16e72270 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ed16deaaa0 0x55ed16e083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed16c6cfd0 0x55ed16e09e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 --2- 172.21.15.47:0/832144661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed16dea690 0x55ed16e0a3a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 >> 172.21.15.47:0/832144661 conn(0x55ed16cabc10 msgr2=0x55ed16e000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.875+0000 7faa8f400700 0 client.25622 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:44.886 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:28:44.886 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 32, 2024-05-14T12:28:44.887 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:28:44.887 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 10, 2024-05-14T12:28:44.887 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:28:44.887 INFO:teuthology.orchestra.run.smithi047.stdout: "bb0fabf7": { 2024-05-14T12:28:44.887 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 10, 2024-05-14T12:28:44.888 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:28:44.888 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:28:44.888 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:28:44.888 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:28:44.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:28:44.888 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 87.5, 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:28:44.889 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:44.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:44.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:44.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:44.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:28:44.890 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:28:44.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.876+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 shutdown_connections 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.877+0000 7faac307eb80 1 -- 172.21.15.47:0/832144661 wait complete. 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.878+0000 7faac307eb80 20 client.25622 trim_cache size 0 max 16384 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.879+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faa940b29c0 msgr2=0x7faa940b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.879+0000 7faab4600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faa940b29c0 0x7faa940b4ed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa9c006fd0 tx=0x7faa9c008040 comp rx=0 tx=0).stop 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.879+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac076680 msgr2=0x7faaac10a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.879+0000 7faab4600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac076680 0x7faaac10a640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faaa000d950 tx=0x7faaa000dd10 comp rx=0 tx=0).stop 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 shutdown_connections 2024-05-14T12:28:44.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7faa940b29c0 0x7faa940b4ed0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaac110ba0 0x7faaac10fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaac075d30 0x7faaac10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 --2- 172.21.15.47:0/2603883911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaac076680 0x7faaac10a640 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 >> 172.21.15.47:0/2603883911 conn(0x7faaac100040 msgr2=0x7faaac100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 shutdown_connections 2024-05-14T12:28:44.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:28:44.880+0000 7faab4600700 1 -- 172.21.15.47:0/2603883911 wait complete. 2024-05-14T12:28:45.736 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:45 smithi047 ceph-mon[31254]: pgmap v557: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 38 op/s 2024-05-14T12:28:46.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:45 smithi073 ceph-mon[35809]: pgmap v557: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 38 op/s 2024-05-14T12:28:46.007 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bb0fabf7', quiesce took 8.7 seconds. Will release after: 27.5 2024-05-14T12:28:46.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:45 smithi066 ceph-mon[35981]: pgmap v557: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 38 op/s 2024-05-14T12:28:47.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:47 smithi047 ceph-mon[31254]: pgmap v558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 MiB/s wr, 50 op/s 2024-05-14T12:28:48.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:47 smithi073 ceph-mon[35809]: pgmap v558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 MiB/s wr, 50 op/s 2024-05-14T12:28:48.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:47 smithi066 ceph-mon[35981]: pgmap v558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 MiB/s wr, 50 op/s 2024-05-14T12:28:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:49 smithi047 ceph-mon[31254]: pgmap v559: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 69 MiB/s wr, 60 op/s 2024-05-14T12:28:50.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:49 smithi073 ceph-mon[35809]: pgmap v559: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 69 MiB/s wr, 60 op/s 2024-05-14T12:28:50.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:49 smithi066 ceph-mon[35981]: pgmap v559: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 69 MiB/s wr, 60 op/s 2024-05-14T12:28:51.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:51 smithi047 ceph-mon[31254]: pgmap v560: 97 pgs: 97 active+clean; 6.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 94 MiB/s wr, 67 op/s 2024-05-14T12:28:52.003 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:51 smithi073 ceph-mon[35809]: pgmap v560: 97 pgs: 97 active+clean; 6.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 94 MiB/s wr, 67 op/s 2024-05-14T12:28:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:51 smithi066 ceph-mon[35981]: pgmap v560: 97 pgs: 97 active+clean; 6.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 94 MiB/s wr, 67 op/s 2024-05-14T12:28:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:53 smithi047 ceph-mon[31254]: pgmap v561: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 102 MiB/s wr, 69 op/s 2024-05-14T12:28:54.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:53 smithi073 ceph-mon[35809]: pgmap v561: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 102 MiB/s wr, 69 op/s 2024-05-14T12:28:54.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:53 smithi066 ceph-mon[35981]: pgmap v561: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 102 MiB/s wr, 69 op/s 2024-05-14T12:28:55.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:55 smithi047 ceph-mon[31254]: pgmap v562: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 110 MiB/s wr, 57 op/s 2024-05-14T12:28:56.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:55 smithi073 ceph-mon[35809]: pgmap v562: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 110 MiB/s wr, 57 op/s 2024-05-14T12:28:56.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:55 smithi066 ceph-mon[35981]: pgmap v562: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 110 MiB/s wr, 57 op/s 2024-05-14T12:28:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 -- 172.21.15.47:0/3789954349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60103ab0 msgr2=0x7fbc601047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/3789954349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60103ab0 0x7fbc601047b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009900 tx=0x7fbc5002a410 comp rx=0 tx=0).stop 2024-05-14T12:28:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 -- 172.21.15.47:0/3789954349 shutdown_connections 2024-05-14T12:28:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/3789954349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc601099f0 0x7fbc6010be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/3789954349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60104cf0 0x7fbc60105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/3789954349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60103ab0 0x7fbc601047b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 -- 172.21.15.47:0/3789954349 >> 172.21.15.47:0/3789954349 conn(0x7fbc600fecc0 msgr2=0x7fbc60101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 -- 172.21.15.47:0/3789954349 shutdown_connections 2024-05-14T12:28:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.171+0000 7fbc5fe00640 1 -- 172.21.15.47:0/3789954349 wait complete. 2024-05-14T12:28:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 Processor -- start 2024-05-14T12:28:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 -- start start 2024-05-14T12:28:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc60103ab0 0x7fbc6019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60104cf0 0x7fbc6019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc601099f0 0x7fbc601a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6010f650 con 0x7fbc60103ab0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6010f4d0 con 0x7fbc60104cf0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6010f7d0 con 0x7fbc601099f0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc60103ab0 0x7fbc6019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc60103ab0 0x7fbc6019c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40686/0 (socket says 172.21.15.47:40686) 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.173+0000 7fbc5ea00640 1 -- 172.21.15.47:0/1532866183 learned_addr learned my addr 172.21.15.47:0/1532866183 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5f400640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc601099f0 0x7fbc601a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5e000640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60104cf0 0x7fbc6019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5ea00640 1 -- 172.21.15.47:0/1532866183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc601099f0 msgr2=0x7fbc601a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5ea00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc601099f0 0x7fbc601a38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5ea00640 1 -- 172.21.15.47:0/1532866183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60104cf0 msgr2=0x7fbc6019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5ea00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60104cf0 0x7fbc6019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5ea00640 1 -- 172.21.15.47:0/1532866183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc601a3f10 con 0x7fbc60103ab0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc5ea00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc60103ab0 0x7fbc6019c3d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc50006010 tx=0x7fbc50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.174+0000 7fbc64a00640 1 -- 172.21.15.47:0/1532866183 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5003f030 con 0x7fbc60103ab0 2024-05-14T12:28:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.175+0000 7fbc64a00640 1 -- 172.21.15.47:0/1532866183 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc50031910 con 0x7fbc60103ab0 2024-05-14T12:28:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.175+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601a41a0 con 0x7fbc60103ab0 2024-05-14T12:28:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.175+0000 7fbc64a00640 1 -- 172.21.15.47:0/1532866183 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50035070 con 0x7fbc60103ab0 2024-05-14T12:28:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.175+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc601a46e0 con 0x7fbc60103ab0 2024-05-14T12:28:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 Processor -- start 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 -- start start 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24e81b0 0x55ccd288a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd288a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd2891780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ccd27ee550 con 0x55ccd24c74d0 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ccd2793bc0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ccd27ea510 con 0x55ccd24e81b0 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc64a00640 1 -- 172.21.15.47:0/1532866183 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbc50042030 con 0x7fbc60103ab0 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24e81b0 0x55ccd288a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24e81b0 0x55ccd288a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59522/0 (socket says 172.21.15.47:59522) 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc5e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd2891780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.178+0000 7fbc5f400640 1 -- 172.21.15.47:0/2232231107 learned_addr learned my addr 172.21.15.47:0/2232231107 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc5ea00640 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd288a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc5f400640 1 -- 172.21.15.47:0/2232231107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 msgr2=0x55ccd288a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc5f400640 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd288a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc5f400640 1 -- 172.21.15.47:0/2232231107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 msgr2=0x55ccd2891780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc5f400640 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd2891780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc5f400640 1 -- 172.21.15.47:0/2232231107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccd2500210 con 0x55ccd24e81b0 2024-05-14T12:28:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc5f400640 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24e81b0 0x55ccd288a300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009fd0 tx=0x7fbc580118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7a3979d2c085ad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc4be00640 1 -- 172.21.15.47:0/2232231107 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58004d20 con 0x55ccd24e81b0 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc4be00640 1 -- 172.21.15.47:0/2232231107 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc58004050 con 0x55ccd24e81b0 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.179+0000 7fbc4be00640 1 -- 172.21.15.47:0/2232231107 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58005260 con 0x55ccd24e81b0 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc64a00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbc440b2920 0x7fbc440b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/2232231107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24e81b0 msgr2=0x55ccd288a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24e81b0 0x55ccd288a300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009fd0 tx=0x7fbc580118d0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc64a00640 1 -- 172.21.15.47:0/1532866183 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbc501024f0 con 0x7fbc60103ab0 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc5ea00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbc440b2920 0x7fbc440b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/2232231107 shutdown_connections 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd2891780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd288a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/2232231107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24e81b0 0x55ccd288a300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.180+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/2232231107 >> 172.21.15.47:0/2232231107 conn(0x55ccd24dc300 msgr2=0x55ccd2885c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.181+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/2232231107 shutdown_connections 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.181+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/2232231107 wait complete. 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.181+0000 7fbc5ea00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbc440b2920 0x7fbc440b4e30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc500fffb0 tx=0x7fbc500ec040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.181+0000 7fbc6cdb7740 1 -- start start 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.181+0000 7fbc6cdb7740 1 Processor -- start 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd2893dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24c74d0 0x55ccd2894310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ccd28921d0 con 0x55ccd24e81b0 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ccd27a7660 con 0x55ccd24c74d0 2024-05-14T12:28:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ccd2892350 con 0x55ccd24bf2f0 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc6cdb7740 10 client.0 _ll_register_callbacks cb 0x55ccd2771400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd2893dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd2893dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59532/0 (socket says 172.21.15.47:59532) 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc5f400640 1 -- 172.21.15.47:0/458190844 learned_addr learned my addr 172.21.15.47:0/458190844 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc5e000640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24c74d0 0x55ccd2894310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.182+0000 7fbc5f400640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc5f400640 1 -- 172.21.15.47:0/458190844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24c74d0 msgr2=0x55ccd2894310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc5f400640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24c74d0 0x55ccd2894310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc5f400640 1 -- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 msgr2=0x55ccd289b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc5f400640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc5f400640 1 -- 172.21.15.47:0/458190844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccd25cc620 con 0x55ccd24bf2f0 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc5e000640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24c74d0 0x55ccd2894310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:28:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc5f400640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd2893dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc580045c0 tx=0x7fbc58000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a22f0beaf4c1325 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc48c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc48c00640 1 -- 172.21.15.47:0/458190844 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5802c020 con 0x55ccd24bf2f0 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc58004050 con 0x55ccd24bf2f0 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc48c00640 1 -- 172.21.15.47:0/458190844 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbc5800f4e0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc48c00640 1 -- 172.21.15.47:0/458190844 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbc5800f8f0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc6cdb7740 10 client.25651 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.183+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ccd289e1a0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc48c00640 1 -- 172.21.15.47:0/458190844 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc58004050 con 0x55ccd24bf2f0 2024-05-14T12:28:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc48c00640 1 -- 172.21.15.47:0/458190844 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fbc58028a00 con 0x55ccd24bf2f0 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc6cdb7740 10 client.25651 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc6cdb7740 10 client.25651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc6cdb7740 20 client.25651 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd24a6d80 0x55ccd28a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc6cdb7740 4 client.25651 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccd27fc160 con 0x55ccd24a6d80 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.184+0000 7fbc5e000640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd24a6d80 0x55ccd28a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.185+0000 7fbc5e000640 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd24a6d80 0x55ccd28a17a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=158a98a0a62a97a4 server_cookie=cce5e5405ec7a8cf in_seq=0 out_seq=0 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.185+0000 7fbc48c00640 10 client.25651 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc48c00640 1 -- 172.21.15.47:0/458190844 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ccd27fc160 con 0x55ccd24a6d80 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc48c00640 10 client.25651 handle_command_reply: tid=0 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 client.25651 shutdown 2024-05-14T12:28:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 msgr2=0x55ccd2893dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd2893dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc580045c0 tx=0x7fbc58000f40 comp rx=0 tx=0).stop 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 shutdown_connections 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd24a6d80 0x55ccd28a17a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24c74d0 0x55ccd2894310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc48c00640 0 client.25651 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/458190844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd2893dd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 >> 172.21.15.47:0/458190844 conn(0x55ccd24dc300 msgr2=0x55ccd2888ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 shutdown_connections 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/458190844 wait complete. 2024-05-14T12:28:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.186+0000 7fbc6cdb7740 20 client.25651 trim_cache size 0 max 16384 2024-05-14T12:28:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.202+0000 7fbc6cdb7740 1 Processor -- start 2024-05-14T12:28:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.202+0000 7fbc6cdb7740 1 -- start start 2024-05-14T12:28:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd2885d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24c74d0 0x55ccd289b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbc601ad3b0 con 0x55ccd24e81b0 2024-05-14T12:28:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbc601aefe0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc601ada80 con 0x55ccd24c74d0 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd2885d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd2885d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:42236/0 (socket says 172.21.15.47:42236) 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5f400640 1 -- 172.21.15.47:0/3284377813 learned_addr learned my addr 172.21.15.47:0/3284377813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5e000640 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24c74d0 0x55ccd289b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5f400640 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5e000640 1 -- 172.21.15.47:0/3284377813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 msgr2=0x55ccd2885d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5e000640 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd2885d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5e000640 1 -- 172.21.15.47:0/3284377813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 msgr2=0x55ccd289b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5e000640 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.203+0000 7fbc5e000640 1 -- 172.21.15.47:0/3284377813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccd28814a0 con 0x55ccd24c74d0 2024-05-14T12:28:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.204+0000 7fbc5e000640 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24c74d0 0x55ccd289b200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55ccd28a1ed0 tx=0x7fbc4c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebdd07b648dc6f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.204+0000 7fbc4b400640 1 -- 172.21.15.47:0/3284377813 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c005020 con 0x55ccd24c74d0 2024-05-14T12:28:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.204+0000 7fbc4b400640 1 -- 172.21.15.47:0/3284377813 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc4c00f7f0 con 0x55ccd24c74d0 2024-05-14T12:28:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.204+0000 7fbc4b400640 1 -- 172.21.15.47:0/3284377813 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c004a00 con 0x55ccd24c74d0 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/3284377813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24c74d0 msgr2=0x55ccd289b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24c74d0 0x55ccd289b200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55ccd28a1ed0 tx=0x7fbc4c005f90 comp rx=0 tx=0).stop 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/3284377813 shutdown_connections 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24e81b0 0x55ccd289b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24c74d0 0x55ccd289b200 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/3284377813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24bf2f0 0x55ccd2885d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/3284377813 >> 172.21.15.47:0/3284377813 conn(0x55ccd24dc300 msgr2=0x55ccd2885650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/3284377813 shutdown_connections 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/3284377813 wait complete. 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.205+0000 7fbc6cdb7740 1 -- start start 2024-05-14T12:28:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 1 Processor -- start 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd289b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd28981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24e81b0 0x55ccd28986e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbc601ae850 con 0x55ccd24c74d0 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbc601ae150 con 0x55ccd24e81b0 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc601ab370 con 0x55ccd24bf2f0 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc6cdb7740 10 client.0 _ll_register_callbacks cb 0x7fbc4c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc5e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd28981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd289b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd289b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59554/0 (socket says 172.21.15.47:59554) 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc5f400640 1 -- 172.21.15.47:0/623683047 learned_addr learned my addr 172.21.15.47:0/623683047 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.206+0000 7fbc5f400640 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24e81b0 0x55ccd28986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc5f400640 1 -- 172.21.15.47:0/623683047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24e81b0 msgr2=0x55ccd28986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc5f400640 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24e81b0 0x55ccd28986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc5f400640 1 -- 172.21.15.47:0/623683047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 msgr2=0x55ccd28981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc5f400640 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd28981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc5f400640 1 -- 172.21.15.47:0/623683047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccd2907b00 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc5f400640 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd289b620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005f10 tx=0x7fbc58003a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff21e79219664a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc48c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc48c00640 1 -- 172.21.15.47:0/623683047 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5802c070 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc4c00f7f0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.207+0000 7fbc48c00640 1 -- 172.21.15.47:0/623683047 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbc580040d0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc48c00640 1 -- 172.21.15.47:0/623683047 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbc58004960 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 10 client.25657 fetch_fsmap learned FSMap version 32 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ccd2908c70 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc48c00640 1 -- 172.21.15.47:0/623683047 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc4c00f7f0 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc48c00640 1 -- 172.21.15.47:0/623683047 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fbc58005040 con 0x55ccd24bf2f0 2024-05-14T12:28:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 10 client.25657 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:28:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 10 client.25657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:28:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 20 client.25657 populate_metadata read hostname 'smithi047' 2024-05-14T12:28:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd247c1c0 0x55ccd290b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:28:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 4 client.25657 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:28:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ccd27f5fd0 con 0x55ccd247c1c0 2024-05-14T12:28:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.208+0000 7fbc5e000640 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd247c1c0 0x55ccd290b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:28:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.209+0000 7fbc5e000640 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd247c1c0 0x55ccd290b660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1df6c89271f9523c server_cookie=746afb39657ccac8 in_seq=0 out_seq=0 2024-05-14T12:28:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.209+0000 7fbc48c00640 10 client.25657 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc48c00640 1 -- 172.21.15.47:0/623683047 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ccd27f5fd0 con 0x55ccd247c1c0 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc48c00640 10 client.25657 handle_command_reply: tid=0 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 client.25657 shutdown 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 msgr2=0x55ccd289b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd289b620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005f10 tx=0x7fbc58003a30 comp rx=0 tx=0).stop 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 shutdown_connections 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ccd247c1c0 0x55ccd290b660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccd24e81b0 0x55ccd28986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd24c74d0 0x55ccd28981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 --2- 172.21.15.47:0/623683047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ccd24bf2f0 0x55ccd289b620 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc48c00640 0 client.25657 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 >> 172.21.15.47:0/623683047 conn(0x55ccd24dc300 msgr2=0x55ccd28933b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 shutdown_connections 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.227+0000 7fbc6cdb7740 1 -- 172.21.15.47:0/623683047 wait complete. 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc6cdb7740 20 client.25657 trim_cache size 0 max 16384 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:28:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:28:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:28:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbc440b2920 msgr2=0x7fbc440b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbc440b2920 0x7fbc440b4e30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc500fffb0 tx=0x7fbc500ec040 comp rx=0 tx=0).stop 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc60103ab0 msgr2=0x7fbc6019c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc60103ab0 0x7fbc6019c3d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc50006010 tx=0x7fbc50004270 comp rx=0 tx=0).stop 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 shutdown_connections 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbc440b2920 0x7fbc440b4e30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc601099f0 0x7fbc601a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.228+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc60104cf0 0x7fbc6019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.229+0000 7fbc5fe00640 1 --2- 172.21.15.47:0/1532866183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc60103ab0 0x7fbc6019c3d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.229+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 >> 172.21.15.47:0/1532866183 conn(0x7fbc600fecc0 msgr2=0x7fbc600ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.229+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 shutdown_connections 2024-05-14T12:28:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:28:57.229+0000 7fbc5fe00640 1 -- 172.21.15.47:0/1532866183 wait complete. 2024-05-14T12:28:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:57 smithi047 ceph-mon[31254]: pgmap v563: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 141 MiB/s wr, 65 op/s 2024-05-14T12:28:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:57 smithi073 ceph-mon[35809]: pgmap v563: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 141 MiB/s wr, 65 op/s 2024-05-14T12:28:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:57 smithi066 ceph-mon[35981]: pgmap v563: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 141 MiB/s wr, 65 op/s 2024-05-14T12:28:59.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:28:59 smithi047 ceph-mon[31254]: pgmap v564: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 207 MiB/s wr, 66 op/s 2024-05-14T12:29:00.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:28:59 smithi073 ceph-mon[35809]: pgmap v564: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 207 MiB/s wr, 66 op/s 2024-05-14T12:29:00.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:28:59 smithi066 ceph-mon[35981]: pgmap v564: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 207 MiB/s wr, 66 op/s 2024-05-14T12:29:01.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:01 smithi047 ceph-mon[31254]: pgmap v565: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 176 MiB/s wr, 59 op/s 2024-05-14T12:29:02.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:01 smithi073 ceph-mon[35809]: pgmap v565: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 176 MiB/s wr, 59 op/s 2024-05-14T12:29:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:01 smithi066 ceph-mon[35981]: pgmap v565: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 176 MiB/s wr, 59 op/s 2024-05-14T12:29:04.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:03 smithi073 ceph-mon[35809]: pgmap v566: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 146 MiB/s wr, 52 op/s 2024-05-14T12:29:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:03 smithi066 ceph-mon[35981]: pgmap v566: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 146 MiB/s wr, 52 op/s 2024-05-14T12:29:04.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:03 smithi047 ceph-mon[31254]: pgmap v566: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 146 MiB/s wr, 52 op/s 2024-05-14T12:29:06.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:05 smithi073 ceph-mon[35809]: pgmap v567: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 139 MiB/s wr, 49 op/s 2024-05-14T12:29:06.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:05 smithi066 ceph-mon[35981]: pgmap v567: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 139 MiB/s wr, 49 op/s 2024-05-14T12:29:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:05 smithi047 ceph-mon[31254]: pgmap v567: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 139 MiB/s wr, 49 op/s 2024-05-14T12:29:08.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:07 smithi073 ceph-mon[35809]: pgmap v568: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 130 MiB/s wr, 48 op/s 2024-05-14T12:29:08.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:07 smithi066 ceph-mon[35981]: pgmap v568: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 130 MiB/s wr, 48 op/s 2024-05-14T12:29:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:07 smithi047 ceph-mon[31254]: pgmap v568: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 130 MiB/s wr, 48 op/s 2024-05-14T12:29:10.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:09 smithi066 ceph-mon[35981]: pgmap v569: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 99 MiB/s wr, 38 op/s 2024-05-14T12:29:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:09 smithi047 ceph-mon[31254]: pgmap v569: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 99 MiB/s wr, 38 op/s 2024-05-14T12:29:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:09 smithi073 ceph-mon[35809]: pgmap v569: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 99 MiB/s wr, 38 op/s 2024-05-14T12:29:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.455+0000 7fcdbbe00640 1 -- 172.21.15.47:0/3318719339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc106f00 msgr2=0x7fcdbc107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.455+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/3318719339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc106f00 0x7fcdbc107310 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009900 tx=0x7fcda802a400 comp rx=0 tx=0).stop 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.455+0000 7fcdbbe00640 1 -- 172.21.15.47:0/3318719339 shutdown_connections 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.455+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/3318719339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdbc10bc00 0x7fcdbc10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.455+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/3318719339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc106f00 0x7fcdbc107310 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.455+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/3318719339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc105cc0 0x7fcdbc1069c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.456+0000 7fcdbbe00640 1 -- 172.21.15.47:0/3318719339 >> 172.21.15.47:0/3318719339 conn(0x7fcdbc100ed0 msgr2=0x7fcdbc103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.456+0000 7fcdbbe00640 1 -- 172.21.15.47:0/3318719339 shutdown_connections 2024-05-14T12:29:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.456+0000 7fcdbbe00640 1 -- 172.21.15.47:0/3318719339 wait complete. 2024-05-14T12:29:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.457+0000 7fcdbbe00640 1 Processor -- start 2024-05-14T12:29:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.457+0000 7fcdbbe00640 1 -- start start 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbbe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdbc105cc0 0x7fcdbc19c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc106f00 0x7fcdbc19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc10bc00 0x7fcdbc1a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc1118d0 con 0x7fcdbc10bc00 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbbe00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc111750 con 0x7fcdbc105cc0 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbbe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc111a50 con 0x7fcdbc106f00 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc10bc00 0x7fcdbc1a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdba000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc106f00 0x7fcdbc19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdba000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc106f00 0x7fcdbc19c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45258/0 (socket says 172.21.15.47:45258) 2024-05-14T12:29:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdbc105cc0 0x7fcdbc19c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc10bc00 0x7fcdbc1a3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38814/0 (socket says 172.21.15.47:38814) 2024-05-14T12:29:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.458+0000 7fcdba000640 1 -- 172.21.15.47:0/2685409300 learned_addr learned my addr 172.21.15.47:0/2685409300 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdbb400640 1 -- 172.21.15.47:0/2685409300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc106f00 msgr2=0x7fcdbc19c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdbb400640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc106f00 0x7fcdbc19c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdbb400640 1 -- 172.21.15.47:0/2685409300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdbc105cc0 msgr2=0x7fcdbc19c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdbb400640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdbc105cc0 0x7fcdbc19c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdbb400640 1 -- 172.21.15.47:0/2685409300 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc1a3ec0 con 0x7fcdbc10bc00 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdbb400640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc10bc00 0x7fcdbc1a3850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009fd0 tx=0x7fcdb400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdb3400640 1 -- 172.21.15.47:0/2685409300 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400ce20 con 0x7fcdbc10bc00 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdb3400640 1 -- 172.21.15.47:0/2685409300 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdb4005020 con 0x7fcdbc10bc00 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.459+0000 7fcdb3400640 1 -- 172.21.15.47:0/2685409300 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4010690 con 0x7fcdbc10bc00 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.460+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc1a41b0 con 0x7fcdbc10bc00 2024-05-14T12:29:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.460+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc1a46b0 con 0x7fcdbc10bc00 2024-05-14T12:29:10.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.463+0000 7fcdc8607740 1 Processor -- start 2024-05-14T12:29:10.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdb3400640 1 -- 172.21.15.47:0/2685409300 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcdb40054d0 con 0x7fcdbc10bc00 2024-05-14T12:29:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdc8607740 1 -- start start 2024-05-14T12:29:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204f4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdc8607740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55de20451550 con 0x55de201222f0 2024-05-14T12:29:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdc8607740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55de203f6bc0 con 0x55de2012a4d0 2024-05-14T12:29:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.464+0000 7fcdc8607740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55de2044d510 con 0x55de2014b1b0 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdba000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdba000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45266/0 (socket says 172.21.15.47:45266) 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdba000640 1 -- 172.21.15.47:0/872147861 learned_addr learned my addr 172.21.15.47:0/872147861 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdba000640 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdbaa00640 1 -- 172.21.15.47:0/872147861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 msgr2=0x55de204ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdbaa00640 1 -- 172.21.15.47:0/872147861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 msgr2=0x55de204f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.465+0000 7fcdbaa00640 1 -- 172.21.15.47:0/872147861 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de20163210 con 0x55de201222f0 2024-05-14T12:29:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.466+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204ed880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc105590 tx=0x7fcdac011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c17a0f09631f243 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.466+0000 7fcdb3400640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcda00b2920 0x7fcda00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.466+0000 7fcda7400640 1 -- 172.21.15.47:0/872147861 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac004230 con 0x55de201222f0 2024-05-14T12:29:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.466+0000 7fcdb3400640 1 -- 172.21.15.47:0/2685409300 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcdb40e28c0 con 0x7fcdbc10bc00 2024-05-14T12:29:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.466+0000 7fcdba000640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcda00b2920 0x7fcda00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.466+0000 7fcda7400640 1 -- 172.21.15.47:0/872147861 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdac009e10 con 0x55de201222f0 2024-05-14T12:29:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.466+0000 7fcda7400640 1 -- 172.21.15.47:0/872147861 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac019680 con 0x55de201222f0 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 -- 172.21.15.47:0/872147861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 msgr2=0x55de204ed880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204ed880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc105590 tx=0x7fcdac011810 comp rx=0 tx=0).stop 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdba000640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcda00b2920 0x7fcda00b4e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55de204ee4d0 tx=0x7fcda80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 -- 172.21.15.47:0/872147861 shutdown_connections 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204ed880 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 --2- 172.21.15.47:0/872147861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 -- 172.21.15.47:0/872147861 >> 172.21.15.47:0/872147861 conn(0x55de2013f300 msgr2=0x55de204e8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.467+0000 7fcdc8607740 1 -- 172.21.15.47:0/872147861 shutdown_connections 2024-05-14T12:29:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.468+0000 7fcdc8607740 1 -- 172.21.15.47:0/872147861 wait complete. 2024-05-14T12:29:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.468+0000 7fcdc8607740 1 -- start start 2024-05-14T12:29:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.468+0000 7fcdc8607740 1 Processor -- start 2024-05-14T12:29:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de201222f0 0x55de204f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2012a4d0 0x55de204f7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2014b1b0 0x55de204fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdc8607740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55de204f51d0 con 0x55de2014b1b0 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdc8607740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55de2040a660 con 0x55de201222f0 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdc8607740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55de204f5350 con 0x55de2012a4d0 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdc8607740 10 client.0 _ll_register_callbacks cb 0x55de203d4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2014b1b0 0x55de204fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2014b1b0 0x55de204fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38836/0 (socket says 172.21.15.47:38836) 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdbb400640 1 -- 172.21.15.47:0/527847382 learned_addr learned my addr 172.21.15.47:0/527847382 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdba000640 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2012a4d0 0x55de204f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.469+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de201222f0 0x55de204f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcdbb400640 1 -- 172.21.15.47:0/527847382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2012a4d0 msgr2=0x55de204f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcdbb400640 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2012a4d0 0x55de204f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcdbb400640 1 -- 172.21.15.47:0/527847382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de201222f0 msgr2=0x55de204f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcdbb400640 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de201222f0 0x55de204f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcdbb400640 1 -- 172.21.15.47:0/527847382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2022f620 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcdbb400640 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2014b1b0 0x55de204fe2a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40a9e30 tx=0x7fcdb40aa6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580532031a195ec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcd9be00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcd9be00640 1 -- 172.21.15.47:0/527847382 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40b2d00 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcd9be00640 1 -- 172.21.15.47:0/527847382 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcdb40a6490 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.470+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdac009e10 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcd9be00640 1 -- 172.21.15.47:0/527847382 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcdb40b2870 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 10 client.15525 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55de205012f0 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcd9be00640 1 -- 172.21.15.47:0/527847382 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdac009e10 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcd9be00640 1 -- 172.21.15.47:0/527847382 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fcdb40c0070 con 0x55de2014b1b0 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 10 client.15525 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 20 client.15525 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de20109d80 0x55de20504a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 4 client.15525 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:29:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.471+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de2045f160 con 0x55de20109d80 2024-05-14T12:29:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.472+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de20109d80 0x55de20504a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.472+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de20109d80 0x55de20504a50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5ea325d4d7be3da server_cookie=ff56906a1af01656 in_seq=0 out_seq=0 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.472+0000 7fcd9be00640 10 client.15525 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.473+0000 7fcd9be00640 1 -- 172.21.15.47:0/527847382 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55de2045f160 con 0x55de20109d80 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.473+0000 7fcd9be00640 10 client.15525 handle_command_reply: tid=0 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.473+0000 7fcdc8607740 1 client.15525 shutdown 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2014b1b0 msgr2=0x55de204fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2014b1b0 0x55de204fe2a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40a9e30 tx=0x7fcdb40aa6e0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 shutdown_connections 2024-05-14T12:29:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de20109d80 0x55de20504a50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2014b1b0 0x55de204fe2a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2012a4d0 0x55de204f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 --2- 172.21.15.47:0/527847382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de201222f0 0x55de204f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcd9be00640 0 client.15525 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 >> 172.21.15.47:0/527847382 conn(0x55de2013f300 msgr2=0x55de204ebba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 shutdown_connections 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 1 -- 172.21.15.47:0/527847382 wait complete. 2024-05-14T12:29:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.474+0000 7fcdc8607740 20 client.15525 trim_cache size 0 max 16384 2024-05-14T12:29:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 Processor -- start 2024-05-14T12:29:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 -- start start 2024-05-14T12:29:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de201222f0 0x55de204e7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2012a4d0 0x55de204fe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2014b1b0 0x55de204e7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc1ad340 con 0x55de2012a4d0 2024-05-14T12:29:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc1aef70 con 0x55de2014b1b0 2024-05-14T12:29:10.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdc8607740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc1ada10 con 0x55de201222f0 2024-05-14T12:29:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de201222f0 0x55de204e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de201222f0 0x55de204e7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45278/0 (socket says 172.21.15.47:45278) 2024-05-14T12:29:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdbaa00640 1 -- 172.21.15.47:0/741884482 learned_addr learned my addr 172.21.15.47:0/741884482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.492+0000 7fcdba000640 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2012a4d0 0x55de204fe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbb400640 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2014b1b0 0x55de204e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbaa00640 1 -- 172.21.15.47:0/741884482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2014b1b0 msgr2=0x55de204e7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2014b1b0 0x55de204e7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbaa00640 1 -- 172.21.15.47:0/741884482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2012a4d0 msgr2=0x55de204fe1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2012a4d0 0x55de204fe1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbaa00640 1 -- 172.21.15.47:0/741884482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de204ee500 con 0x55de201222f0 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbb400640 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2014b1b0 0x55de204e7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de201222f0 0x55de204e7250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcdac014040 tx=0x7fcdac0098f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bb083c514b273c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcda6a00640 1 -- 172.21.15.47:0/741884482 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac005040 con 0x55de201222f0 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcda6a00640 1 -- 172.21.15.47:0/741884482 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdac0035f0 con 0x55de201222f0 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.493+0000 7fcda6a00640 1 -- 172.21.15.47:0/741884482 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac02c2f0 con 0x55de201222f0 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 -- 172.21.15.47:0/741884482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de201222f0 msgr2=0x55de204e7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de201222f0 0x55de204e7250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcdac014040 tx=0x7fcdac0098f0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 -- 172.21.15.47:0/741884482 shutdown_connections 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2014b1b0 0x55de204e7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de2012a4d0 0x55de204fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 --2- 172.21.15.47:0/741884482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de201222f0 0x55de204e7250 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 -- 172.21.15.47:0/741884482 >> 172.21.15.47:0/741884482 conn(0x55de2013f300 msgr2=0x55de204f1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.494+0000 7fcdc8607740 1 -- 172.21.15.47:0/741884482 shutdown_connections 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.495+0000 7fcdc8607740 1 -- 172.21.15.47:0/741884482 wait complete. 2024-05-14T12:29:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.495+0000 7fcdc8607740 1 -- start start 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.495+0000 7fcdc8607740 1 Processor -- start 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204fb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204fbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdc8607740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdc8607740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc1ae7e0 con 0x55de201222f0 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdc8607740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc1ae0e0 con 0x55de2012a4d0 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdc8607740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc1ab300 con 0x55de2014b1b0 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdc8607740 10 client.0 _ll_register_callbacks cb 0x7fcdb40a5d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204fb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45280/0 (socket says 172.21.15.47:45280) 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdbb400640 1 -- 172.21.15.47:0/2786360057 learned_addr learned my addr 172.21.15.47:0/2786360057 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdbaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204fb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38854/0 (socket says 172.21.15.47:38854) 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.496+0000 7fcdba000640 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdbb400640 1 -- 172.21.15.47:0/2786360057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 msgr2=0x55de204fbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdbb400640 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204fbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdbb400640 1 -- 172.21.15.47:0/2786360057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 msgr2=0x55de204fb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdbb400640 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204fb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdbb400640 1 -- 172.21.15.47:0/2786360057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de204fd290 con 0x55de2014b1b0 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdbb400640 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204fccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40ae410 tx=0x7fcdb40053e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c23cbbb139a45a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcd9be00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcd9be00640 1 -- 172.21.15.47:0/2786360057 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40a99b0 con 0x55de2014b1b0 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcd9be00640 1 -- 172.21.15.47:0/2786360057 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcdb40a6490 con 0x55de2014b1b0 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdac0035f0 con 0x55de2014b1b0 2024-05-14T12:29:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcd9be00640 1 -- 172.21.15.47:0/2786360057 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcdb40af780 con 0x55de2014b1b0 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdc8607740 10 client.25675 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.497+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55de204fe490 con 0x55de2014b1b0 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcd9be00640 1 -- 172.21.15.47:0/2786360057 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdac0035f0 con 0x55de2014b1b0 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcd9be00640 1 -- 172.21.15.47:0/2786360057 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fcdb408b020 con 0x55de2014b1b0 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcdc8607740 10 client.25675 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcdc8607740 10 client.25675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcdc8607740 20 client.25675 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcdc8607740 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de200df1c0 0x55de2056f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcdc8607740 4 client.25675 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de20458fd0 con 0x55de200df1c0 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.498+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de200df1c0 0x55de2056f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.499+0000 7fcdbaa00640 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de200df1c0 0x55de2056f6a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=161374fc567d5ec9 server_cookie=9a6b01d064dea1b5 in_seq=0 out_seq=0 2024-05-14T12:29:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.499+0000 7fcd9be00640 10 client.25675 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcd9be00640 1 -- 172.21.15.47:0/2786360057 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de20458fd0 con 0x55de200df1c0 2024-05-14T12:29:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcd9be00640 10 client.25675 handle_command_reply: tid=0 2024-05-14T12:29:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 client.25675 shutdown 2024-05-14T12:29:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 msgr2=0x55de204fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204fccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40ae410 tx=0x7fcdb40053e0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 shutdown_connections 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55de200df1c0 0x55de2056f6a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55de2014b1b0 0x55de204fccd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de2012a4d0 0x55de204fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 --2- 172.21.15.47:0/2786360057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55de201222f0 0x55de204fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcd9be00640 0 client.25675 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 >> 172.21.15.47:0/2786360057 conn(0x55de2013f300 msgr2=0x55de204eba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 shutdown_connections 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 1 -- 172.21.15.47:0/2786360057 wait complete. 2024-05-14T12:29:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.514+0000 7fcdc8607740 20 client.25675 trim_cache size 0 max 16384 2024-05-14T12:29:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:29:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:29:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:29:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcda00b2920 msgr2=0x7fcda00b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcda00b2920 0x7fcda00b4e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55de204ee4d0 tx=0x7fcda80314a0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc10bc00 msgr2=0x7fcdbc1a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc10bc00 0x7fcdbc1a3850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009fd0 tx=0x7fcdb400ef10 comp rx=0 tx=0).stop 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 shutdown_connections 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fcda00b2920 0x7fcda00b4e30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdbc10bc00 0x7fcdbc1a3850 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc106f00 0x7fcdbc19c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 --2- 172.21.15.47:0/2685409300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdbc105cc0 0x7fcdbc19c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 >> 172.21.15.47:0/2685409300 conn(0x7fcdbc100ed0 msgr2=0x7fcdbc103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.515+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 shutdown_connections 2024-05-14T12:29:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:10.516+0000 7fcdbbe00640 1 -- 172.21.15.47:0/2685409300 wait complete. 2024-05-14T12:29:12.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:11 smithi066 ceph-mon[35981]: pgmap v570: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-05-14T12:29:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:11 smithi047 ceph-mon[31254]: pgmap v570: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-05-14T12:29:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:11 smithi073 ceph-mon[35809]: pgmap v570: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-05-14T12:29:13.508 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:29:13.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:13 smithi047 ceph-mon[31254]: pgmap v571: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-05-14T12:29:14.002 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:29:14.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:13 smithi066 ceph-mon[35981]: pgmap v571: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-05-14T12:29:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:13 smithi073 ceph-mon[35809]: pgmap v571: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 12 op/s 2024-05-14T12:29:16.001 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:15 smithi047 ceph-mon[31254]: pgmap v572: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-14T12:29:16.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:15 smithi066 ceph-mon[35981]: pgmap v572: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-14T12:29:16.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:15 smithi073 ceph-mon[35809]: pgmap v572: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.370+0000 7f9ccdc00700 1 -- 172.21.15.47:0/3967756901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106580 msgr2=0x7f9cc8106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.370+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/3967756901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106580 0x7f9cc8106990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009990 tx=0x7f9cb4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.370+0000 7f9ccdc00700 1 -- 172.21.15.47:0/3967756901 shutdown_connections 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.370+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/3967756901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc8106ed0 0x7f9cc8113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.370+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/3967756901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc810c5c0 0x7f9cc810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.370+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/3967756901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106580 0x7f9cc8106990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.371+0000 7f9ccdc00700 1 -- 172.21.15.47:0/3967756901 >> 172.21.15.47:0/3967756901 conn(0x7f9cc8102080 msgr2=0x7f9cc81044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.371+0000 7f9ccdc00700 1 -- 172.21.15.47:0/3967756901 shutdown_connections 2024-05-14T12:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.371+0000 7f9ccdc00700 1 -- 172.21.15.47:0/3967756901 wait complete. 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.372+0000 7f9ccdc00700 1 Processor -- start 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.372+0000 7f9ccdc00700 1 -- start start 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9ccdc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc8106580 0x7f9cc819d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9ccdc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106ed0 0x7f9cc819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9ccdc00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc810c5c0 0x7f9cc81a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9ccdc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc81166f0 con 0x7f9cc8106ed0 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9ccdc00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc8116570 con 0x7f9cc8106580 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9ccdc00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc8116870 con 0x7f9cc810c5c0 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9cc6a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc8106580 0x7f9cc819d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9cc6000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106ed0 0x7f9cc819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9cc6a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc8106580 0x7f9cc819d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:34308/0 (socket says 172.21.15.47:34308) 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9cc6a00700 1 -- 172.21.15.47:0/606523043 learned_addr learned my addr 172.21.15.47:0/606523043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9cc7400700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc810c5c0 0x7f9cc81a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9cc6a00700 1 -- 172.21.15.47:0/606523043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc810c5c0 msgr2=0x7f9cc81a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.373+0000 7f9cc6a00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc810c5c0 0x7f9cc81a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9cc6a00700 1 -- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106ed0 msgr2=0x7f9cc819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9cc6a00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106ed0 0x7f9cc819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9cc6a00700 1 -- 172.21.15.47:0/606523043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc81a1fd0 con 0x7f9cc8106580 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9cc6a00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc8106580 0x7f9cc819d100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800e970 tx=0x7f9cb800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9cbf400700 1 -- 172.21.15.47:0/606523043 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8004a30 con 0x7f9cc8106580 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc81a22c0 con 0x7f9cc8106580 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9cbf400700 1 -- 172.21.15.47:0/606523043 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb800cc90 con 0x7f9cc8106580 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9cbf400700 1 -- 172.21.15.47:0/606523043 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8005610 con 0x7f9cc8106580 2024-05-14T12:29:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.374+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc81a9be0 con 0x7f9cc8106580 2024-05-14T12:29:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.375+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc80512c0 con 0x7f9cc8106580 2024-05-14T12:29:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.379+0000 7f9cbf400700 1 -- 172.21.15.47:0/606523043 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9cb800c7e0 con 0x7f9cc8106580 2024-05-14T12:29:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.380+0000 7f9cbf400700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9cac0b2900 0x7f9cac0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.380+0000 7f9cbf400700 1 -- 172.21.15.47:0/606523043 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f9cb80e2830 con 0x7f9cc8106580 2024-05-14T12:29:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.380+0000 7f9cc6000700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9cac0b2900 0x7f9cac0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:16.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.381+0000 7f9cc6000700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9cac0b2900 0x7f9cac0b4e10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:16.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.382+0000 7f9cbf400700 1 -- 172.21.15.47:0/606523043 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9cb80aa510 con 0x7f9cc8106580 2024-05-14T12:29:16.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.669+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cc819e460 con 0x7f9cc8106580 2024-05-14T12:29:16.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.671+0000 7f9cbf400700 1 -- 172.21.15.47:0/606523043 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11927 (secure 0 0 0) 0x7f9cb80a9e10 con 0x7f9cc8106580 2024-05-14T12:29:16.671 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:29:16.671 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:27:59.832298+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:29:16.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9cac0b2900 msgr2=0x7f9cac0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9cac0b2900 0x7f9cac0b4e10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb400b260 comp rx=0 tx=0).stop 2024-05-14T12:29:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc8106580 msgr2=0x7f9cc819d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc8106580 0x7f9cc819d100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800e970 tx=0x7f9cb800ec80 comp rx=0 tx=0).stop 2024-05-14T12:29:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 shutdown_connections 2024-05-14T12:29:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f9cac0b2900 0x7f9cac0b4e10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cc810c5c0 0x7f9cc81a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cc8106580 0x7f9cc819d100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 --2- 172.21.15.47:0/606523043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc8106ed0 0x7f9cc819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:16.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 >> 172.21.15.47:0/606523043 conn(0x7f9cc8102080 msgr2=0x7f9cc8104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:16.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 shutdown_connections 2024-05-14T12:29:16.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:16.674+0000 7f9ccdc00700 1 -- 172.21.15.47:0/606523043 wait complete. 2024-05-14T12:29:16.675 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 32 2024-05-14T12:29:16.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:16 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/606523043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:29:17.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:16 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/606523043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:29:17.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:16 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/606523043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:29:17.678 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id bb0fabf7 --release --await' 2024-05-14T12:29:17.679 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id bb0fabf7 --release --await 2024-05-14T12:29:17.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:17 smithi047 ceph-mon[31254]: pgmap v573: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-05-14T12:29:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:17 smithi066 ceph-mon[35981]: pgmap v573: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-05-14T12:29:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:29:18.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:17 smithi073 ceph-mon[35809]: pgmap v573: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-05-14T12:29:19.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:19 smithi047 ceph-mon[31254]: pgmap v574: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2024-05-14T12:29:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:19 smithi066 ceph-mon[35981]: pgmap v574: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2024-05-14T12:29:20.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:19 smithi073 ceph-mon[35809]: pgmap v574: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2024-05-14T12:29:20.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 -- 172.21.15.47:0/3173278551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd010c5d0 msgr2=0x7febd010c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 --2- 172.21.15.47:0/3173278551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd010c5d0 0x7febd010c9e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7febc40098f0 tx=0x7febc4009c00 comp rx=0 tx=0).stop 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 -- 172.21.15.47:0/3173278551 shutdown_connections 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 --2- 172.21.15.47:0/3173278551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febd0106ee0 0x7febd0113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 --2- 172.21.15.47:0/3173278551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd010c5d0 0x7febd010c9e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 --2- 172.21.15.47:0/3173278551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd0106590 0x7febd01069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 -- 172.21.15.47:0/3173278551 >> 172.21.15.47:0/3173278551 conn(0x7febd0102090 msgr2=0x7febd01044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.616+0000 7febd8000700 1 -- 172.21.15.47:0/3173278551 shutdown_connections 2024-05-14T12:29:20.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.617+0000 7febd8000700 1 -- 172.21.15.47:0/3173278551 wait complete. 2024-05-14T12:29:20.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.618+0000 7febd8000700 1 Processor -- start 2024-05-14T12:29:20.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.619+0000 7febd8000700 1 -- start start 2024-05-14T12:29:20.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.619+0000 7febd8000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd0106590 0x7febd019d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.619+0000 7febd8000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febd0106ee0 0x7febd019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.619+0000 7febd8000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd010c5d0 0x7febd01a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.619+0000 7febd8000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febd01166e0 con 0x7febd0106ee0 2024-05-14T12:29:20.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.619+0000 7febd8000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7febd0116560 con 0x7febd010c5d0 2024-05-14T12:29:20.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.619+0000 7febd8000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7febd0116860 con 0x7febd0106590 2024-05-14T12:29:20.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd0106590 0x7febd019d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd0106590 0x7febd019d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34756/0 (socket says 172.21.15.47:34756) 2024-05-14T12:29:20.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 -- 172.21.15.47:0/2340814862 learned_addr learned my addr 172.21.15.47:0/2340814862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:20.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd4c00700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febd0106ee0 0x7febd019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd6000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd010c5d0 0x7febd01a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 -- 172.21.15.47:0/2340814862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd010c5d0 msgr2=0x7febd01a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd010c5d0 0x7febd01a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 -- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febd0106ee0 msgr2=0x7febd019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febd0106ee0 0x7febd019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd5600700 1 -- 172.21.15.47:0/2340814862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd01a1f60 con 0x7febd0106590 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.620+0000 7febd6000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd010c5d0 0x7febd01a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.621+0000 7febd5600700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd0106590 0x7febd019d090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7febc4009230 tx=0x7febc400fa40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.621+0000 7febce000700 1 -- 172.21.15.47:0/2340814862 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc40051c0 con 0x7febd0106590 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.621+0000 7febce000700 1 -- 172.21.15.47:0/2340814862 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc400b560 con 0x7febd0106590 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.621+0000 7febce000700 1 -- 172.21.15.47:0/2340814862 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4003a20 con 0x7febd0106590 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.621+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd01a21f0 con 0x7febd0106590 2024-05-14T12:29:20.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.621+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd01a9b70 con 0x7febd0106590 2024-05-14T12:29:20.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.625+0000 7febce000700 1 -- 172.21.15.47:0/2340814862 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7febc400b9a0 con 0x7febd0106590 2024-05-14T12:29:20.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.626+0000 7febe6aadb80 1 Processor -- start 2024-05-14T12:29:20.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.627+0000 7febe6aadb80 1 -- start start 2024-05-14T12:29:20.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.627+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd13c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.627+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd183e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.627+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd18d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.627+0000 7febe6aadb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f56fc35b20 con 0x55f56fd14140 2024-05-14T12:29:20.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.627+0000 7febe6aadb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f56fbd3860 con 0x55f56fb95f40 2024-05-14T12:29:20.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.627+0000 7febe6aadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f56fc31ae0 con 0x55f56fd18920 2024-05-14T12:29:20.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd5600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd6000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd13c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd5600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd183e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45456/0 (socket says 172.21.15.47:45456) 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd5600700 1 -- 172.21.15.47:0/1488326519 learned_addr learned my addr 172.21.15.47:0/1488326519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd4c00700 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd18d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febce000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7febb80b2900 0x7febb80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febce000700 1 -- 172.21.15.47:0/2340814862 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7febc40e3120 con 0x7febd0106590 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd4c00700 1 -- 172.21.15.47:0/1488326519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 msgr2=0x55f56fd13c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd4c00700 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd13c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd4c00700 1 -- 172.21.15.47:0/1488326519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 msgr2=0x55f56fd183e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd4c00700 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd183e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd4c00700 1 -- 172.21.15.47:0/1488326519 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56fb829d0 con 0x55f56fd18920 2024-05-14T12:29:20.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd5600700 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:20.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.628+0000 7febd6000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7febb80b2900 0x7febb80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.629+0000 7febd4c00700 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd18d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7febd006acf0 tx=0x7febbc011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54901c5cb02d2739 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:20.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.629+0000 7febc2a00700 1 -- 172.21.15.47:0/1488326519 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc011c90 con 0x55f56fd18920 2024-05-14T12:29:20.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.629+0000 7febc2a00700 1 -- 172.21.15.47:0/1488326519 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc011e30 con 0x55f56fd18920 2024-05-14T12:29:20.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.629+0000 7febc2a00700 1 -- 172.21.15.47:0/1488326519 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc005280 con 0x55f56fd18920 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 -- 172.21.15.47:0/1488326519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 msgr2=0x55f56fd18d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febd6000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7febb80b2900 0x7febb80b4e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febc80075c0 tx=0x7febc8004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd18d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7febd006acf0 tx=0x7febbc011440 comp rx=0 tx=0).stop 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 -- 172.21.15.47:0/1488326519 shutdown_connections 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd18d30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd13c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1488326519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 -- 172.21.15.47:0/1488326519 >> 172.21.15.47:0/1488326519 conn(0x55f56fbdb070 msgr2=0x55f56fd0e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:20.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 -- 172.21.15.47:0/1488326519 shutdown_connections 2024-05-14T12:29:20.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.630+0000 7febe6aadb80 1 -- 172.21.15.47:0/1488326519 wait complete. 2024-05-14T12:29:20.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.631+0000 7febe6aadb80 1 -- start start 2024-05-14T12:29:20.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.631+0000 7febe6aadb80 1 Processor -- start 2024-05-14T12:29:20.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd1d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd14140 0x55f56fd1dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd18920 0x55f56fd1e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febe6aadb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f56fd20870 con 0x55f56fd18920 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febe6aadb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f56fb9bc20 con 0x55f56fd14140 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febe6aadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f56fd209f0 con 0x55f56fb95f40 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febe6aadb80 10 client.0 _ll_register_callbacks cb 0x55f56fbdcd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febd6000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd18920 0x55f56fd1e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febd5600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd1d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febd5600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd1d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34784/0 (socket says 172.21.15.47:34784) 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febd5600700 1 -- 172.21.15.47:0/878743016 learned_addr learned my addr 172.21.15.47:0/878743016 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.632+0000 7febd4c00700 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd14140 0x55f56fd1dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febd5600700 1 -- 172.21.15.47:0/878743016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd14140 msgr2=0x55f56fd1dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febd5600700 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd14140 0x55f56fd1dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febd5600700 1 -- 172.21.15.47:0/878743016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd18920 msgr2=0x55f56fd1e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febd5600700 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd18920 0x55f56fd1e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febd5600700 1 -- 172.21.15.47:0/878743016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56fbfb520 con 0x55f56fb95f40 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febd5600700 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd1d670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7febc4009c40 tx=0x7febc40a66d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f4e85363aff1d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febb7400700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febb7400700 1 -- 172.21.15.47:0/878743016 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc40aa560 con 0x55f56fb95f40 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febb7400700 1 -- 172.21.15.47:0/878743016 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7febc40aa9f0 con 0x55f56fb95f40 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.633+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febbc011e30 con 0x55f56fb95f40 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febb7400700 1 -- 172.21.15.47:0/878743016 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7febc40a9f00 con 0x55f56fb95f40 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 10 client.25693 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f56fd208d0 con 0x55f56fb95f40 2024-05-14T12:29:20.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febb7400700 1 -- 172.21.15.47:0/878743016 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc011e30 con 0x55f56fb95f40 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febb7400700 1 -- 172.21.15.47:0/878743016 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7febc40b30d0 con 0x55f56fb95f40 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 10 client.25693 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 10 client.25693 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 20 client.25693 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd2db70 0x55f56fd30000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 4 client.25693 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.634+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f56fce02c0 con 0x55f56fd2db70 2024-05-14T12:29:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.635+0000 7febd4c00700 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd2db70 0x55f56fd30000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.636+0000 7febd4c00700 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd2db70 0x55f56fd30000 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5ea0bb5f9c3084 server_cookie=adb4db7242958452 in_seq=0 out_seq=0 2024-05-14T12:29:20.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.636+0000 7febb7400700 10 client.25693 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:20.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.636+0000 7febb7400700 1 -- 172.21.15.47:0/878743016 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f56fce02c0 con 0x55f56fd2db70 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.636+0000 7febb7400700 10 client.25693 handle_command_reply: tid=0 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.636+0000 7febe6aadb80 1 client.25693 shutdown 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 msgr2=0x55f56fd1d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd1d670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7febc4009c40 tx=0x7febc40a66d0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 shutdown_connections 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd2db70 0x55f56fd30000 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd18920 0x55f56fd1e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd1d670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 --2- 172.21.15.47:0/878743016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd14140 0x55f56fd1dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febb7400700 0 client.25693 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 >> 172.21.15.47:0/878743016 conn(0x55f56fbdb070 msgr2=0x55f56fd12950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 shutdown_connections 2024-05-14T12:29:20.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 1 -- 172.21.15.47:0/878743016 wait complete. 2024-05-14T12:29:20.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.637+0000 7febe6aadb80 20 client.25693 trim_cache size 0 max 16384 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.659+0000 7febe6aadb80 1 Processor -- start 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febe6aadb80 1 -- start start 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd13330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd357c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd18920 0x55f56fd35d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febe6aadb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febd01b0e90 con 0x55f56fd14140 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febe6aadb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7febd01b2ac0 con 0x55f56fd18920 2024-05-14T12:29:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febe6aadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7febd01b1560 con 0x55f56fb95f40 2024-05-14T12:29:20.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.660+0000 7febd4c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd357c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45462/0 (socket says 172.21.15.47:45462) 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 -- 172.21.15.47:0/2475706621 learned_addr learned my addr 172.21.15.47:0/2475706621 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd6000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd18920 0x55f56fd35d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd5600700 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd13330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 -- 172.21.15.47:0/2475706621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 msgr2=0x55f56fd13330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd13330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 -- 172.21.15.47:0/2475706621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd18920 msgr2=0x55f56fd35d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd18920 0x55f56fd35d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 -- 172.21.15.47:0/2475706621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56fd10430 con 0x55f56fd14140 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.661+0000 7febd4c00700 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd357c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7febd006acf0 tx=0x7febbc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267ebc9b7b26c23c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.662+0000 7febc2000700 1 -- 172.21.15.47:0/2475706621 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc030070 con 0x55f56fd14140 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.662+0000 7febc2000700 1 -- 172.21.15.47:0/2475706621 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc011a90 con 0x55f56fd14140 2024-05-14T12:29:20.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.662+0000 7febc2000700 1 -- 172.21.15.47:0/2475706621 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc02a540 con 0x55f56fd14140 2024-05-14T12:29:20.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 -- 172.21.15.47:0/2475706621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 msgr2=0x55f56fd357c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd357c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7febd006acf0 tx=0x7febbc005e80 comp rx=0 tx=0).stop 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 -- 172.21.15.47:0/2475706621 shutdown_connections 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fd18920 0x55f56fd35d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fb95f40 0x55f56fd13330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 --2- 172.21.15.47:0/2475706621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd357c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 -- 172.21.15.47:0/2475706621 >> 172.21.15.47:0/2475706621 conn(0x55f56fbdb070 msgr2=0x55f56fd1f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 -- 172.21.15.47:0/2475706621 shutdown_connections 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 -- 172.21.15.47:0/2475706621 wait complete. 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.663+0000 7febe6aadb80 1 -- start start 2024-05-14T12:29:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 1 Processor -- start 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd26030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd243c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd24900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febd01b2330 con 0x55f56fd14140 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7febd01b1c30 con 0x55f56fb95f40 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7febd01aee10 con 0x55f56fd18920 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.664+0000 7febe6aadb80 10 client.0 _ll_register_callbacks cb 0x55f56fd0efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:20.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd4c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd5600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd26030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd5600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd26030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:32860/0 (socket says 172.21.15.47:32860) 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd5600700 1 -- 172.21.15.47:0/1523475310 learned_addr learned my addr 172.21.15.47:0/1523475310 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd4c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd243c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45470/0 (socket says 172.21.15.47:45470) 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd6000700 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd24900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd4c00700 1 -- 172.21.15.47:0/1523475310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 msgr2=0x55f56fd24900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd4c00700 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd24900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd4c00700 1 -- 172.21.15.47:0/1523475310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 msgr2=0x55f56fd26030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd4c00700 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd26030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd4c00700 1 -- 172.21.15.47:0/1523475310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56fd24f10 con 0x55f56fd14140 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.665+0000 7febd5600700 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd26030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.666+0000 7febd4c00700 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd243c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55f56fc3e160 tx=0x7febbc0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b9683e7ff27e96 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.666+0000 7febb7400700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:29:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.666+0000 7febb7400700 1 -- 172.21.15.47:0/1523475310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc038020 con 0x55f56fd14140 2024-05-14T12:29:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.666+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febbc011a90 con 0x55f56fd14140 2024-05-14T12:29:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.666+0000 7febb7400700 1 -- 172.21.15.47:0/1523475310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7febbc011020 con 0x55f56fd14140 2024-05-14T12:29:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febb7400700 1 -- 172.21.15.47:0/1523475310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7febbc030040 con 0x55f56fd14140 2024-05-14T12:29:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 10 client.15555 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f56fd99170 con 0x55f56fd14140 2024-05-14T12:29:20.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febb7400700 1 -- 172.21.15.47:0/1523475310 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc011a90 con 0x55f56fd14140 2024-05-14T12:29:20.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febb7400700 1 -- 172.21.15.47:0/1523475310 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7febbc03d070 con 0x55f56fd14140 2024-05-14T12:29:20.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 10 client.15555 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 10 client.15555 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 20 client.15555 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd99650 0x55f56fd9ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 4 client.15555 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bb0fabf7", "release": true, "await": true}] 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.667+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bb0fabf7", "release": true, "await": true}) -- 0x55f56fc43500 con 0x55f56fd99650 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.668+0000 7febd5600700 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd99650 0x55f56fd9ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.668+0000 7febd5600700 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd99650 0x55f56fd9ba70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b23a32a34cc57b0 server_cookie=e65c36bbc6ad8320 in_seq=0 out_seq=0 2024-05-14T12:29:20.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.668+0000 7febb7400700 10 client.15555 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:20.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.674+0000 7febb7400700 1 -- 172.21.15.47:0/1523475310 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55f56fc43500 con 0x55f56fd99650 2024-05-14T12:29:20.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.674+0000 7febb7400700 10 client.15555 handle_command_reply: tid=0 2024-05-14T12:29:20.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.674+0000 7febe6aadb80 1 client.15555 shutdown 2024-05-14T12:29:20.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 msgr2=0x55f56fd243c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd243c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55f56fc3e160 tx=0x7febbc0040f0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 shutdown_connections 2024-05-14T12:29:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f56fd99650 0x55f56fd9ba70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f56fd18920 0x55f56fd24900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f56fb95f40 0x55f56fd26030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 --2- 172.21.15.47:0/1523475310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f56fd14140 0x55f56fd243c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 >> 172.21.15.47:0/1523475310 conn(0x55f56fbdb070 msgr2=0x55f56fd172e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febb7400700 0 client.15555 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 shutdown_connections 2024-05-14T12:29:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.675+0000 7febe6aadb80 1 -- 172.21.15.47:0/1523475310 wait complete. 2024-05-14T12:29:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.676+0000 7febe6aadb80 20 client.15555 trim_cache size 0 max 16384 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 32, 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 12, 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "bb0fabf7": { 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 12, 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:29:20.677 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 87.5, 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:29:20.678 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:29:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.676+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7febb80b2900 msgr2=0x7febb80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.676+0000 7febd8000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7febb80b2900 0x7febb80b4e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febc80075c0 tx=0x7febc8004ad0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.676+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd0106590 msgr2=0x7febd019d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.676+0000 7febd8000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd0106590 0x7febd019d090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7febc4009230 tx=0x7febc400fa40 comp rx=0 tx=0).stop 2024-05-14T12:29:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 shutdown_connections 2024-05-14T12:29:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7febb80b2900 0x7febb80b4e10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd010c5d0 0x7febd01a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd0106590 0x7febd019d090 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 --2- 172.21.15.47:0/2340814862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febd0106ee0 0x7febd019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 >> 172.21.15.47:0/2340814862 conn(0x7febd0102090 msgr2=0x7febd01048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 shutdown_connections 2024-05-14T12:29:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:29:20.677+0000 7febd8000700 1 -- 172.21.15.47:0/2340814862 wait complete. 2024-05-14T12:29:21.646 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bb0fabf7', seconds elapsed: 44.4 2024-05-14T12:29:21.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:21 smithi047 ceph-mon[31254]: pgmap v575: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-05-14T12:29:22.054 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:21 smithi073 ceph-mon[35809]: pgmap v575: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-05-14T12:29:22.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:21 smithi066 ceph-mon[35981]: pgmap v575: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-05-14T12:29:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 -- 172.21.15.47:0/3036381767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c104230 msgr2=0x7f6c3c106650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 --2- 172.21.15.47:0/3036381767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c104230 0x7f6c3c106650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009900 tx=0x7f6c3002a3f0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 -- 172.21.15.47:0/3036381767 shutdown_connections 2024-05-14T12:29:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 --2- 172.21.15.47:0/3036381767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c109750 0x7f6c3c10bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 --2- 172.21.15.47:0/3036381767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3c106c20 0x7f6c3c1090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 --2- 172.21.15.47:0/3036381767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c104230 0x7f6c3c106650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 -- 172.21.15.47:0/3036381767 >> 172.21.15.47:0/3036381767 conn(0x7f6c3c0fdbb0 msgr2=0x7f6c3c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 -- 172.21.15.47:0/3036381767 shutdown_connections 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.741+0000 7f6c43200640 1 -- 172.21.15.47:0/3036381767 wait complete. 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.742+0000 7f6c43200640 1 Processor -- start 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c43200640 1 -- start start 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c43200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c104230 0x7f6c3c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c43200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3c106c20 0x7f6c3c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c43200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c109750 0x7f6c3c1a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c43200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c10f6a0 con 0x7f6c3c109750 2024-05-14T12:29:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c43200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c10f520 con 0x7f6c3c104230 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c43200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c10f820 con 0x7f6c3c106c20 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c41e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c104230 0x7f6c3c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c41e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c104230 0x7f6c3c19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:32876/0 (socket says 172.21.15.47:32876) 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c41e00640 1 -- 172.21.15.47:0/58152745 learned_addr learned my addr 172.21.15.47:0/58152745 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c41400640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3c106c20 0x7f6c3c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.743+0000 7f6c42800640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c109750 0x7f6c3c1a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c41e00640 1 -- 172.21.15.47:0/58152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3c106c20 msgr2=0x7f6c3c19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c41e00640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3c106c20 0x7f6c3c19c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c41e00640 1 -- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c109750 msgr2=0x7f6c3c1a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c41e00640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c109750 0x7f6c3c1a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c41e00640 1 -- 172.21.15.47:0/58152745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c1a3f00 con 0x7f6c3c104230 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c41400640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3c106c20 0x7f6c3c19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c41e00640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c104230 0x7f6c3c19c3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c30031440 tx=0x7f6c30003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.744+0000 7f6c36a00640 1 -- 172.21.15.47:0/58152745 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3003f070 con 0x7f6c3c104230 2024-05-14T12:29:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.745+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3c1a4190 con 0x7f6c3c104230 2024-05-14T12:29:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.745+0000 7f6c36a00640 1 -- 172.21.15.47:0/58152745 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c30031c50 con 0x7f6c3c104230 2024-05-14T12:29:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.745+0000 7f6c36a00640 1 -- 172.21.15.47:0/58152745 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30035030 con 0x7f6c3c104230 2024-05-14T12:29:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.745+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3c1a46d0 con 0x7f6c3c104230 2024-05-14T12:29:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 Processor -- start 2024-05-14T12:29:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 -- start start 2024-05-14T12:29:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875db62300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db62880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db69780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55875dac6550 con 0x55875d7972f0 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55875da6bbc0 con 0x55875d7c01b0 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.748+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55875dac2510 con 0x55875d79f4d0 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875db62300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c41400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db69780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875db62300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:32884/0 (socket says 172.21.15.47:32884) 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 -- 172.21.15.47:0/4151219903 learned_addr learned my addr 172.21.15.47:0/4151219903 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c36a00640 1 -- 172.21.15.47:0/58152745 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6c30042070 con 0x7f6c3c104230 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 -- 172.21.15.47:0/4151219903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 msgr2=0x55875db69780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db69780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 -- 172.21.15.47:0/4151219903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 msgr2=0x55875db62880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:29:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db62880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c42800640 1 -- 172.21.15.47:0/4151219903 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875d7d8210 con 0x55875d7c01b0 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.749+0000 7f6c41400640 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db69780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.750+0000 7f6c42800640 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875db62300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009fd0 tx=0x7f6c380118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465cec26e3b54566 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.750+0000 7f6c2b000640 1 -- 172.21.15.47:0/4151219903 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38004d20 con 0x55875d7c01b0 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.750+0000 7f6c2b000640 1 -- 172.21.15.47:0/4151219903 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c38004050 con 0x55875d7c01b0 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.750+0000 7f6c2b000640 1 -- 172.21.15.47:0/4151219903 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38005280 con 0x55875d7c01b0 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c36a00640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6c240b28a0 0x7f6c240b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c36a00640 1 -- 172.21.15.47:0/58152745 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6c30102980 con 0x7f6c3c104230 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 -- 172.21.15.47:0/4151219903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 msgr2=0x55875db62300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875db62300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009fd0 tx=0x7f6c380118d0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c41e00640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6c240b28a0 0x7f6c240b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 -- 172.21.15.47:0/4151219903 shutdown_connections 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db69780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db62880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/4151219903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875db62300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 -- 172.21.15.47:0/4151219903 >> 172.21.15.47:0/4151219903 conn(0x55875d7b4300 msgr2=0x55875db5dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 -- 172.21.15.47:0/4151219903 shutdown_connections 2024-05-14T12:29:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.751+0000 7f6c4b81c740 1 -- 172.21.15.47:0/4151219903 wait complete. 2024-05-14T12:29:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.752+0000 7f6c41e00640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6c240b28a0 0x7f6c240b4db0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c300c60d0 tx=0x7f6c3002a3f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.752+0000 7f6c4b81c740 1 -- start start 2024-05-14T12:29:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.752+0000 7f6c4b81c740 1 Processor -- start 2024-05-14T12:29:23.755 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7c01b0 0x55875db732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55875db6a1d0 con 0x55875d7972f0 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55875da7f660 con 0x55875d79f4d0 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55875db6a350 con 0x55875d7c01b0 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c4b81c740 10 client.0 _ll_register_callbacks cb 0x55875da49400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45514/0 (socket says 172.21.15.47:45514) 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 -- 172.21.15.47:0/2237535400 learned_addr learned my addr 172.21.15.47:0/2237535400 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7c01b0 0x55875db732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c41400640 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 -- 172.21.15.47:0/2237535400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7c01b0 msgr2=0x55875db732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7c01b0 0x55875db732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 -- 172.21.15.47:0/2237535400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 msgr2=0x55875db6c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.753+0000 7f6c42800640 1 -- 172.21.15.47:0/2237535400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55875d8a4620 con 0x55875d7972f0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c42800640 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6be20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c38004910 tx=0x7f6c38003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeadb233e0901ba server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c1f400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c1f400640 1 -- 172.21.15.47:0/2237535400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38005240 con 0x55875d7972f0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c1f400640 1 -- 172.21.15.47:0/2237535400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6c380053e0 con 0x55875d7972f0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c38004050 con 0x55875d7972f0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c1f400640 1 -- 172.21.15.47:0/2237535400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c380055e0 con 0x55875d7972f0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c4b81c740 10 client.15564 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.754+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55875db761f0 con 0x55875d7972f0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c1f400640 1 -- 172.21.15.47:0/2237535400 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c38004050 con 0x55875d7972f0 2024-05-14T12:29:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c1f400640 1 -- 172.21.15.47:0/2237535400 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f6c38025040 con 0x55875d7972f0 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c4b81c740 10 client.15564 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c4b81c740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c4b81c740 20 client.15564 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d77ed80 0x55875db79790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c4b81c740 4 client.15564 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55875dad4160 con 0x55875d77ed80 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.755+0000 7f6c41400640 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d77ed80 0x55875db79790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.756+0000 7f6c41400640 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d77ed80 0x55875db79790 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f88004a957893ce server_cookie=66c8941359c2382a in_seq=0 out_seq=0 2024-05-14T12:29:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.756+0000 7f6c1f400640 10 client.15564 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c1f400640 1 -- 172.21.15.47:0/2237535400 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55875dad4160 con 0x55875d77ed80 2024-05-14T12:29:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c1f400640 10 client.15564 handle_command_reply: tid=0 2024-05-14T12:29:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 client.15564 shutdown 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 msgr2=0x55875db6be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6be20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c38004910 tx=0x7f6c38003f50 comp rx=0 tx=0).stop 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 shutdown_connections 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d77ed80 0x55875db79790 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7c01b0 0x55875db732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2237535400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6be20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c1f400640 0 client.15564 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 >> 172.21.15.47:0/2237535400 conn(0x55875d7b4300 msgr2=0x55875db5cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 shutdown_connections 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2237535400 wait complete. 2024-05-14T12:29:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.757+0000 7f6c4b81c740 20 client.15564 trim_cache size 0 max 16384 2024-05-14T12:29:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 Processor -- start 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 -- start start 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7972f0 0x55875db6ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7c01b0 0x55875db6bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1ad360 con 0x55875d7c01b0 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1aef90 con 0x55875d79f4d0 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1ada30 con 0x55875d7972f0 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c42800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7c01b0 0x55875db6bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c41400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.775+0000 7f6c42800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7972f0 0x55875db6ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:32900/0 (socket says 172.21.15.47:32900) 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c42800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7972f0 0x55875db6ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34858/0 (socket says 172.21.15.47:34858) 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 -- 172.21.15.47:0/2301310723 learned_addr learned my addr 172.21.15.47:0/2301310723 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 -- 172.21.15.47:0/2301310723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7972f0 msgr2=0x55875db6ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 --2- 172.21.15.47:0/2301310723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7972f0 0x55875db6ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 -- 172.21.15.47:0/2301310723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7c01b0 msgr2=0x55875db6bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 --2- 172.21.15.47:0/2301310723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7c01b0 0x55875db6bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 -- 172.21.15.47:0/2301310723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875db66c80 con 0x55875d79f4d0 2024-05-14T12:29:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c41400640 1 --2- 172.21.15.47:0/2301310723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6b9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55875db6ce90 tx=0x7f6c2c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc418ae5f53dfdb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.776+0000 7f6c2a600640 1 -- 172.21.15.47:0/2301310723 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c004220 con 0x55875d79f4d0 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.777+0000 7f6c2a600640 1 -- 172.21.15.47:0/2301310723 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c2c0043c0 con 0x55875d79f4d0 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.777+0000 7f6c2a600640 1 -- 172.21.15.47:0/2301310723 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c004e10 con 0x55875d79f4d0 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.777+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2301310723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 msgr2=0x55875db6b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.777+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2301310723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6b9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55875db6ce90 tx=0x7f6c2c005f90 comp rx=0 tx=0).stop 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2301310723 shutdown_connections 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2301310723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7c01b0 0x55875db6bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2301310723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d79f4d0 0x55875db6b9f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/2301310723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d7972f0 0x55875db6ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2301310723 >> 172.21.15.47:0/2301310723 conn(0x55875d7b4300 msgr2=0x55875db6a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2301310723 shutdown_connections 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 -- 172.21.15.47:0/2301310723 wait complete. 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 -- start start 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.778+0000 7f6c4b81c740 1 Processor -- start 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db70030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c4b81c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875dbdfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1ae800 con 0x55875d7972f0 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1ae100 con 0x55875d7c01b0 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c4b81c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1ab320 con 0x55875d79f4d0 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c4b81c740 10 client.0 _ll_register_callbacks cb 0x7f6c2c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c42800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c41400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db70030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c42800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45540/0 (socket says 172.21.15.47:45540) 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c42800640 1 -- 172.21.15.47:0/3795133270 learned_addr learned my addr 172.21.15.47:0/3795133270 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.779+0000 7f6c42800640 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875dbdfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c42800640 1 -- 172.21.15.47:0/3795133270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 msgr2=0x55875db70030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c42800640 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db70030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c42800640 1 -- 172.21.15.47:0/3795133270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 msgr2=0x55875dbdfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c42800640 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875dbdfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c42800640 1 -- 172.21.15.47:0/3795133270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55875dbe00f0 con 0x55875d7972f0 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c41400640 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db70030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c42800640 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6faf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800fe30 tx=0x7f6c38009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af16c6e4c45f6dfc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c1f400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:29:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c1f400640 1 -- 172.21.15.47:0/3795133270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003c90 con 0x55875d7972f0 2024-05-14T12:29:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c2c0043c0 con 0x55875d7972f0 2024-05-14T12:29:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c1f400640 1 -- 172.21.15.47:0/3795133270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6c3800f6f0 con 0x55875d7972f0 2024-05-14T12:29:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c1f400640 1 -- 172.21.15.47:0/3795133270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c38004720 con 0x55875d7972f0 2024-05-14T12:29:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c4b81c740 10 client.15570 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.780+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55875dbe1380 con 0x55875d7972f0 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c1f400640 1 -- 172.21.15.47:0/3795133270 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c2c0043c0 con 0x55875d7972f0 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c1f400640 1 -- 172.21.15.47:0/3795133270 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f6c380324c0 con 0x55875d7972f0 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c4b81c740 10 client.15570 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c4b81c740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c4b81c740 20 client.15570 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d7541c0 0x55875dbe3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c4b81c740 4 client.15570 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55875dacdfd0 con 0x55875d7541c0 2024-05-14T12:29:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.781+0000 7f6c41400640 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d7541c0 0x55875dbe3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.782+0000 7f6c41400640 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d7541c0 0x55875dbe3d80 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=948fd17189c2033d server_cookie=9c8c64d4983090b2 in_seq=0 out_seq=0 2024-05-14T12:29:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.782+0000 7f6c1f400640 10 client.15570 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c1f400640 1 -- 172.21.15.47:0/3795133270 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55875dacdfd0 con 0x55875d7541c0 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c1f400640 10 client.15570 handle_command_reply: tid=0 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 client.15570 shutdown 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 msgr2=0x55875db6faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6faf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800fe30 tx=0x7f6c38009d70 comp rx=0 tx=0).stop 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 shutdown_connections 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55875d7541c0 0x55875dbe3d80 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55875d7c01b0 0x55875dbdfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55875d79f4d0 0x55875db70030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 --2- 172.21.15.47:0/3795133270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55875d7972f0 0x55875db6faf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 >> 172.21.15.47:0/3795133270 conn(0x55875d7b4300 msgr2=0x55875db6b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.798+0000 7f6c1f400640 0 client.15570 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.799+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 shutdown_connections 2024-05-14T12:29:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.799+0000 7f6c4b81c740 1 -- 172.21.15.47:0/3795133270 wait complete. 2024-05-14T12:29:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.799+0000 7f6c4b81c740 20 client.15570 trim_cache size 0 max 16384 2024-05-14T12:29:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:29:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:29:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:29:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.799+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6c240b28a0 msgr2=0x7f6c240b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.799+0000 7f6c43200640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6c240b28a0 0x7f6c240b4db0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c300c60d0 tx=0x7f6c3002a3f0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.799+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c104230 msgr2=0x7f6c3c19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c104230 0x7f6c3c19c3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c30031440 tx=0x7f6c30003c10 comp rx=0 tx=0).stop 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 shutdown_connections 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6c240b28a0 0x7f6c240b4db0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3c109750 0x7f6c3c1a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3c106c20 0x7f6c3c19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 --2- 172.21.15.47:0/58152745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c104230 0x7f6c3c19c3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 >> 172.21.15.47:0/58152745 conn(0x7f6c3c0fdbb0 msgr2=0x7f6c3c103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 shutdown_connections 2024-05-14T12:29:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:23.800+0000 7f6c43200640 1 -- 172.21.15.47:0/58152745 wait complete. 2024-05-14T12:29:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:23 smithi066 ceph-mon[35981]: pgmap v576: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.9 MiB/s wr, 15 op/s 2024-05-14T12:29:24.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:23 smithi047 ceph-mon[31254]: pgmap v576: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.9 MiB/s wr, 15 op/s 2024-05-14T12:29:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:23 smithi073 ceph-mon[35809]: pgmap v576: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.9 MiB/s wr, 15 op/s 2024-05-14T12:29:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:25 smithi066 ceph-mon[35981]: pgmap v577: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.9 MiB/s wr, 14 op/s 2024-05-14T12:29:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:25 smithi047 ceph-mon[31254]: pgmap v577: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.9 MiB/s wr, 14 op/s 2024-05-14T12:29:26.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:25 smithi073 ceph-mon[35809]: pgmap v577: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.9 MiB/s wr, 14 op/s 2024-05-14T12:29:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:27 smithi066 ceph-mon[35981]: pgmap v578: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 30 op/s 2024-05-14T12:29:28.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:27 smithi047 ceph-mon[31254]: pgmap v578: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 30 op/s 2024-05-14T12:29:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:27 smithi073 ceph-mon[35809]: pgmap v578: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 30 op/s 2024-05-14T12:29:29.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:28 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:29:29.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:28 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:29:29.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:28 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:29:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:29 smithi047 ceph-mon[31254]: pgmap v579: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.9 MiB/s wr, 27 op/s 2024-05-14T12:29:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:29 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:29 smithi073 ceph-mon[35809]: pgmap v579: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.9 MiB/s wr, 27 op/s 2024-05-14T12:29:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:29 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:29 smithi066 ceph-mon[35981]: pgmap v579: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.9 MiB/s wr, 27 op/s 2024-05-14T12:29:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:29 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.226 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi066 to 176.2M 2024-05-14T12:29:31.226 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: Unable to set osd_memory_target on smithi066 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-05-14T12:29:31.226 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.226 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi047 to 177.5M 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: Unable to set osd_memory_target on smithi047 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:29:31.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:30 smithi066 ceph-mon[35981]: pgmap v580: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 47 op/s 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi066 to 176.2M 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: Unable to set osd_memory_target on smithi066 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi047 to 177.5M 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: Unable to set osd_memory_target on smithi047 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:29:31.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:29:31.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:29:31.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:30 smithi047 ceph-mon[31254]: pgmap v580: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 47 op/s 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi066 to 176.2M 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: Unable to set osd_memory_target on smithi066 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi047 to 177.5M 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: Unable to set osd_memory_target on smithi047 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:29:31.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:30 smithi073 ceph-mon[35809]: pgmap v580: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 47 op/s 2024-05-14T12:29:33.020 INFO:tasks.workunit.client.0.smithi047.stdout:fs setup took 113 secs 2024-05-14T12:29:33.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:33 smithi066 ceph-mon[35981]: pgmap v581: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 62 MiB/s wr, 58 op/s 2024-05-14T12:29:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:33 smithi047 ceph-mon[31254]: pgmap v581: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 62 MiB/s wr, 58 op/s 2024-05-14T12:29:34.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:33 smithi073 ceph-mon[35809]: pgmap v581: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 62 MiB/s wr, 58 op/s 2024-05-14T12:29:35.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:35 smithi066 ceph-mon[35981]: pgmap v582: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 75 MiB/s wr, 61 op/s 2024-05-14T12:29:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:35 smithi047 ceph-mon[31254]: pgmap v582: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 75 MiB/s wr, 61 op/s 2024-05-14T12:29:36.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:35 smithi073 ceph-mon[35809]: pgmap v582: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 75 MiB/s wr, 61 op/s 2024-05-14T12:29:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.083+0000 7fb472000640 1 -- 172.21.15.47:0/2558154760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c1036b0 msgr2=0x7fb46c103bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.083+0000 7fb472000640 1 --2- 172.21.15.47:0/2558154760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c1036b0 0x7fb46c103bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb464009ca0 tx=0x7fb46402a8c0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.083+0000 7fb472000640 1 -- 172.21.15.47:0/2558154760 shutdown_connections 2024-05-14T12:29:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.083+0000 7fb472000640 1 --2- 172.21.15.47:0/2558154760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c1036b0 0x7fb46c103bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.083+0000 7fb472000640 1 --2- 172.21.15.47:0/2558154760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c102b50 0x7fb46c103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.083+0000 7fb472000640 1 --2- 172.21.15.47:0/2558154760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c102170 0x7fb46c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.083+0000 7fb472000640 1 -- 172.21.15.47:0/2558154760 >> 172.21.15.47:0/2558154760 conn(0x7fb46c0fdd40 msgr2=0x7fb46c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.085+0000 7fb472000640 1 -- 172.21.15.47:0/2558154760 shutdown_connections 2024-05-14T12:29:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.085+0000 7fb472000640 1 -- 172.21.15.47:0/2558154760 wait complete. 2024-05-14T12:29:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.086+0000 7fb472000640 1 Processor -- start 2024-05-14T12:29:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb472000640 1 -- start start 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb472000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c102170 0x7fb46c19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb472000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c102b50 0x7fb46c19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb472000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c1036b0 0x7fb46c1a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb472000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c111980 con 0x7fb46c1036b0 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb472000640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c111800 con 0x7fb46c102b50 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb472000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c111b00 con 0x7fb46c102170 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb46b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c102170 0x7fb46c19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb46be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c1036b0 0x7fb46c1a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46aa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c102b50 0x7fb46c19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c1036b0 0x7fb46c1a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58200/0 (socket says 172.21.15.47:58200) 2024-05-14T12:29:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46be00640 1 -- 172.21.15.47:0/2494060343 learned_addr learned my addr 172.21.15.47:0/2494060343 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.087+0000 7fb46b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c102170 0x7fb46c19c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52908/0 (socket says 172.21.15.47:52908) 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46aa00640 1 -- 172.21.15.47:0/2494060343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c102170 msgr2=0x7fb46c19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46aa00640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c102170 0x7fb46c19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46aa00640 1 -- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c1036b0 msgr2=0x7fb46c1a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46aa00640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c1036b0 0x7fb46c1a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46aa00640 1 -- 172.21.15.47:0/2494060343 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c1a3ec0 con 0x7fb46c102b50 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46be00640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c1036b0 0x7fb46c1a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.088+0000 7fb46aa00640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c102b50 0x7fb46c19c970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00e9f0 tx=0x7fb45c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.089+0000 7fb463e00640 1 -- 172.21.15.47:0/2494060343 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00ccc0 con 0x7fb46c102b50 2024-05-14T12:29:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.089+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c1a41b0 con 0x7fb46c102b50 2024-05-14T12:29:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.089+0000 7fb463e00640 1 -- 172.21.15.47:0/2494060343 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb45c0108e0 con 0x7fb46c102b50 2024-05-14T12:29:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.089+0000 7fb463e00640 1 -- 172.21.15.47:0/2494060343 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0188e0 con 0x7fb46c102b50 2024-05-14T12:29:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.089+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c1a4750 con 0x7fb46c102b50 2024-05-14T12:29:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.092+0000 7fb479021740 1 Processor -- start 2024-05-14T12:29:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.092+0000 7fb479021740 1 -- start start 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.092+0000 7fb479021740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b124100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.092+0000 7fb479021740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b124680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb479021740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb479021740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f8b088550 con 0x559f8ad614d0 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb479021740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559f8b02dbc0 con 0x559f8ad821b0 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb479021740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559f8b084510 con 0x559f8ad592f0 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b124100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b124680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b124100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40626/0 (socket says 172.21.15.47:40626) 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b124680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52922/0 (socket says 172.21.15.47:52922) 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46be00640 1 -- 172.21.15.47:0/3485478836 learned_addr learned my addr 172.21.15.47:0/3485478836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46b400640 1 -- 172.21.15.47:0/3485478836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 msgr2=0x559f8b124100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46b400640 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b124100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46b400640 1 -- 172.21.15.47:0/3485478836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 msgr2=0x559f8b12b580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46b400640 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46b400640 1 -- 172.21.15.47:0/3485478836 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8ad9a210 con 0x559f8ad592f0 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.093+0000 7fb46be00640 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b124100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.094+0000 7fb46b400640 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b124680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb45800aba0 tx=0x7fb45800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a38eb0874efe33 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.094+0000 7fb463e00640 1 -- 172.21.15.47:0/2494060343 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb45c010430 con 0x7fb46c102b50 2024-05-14T12:29:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.095+0000 7fb463e00640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4500b2920 0x7fb4500b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.095+0000 7fb463e00640 1 -- 172.21.15.47:0/2494060343 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb45c0e24c0 con 0x7fb46c102b50 2024-05-14T12:29:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.096+0000 7fb46be00640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4500b2920 0x7fb4500b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.096+0000 7fb457e00640 1 -- 172.21.15.47:0/3485478836 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458005220 con 0x559f8ad592f0 2024-05-14T12:29:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.096+0000 7fb457e00640 1 -- 172.21.15.47:0/3485478836 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb458004c50 con 0x559f8ad592f0 2024-05-14T12:29:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.096+0000 7fb457e00640 1 -- 172.21.15.47:0/3485478836 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458018840 con 0x559f8ad592f0 2024-05-14T12:29:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 -- 172.21.15.47:0/3485478836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 msgr2=0x559f8b124680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b124680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb45800aba0 tx=0x7fb45800f790 comp rx=0 tx=0).stop 2024-05-14T12:29:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb46be00640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4500b2920 0x7fb4500b4e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb464009a60 tx=0x7fb464031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 -- 172.21.15.47:0/3485478836 shutdown_connections 2024-05-14T12:29:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b124680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 --2- 172.21.15.47:0/3485478836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b124100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 -- 172.21.15.47:0/3485478836 >> 172.21.15.47:0/3485478836 conn(0x559f8ad76300 msgr2=0x559f8b11fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 -- 172.21.15.47:0/3485478836 shutdown_connections 2024-05-14T12:29:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.097+0000 7fb479021740 1 -- 172.21.15.47:0/3485478836 wait complete. 2024-05-14T12:29:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.098+0000 7fb479021740 1 -- start start 2024-05-14T12:29:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.098+0000 7fb479021740 1 Processor -- start 2024-05-14T12:29:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.099+0000 7fb479021740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad592f0 0x559f8b12dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.099+0000 7fb479021740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.099+0000 7fb479021740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad821b0 0x559f8b135160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.099+0000 7fb479021740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f8b12bfd0 con 0x559f8ad614d0 2024-05-14T12:29:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.099+0000 7fb479021740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559f8b041660 con 0x559f8ad592f0 2024-05-14T12:29:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.099+0000 7fb479021740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559f8b12c150 con 0x559f8ad821b0 2024-05-14T12:29:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.099+0000 7fb479021740 10 client.0 _ll_register_callbacks cb 0x559f8b00b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad592f0 0x559f8b12dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad592f0 0x559f8b12dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40630/0 (socket says 172.21.15.47:40630) 2024-05-14T12:29:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46b400640 1 -- 172.21.15.47:0/1744799360 learned_addr learned my addr 172.21.15.47:0/1744799360 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46aa00640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46be00640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad821b0 0x559f8b135160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46b400640 1 -- 172.21.15.47:0/1744799360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad821b0 msgr2=0x559f8b135160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46b400640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad821b0 0x559f8b135160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.100+0000 7fb46b400640 1 -- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 msgr2=0x559f8b12e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb46b400640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb46b400640 1 -- 172.21.15.47:0/1744799360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8ae66620 con 0x559f8ad592f0 2024-05-14T12:29:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb46aa00640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb46be00640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad821b0 0x559f8b135160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:29:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb46b400640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad592f0 0x559f8b12dcc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb458000c00 tx=0x7fb458005030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0c6603d7c99babc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb454c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb454c00640 1 -- 172.21.15.47:0/1744799360 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45800a7a0 con 0x559f8ad592f0 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb454c00640 1 -- 172.21.15.47:0/1744799360 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb4580053e0 con 0x559f8ad592f0 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.101+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb458004c50 con 0x559f8ad592f0 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.102+0000 7fb454c00640 1 -- 172.21.15.47:0/1744799360 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb458032050 con 0x559f8ad592f0 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.102+0000 7fb479021740 10 client.25709 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.102+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559f8b138090 con 0x559f8ad592f0 2024-05-14T12:29:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.102+0000 7fb454c00640 1 -- 172.21.15.47:0/1744799360 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4580035f0 con 0x559f8ad592f0 2024-05-14T12:29:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb454c00640 1 -- 172.21.15.47:0/1744799360 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fb458018540 con 0x559f8ad592f0 2024-05-14T12:29:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb479021740 10 client.25709 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb479021740 10 client.25709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb479021740 20 client.25709 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb479021740 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad40d80 0x559f8b13b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb479021740 4 client.25709 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:29:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb458004c50 con 0x559f8ad40d80 2024-05-14T12:29:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.103+0000 7fb46aa00640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad40d80 0x559f8b13b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.105+0000 7fb46aa00640 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad40d80 0x559f8b13b5d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a263ad97f3e9d server_cookie=43d06143bc02f42b in_seq=0 out_seq=0 2024-05-14T12:29:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.105+0000 7fb454c00640 10 client.25709 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.107+0000 7fb454c00640 1 -- 172.21.15.47:0/1744799360 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fb458004c50 con 0x559f8ad40d80 2024-05-14T12:29:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.107+0000 7fb454c00640 10 client.25709 handle_command_reply: tid=0 2024-05-14T12:29:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.107+0000 7fb479021740 1 client.25709 shutdown 2024-05-14T12:29:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad592f0 msgr2=0x559f8b12dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad592f0 0x559f8b12dcc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb458000c00 tx=0x7fb458005030 comp rx=0 tx=0).stop 2024-05-14T12:29:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 shutdown_connections 2024-05-14T12:29:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad40d80 0x559f8b13b5d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad821b0 0x559f8b135160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b12e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 --2- 172.21.15.47:0/1744799360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad592f0 0x559f8b12dcc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 >> 172.21.15.47:0/1744799360 conn(0x559f8ad76300 msgr2=0x559f8b1229a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb454c00640 0 client.25709 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 shutdown_connections 2024-05-14T12:29:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.111+0000 7fb479021740 1 -- 172.21.15.47:0/1744799360 wait complete. 2024-05-14T12:29:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.112+0000 7fb479021740 20 client.25709 trim_cache size 0 max 16384 2024-05-14T12:29:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.151+0000 7fb479021740 1 Processor -- start 2024-05-14T12:29:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.152+0000 7fb479021740 1 -- start start 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.152+0000 7fb479021740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad592f0 0x559f8b11f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.152+0000 7fb479021740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad614d0 0x559f8b11f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.152+0000 7fb479021740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b11fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.153+0000 7fb46aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad614d0 0x559f8b11f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.153+0000 7fb46b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad592f0 0x559f8b11f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.153+0000 7fb46aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad614d0 0x559f8b11f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52948/0 (socket says 172.21.15.47:52948) 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.153+0000 7fb46b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad592f0 0x559f8b11f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58216/0 (socket says 172.21.15.47:58216) 2024-05-14T12:29:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.153+0000 7fb46aa00640 1 -- 172.21.15.47:0/11341520 learned_addr learned my addr 172.21.15.47:0/11341520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.153+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ad570 con 0x559f8ad592f0 2024-05-14T12:29:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.153+0000 7fb46be00640 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b11fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.154+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1af1a0 con 0x559f8ad821b0 2024-05-14T12:29:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.154+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1adc40 con 0x559f8ad614d0 2024-05-14T12:29:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.155+0000 7fb46aa00640 1 -- 172.21.15.47:0/11341520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 msgr2=0x559f8b11fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.155+0000 7fb46aa00640 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b11fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.155+0000 7fb46aa00640 1 -- 172.21.15.47:0/11341520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad592f0 msgr2=0x559f8b11f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.155+0000 7fb46aa00640 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad592f0 0x559f8b11f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.155+0000 7fb46aa00640 1 -- 172.21.15.47:0/11341520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8b12b470 con 0x559f8ad614d0 2024-05-14T12:29:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.156+0000 7fb46be00640 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b11fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:29:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.157+0000 7fb46aa00640 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad614d0 0x559f8b11f6f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0a6130 tx=0x7fb45c0dfe90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd738c49e4333ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.157+0000 7fb457400640 1 -- 172.21.15.47:0/11341520 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c08f070 con 0x559f8ad614d0 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.157+0000 7fb457400640 1 -- 172.21.15.47:0/11341520 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb45c0b2940 con 0x559f8ad614d0 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.158+0000 7fb457400640 1 -- 172.21.15.47:0/11341520 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0aa050 con 0x559f8ad614d0 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.158+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad614d0 msgr2=0x559f8b11f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.158+0000 7fb479021740 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad614d0 0x559f8b11f6f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0a6130 tx=0x7fb45c0dfe90 comp rx=0 tx=0).stop 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.159+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 shutdown_connections 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.159+0000 7fb479021740 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b11fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.159+0000 7fb479021740 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad614d0 0x559f8b11f6f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.159+0000 7fb479021740 1 --2- 172.21.15.47:0/11341520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad592f0 0x559f8b11f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.159+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 >> 172.21.15.47:0/11341520 conn(0x559f8ad76300 msgr2=0x559f8b1280c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.159+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 shutdown_connections 2024-05-14T12:29:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.159+0000 7fb479021740 1 -- 172.21.15.47:0/11341520 wait complete. 2024-05-14T12:29:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.160+0000 7fb479021740 1 -- start start 2024-05-14T12:29:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.161+0000 7fb479021740 1 Processor -- start 2024-05-14T12:29:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.162+0000 7fb479021740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b1352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.162+0000 7fb479021740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b135830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.162+0000 7fb46b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b1352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.162+0000 7fb46b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b1352f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52962/0 (socket says 172.21.15.47:52962) 2024-05-14T12:29:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.162+0000 7fb479021740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.163+0000 7fb479021740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1aea10 con 0x559f8ad614d0 2024-05-14T12:29:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.163+0000 7fb46b400640 1 -- 172.21.15.47:0/2256816823 learned_addr learned my addr 172.21.15.47:0/2256816823 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.163+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ae310 con 0x559f8ad821b0 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.163+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ab530 con 0x559f8ad592f0 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.163+0000 7fb479021740 10 client.0 _ll_register_callbacks cb 0x7fb464009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.163+0000 7fb46aa00640 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.164+0000 7fb46be00640 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.164+0000 7fb46b400640 1 -- 172.21.15.47:0/2256816823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 msgr2=0x559f8b131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.164+0000 7fb46b400640 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b131ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.164+0000 7fb46b400640 1 -- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 msgr2=0x559f8b135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.164+0000 7fb46b400640 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.164+0000 7fb46b400640 1 -- 172.21.15.47:0/2256816823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8b132630 con 0x559f8ad592f0 2024-05-14T12:29:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.165+0000 7fb46b400640 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b1352f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb458001eb0 tx=0x7fb458018d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f32e112cde1ec996 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.165+0000 7fb454c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:29:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.166+0000 7fb454c00640 1 -- 172.21.15.47:0/2256816823 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4580186e0 con 0x559f8ad592f0 2024-05-14T12:29:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.166+0000 7fb454c00640 1 -- 172.21.15.47:0/2256816823 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb4580049d0 con 0x559f8ad592f0 2024-05-14T12:29:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.168+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb45c0b2940 con 0x559f8ad592f0 2024-05-14T12:29:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.169+0000 7fb454c00640 1 -- 172.21.15.47:0/2256816823 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb45800a7a0 con 0x559f8ad592f0 2024-05-14T12:29:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.169+0000 7fb479021740 10 client.25732 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.169+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559f8b1a2630 con 0x559f8ad592f0 2024-05-14T12:29:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.170+0000 7fb454c00640 1 -- 172.21.15.47:0/2256816823 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb45c0b2940 con 0x559f8ad592f0 2024-05-14T12:29:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.170+0000 7fb454c00640 1 -- 172.21.15.47:0/2256816823 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fb4580043a0 con 0x559f8ad592f0 2024-05-14T12:29:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.170+0000 7fb479021740 10 client.25732 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.170+0000 7fb479021740 10 client.25732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.171+0000 7fb479021740 20 client.25732 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.171+0000 7fb479021740 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad161c0 0x559f8b1a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.171+0000 7fb479021740 4 client.25732 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:29:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.171+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f8b096160 con 0x559f8ad161c0 2024-05-14T12:29:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.173+0000 7fb46aa00640 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad161c0 0x559f8b1a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.174+0000 7fb46aa00640 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad161c0 0x559f8b1a5110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=141eda601aaa960a server_cookie=1dc89e7545144eab in_seq=0 out_seq=0 2024-05-14T12:29:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.174+0000 7fb454c00640 10 client.25732 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.228+0000 7fb454c00640 1 -- 172.21.15.47:0/2256816823 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f8b096160 con 0x559f8ad161c0 2024-05-14T12:29:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.228+0000 7fb454c00640 10 client.25732 handle_command_reply: tid=0 2024-05-14T12:29:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.228+0000 7fb479021740 1 client.25732 shutdown 2024-05-14T12:29:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 msgr2=0x559f8b1352f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b1352f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb458001eb0 tx=0x7fb458018d80 comp rx=0 tx=0).stop 2024-05-14T12:29:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 shutdown_connections 2024-05-14T12:29:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559f8ad161c0 0x559f8b1a5110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f8ad821b0 0x559f8b131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8ad614d0 0x559f8b135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 --2- 172.21.15.47:0/2256816823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559f8ad592f0 0x559f8b1352f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.230 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 >> 172.21.15.47:0/2256816823 conn(0x559f8ad76300 msgr2=0x559f8b1280c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.229+0000 7fb454c00640 0 client.25732 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.230+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 shutdown_connections 2024-05-14T12:29:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.230+0000 7fb479021740 1 -- 172.21.15.47:0/2256816823 wait complete. 2024-05-14T12:29:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.230+0000 7fb479021740 20 client.25732 trim_cache size 0 max 16384 2024-05-14T12:29:37.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:29:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:29:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:29:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:29:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4500b2920 msgr2=0x7fb4500b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4500b2920 0x7fb4500b4e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb464009a60 tx=0x7fb464031af0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c102b50 msgr2=0x7fb46c19c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c102b50 0x7fb46c19c970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00e9f0 tx=0x7fb45c00eeb0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 shutdown_connections 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb4500b2920 0x7fb4500b4e30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb46c1036b0 0x7fb46c1a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb46c102b50 0x7fb46c19c970 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 --2- 172.21.15.47:0/2494060343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c102170 0x7fb46c19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.231+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 >> 172.21.15.47:0/2494060343 conn(0x7fb46c0fdd40 msgr2=0x7fb46c10a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.232+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 shutdown_connections 2024-05-14T12:29:37.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:37.232+0000 7fb472000640 1 -- 172.21.15.47:0/2494060343 wait complete. 2024-05-14T12:29:37.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:37 smithi047 ceph-mon[31254]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 139 MiB/s wr, 85 op/s 2024-05-14T12:29:38.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:37 smithi073 ceph-mon[35809]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 139 MiB/s wr, 85 op/s 2024-05-14T12:29:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:37 smithi066 ceph-mon[35981]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 139 MiB/s wr, 85 op/s 2024-05-14T12:29:39.617 INFO:tasks.workunit.client.0.smithi047.stdout:Syncing()...6 sec 2024-05-14T12:29:39.620 INFO:tasks.workunit.client.0.smithi047.stdout:Starting Actual Benchmark At: Tue May 14 12:29:39 2024 2024-05-14T12:29:39.620 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:29:40.000 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:39 smithi047 ceph-mon[31254]: pgmap v584: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 214 MiB/s wr, 89 op/s 2024-05-14T12:29:40.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:39 smithi073 ceph-mon[35809]: pgmap v584: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 214 MiB/s wr, 89 op/s 2024-05-14T12:29:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:39 smithi066 ceph-mon[35981]: pgmap v584: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 214 MiB/s wr, 89 op/s 2024-05-14T12:29:42.249 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:41 smithi047 ceph-mon[31254]: pgmap v585: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 274 MiB/s wr, 114 op/s 2024-05-14T12:29:42.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:41 smithi073 ceph-mon[35809]: pgmap v585: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 274 MiB/s wr, 114 op/s 2024-05-14T12:29:42.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:41 smithi066 ceph-mon[35981]: pgmap v585: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 274 MiB/s wr, 114 op/s 2024-05-14T12:29:43.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:42 smithi047 ceph-mon[31254]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 304 MiB/s wr, 284 op/s 2024-05-14T12:29:43.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:42 smithi073 ceph-mon[35809]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 304 MiB/s wr, 284 op/s 2024-05-14T12:29:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:42 smithi066 ceph-mon[35981]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 304 MiB/s wr, 284 op/s 2024-05-14T12:29:45.824 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:45 smithi066 ceph-mon[35981]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 280 MiB/s wr, 690 op/s 2024-05-14T12:29:45.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:45 smithi047 ceph-mon[31254]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 280 MiB/s wr, 690 op/s 2024-05-14T12:29:46.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:45 smithi073 ceph-mon[35809]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 280 MiB/s wr, 690 op/s 2024-05-14T12:29:47.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:47 smithi047 ceph-mon[31254]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 267 MiB/s wr, 1.69k op/s 2024-05-14T12:29:48.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:47 smithi073 ceph-mon[35809]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 267 MiB/s wr, 1.69k op/s 2024-05-14T12:29:48.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:47 smithi066 ceph-mon[35981]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 267 MiB/s wr, 1.69k op/s 2024-05-14T12:29:49.988 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:49 smithi047 ceph-mon[31254]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 215 MiB/s wr, 3.51k op/s 2024-05-14T12:29:50.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:49 smithi073 ceph-mon[35809]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 215 MiB/s wr, 3.51k op/s 2024-05-14T12:29:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:49 smithi066 ceph-mon[35981]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 215 MiB/s wr, 3.51k op/s 2024-05-14T12:29:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 -- 172.21.15.47:0/2056447199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89441070a0 msgr2=0x7f89441094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 --2- 172.21.15.47:0/2056447199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89441070a0 0x7f89441094c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8930009900 tx=0x7f893002a410 comp rx=0 tx=0).stop 2024-05-14T12:29:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 -- 172.21.15.47:0/2056447199 shutdown_connections 2024-05-14T12:29:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 --2- 172.21.15.47:0/2056447199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944109a00 0x7f894410be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 --2- 172.21.15.47:0/2056447199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89441070a0 0x7f89441094c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 --2- 172.21.15.47:0/2056447199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8944104740 0x7f8944106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 -- 172.21.15.47:0/2056447199 >> 172.21.15.47:0/2056447199 conn(0x7f89440fdd40 msgr2=0x7f89441001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 -- 172.21.15.47:0/2056447199 shutdown_connections 2024-05-14T12:29:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.599+0000 7f894a000640 1 -- 172.21.15.47:0/2056447199 wait complete. 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.600+0000 7f894a000640 1 Processor -- start 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f894a000640 1 -- start start 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f894a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8944104740 0x7f894419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f894a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89441070a0 0x7f894419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f894a000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944109a00 0x7f89441a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f894a000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f894410f7b0 con 0x7f8944104740 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f894a000640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f894410f630 con 0x7f8944109a00 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f894a000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f894410f930 con 0x7f89441070a0 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f8942a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89441070a0 0x7f894419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f8943400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8944104740 0x7f894419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f8942a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89441070a0 0x7f894419ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55184/0 (socket says 172.21.15.47:55184) 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.601+0000 7f8942a00640 1 -- 172.21.15.47:0/1715826773 learned_addr learned my addr 172.21.15.47:0/1715826773 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.602+0000 7f8943e00640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944109a00 0x7f89441a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.602+0000 7f8942a00640 1 -- 172.21.15.47:0/1715826773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944109a00 msgr2=0x7f89441a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.602+0000 7f8942a00640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944109a00 0x7f89441a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.602+0000 7f8942a00640 1 -- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8944104740 msgr2=0x7f894419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.602+0000 7f8942a00640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8944104740 0x7f894419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.602+0000 7f8942a00640 1 -- 172.21.15.47:0/1715826773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89441a4010 con 0x7f89441070a0 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.602+0000 7f8942a00640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89441070a0 0x7f894419ca10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8930031440 tx=0x7f8930003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.603+0000 7f893be00640 1 -- 172.21.15.47:0/1715826773 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893003f070 con 0x7f89441070a0 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.603+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89441a42a0 con 0x7f89441070a0 2024-05-14T12:29:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.603+0000 7f893be00640 1 -- 172.21.15.47:0/1715826773 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8930031c50 con 0x7f89441070a0 2024-05-14T12:29:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.603+0000 7f893be00640 1 -- 172.21.15.47:0/1715826773 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930035030 con 0x7f89441070a0 2024-05-14T12:29:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.603+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89441a4790 con 0x7f89441070a0 2024-05-14T12:29:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 Processor -- start 2024-05-14T12:29:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 -- start start 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95086100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac95086680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac9508d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ac94fea550 con 0x55ac94cbb2f0 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ac94f8fbc0 con 0x55ac94cc34d0 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f8950ff7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ac94fe6510 con 0x55ac94ce41b0 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.608+0000 7f893be00640 1 -- 172.21.15.47:0/1715826773 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8930042070 con 0x7f89441070a0 2024-05-14T12:29:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95086100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95086100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55198/0 (socket says 172.21.15.47:55198) 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 -- 172.21.15.47:0/2751043758 learned_addr learned my addr 172.21.15.47:0/2751043758 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943400640 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac95086680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8942a00640 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac9508d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 -- 172.21.15.47:0/2751043758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 msgr2=0x55ac9508d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac9508d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 -- 172.21.15.47:0/2751043758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 msgr2=0x55ac95086680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac95086680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8943e00640 1 -- 172.21.15.47:0/2751043758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac94cfc210 con 0x55ac94ce41b0 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.609+0000 7f8942a00640 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac9508d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:29:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.610+0000 7f8943e00640 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95086100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f893c009f90 tx=0x7f893c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd08d9c04bffd5f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.610+0000 7f892fe00640 1 -- 172.21.15.47:0/2751043758 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c004d20 con 0x55ac94ce41b0 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.610+0000 7f892fe00640 1 -- 172.21.15.47:0/2751043758 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f893c004050 con 0x55ac94ce41b0 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.610+0000 7f892fe00640 1 -- 172.21.15.47:0/2751043758 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c005240 con 0x55ac94ce41b0 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f893be00640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f89280b28a0 0x7f89280b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 -- 172.21.15.47:0/2751043758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 msgr2=0x55ac95086100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95086100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f893c009f90 tx=0x7f893c0118d0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 -- 172.21.15.47:0/2751043758 shutdown_connections 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac9508d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac95086680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2751043758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95086100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 -- 172.21.15.47:0/2751043758 >> 172.21.15.47:0/2751043758 conn(0x55ac94cd8300 msgr2=0x55ac95081a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f893be00640 1 -- 172.21.15.47:0/1715826773 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8930102910 con 0x7f89441070a0 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8943400640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f89280b28a0 0x7f89280b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.611+0000 7f8950ff7740 1 -- 172.21.15.47:0/2751043758 shutdown_connections 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.612+0000 7f8950ff7740 1 -- 172.21.15.47:0/2751043758 wait complete. 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.612+0000 7f8950ff7740 1 -- start start 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.612+0000 7f8943400640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f89280b28a0 0x7f89280b4db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55ac95082820 tx=0x7f8934005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.612+0000 7f8950ff7740 1 Processor -- start 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cc34d0 0x55ac950900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94ce41b0 0x55ac95097030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8950ff7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ac9508dfd0 con 0x55ac94cc34d0 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8950ff7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ac94fa3660 con 0x55ac94ce41b0 2024-05-14T12:29:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8950ff7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ac9508e150 con 0x55ac94cbb2f0 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8950ff7740 10 client.0 _ll_register_callbacks cb 0x55ac94f6d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8943400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8943400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55208/0 (socket says 172.21.15.47:55208) 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8943400640 1 -- 172.21.15.47:0/1476425745 learned_addr learned my addr 172.21.15.47:0/1476425745 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8943e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94ce41b0 0x55ac95097030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.613+0000 7f8942a00640 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cc34d0 0x55ac950900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f8943400640 1 -- 172.21.15.47:0/1476425745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94ce41b0 msgr2=0x55ac95097030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f8943400640 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94ce41b0 0x55ac95097030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f8943400640 1 -- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cc34d0 msgr2=0x55ac950900d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f8943400640 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cc34d0 0x55ac950900d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f8943400640 1 -- 172.21.15.47:0/1476425745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac94dc8620 con 0x55ac94cbb2f0 2024-05-14T12:29:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f8943400640 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fb90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8934009560 tx=0x7f8934004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f8c1daa71af86db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:50.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f892cc00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:29:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f892cc00640 1 -- 172.21.15.47:0/1476425745 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934029440 con 0x55ac94cbb2f0 2024-05-14T12:29:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f893c004050 con 0x55ac94cbb2f0 2024-05-14T12:29:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.614+0000 7f892cc00640 1 -- 172.21.15.47:0/1476425745 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f893401f430 con 0x55ac94cbb2f0 2024-05-14T12:29:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f892cc00640 1 -- 172.21.15.47:0/1476425745 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f893401f630 con 0x55ac94cbb2f0 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 10 client.25744 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ac95099fa0 con 0x55ac94cbb2f0 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f892cc00640 1 -- 172.21.15.47:0/1476425745 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f893c004050 con 0x55ac94cbb2f0 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f892cc00640 1 -- 172.21.15.47:0/1476425745 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f8934027070 con 0x55ac94cbb2f0 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 10 client.25744 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 10 client.25744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 20 client.25744 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94ca2d80 0x55ac9509d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 4 client.25744 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.615+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac94ff8160 con 0x55ac94ca2d80 2024-05-14T12:29:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.616+0000 7f8942a00640 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94ca2d80 0x55ac9509d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.617+0000 7f892cc00640 10 client.25744 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.616+0000 7f8942a00640 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94ca2d80 0x55ac9509d750 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f407d2c28b36d14 server_cookie=6660cde62159e7be in_seq=0 out_seq=0 2024-05-14T12:29:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f892cc00640 1 -- 172.21.15.47:0/1476425745 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ac94ff8160 con 0x55ac94ca2d80 2024-05-14T12:29:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f892cc00640 10 client.25744 handle_command_reply: tid=0 2024-05-14T12:29:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 client.25744 shutdown 2024-05-14T12:29:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cbb2f0 msgr2=0x55ac9508fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fb90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8934009560 tx=0x7f8934004730 comp rx=0 tx=0).stop 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 shutdown_connections 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94ca2d80 0x55ac9509d750 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94ce41b0 0x55ac95097030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cc34d0 0x55ac950900d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 --2- 172.21.15.47:0/1476425745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fb90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 >> 172.21.15.47:0/1476425745 conn(0x55ac94cd8300 msgr2=0x55ac95081a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.618+0000 7f892cc00640 0 client.25744 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.619+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 shutdown_connections 2024-05-14T12:29:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.619+0000 7f8950ff7740 1 -- 172.21.15.47:0/1476425745 wait complete. 2024-05-14T12:29:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.619+0000 7f8950ff7740 20 client.25744 trim_cache size 0 max 16384 2024-05-14T12:29:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.636+0000 7f8950ff7740 1 Processor -- start 2024-05-14T12:29:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.636+0000 7f8950ff7740 1 -- start start 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.636+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac95096fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95097500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8950ff7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89441ad5b0 con 0x55ac94cbb2f0 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8950ff7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f89441af1e0 con 0x55ac94cc34d0 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8950ff7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f89441adc80 con 0x55ac94ce41b0 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95097500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8942a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac95096fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95097500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55220/0 (socket says 172.21.15.47:55220) 2024-05-14T12:29:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 -- 172.21.15.47:0/936535711 learned_addr learned my addr 172.21.15.47:0/936535711 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 -- 172.21.15.47:0/936535711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 msgr2=0x55ac95096fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac95096fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 -- 172.21.15.47:0/936535711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 msgr2=0x55ac9508fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.637+0000 7f8943e00640 1 -- 172.21.15.47:0/936535711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac95090c10 con 0x55ac94ce41b0 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.638+0000 7f8942a00640 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac95096fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.638+0000 7f8943e00640 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95097500 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f893c014040 tx=0x7f893c003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40c3dfd2f461e30 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.638+0000 7f892f400640 1 -- 172.21.15.47:0/936535711 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c004050 con 0x55ac94ce41b0 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.638+0000 7f892f400640 1 -- 172.21.15.47:0/936535711 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f893c004820 con 0x55ac94ce41b0 2024-05-14T12:29:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.638+0000 7f892f400640 1 -- 172.21.15.47:0/936535711 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c0052a0 con 0x55ac94ce41b0 2024-05-14T12:29:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.639+0000 7f8950ff7740 1 -- 172.21.15.47:0/936535711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 msgr2=0x55ac95097500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:29:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.639+0000 7f8950ff7740 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95097500 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f893c014040 tx=0x7f893c003ce0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.639+0000 7f8950ff7740 1 -- 172.21.15.47:0/936535711 shutdown_connections 2024-05-14T12:29:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.639+0000 7f8950ff7740 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94ce41b0 0x55ac95097500 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.640+0000 7f8950ff7740 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cc34d0 0x55ac95096fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.640+0000 7f8950ff7740 1 --2- 172.21.15.47:0/936535711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94cbb2f0 0x55ac9508fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.640+0000 7f8950ff7740 1 -- 172.21.15.47:0/936535711 >> 172.21.15.47:0/936535711 conn(0x55ac94cd8300 msgr2=0x55ac9508f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:29:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.642+0000 7f8950ff7740 1 -- 172.21.15.47:0/936535711 shutdown_connections 2024-05-14T12:29:50.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.642+0000 7f8950ff7740 1 -- 172.21.15.47:0/936535711 wait complete. 2024-05-14T12:29:50.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.642+0000 7f8950ff7740 1 -- start start 2024-05-14T12:29:50.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 1 Processor -- start 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cbb2f0 0x55ac95094440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cc34d0 0x55ac95094980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94ce41b0 0x55ac95103af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89441aea50 con 0x55ac94ce41b0 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f89441ae350 con 0x55ac94cbb2f0 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f89441ab570 con 0x55ac94cc34d0 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8950ff7740 10 client.0 _ll_register_callbacks cb 0x7f8934009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8943400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cbb2f0 0x55ac95094440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8942a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cc34d0 0x55ac95094980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8942a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cc34d0 0x55ac95094980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55232/0 (socket says 172.21.15.47:55232) 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8943400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cbb2f0 0x55ac95094440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:44614/0 (socket says 172.21.15.47:44614) 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.643+0000 7f8942a00640 1 -- 172.21.15.47:0/2986062192 learned_addr learned my addr 172.21.15.47:0/2986062192 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8943e00640 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94ce41b0 0x55ac95103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8942a00640 1 -- 172.21.15.47:0/2986062192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cbb2f0 msgr2=0x55ac95094440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8942a00640 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cbb2f0 0x55ac95094440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8942a00640 1 -- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94ce41b0 msgr2=0x55ac95103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8942a00640 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94ce41b0 0x55ac95103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8942a00640 1 -- 172.21.15.47:0/2986062192 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac95104030 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8943400640 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cbb2f0 0x55ac95094440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f8942a00640 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cc34d0 0x55ac95094980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89300c6060 tx=0x7f893004b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc743371f0256e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f892cc00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f892cc00640 1 -- 172.21.15.47:0/2986062192 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8930049040 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.644+0000 7f892cc00640 1 -- 172.21.15.47:0/2986062192 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f893003b460 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f893c004820 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f892cc00640 1 -- 172.21.15.47:0/2986062192 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f89300ce2e0 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 10 client.25750 fetch_fsmap learned FSMap version 32 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ac95105240 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f892cc00640 1 -- 172.21.15.47:0/2986062192 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f893c004820 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f892cc00640 1 -- 172.21.15.47:0/2986062192 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f89300d2900 con 0x55ac94cc34d0 2024-05-14T12:29:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 10 client.25750 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 10 client.25750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 20 client.25750 populate_metadata read hostname 'smithi047' 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94c781c0 0x55ac95107d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 4 client.25750 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.645+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ac94ff1fd0 con 0x55ac94c781c0 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.646+0000 7f8943400640 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94c781c0 0x55ac95107d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.646+0000 7f8943400640 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94c781c0 0x55ac95107d20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5296b4a8fe2ea0d server_cookie=f5c32909e8a77d in_seq=0 out_seq=0 2024-05-14T12:29:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:29:50.646+0000 7f892cc00640 10 client.25750 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:29:51.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:51 smithi047 ceph-mon[31254]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 147 MiB/s wr, 4.57k op/s 2024-05-14T12:29:52.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:51 smithi073 ceph-mon[35809]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 147 MiB/s wr, 4.57k op/s 2024-05-14T12:29:52.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:51 smithi066 ceph-mon[35981]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 147 MiB/s wr, 4.57k op/s 2024-05-14T12:29:53.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:53 smithi047 ceph-mon[31254]: pgmap v591: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 97 MiB/s wr, 5.93k op/s 2024-05-14T12:29:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:53 smithi073 ceph-mon[35809]: pgmap v591: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 97 MiB/s wr, 5.93k op/s 2024-05-14T12:29:54.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:53 smithi066 ceph-mon[35981]: pgmap v591: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 97 MiB/s wr, 5.93k op/s 2024-05-14T12:29:56.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:55 smithi073 ceph-mon[35809]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 59 MiB/s wr, 6.56k op/s 2024-05-14T12:29:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:55 smithi066 ceph-mon[35981]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 59 MiB/s wr, 6.56k op/s 2024-05-14T12:29:56.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:55 smithi047 ceph-mon[31254]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 59 MiB/s wr, 6.56k op/s 2024-05-14T12:29:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:57 smithi066 ceph-mon[35981]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 45 MiB/s wr, 6.96k op/s 2024-05-14T12:29:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:57 smithi047 ceph-mon[31254]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 45 MiB/s wr, 6.96k op/s 2024-05-14T12:29:58.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:57 smithi073 ceph-mon[35809]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 45 MiB/s wr, 6.96k op/s 2024-05-14T12:30:00.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:29:59 smithi066 ceph-mon[35981]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 52 MiB/s wr, 7.48k op/s 2024-05-14T12:30:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:29:59 smithi047 ceph-mon[31254]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 52 MiB/s wr, 7.48k op/s 2024-05-14T12:30:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:29:59 smithi073 ceph-mon[35809]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 52 MiB/s wr, 7.48k op/s 2024-05-14T12:30:01.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:00 smithi066 ceph-mon[35981]: overall HEALTH_OK 2024-05-14T12:30:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:00 smithi047 ceph-mon[31254]: overall HEALTH_OK 2024-05-14T12:30:01.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:00 smithi073 ceph-mon[35809]: overall HEALTH_OK 2024-05-14T12:30:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:01 smithi066 ceph-mon[35981]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 50 MiB/s wr, 6.69k op/s 2024-05-14T12:30:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:01 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:30:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:01 smithi047 ceph-mon[31254]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 50 MiB/s wr, 6.69k op/s 2024-05-14T12:30:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:01 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:30:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:01 smithi073 ceph-mon[35809]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 50 MiB/s wr, 6.69k op/s 2024-05-14T12:30:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:01 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:30:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:03 smithi066 ceph-mon[35981]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 53 MiB/s wr, 6.86k op/s 2024-05-14T12:30:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:03 smithi047 ceph-mon[31254]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 53 MiB/s wr, 6.86k op/s 2024-05-14T12:30:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:03 smithi073 ceph-mon[35809]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 53 MiB/s wr, 6.86k op/s 2024-05-14T12:30:06.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:05 smithi066 ceph-mon[35981]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 49 MiB/s wr, 6.02k op/s 2024-05-14T12:30:06.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:05 smithi047 ceph-mon[31254]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 49 MiB/s wr, 6.02k op/s 2024-05-14T12:30:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:05 smithi073 ceph-mon[35809]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 49 MiB/s wr, 6.02k op/s 2024-05-14T12:30:08.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:07 smithi066 ceph-mon[35981]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 49 MiB/s wr, 5.91k op/s 2024-05-14T12:30:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:07 smithi047 ceph-mon[31254]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 49 MiB/s wr, 5.91k op/s 2024-05-14T12:30:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:07 smithi073 ceph-mon[35809]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 49 MiB/s wr, 5.91k op/s 2024-05-14T12:30:10.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:09 smithi066 ceph-mon[35981]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 56 MiB/s wr, 6.77k op/s 2024-05-14T12:30:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:09 smithi047 ceph-mon[31254]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 56 MiB/s wr, 6.77k op/s 2024-05-14T12:30:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:09 smithi073 ceph-mon[35809]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 56 MiB/s wr, 6.77k op/s 2024-05-14T12:30:12.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:11 smithi066 ceph-mon[35981]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 49 MiB/s wr, 6.12k op/s 2024-05-14T12:30:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:11 smithi047 ceph-mon[31254]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 49 MiB/s wr, 6.12k op/s 2024-05-14T12:30:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:11 smithi073 ceph-mon[35809]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 49 MiB/s wr, 6.12k op/s 2024-05-14T12:30:14.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:13 smithi066 ceph-mon[35981]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 51 MiB/s wr, 6.60k op/s 2024-05-14T12:30:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:13 smithi047 ceph-mon[31254]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 51 MiB/s wr, 6.60k op/s 2024-05-14T12:30:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:13 smithi073 ceph-mon[35809]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 51 MiB/s wr, 6.60k op/s 2024-05-14T12:30:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.314+0000 7f892cc00640 1 -- 172.21.15.47:0/2986062192 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ac94ff1fd0 con 0x55ac94c781c0 2024-05-14T12:30:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.314+0000 7f892cc00640 10 client.25750 handle_command_reply: tid=0 2024-05-14T12:30:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.314+0000 7f8950ff7740 1 client.25750 shutdown 2024-05-14T12:30:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cc34d0 msgr2=0x55ac95094980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cc34d0 0x55ac95094980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89300c6060 tx=0x7f893004b000 comp rx=0 tx=0).stop 2024-05-14T12:30:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 shutdown_connections 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55ac94c781c0 0x55ac95107d20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ac94ce41b0 0x55ac95103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac94cc34d0 0x55ac95094980 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 --2- 172.21.15.47:0/2986062192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac94cbb2f0 0x55ac95094440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f892cc00640 0 client.25750 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 >> 172.21.15.47:0/2986062192 conn(0x55ac94cd8300 msgr2=0x55ac95080000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 shutdown_connections 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.315+0000 7f8950ff7740 1 -- 172.21.15.47:0/2986062192 wait complete. 2024-05-14T12:30:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.316+0000 7f8950ff7740 20 client.25750 trim_cache size 0 max 16384 2024-05-14T12:30:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:30:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:30:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:30:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:30:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f89280b28a0 msgr2=0x7f89280b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f89280b28a0 0x7f89280b4db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55ac95082820 tx=0x7f8934005f90 comp rx=0 tx=0).stop 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89441070a0 msgr2=0x7f894419ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89441070a0 0x7f894419ca10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8930031440 tx=0x7f8930003c10 comp rx=0 tx=0).stop 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 shutdown_connections 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f89280b28a0 0x7f89280b4db0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8944109a00 0x7f89441a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89441070a0 0x7f894419ca10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 --2- 172.21.15.47:0/1715826773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8944104740 0x7f894419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.317+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 >> 172.21.15.47:0/1715826773 conn(0x7f89440fdd40 msgr2=0x7f89441087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.318+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 shutdown_connections 2024-05-14T12:30:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:15.318+0000 7f894a000640 1 -- 172.21.15.47:0/1715826773 wait complete. 2024-05-14T12:30:16.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:15 smithi047 ceph-mon[31254]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 45 MiB/s wr, 5.96k op/s 2024-05-14T12:30:16.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:15 smithi073 ceph-mon[35809]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 45 MiB/s wr, 5.96k op/s 2024-05-14T12:30:16.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:15 smithi066 ceph-mon[35981]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 45 MiB/s wr, 5.96k op/s 2024-05-14T12:30:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:17 smithi047 ceph-mon[31254]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 47 MiB/s wr, 6.28k op/s 2024-05-14T12:30:18.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:17 smithi073 ceph-mon[35809]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 47 MiB/s wr, 6.28k op/s 2024-05-14T12:30:18.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:17 smithi066 ceph-mon[35981]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 47 MiB/s wr, 6.28k op/s 2024-05-14T12:30:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:19 smithi047 ceph-mon[31254]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 50 MiB/s wr, 6.77k op/s 2024-05-14T12:30:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:19 smithi073 ceph-mon[35809]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 50 MiB/s wr, 6.77k op/s 2024-05-14T12:30:20.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:19 smithi066 ceph-mon[35981]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 50 MiB/s wr, 6.77k op/s 2024-05-14T12:30:22.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:21 smithi047 ceph-mon[31254]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 49 MiB/s wr, 6.54k op/s 2024-05-14T12:30:22.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:21 smithi073 ceph-mon[35809]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 49 MiB/s wr, 6.54k op/s 2024-05-14T12:30:22.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:21 smithi066 ceph-mon[35981]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 49 MiB/s wr, 6.54k op/s 2024-05-14T12:30:23.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:22 smithi047 ceph-mon[31254]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 53 MiB/s wr, 6.88k op/s 2024-05-14T12:30:23.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:22 smithi073 ceph-mon[35809]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 53 MiB/s wr, 6.88k op/s 2024-05-14T12:30:23.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:22 smithi066 ceph-mon[35981]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 53 MiB/s wr, 6.88k op/s 2024-05-14T12:30:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:25 smithi047 ceph-mon[31254]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 49 MiB/s wr, 6.13k op/s 2024-05-14T12:30:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:25 smithi073 ceph-mon[35809]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 49 MiB/s wr, 6.13k op/s 2024-05-14T12:30:26.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:25 smithi066 ceph-mon[35981]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 49 MiB/s wr, 6.13k op/s 2024-05-14T12:30:27.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:27 smithi047 ceph-mon[31254]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 50 MiB/s wr, 6.14k op/s 2024-05-14T12:30:28.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:27 smithi073 ceph-mon[35809]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 50 MiB/s wr, 6.14k op/s 2024-05-14T12:30:28.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:27 smithi066 ceph-mon[35981]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 50 MiB/s wr, 6.14k op/s 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.532+0000 7f64d3c00640 1 -- 172.21.15.47:0/2584232344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc112360 msgr2=0x7f64cc114780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.532+0000 7f64d3c00640 1 --2- 172.21.15.47:0/2584232344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc112360 0x7f64cc114780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009be0 tx=0x7f64c402a6c0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.532+0000 7f64d3c00640 1 -- 172.21.15.47:0/2584232344 shutdown_connections 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.532+0000 7f64d3c00640 1 --2- 172.21.15.47:0/2584232344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc112360 0x7f64cc114780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.532+0000 7f64d3c00640 1 --2- 172.21.15.47:0/2584232344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64cc10d660 0x7f64cc10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.532+0000 7f64d3c00640 1 --2- 172.21.15.47:0/2584232344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 0x7f64cc10d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.532+0000 7f64d3c00640 1 -- 172.21.15.47:0/2584232344 >> 172.21.15.47:0/2584232344 conn(0x7f64cc072840 msgr2=0x7f64cc109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.533+0000 7f64d3c00640 1 -- 172.21.15.47:0/2584232344 shutdown_connections 2024-05-14T12:30:28.534 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.533+0000 7f64d3c00640 1 -- 172.21.15.47:0/2584232344 wait complete. 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 Processor -- start 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 -- start start 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 0x7f64cc1a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc10d660 0x7f64cc1a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64cc112360 0x7f64cc1ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc117f40 con 0x7f64cc112360 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc117dc0 con 0x7f64cc10c420 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d3c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1180c0 con 0x7f64cc10d660 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d1200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 0x7f64cc1a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.534+0000 7f64d1200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 0x7f64cc1a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56902/0 (socket says 172.21.15.47:56902) 2024-05-14T12:30:28.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1200640 1 -- 172.21.15.47:0/3491182823 learned_addr learned my addr 172.21.15.47:0/3491182823 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64cc112360 0x7f64cc1ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64cbe00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc10d660 0x7f64cc1a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1200640 1 -- 172.21.15.47:0/3491182823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc10d660 msgr2=0x7f64cc1a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1200640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc10d660 0x7f64cc1a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1200640 1 -- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64cc112360 msgr2=0x7f64cc1ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1200640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64cc112360 0x7f64cc1ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1200640 1 -- 172.21.15.47:0/3491182823 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64cc1ac7b0 con 0x7f64cc10c420 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64cc112360 0x7f64cc1ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.535+0000 7f64d1200640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 0x7f64cc1a4c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64c000e9c0 tx=0x7f64c000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.536+0000 7f64c9600640 1 -- 172.21.15.47:0/3491182823 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c000ccc0 con 0x7f64cc10c420 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.536+0000 7f64c9600640 1 -- 172.21.15.47:0/3491182823 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64c00035f0 con 0x7f64cc10c420 2024-05-14T12:30:28.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.536+0000 7f64c9600640 1 -- 172.21.15.47:0/3491182823 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c000ce60 con 0x7f64cc10c420 2024-05-14T12:30:28.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.536+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64cc1acaa0 con 0x7f64cc10c420 2024-05-14T12:30:28.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.536+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64cc1acfa0 con 0x7f64cc10c420 2024-05-14T12:30:28.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 Processor -- start 2024-05-14T12:30:28.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 -- start start 2024-05-14T12:30:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c97101b0 0x55d9c9ab2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96e72f0 0x55d9c9ab2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ab9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d9c9a16550 con 0x55d9c96ef4d0 2024-05-14T12:30:28.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d9c99bbbc0 con 0x55d9c97101b0 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.539+0000 7f64dabdf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d9c9a12510 con 0x55d9c96e72f0 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c97101b0 0x55d9c9ab2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c97101b0 0x55d9c9ab2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56908/0 (socket says 172.21.15.47:56908) 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 -- 172.21.15.47:0/2804733496 learned_addr learned my addr 172.21.15.47:0/2804733496 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64cbe00640 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ab9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 -- 172.21.15.47:0/2804733496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96e72f0 msgr2=0x55d9c9ab2680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96e72f0 0x55d9c9ab2680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 -- 172.21.15.47:0/2804733496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 msgr2=0x55d9c9ab9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ab9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 -- 172.21.15.47:0/2804733496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c9728210 con 0x55d9c97101b0 2024-05-14T12:30:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64cbe00640 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ab9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:30:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64c9600640 1 -- 172.21.15.47:0/3491182823 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f64c0004000 con 0x7f64cc10c420 2024-05-14T12:30:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.540+0000 7f64d1c00640 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c97101b0 0x55d9c9ab2100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009be0 tx=0x7f64c4005c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aaf228f5550cf99 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:30:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.541+0000 7f64be000640 1 -- 172.21.15.47:0/2804733496 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c4041030 con 0x55d9c97101b0 2024-05-14T12:30:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.541+0000 7f64be000640 1 -- 172.21.15.47:0/2804733496 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64c4003970 con 0x55d9c97101b0 2024-05-14T12:30:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.541+0000 7f64be000640 1 -- 172.21.15.47:0/2804733496 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c4036040 con 0x55d9c97101b0 2024-05-14T12:30:28.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.541+0000 7f64dabdf740 1 -- 172.21.15.47:0/2804733496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c97101b0 msgr2=0x55d9c9ab2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:28.546 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.541+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c97101b0 0x55d9c9ab2100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009be0 tx=0x7f64c4005c80 comp rx=0 tx=0).stop 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64dabdf740 1 -- 172.21.15.47:0/2804733496 shutdown_connections 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ab9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96e72f0 0x55d9c9ab2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2804733496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c97101b0 0x55d9c9ab2100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64dabdf740 1 -- 172.21.15.47:0/2804733496 >> 172.21.15.47:0/2804733496 conn(0x55d9c9704300 msgr2=0x55d9c9aada90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64c9600640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64b40b2920 0x7f64b40b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64c9600640 1 -- 172.21.15.47:0/3491182823 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f64c00e2470 con 0x7f64cc10c420 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64dabdf740 1 -- 172.21.15.47:0/2804733496 shutdown_connections 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64dabdf740 1 -- 172.21.15.47:0/2804733496 wait complete. 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.542+0000 7f64d1c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64b40b2920 0x7f64b40b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.543+0000 7f64dabdf740 1 -- start start 2024-05-14T12:30:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.543+0000 7f64dabdf740 1 Processor -- start 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.543+0000 7f64d1c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64b40b2920 0x7f64b40b4e30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f64c402acb0 tx=0x7f64c402a6c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9abbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9abc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9ac3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64dabdf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d9c9ab9f70 con 0x55d9c96ef4d0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64dabdf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d9c99cf660 con 0x55d9c96e72f0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64dabdf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d9c9aba0f0 con 0x55d9c97101b0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64dabdf740 10 client.0 _ll_register_callbacks cb 0x55d9c9999400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9abbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9ac3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64cbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9abc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9abbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56910/0 (socket says 172.21.15.47:56910) 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 -- 172.21.15.47:0/3379971007 learned_addr learned my addr 172.21.15.47:0/3379971007 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:30:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 -- 172.21.15.47:0/3379971007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 msgr2=0x55d9c9ac3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9ac3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 -- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 msgr2=0x55d9c9abc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9abc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64d1200640 1 -- 172.21.15.47:0/3379971007 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c97f4620 con 0x55d9c96e72f0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.544+0000 7f64cbe00640 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9abc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64d1200640 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9abbbf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64c00a9750 tx=0x7f64c00a96c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327c33f9a68069b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64b2a00640 1 -- 172.21.15.47:0/3379971007 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c00a5050 con 0x55d9c96e72f0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64b2a00640 1 -- 172.21.15.47:0/3379971007 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f64c00037a0 con 0x55d9c96e72f0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64c4003970 con 0x55d9c96e72f0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64b2a00640 1 -- 172.21.15.47:0/3379971007 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f64c00b28b0 con 0x55d9c96e72f0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64dabdf740 10 client.25739 fetch_fsmap learned FSMap version 33 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.545+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d9c9ac6090 con 0x55d9c96e72f0 2024-05-14T12:30:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64b2a00640 1 -- 172.21.15.47:0/3379971007 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64c4003970 con 0x55d9c96e72f0 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64b2a00640 1 -- 172.21.15.47:0/3379971007 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f64c00b2420 con 0x55d9c96e72f0 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64dabdf740 10 client.25739 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64dabdf740 10 client.25739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64dabdf740 20 client.25739 populate_metadata read hostname 'smithi047' 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96ced80 0x55d9c9ac9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64dabdf740 4 client.25739 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9c9a24160 con 0x55d9c96ced80 2024-05-14T12:30:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.546+0000 7f64cbe00640 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96ced80 0x55d9c9ac9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.547+0000 7f64cbe00640 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96ced80 0x55d9c9ac9810 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c050b4ef63edefd7 server_cookie=42d68333172650e6 in_seq=0 out_seq=0 2024-05-14T12:30:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.547+0000 7f64b2a00640 10 client.25739 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:30:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.547+0000 7f64b2a00640 1 -- 172.21.15.47:0/3379971007 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d9c9a24160 con 0x55d9c96ced80 2024-05-14T12:30:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.547+0000 7f64b2a00640 10 client.25739 handle_command_reply: tid=0 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 client.25739 shutdown 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 msgr2=0x55d9c9abbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9abbbf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64c00a9750 tx=0x7f64c00a96c0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 shutdown_connections 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96ced80 0x55d9c9ac9810 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9ac3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96ef4d0 0x55d9c9abc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3379971007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9abbbf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64b2a00640 0 client.25739 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 >> 172.21.15.47:0/3379971007 conn(0x55d9c9704300 msgr2=0x55d9c9aaca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 shutdown_connections 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 1 -- 172.21.15.47:0/3379971007 wait complete. 2024-05-14T12:30:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.548+0000 7f64dabdf740 20 client.25739 trim_cache size 0 max 16384 2024-05-14T12:30:28.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 Processor -- start 2024-05-14T12:30:28.565 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 -- start start 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96e72f0 0x55d9c9aadb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96ef4d0 0x55d9c9aac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9aac540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1b5cc0 con 0x55d9c96e72f0 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1b7980 con 0x55d9c96ef4d0 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.565+0000 7f64dabdf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1b6390 con 0x55d9c97101b0 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64d1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96e72f0 0x55d9c9aadb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96ef4d0 0x55d9c9aac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96ef4d0 0x55d9c9aac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56916/0 (socket says 172.21.15.47:56916) 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64d1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96e72f0 0x55d9c9aadb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45684/0 (socket says 172.21.15.47:45684) 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 -- 172.21.15.47:0/2524649209 learned_addr learned my addr 172.21.15.47:0/2524649209 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64d1c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9aac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 -- 172.21.15.47:0/2524649209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 msgr2=0x55d9c9aac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 --2- 172.21.15.47:0/2524649209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9aac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 -- 172.21.15.47:0/2524649209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96e72f0 msgr2=0x55d9c9aadb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 --2- 172.21.15.47:0/2524649209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96e72f0 0x55d9c9aadb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 -- 172.21.15.47:0/2524649209 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c9aa9280 con 0x55d9c96ef4d0 2024-05-14T12:30:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.566+0000 7f64cbe00640 1 --2- 172.21.15.47:0/2524649209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96ef4d0 0x55d9c9aac000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009fd0 tx=0x7f64b8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f4277104c25a70d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.567+0000 7f64bd600640 1 -- 172.21.15.47:0/2524649209 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8004310 con 0x55d9c96ef4d0 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.567+0000 7f64bd600640 1 -- 172.21.15.47:0/2524649209 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b80044b0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.567+0000 7f64bd600640 1 -- 172.21.15.47:0/2524649209 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b80206a0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 -- 172.21.15.47:0/2524649209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96ef4d0 msgr2=0x55d9c9aac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2524649209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96ef4d0 0x55d9c9aac000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009fd0 tx=0x7f64b8005f90 comp rx=0 tx=0).stop 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 -- 172.21.15.47:0/2524649209 shutdown_connections 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2524649209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c97101b0 0x55d9c9aac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2524649209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96ef4d0 0x55d9c9aac000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 --2- 172.21.15.47:0/2524649209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c96e72f0 0x55d9c9aadb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 -- 172.21.15.47:0/2524649209 >> 172.21.15.47:0/2524649209 conn(0x55d9c9704300 msgr2=0x55d9c9aad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 -- 172.21.15.47:0/2524649209 shutdown_connections 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 -- 172.21.15.47:0/2524649209 wait complete. 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 -- start start 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.568+0000 7f64dabdf740 1 Processor -- start 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9ac11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ac1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64dabdf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c97101b0 0x55d9c9b2fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64dabdf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1b71f0 con 0x55d9c97101b0 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64dabdf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1b6a60 con 0x55d9c96e72f0 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64dabdf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1b3c80 con 0x55d9c96ef4d0 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64dabdf740 10 client.0 _ll_register_callbacks cb 0x7f64c0003d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:30:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ac1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64d1200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9ac11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ac1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49222/0 (socket says 172.21.15.47:49222) 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 -- 172.21.15.47:0/3092006145 learned_addr learned my addr 172.21.15.47:0/3092006145 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64d1c00640 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c97101b0 0x55d9c9b2fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 -- 172.21.15.47:0/3092006145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 msgr2=0x55d9c9ac11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9ac11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 -- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c97101b0 msgr2=0x55d9c9b2fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c97101b0 0x55d9c9b2fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64cbe00640 1 -- 172.21.15.47:0/3092006145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c9ac1ef0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.569+0000 7f64d1c00640 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c97101b0 0x55d9c9b2fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64cbe00640 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ac1730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64b8014010 tx=0x7f64b8004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16852eb2a965717f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:30:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64b2a00640 1 -- 172.21.15.47:0/3092006145 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8005450 con 0x55d9c96ef4d0 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64b2a00640 1 -- 172.21.15.47:0/3092006145 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f64b80055f0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64b80044b0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64b2a00640 1 -- 172.21.15.47:0/3092006145 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f64b80203e0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64dabdf740 10 client.25765 fetch_fsmap learned FSMap version 33 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d9c9b310e0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.570+0000 7f64b2a00640 1 -- 172.21.15.47:0/3092006145 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b80044b0 con 0x55d9c96ef4d0 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64b2a00640 1 -- 172.21.15.47:0/3092006145 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f64b8004b80 con 0x55d9c96ef4d0 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64dabdf740 10 client.25765 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64dabdf740 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64dabdf740 20 client.25765 populate_metadata read hostname 'smithi047' 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96a41c0 0x55d9c9b33b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64dabdf740 4 client.25765 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:30:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d9c9a1dfd0 con 0x55d9c96a41c0 2024-05-14T12:30:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64d1200640 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96a41c0 0x55d9c9b33b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:30:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64d1200640 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96a41c0 0x55d9c9b33b90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ff0e271ff9cd8d server_cookie=25609f453f6f0295 in_seq=0 out_seq=0 2024-05-14T12:30:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:28.571+0000 7f64b2a00640 10 client.25765 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:30:29.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:29 smithi047 ceph-mon[31254]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 55 MiB/s wr, 6.45k op/s 2024-05-14T12:30:30.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:29 smithi073 ceph-mon[35809]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 55 MiB/s wr, 6.45k op/s 2024-05-14T12:30:30.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:29 smithi066 ceph-mon[35981]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 55 MiB/s wr, 6.45k op/s 2024-05-14T12:30:30.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:30 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:30:31.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:30 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:30:31.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:30 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:30:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:31 smithi047 ceph-mon[31254]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 59 MiB/s wr, 6.66k op/s 2024-05-14T12:30:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:31 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:31 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:31 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:31.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:31 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:31 smithi073 ceph-mon[35809]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 59 MiB/s wr, 6.66k op/s 2024-05-14T12:30:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:31 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:31 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:31 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:31 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:31 smithi066 ceph-mon[35981]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 59 MiB/s wr, 6.66k op/s 2024-05-14T12:30:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:31 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:31 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:31 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:31 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:30:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:32 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi073 to 176.2M 2024-05-14T12:30:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:32 smithi047 ceph-mon[31254]: Unable to set osd_memory_target on smithi073 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-05-14T12:30:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:30:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:30:32.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:30:33.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:32 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi073 to 176.2M 2024-05-14T12:30:33.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:32 smithi073 ceph-mon[35809]: Unable to set osd_memory_target on smithi073 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-05-14T12:30:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:30:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:30:33.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:30:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:32 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi073 to 176.2M 2024-05-14T12:30:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:32 smithi066 ceph-mon[35981]: Unable to set osd_memory_target on smithi073 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-05-14T12:30:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:30:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:30:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:30:33.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:33 smithi047 ceph-mon[31254]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 55 MiB/s wr, 6.12k op/s 2024-05-14T12:30:34.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:33 smithi073 ceph-mon[35809]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 55 MiB/s wr, 6.12k op/s 2024-05-14T12:30:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:33 smithi066 ceph-mon[35981]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 55 MiB/s wr, 6.12k op/s 2024-05-14T12:30:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:35 smithi047 ceph-mon[31254]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 55 MiB/s wr, 6.31k op/s 2024-05-14T12:30:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:35 smithi073 ceph-mon[35809]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 55 MiB/s wr, 6.31k op/s 2024-05-14T12:30:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:35 smithi066 ceph-mon[35981]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 55 MiB/s wr, 6.31k op/s 2024-05-14T12:30:37.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:37 smithi047 ceph-mon[31254]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 55 MiB/s wr, 6.29k op/s 2024-05-14T12:30:38.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:37 smithi073 ceph-mon[35809]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 55 MiB/s wr, 6.29k op/s 2024-05-14T12:30:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:37 smithi066 ceph-mon[35981]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 55 MiB/s wr, 6.29k op/s 2024-05-14T12:30:39.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:39 smithi047 ceph-mon[31254]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 58 MiB/s wr, 6.86k op/s 2024-05-14T12:30:40.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:39 smithi073 ceph-mon[35809]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 58 MiB/s wr, 6.86k op/s 2024-05-14T12:30:40.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:39 smithi066 ceph-mon[35981]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 58 MiB/s wr, 6.86k op/s 2024-05-14T12:30:41.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:41 smithi047 ceph-mon[31254]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 58 MiB/s wr, 7.04k op/s 2024-05-14T12:30:42.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:41 smithi073 ceph-mon[35809]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 58 MiB/s wr, 7.04k op/s 2024-05-14T12:30:42.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:41 smithi066 ceph-mon[35981]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 58 MiB/s wr, 7.04k op/s 2024-05-14T12:30:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:43 smithi047 ceph-mon[31254]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 55 MiB/s wr, 6.67k op/s 2024-05-14T12:30:44.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:43 smithi073 ceph-mon[35809]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 55 MiB/s wr, 6.67k op/s 2024-05-14T12:30:44.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:43 smithi066 ceph-mon[35981]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 55 MiB/s wr, 6.67k op/s 2024-05-14T12:30:45.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:45 smithi047 ceph-mon[31254]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 55 MiB/s wr, 6.51k op/s 2024-05-14T12:30:46.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:45 smithi073 ceph-mon[35809]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 55 MiB/s wr, 6.51k op/s 2024-05-14T12:30:46.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:45 smithi066 ceph-mon[35981]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 55 MiB/s wr, 6.51k op/s 2024-05-14T12:30:47.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:47 smithi047 ceph-mon[31254]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 53 MiB/s wr, 6.05k op/s 2024-05-14T12:30:48.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:47 smithi073 ceph-mon[35809]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 53 MiB/s wr, 6.05k op/s 2024-05-14T12:30:48.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:47 smithi066 ceph-mon[35981]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 53 MiB/s wr, 6.05k op/s 2024-05-14T12:30:49.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:49 smithi047 ceph-mon[31254]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 56 MiB/s wr, 6.25k op/s 2024-05-14T12:30:50.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:49 smithi073 ceph-mon[35809]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 56 MiB/s wr, 6.25k op/s 2024-05-14T12:30:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:49 smithi066 ceph-mon[35981]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 56 MiB/s wr, 6.25k op/s 2024-05-14T12:30:51.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:51 smithi047 ceph-mon[31254]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 62 MiB/s wr, 6.66k op/s 2024-05-14T12:30:52.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:51 smithi073 ceph-mon[35809]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 62 MiB/s wr, 6.66k op/s 2024-05-14T12:30:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:51 smithi066 ceph-mon[35981]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 62 MiB/s wr, 6.66k op/s 2024-05-14T12:30:53.989 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:53 smithi047 ceph-mon[31254]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 60 MiB/s wr, 6.39k op/s 2024-05-14T12:30:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:53 smithi073 ceph-mon[35809]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 60 MiB/s wr, 6.39k op/s 2024-05-14T12:30:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:53 smithi066 ceph-mon[35981]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 60 MiB/s wr, 6.39k op/s 2024-05-14T12:30:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:55 smithi047 ceph-mon[31254]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 59 MiB/s wr, 6.51k op/s 2024-05-14T12:30:56.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:55 smithi073 ceph-mon[35809]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 59 MiB/s wr, 6.51k op/s 2024-05-14T12:30:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:55 smithi066 ceph-mon[35981]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 59 MiB/s wr, 6.51k op/s 2024-05-14T12:30:57.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.107+0000 7f64b2a00640 1 -- 172.21.15.47:0/3092006145 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d9c9a1dfd0 con 0x55d9c96a41c0 2024-05-14T12:30:57.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.107+0000 7f64b2a00640 10 client.25765 handle_command_reply: tid=0 2024-05-14T12:30:57.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.107+0000 7f64dabdf740 1 client.25765 shutdown 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96ef4d0 msgr2=0x55d9c9ac1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ac1730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64b8014010 tx=0x7f64b8004250 comp rx=0 tx=0).stop 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 shutdown_connections 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d9c96a41c0 0x55d9c9b33b90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9c97101b0 0x55d9c9b2fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c96ef4d0 0x55d9c9ac1730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 --2- 172.21.15.47:0/3092006145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9c96e72f0 0x55d9c9ac11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64b2a00640 0 client.25765 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 >> 172.21.15.47:0/3092006145 conn(0x55d9c9704300 msgr2=0x55d9c9ace000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 shutdown_connections 2024-05-14T12:30:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 1 -- 172.21.15.47:0/3092006145 wait complete. 2024-05-14T12:30:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.108+0000 7f64dabdf740 20 client.25765 trim_cache size 0 max 16384 2024-05-14T12:30:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:30:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:30:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:30:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:30:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64b40b2920 msgr2=0x7f64b40b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64b40b2920 0x7f64b40b4e30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f64c402acb0 tx=0x7f64c402a6c0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 msgr2=0x7f64cc1a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:30:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 0x7f64cc1a4c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64c000e9c0 tx=0x7f64c000ee80 comp rx=0 tx=0).stop 2024-05-14T12:30:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 shutdown_connections 2024-05-14T12:30:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64b40b2920 0x7f64b40b4e30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64cc112360 0x7f64cc1ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64cc10d660 0x7f64cc1a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 --2- 172.21.15.47:0/3491182823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc10c420 0x7f64cc1a4c80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:30:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.110+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 >> 172.21.15.47:0/3491182823 conn(0x7f64cc072840 msgr2=0x7f64cc112770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:30:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.111+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 shutdown_connections 2024-05-14T12:30:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:30:57.111+0000 7f64d3c00640 1 -- 172.21.15.47:0/3491182823 wait complete. 2024-05-14T12:30:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:57 smithi066 ceph-mon[35981]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 57 MiB/s wr, 6.49k op/s 2024-05-14T12:30:58.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:57 smithi047 ceph-mon[31254]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 57 MiB/s wr, 6.49k op/s 2024-05-14T12:30:58.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:57 smithi073 ceph-mon[35809]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 57 MiB/s wr, 6.49k op/s 2024-05-14T12:31:00.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:30:59 smithi066 ceph-mon[35981]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 58 MiB/s wr, 6.75k op/s 2024-05-14T12:31:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:30:59 smithi047 ceph-mon[31254]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 58 MiB/s wr, 6.75k op/s 2024-05-14T12:31:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:30:59 smithi073 ceph-mon[35809]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 58 MiB/s wr, 6.75k op/s 2024-05-14T12:31:02.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:01 smithi066 ceph-mon[35981]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 61 MiB/s wr, 7.02k op/s 2024-05-14T12:31:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:01 smithi047 ceph-mon[31254]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 61 MiB/s wr, 7.02k op/s 2024-05-14T12:31:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:01 smithi073 ceph-mon[35809]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 61 MiB/s wr, 7.02k op/s 2024-05-14T12:31:03.790 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-14T12:31:03.790 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-14T12:31:03.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:31:04.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:03 smithi066 ceph-mon[35981]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 55 MiB/s wr, 6.26k op/s 2024-05-14T12:31:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:03 smithi047 ceph-mon[31254]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 55 MiB/s wr, 6.26k op/s 2024-05-14T12:31:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:03 smithi073 ceph-mon[35809]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 55 MiB/s wr, 6.26k op/s 2024-05-14T12:31:04.506 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:31:06.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:05 smithi066 ceph-mon[35981]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 55 MiB/s wr, 6.01k op/s 2024-05-14T12:31:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:05 smithi047 ceph-mon[31254]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 55 MiB/s wr, 6.01k op/s 2024-05-14T12:31:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:05 smithi073 ceph-mon[35809]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 55 MiB/s wr, 6.01k op/s 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.470+0000 7f2b0ec00700 1 -- 172.21.15.47:0/516018854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 msgr2=0x7f2b08110da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.470+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/516018854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 0x7f2b08110da0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2af80098f0 tx=0x7f2af8009c00 comp rx=0 tx=0).stop 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.471+0000 7f2b0ec00700 1 -- 172.21.15.47:0/516018854 shutdown_connections 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.471+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/516018854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0810b2b0 0x7f2b08117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.471+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/516018854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 0x7f2b08110da0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.471+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/516018854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0810a960 0x7f2b0810ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.471+0000 7f2b0ec00700 1 -- 172.21.15.47:0/516018854 >> 172.21.15.47:0/516018854 conn(0x7f2b08076d30 msgr2=0x7f2b08077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.471+0000 7f2b0ec00700 1 -- 172.21.15.47:0/516018854 shutdown_connections 2024-05-14T12:31:07.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.471+0000 7f2b0ec00700 1 -- 172.21.15.47:0/516018854 wait complete. 2024-05-14T12:31:07.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.472+0000 7f2b0ec00700 1 Processor -- start 2024-05-14T12:31:07.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0ec00700 1 -- start start 2024-05-14T12:31:07.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0ec00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0810a960 0x7f2b081a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:07.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0ec00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0810b2b0 0x7f2b081a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:07.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0ec00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 0x7f2b081a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:07.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0ec00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0811aa90 con 0x7f2b0810b2b0 2024-05-14T12:31:07.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0ec00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0811a910 con 0x7f2b08110990 2024-05-14T12:31:07.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0ec00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0811ac10 con 0x7f2b0810a960 2024-05-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0cc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 0x7f2b081a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b07e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0810a960 0x7f2b081a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0cc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 0x7f2b081a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35948/0 (socket says 172.21.15.47:35948) 2024-05-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b0cc00700 1 -- 172.21.15.47:0/4083976777 learned_addr learned my addr 172.21.15.47:0/4083976777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.473+0000 7f2b07400700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0810b2b0 0x7f2b081a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.474+0000 7f2b07e00700 1 -- 172.21.15.47:0/4083976777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 msgr2=0x7f2b081a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.474+0000 7f2b07e00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 0x7f2b081a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.474+0000 7f2b07e00700 1 -- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0810b2b0 msgr2=0x7f2b081a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.474+0000 7f2b07e00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0810b2b0 0x7f2b081a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.474+0000 7f2b07e00700 1 -- 172.21.15.47:0/4083976777 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b081a6370 con 0x7f2b0810a960 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.474+0000 7f2b07e00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0810a960 0x7f2b081a14a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009230 tx=0x7f2af800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.475+0000 7f2b04c00700 1 -- 172.21.15.47:0/4083976777 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8005140 con 0x7f2b0810a960 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.475+0000 7f2b04c00700 1 -- 172.21.15.47:0/4083976777 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2af800b560 con 0x7f2b0810a960 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.475+0000 7f2b04c00700 1 -- 172.21.15.47:0/4083976777 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80039b0 con 0x7f2b0810a960 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.475+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b081a6600 con 0x7f2b0810a960 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.475+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b081adf80 con 0x7f2b0810a960 2024-05-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.476+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0810c0a0 con 0x7f2b0810a960 2024-05-14T12:31:07.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.479+0000 7f2b04c00700 1 -- 172.21.15.47:0/4083976777 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2af800b9a0 con 0x7f2b0810a960 2024-05-14T12:31:07.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.480+0000 7f2b04c00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2aec0b2900 0x7f2aec0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:07.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.481+0000 7f2b04c00700 1 -- 172.21.15.47:0/4083976777 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2af80e2b60 con 0x7f2b0810a960 2024-05-14T12:31:07.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.481+0000 7f2b07400700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2aec0b2900 0x7f2aec0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:07.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.481+0000 7f2b07400700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2aec0b2900 0x7f2aec0b4e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2b08108690 tx=0x7f2af4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:07.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.485+0000 7f2b04c00700 1 -- 172.21.15.47:0/4083976777 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2af8013030 con 0x7f2b0810a960 2024-05-14T12:31:07.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.803+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b080512f0 con 0x7f2b0810a960 2024-05-14T12:31:07.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.804+0000 7f2b04c00700 1 -- 172.21.15.47:0/4083976777 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11933 (secure 0 0 0) 0x7f2b080512f0 con 0x7f2b0810a960 2024-05-14T12:31:07.804 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:31:07.804 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:29:59.838930+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24535,24521,24517,24490,24502]},"id":1}]} 2024-05-14T12:31:07.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2aec0b2900 msgr2=0x7f2aec0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:07.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2aec0b2900 0x7f2aec0b4e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2b08108690 tx=0x7f2af4009310 comp rx=0 tx=0).stop 2024-05-14T12:31:07.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0810a960 msgr2=0x7f2b081a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0810a960 0x7f2b081a14a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009230 tx=0x7f2af800fa00 comp rx=0 tx=0).stop 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 shutdown_connections 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2aec0b2900 0x7f2aec0b4e10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b08110990 0x7f2b081a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b0810a960 0x7f2b081a14a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 --2- 172.21.15.47:0/4083976777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b0810b2b0 0x7f2b081a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 >> 172.21.15.47:0/4083976777 conn(0x7f2b08076d30 msgr2=0x7f2b08109280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.807+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 shutdown_connections 2024-05-14T12:31:07.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:07.808+0000 7f2b0ec00700 1 -- 172.21.15.47:0/4083976777 wait complete. 2024-05-14T12:31:07.809 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 33 2024-05-14T12:31:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:07 smithi047 ceph-mon[31254]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 57 MiB/s wr, 5.91k op/s 2024-05-14T12:31:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:07 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/4083976777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:31:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:07 smithi073 ceph-mon[35809]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 57 MiB/s wr, 5.91k op/s 2024-05-14T12:31:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:07 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/4083976777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:31:08.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:07 smithi066 ceph-mon[35981]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 57 MiB/s wr, 5.91k op/s 2024-05-14T12:31:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:07 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/4083976777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:31:08.763 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-14T12:31:08.763 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-14T12:31:09.397 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:31:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:09 smithi047 ceph-mon[31254]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 61 MiB/s wr, 6.24k op/s 2024-05-14T12:31:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:09 smithi073 ceph-mon[35809]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 61 MiB/s wr, 6.24k op/s 2024-05-14T12:31:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:09 smithi066 ceph-mon[35981]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 61 MiB/s wr, 6.24k op/s 2024-05-14T12:31:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 -- 172.21.15.47:0/1153665408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc104cc0 msgr2=0x7f68fc1050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 --2- 172.21.15.47:0/1153665408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc104cc0 0x7f68fc1050d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009900 tx=0x7f68e402a410 comp rx=0 tx=0).stop 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 -- 172.21.15.47:0/1153665408 shutdown_connections 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 --2- 172.21.15.47:0/1153665408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68fc1099c0 0x7f68fc10bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 --2- 172.21.15.47:0/1153665408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc104cc0 0x7f68fc1050d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 --2- 172.21.15.47:0/1153665408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68fc103a80 0x7f68fc104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 -- 172.21.15.47:0/1153665408 >> 172.21.15.47:0/1153665408 conn(0x7f68fc0fec70 msgr2=0x7f68fc101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 -- 172.21.15.47:0/1153665408 shutdown_connections 2024-05-14T12:31:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.428+0000 7f68fb200640 1 -- 172.21.15.47:0/1153665408 wait complete. 2024-05-14T12:31:10.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.429+0000 7f68fb200640 1 Processor -- start 2024-05-14T12:31:10.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.429+0000 7f68fb200640 1 -- start start 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68fb200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc103a80 0x7f68fc076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68fb200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68fc104cc0 0x7f68fc075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68fb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68fc1099c0 0x7f68fc075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68fb200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc10f670 con 0x7f68fc104cc0 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68fb200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc10f4f0 con 0x7f68fc103a80 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68fb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc10f7f0 con 0x7f68fc1099c0 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc103a80 0x7f68fc076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc103a80 0x7f68fc076980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43198/0 (socket says 172.21.15.47:43198) 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 -- 172.21.15.47:0/3993034855 learned_addr learned my addr 172.21.15.47:0/3993034855 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68fa800640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68fc1099c0 0x7f68fc075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f1400640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68fc104cc0 0x7f68fc075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 -- 172.21.15.47:0/3993034855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68fc1099c0 msgr2=0x7f68fc075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68fc1099c0 0x7f68fc075560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 -- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68fc104cc0 msgr2=0x7f68fc075020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68fc104cc0 0x7f68fc075020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.430+0000 7f68f9e00640 1 -- 172.21.15.47:0/3993034855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc075c90 con 0x7f68fc103a80 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.431+0000 7f68f1400640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68fc104cc0 0x7f68fc075020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.431+0000 7f68f9e00640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc103a80 0x7f68fc076980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00d740 tx=0x7f68ec00dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.431+0000 7f68f3400640 1 -- 172.21.15.47:0/3993034855 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec017070 con 0x7f68fc103a80 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.431+0000 7f68f3400640 1 -- 172.21.15.47:0/3993034855 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68ec00de50 con 0x7f68fc103a80 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.431+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68fc1a4210 con 0x7f68fc103a80 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.431+0000 7f68f3400640 1 -- 172.21.15.47:0/3993034855 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec003c20 con 0x7f68fc103a80 2024-05-14T12:31:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.431+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68fc1a4700 con 0x7f68fc103a80 2024-05-14T12:31:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 Processor -- start 2024-05-14T12:31:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 -- start start 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f68f3400640 1 -- 172.21.15.47:0/3993034855 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f68ec003dc0 con 0x7f68fc103a80 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2451b0 0x56353f5e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f21c2f0 0x56353f5e7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5ee780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56353f54b550 con 0x56353f2451b0 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56353f4f0bc0 con 0x56353f2244d0 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.435+0000 7f6907f98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56353f547510 con 0x56353f21c2f0 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68fa800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2451b0 0x56353f5e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5ee780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43202/0 (socket says 172.21.15.47:43202) 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 -- 172.21.15.47:0/490925611 learned_addr learned my addr 172.21.15.47:0/490925611 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f9e00640 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f21c2f0 0x56353f5e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 -- 172.21.15.47:0/490925611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f21c2f0 msgr2=0x56353f5e7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f21c2f0 0x56353f5e7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 -- 172.21.15.47:0/490925611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2451b0 msgr2=0x56353f5e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2451b0 0x56353f5e7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f1400640 1 -- 172.21.15.47:0/490925611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56353f25d210 con 0x56353f2244d0 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68f9e00640 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f21c2f0 0x56353f5e7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.436+0000 7f68fa800640 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2451b0 0x56353f5e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:31:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.437+0000 7f68f1400640 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5ee780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f68e4031500 tx=0x7f68e4004190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339ec0af287df7d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.437+0000 7f68eb400640 1 -- 172.21.15.47:0/490925611 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4035030 con 0x56353f2244d0 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.437+0000 7f68eb400640 1 -- 172.21.15.47:0/490925611 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68e40054f0 con 0x56353f2244d0 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.437+0000 7f68eb400640 1 -- 172.21.15.47:0/490925611 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4003850 con 0x56353f2244d0 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.437+0000 7f68f3400640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68e00b2920 0x7f68e00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.437+0000 7f68f3400640 1 -- 172.21.15.47:0/3993034855 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f68ec0e1c30 con 0x7f68fc103a80 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f68fa800640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68e00b2920 0x7f68e00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 -- 172.21.15.47:0/490925611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 msgr2=0x56353f5ee780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5ee780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f68e4031500 tx=0x7f68e4004190 comp rx=0 tx=0).stop 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 -- 172.21.15.47:0/490925611 shutdown_connections 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5ee780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f21c2f0 0x56353f5e7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 --2- 172.21.15.47:0/490925611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2451b0 0x56353f5e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 -- 172.21.15.47:0/490925611 >> 172.21.15.47:0/490925611 conn(0x56353f239300 msgr2=0x56353f5e2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:10.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f68fa800640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68e00b2920 0x7f68e00b4e30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x56353f5e84d0 tx=0x7f68f4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:10.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.438+0000 7f6907f98740 1 -- 172.21.15.47:0/490925611 shutdown_connections 2024-05-14T12:31:10.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.439+0000 7f6907f98740 1 -- 172.21.15.47:0/490925611 wait complete. 2024-05-14T12:31:10.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.439+0000 7f6907f98740 1 -- start start 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 1 Processor -- start 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2244d0 0x56353f5f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2451b0 0x56353f5f8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56353f5ef170 con 0x56353f21c2f0 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56353f504660 con 0x56353f2451b0 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56353f5ef2f0 con 0x56353f2244d0 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.440+0000 7f6907f98740 10 client.0 _ll_register_callbacks cb 0x56353f4ce400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2244d0 0x56353f5f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2244d0 0x56353f5f12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:36298/0 (socket says 172.21.15.47:36298) 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 -- 172.21.15.47:0/4213873822 learned_addr learned my addr 172.21.15.47:0/4213873822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68fa800640 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2451b0 0x56353f5f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f9e00640 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 -- 172.21.15.47:0/4213873822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2451b0 msgr2=0x56353f5f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2451b0 0x56353f5f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 -- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 msgr2=0x56353f5f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.441+0000 7f68f1400640 1 -- 172.21.15.47:0/4213873822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56353f329620 con 0x56353f2244d0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f68f1400640 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2244d0 0x56353f5f12b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f68e4000c00 tx=0x7f68e402aa90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d389e74bb73c2972 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f68dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f68dfe00640 1 -- 172.21.15.47:0/4213873822 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4035040 con 0x56353f2244d0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68e40054f0 con 0x56353f2244d0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f68dfe00640 1 -- 172.21.15.47:0/4213873822 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f68e40052c0 con 0x56353f2244d0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f68dfe00640 1 -- 172.21.15.47:0/4213873822 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f68e40035f0 con 0x56353f2244d0 2024-05-14T12:31:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f6907f98740 10 client.25783 fetch_fsmap learned FSMap version 33 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56353f5ef170 con 0x56353f2244d0 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.442+0000 7f68dfe00640 1 -- 172.21.15.47:0/4213873822 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68e40054f0 con 0x56353f2244d0 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f68dfe00640 1 -- 172.21.15.47:0/4213873822 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f68e404b070 con 0x56353f2244d0 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f6907f98740 10 client.25783 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f6907f98740 10 client.25783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f6907f98740 20 client.25783 populate_metadata read hostname 'smithi047' 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f6907f98740 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f203d80 0x56353f5fe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f6907f98740 4 client.25783 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56353f559160 con 0x56353f203d80 2024-05-14T12:31:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.443+0000 7f68f9e00640 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f203d80 0x56353f5fe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.444+0000 7f68dfe00640 10 client.25783 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.444+0000 7f68f9e00640 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f203d80 0x56353f5fe480 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f407e96496c5f2f server_cookie=91322463211f8e18 in_seq=0 out_seq=0 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.445+0000 7f68dfe00640 1 -- 172.21.15.47:0/4213873822 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56353f559160 con 0x56353f203d80 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.445+0000 7f68dfe00640 10 client.25783 handle_command_reply: tid=0 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.445+0000 7f6907f98740 1 client.25783 shutdown 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2244d0 msgr2=0x56353f5f12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2244d0 0x56353f5f12b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f68e4000c00 tx=0x7f68e402aa90 comp rx=0 tx=0).stop 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 shutdown_connections 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f203d80 0x56353f5fe480 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2451b0 0x56353f5f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2244d0 0x56353f5f12b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f68dfe00640 0 client.25783 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 --2- 172.21.15.47:0/4213873822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 >> 172.21.15.47:0/4213873822 conn(0x56353f239300 msgr2=0x56353f5e5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 shutdown_connections 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 1 -- 172.21.15.47:0/4213873822 wait complete. 2024-05-14T12:31:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.446+0000 7f6907f98740 20 client.25783 trim_cache size 0 max 16384 2024-05-14T12:31:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.479+0000 7f6907f98740 1 Processor -- start 2024-05-14T12:31:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.479+0000 7f6907f98740 1 -- start start 2024-05-14T12:31:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f6907f98740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f6907f98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f6907f98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f6907f98740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ad380 con 0x56353f21c2f0 2024-05-14T12:31:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f6907f98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1af040 con 0x56353f2244d0 2024-05-14T12:31:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f6907f98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ada50 con 0x56353f2451b0 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f68f1400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f68fa800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f68f1400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5f8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43228/0 (socket says 172.21.15.47:43228) 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f68f1400640 1 -- 172.21.15.47:0/1920413513 learned_addr learned my addr 172.21.15.47:0/1920413513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.480+0000 7f68f9e00640 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68f1400640 1 -- 172.21.15.47:0/1920413513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 msgr2=0x56353f5f8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68f1400640 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68f1400640 1 -- 172.21.15.47:0/1920413513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 msgr2=0x56353f5e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68f1400640 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68f1400640 1 -- 172.21.15.47:0/1920413513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56353f5eacc0 con 0x56353f2244d0 2024-05-14T12:31:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68f9e00640 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:31:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68f1400640 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5f8130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68e4031440 tx=0x7f68e4005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed0587fd5833cd0a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.481+0000 7f68eaa00640 1 -- 172.21.15.47:0/1920413513 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4035070 con 0x56353f2244d0 2024-05-14T12:31:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.482+0000 7f68eaa00640 1 -- 172.21.15.47:0/1920413513 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68e40317a0 con 0x56353f2244d0 2024-05-14T12:31:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.482+0000 7f68eaa00640 1 -- 172.21.15.47:0/1920413513 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e40039f0 con 0x56353f2244d0 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.482+0000 7f6907f98740 1 -- 172.21.15.47:0/1920413513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 msgr2=0x56353f5f8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.482+0000 7f6907f98740 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5f8130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68e4031440 tx=0x7f68e4005970 comp rx=0 tx=0).stop 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 -- 172.21.15.47:0/1920413513 shutdown_connections 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f2244d0 0x56353f5f8130 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 --2- 172.21.15.47:0/1920413513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f21c2f0 0x56353f5e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 -- 172.21.15.47:0/1920413513 >> 172.21.15.47:0/1920413513 conn(0x56353f239300 msgr2=0x56353f5e2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 -- 172.21.15.47:0/1920413513 shutdown_connections 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 -- 172.21.15.47:0/1920413513 wait complete. 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 -- start start 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.483+0000 7f6907f98740 1 Processor -- start 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f6907f98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f21c2f0 0x56353f5f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f6907f98740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2244d0 0x56353f5f6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f6907f98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f6907f98740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ae8b0 con 0x56353f2244d0 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f6907f98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ae120 con 0x56353f21c2f0 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f6907f98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1ab340 con 0x56353f2451b0 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f6907f98740 10 client.0 _ll_register_callbacks cb 0x7f68e4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f68f9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f21c2f0 0x56353f5f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f68f9e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f21c2f0 0x56353f5f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43238/0 (socket says 172.21.15.47:43238) 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f68f9e00640 1 -- 172.21.15.47:0/1560898475 learned_addr learned my addr 172.21.15.47:0/1560898475 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f68fa800640 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.484+0000 7f68f1400640 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2244d0 0x56353f5f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68f9e00640 1 -- 172.21.15.47:0/1560898475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 msgr2=0x56353f5f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68f9e00640 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68f9e00640 1 -- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2244d0 msgr2=0x56353f5f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68f9e00640 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2244d0 0x56353f5f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68f9e00640 1 -- 172.21.15.47:0/1560898475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56353f5f78c0 con 0x56353f21c2f0 2024-05-14T12:31:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68f9e00640 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f21c2f0 0x56353f5f5f00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0a91a0 tx=0x7f68ec0a99d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e6f12aee2e2147 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68dfe00640 1 -- 172.21.15.47:0/1560898475 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec020040 con 0x56353f21c2f0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68dfe00640 1 -- 172.21.15.47:0/1560898475 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f68ec0a54a0 con 0x56353f21c2f0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68e40317a0 con 0x56353f21c2f0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f68dfe00640 1 -- 172.21.15.47:0/1560898475 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f68ec0b2070 con 0x56353f21c2f0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f6907f98740 10 client.25769 fetch_fsmap learned FSMap version 33 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.485+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56353f5f8c20 con 0x56353f21c2f0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f68dfe00640 1 -- 172.21.15.47:0/1560898475 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68e40317a0 con 0x56353f21c2f0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f68dfe00640 1 -- 172.21.15.47:0/1560898475 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f68ec0c3b00 con 0x56353f21c2f0 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f6907f98740 10 client.25769 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:31:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f6907f98740 10 client.25769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:31:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f6907f98740 20 client.25769 populate_metadata read hostname 'smithi047' 2024-05-14T12:31:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f6907f98740 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f1d91c0 0x56353f668f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f6907f98740 4 client.25769 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:31:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56353f552fd0 con 0x56353f1d91c0 2024-05-14T12:31:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.486+0000 7f68f1400640 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f1d91c0 0x56353f668f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.487+0000 7f68f1400640 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f1d91c0 0x56353f668f50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae4f92831afc22db server_cookie=92754a3a5ae5c62f in_seq=0 out_seq=0 2024-05-14T12:31:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:10.487+0000 7f68dfe00640 10 client.25769 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.044+0000 7fbe1f200700 1 -- 172.21.15.47:0/3969127164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 msgr2=0x7fbe20109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.044+0000 7fbe1f200700 1 --2- 172.21.15.47:0/3969127164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 0x7fbe20109140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0099c0 tx=0x7fbe0c009cd0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.044+0000 7fbe1f200700 1 -- 172.21.15.47:0/3969127164 shutdown_connections 2024-05-14T12:31:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.044+0000 7fbe1f200700 1 --2- 172.21.15.47:0/3969127164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20109680 0x7fbe20110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.044+0000 7fbe1f200700 1 --2- 172.21.15.47:0/3969127164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20104400 0x7fbe20104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.044+0000 7fbe1f200700 1 --2- 172.21.15.47:0/3969127164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 0x7fbe20109140 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.045+0000 7fbe1f200700 1 -- 172.21.15.47:0/3969127164 >> 172.21.15.47:0/3969127164 conn(0x7fbe20079d10 msgr2=0x7fbe2007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:12.046 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:11 smithi047 ceph-mon[31254]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 61 MiB/s wr, 6.10k op/s 2024-05-14T12:31:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.045+0000 7fbe1f200700 1 -- 172.21.15.47:0/3969127164 shutdown_connections 2024-05-14T12:31:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.045+0000 7fbe1f200700 1 -- 172.21.15.47:0/3969127164 wait complete. 2024-05-14T12:31:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 Processor -- start 2024-05-14T12:31:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 -- start start 2024-05-14T12:31:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20104400 0x7fbe2019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 0x7fbe2019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20109680 0x7fbe201a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201142e0 con 0x7fbe20109680 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20114160 con 0x7fbe20104400 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.047+0000 7fbe1f200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20114460 con 0x7fbe20108d30 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1e800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20109680 0x7fbe201a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20104400 0x7fbe2019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1d400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 0x7fbe2019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20104400 0x7fbe2019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43252/0 (socket says 172.21.15.47:43252) 2024-05-14T12:31:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 -- 172.21.15.47:0/543739985 learned_addr learned my addr 172.21.15.47:0/543739985 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 -- 172.21.15.47:0/543739985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 msgr2=0x7fbe2019d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 0x7fbe2019d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 -- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20109680 msgr2=0x7fbe201a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20109680 0x7fbe201a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.048+0000 7fbe1de00700 1 -- 172.21.15.47:0/543739985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe201a1d80 con 0x7fbe20104400 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.049+0000 7fbe1de00700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20104400 0x7fbe2019ceb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000e9a0 tx=0x7fbe1000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.049+0000 7fbe16a00700 1 -- 172.21.15.47:0/543739985 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000ca10 con 0x7fbe20104400 2024-05-14T12:31:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.049+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe201a2070 con 0x7fbe20104400 2024-05-14T12:31:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.049+0000 7fbe16a00700 1 -- 172.21.15.47:0/543739985 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe1000cbb0 con 0x7fbe20104400 2024-05-14T12:31:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.049+0000 7fbe16a00700 1 -- 172.21.15.47:0/543739985 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10018680 con 0x7fbe20104400 2024-05-14T12:31:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.049+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe201a9990 con 0x7fbe20104400 2024-05-14T12:31:12.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.053+0000 7fbe16a00700 1 -- 172.21.15.47:0/543739985 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbe10010430 con 0x7fbe20104400 2024-05-14T12:31:12.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.054+0000 7fbe337c7b80 1 Processor -- start 2024-05-14T12:31:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.054+0000 7fbe337c7b80 1 -- start start 2024-05-14T12:31:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.054+0000 7fbe16a00700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe040b2900 0x7fbe040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562032755fd0 0x5620328d4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe16a00700 1 -- 172.21.15.47:0/543739985 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbe100e2340 con 0x7fbe20104400 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328d8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328d92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe1e800700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe040b2900 0x7fbe040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5620327f5bb0 con 0x5620328d46a0 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5620327938f0 con 0x5620328d8ea0 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5620327f1b70 con 0x562032755fd0 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe1de00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562032755fd0 0x5620328d4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe1de00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562032755fd0 0x5620328d4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:36346/0 (socket says 172.21.15.47:36346) 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe1de00700 1 -- 172.21.15.47:0/3667679020 learned_addr learned my addr 172.21.15.47:0/3667679020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe1e800700 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328d92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.055+0000 7fbe1d400700 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328d8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe1de00700 1 -- 172.21.15.47:0/3667679020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 msgr2=0x5620328d92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328d92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe1de00700 1 -- 172.21.15.47:0/3667679020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 msgr2=0x5620328d8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328d8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe1de00700 1 -- 172.21.15.47:0/3667679020 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562032742a60 con 0x562032755fd0 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562032755fd0 0x5620328d4160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a98b0 tx=0x7fbe100b2190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=171b4e2b26e5346e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe1e800700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe040b2900 0x7fbe040b4e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009ec0 tx=0x7fbe18013480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe0b400700 1 -- 172.21.15.47:0/3667679020 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100aa020 con 0x562032755fd0 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe0b400700 1 -- 172.21.15.47:0/3667679020 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe100a9920 con 0x562032755fd0 2024-05-14T12:31:12.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.056+0000 7fbe0b400700 1 -- 172.21.15.47:0/3667679020 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100cabd0 con 0x562032755fd0 2024-05-14T12:31:12.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3667679020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562032755fd0 msgr2=0x5620328d4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:12.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562032755fd0 0x5620328d4160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a98b0 tx=0x7fbe100b2190 comp rx=0 tx=0).stop 2024-05-14T12:31:12.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3667679020 shutdown_connections 2024-05-14T12:31:12.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328d92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562032755fd0 0x5620328d4160 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3667679020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328d8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3667679020 >> 172.21.15.47:0/3667679020 conn(0x562032794c10 msgr2=0x5620328cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3667679020 shutdown_connections 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.057+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3667679020 wait complete. 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.058+0000 7fbe337c7b80 1 -- start start 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.058+0000 7fbe337c7b80 1 Processor -- start 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328de130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620328de670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5620328e0e50 con 0x5620328d46a0 2024-05-14T12:31:12.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56203275bcb0 con 0x562032755fd0 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5620328e0fd0 con 0x5620328d8ea0 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe337c7b80 10 client.0 _ll_register_callbacks cb 0x562032789510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe1e800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620328de670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe1e800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620328de670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:36352/0 (socket says 172.21.15.47:36352) 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe1e800700 1 -- 172.21.15.47:0/2322357075 learned_addr learned my addr 172.21.15.47:0/2322357075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe1d400700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.059+0000 7fbe1de00700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe1e800700 1 -- 172.21.15.47:0/2322357075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 msgr2=0x5620328ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe1e800700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe1e800700 1 -- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 msgr2=0x5620328de130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe1e800700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328de130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe1e800700 1 -- 172.21.15.47:0/2322357075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620327bb5b0 con 0x5620328d8ea0 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe1d400700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328de130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:31:12.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe1e800700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620328de670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009e20 tx=0x7fbe18004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b061140ea955f9cd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:12.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbdffe00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbdffe00700 1 -- 172.21.15.47:0/2322357075 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18029020 con 0x5620328d8ea0 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbdffe00700 1 -- 172.21.15.47:0/2322357075 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbe1801b450 con 0x5620328d8ea0 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe100a9920 con 0x5620328d8ea0 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbdffe00700 1 -- 172.21.15.47:0/2322357075 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbe18021070 con 0x5620328d8ea0 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe337c7b80 10 client.25801 fetch_fsmap learned FSMap version 33 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.060+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5620328ebaf0 con 0x5620328d8ea0 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbdffe00700 1 -- 172.21.15.47:0/2322357075 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe100a9920 con 0x5620328d8ea0 2024-05-14T12:31:12.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbdffe00700 1 -- 172.21.15.47:0/2322357075 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fbe18025540 con 0x5620328d8ea0 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbe337c7b80 10 client.25801 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbe337c7b80 10 client.25801 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbe337c7b80 20 client.25801 populate_metadata read hostname 'smithi047' 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620328ee1d0 0x5620328f0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbe337c7b80 4 client.25801 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.061+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620328a0200 con 0x5620328ee1d0 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.062+0000 7fbe1de00700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620328ee1d0 0x5620328f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.062+0000 7fbe1de00700 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620328ee1d0 0x5620328f0670 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21947629ad620a3d server_cookie=f445490290672eeb in_seq=0 out_seq=0 2024-05-14T12:31:12.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:12.062+0000 7fbdffe00700 10 client.25801 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:11 smithi073 ceph-mon[35809]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 61 MiB/s wr, 6.10k op/s 2024-05-14T12:31:12.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:11 smithi066 ceph-mon[35981]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 61 MiB/s wr, 6.10k op/s 2024-05-14T12:31:13.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:12 smithi047 ceph-mon[31254]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 60 MiB/s wr, 6.12k op/s 2024-05-14T12:31:13.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:12 smithi073 ceph-mon[35809]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 60 MiB/s wr, 6.12k op/s 2024-05-14T12:31:13.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:12 smithi066 ceph-mon[35981]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 60 MiB/s wr, 6.12k op/s 2024-05-14T12:31:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:15 smithi047 ceph-mon[31254]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 60 MiB/s wr, 6.28k op/s 2024-05-14T12:31:16.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:15 smithi073 ceph-mon[35809]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 60 MiB/s wr, 6.28k op/s 2024-05-14T12:31:16.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:15 smithi066 ceph-mon[35981]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 60 MiB/s wr, 6.28k op/s 2024-05-14T12:31:17.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:17 smithi047 ceph-mon[31254]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 58 MiB/s wr, 6.23k op/s 2024-05-14T12:31:18.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:17 smithi073 ceph-mon[35809]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 58 MiB/s wr, 6.23k op/s 2024-05-14T12:31:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:17 smithi066 ceph-mon[35981]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 58 MiB/s wr, 6.23k op/s 2024-05-14T12:31:19.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:19 smithi047 ceph-mon[31254]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 57 MiB/s wr, 6.32k op/s 2024-05-14T12:31:20.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:19 smithi073 ceph-mon[35809]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 57 MiB/s wr, 6.32k op/s 2024-05-14T12:31:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:19 smithi066 ceph-mon[35981]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 57 MiB/s wr, 6.32k op/s 2024-05-14T12:31:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f68dfe00640 1 -- 172.21.15.47:0/1560898475 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56353f552fd0 con 0x56353f1d91c0 2024-05-14T12:31:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f68dfe00640 10 client.25769 handle_command_reply: tid=0 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 client.25769 shutdown 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f21c2f0 msgr2=0x56353f5f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f21c2f0 0x56353f5f5f00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0a91a0 tx=0x7f68ec0a99d0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 shutdown_connections 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56353f1d91c0 0x56353f668f50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56353f2451b0 0x56353f5f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56353f2244d0 0x56353f5f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 --2- 172.21.15.47:0/1560898475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56353f21c2f0 0x56353f5f5f00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f68dfe00640 0 client.25769 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.627+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 >> 172.21.15.47:0/1560898475 conn(0x56353f239300 msgr2=0x56353f602c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.628+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 shutdown_connections 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.628+0000 7f6907f98740 1 -- 172.21.15.47:0/1560898475 wait complete. 2024-05-14T12:31:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.628+0000 7f6907f98740 20 client.25769 trim_cache size 0 max 16384 2024-05-14T12:31:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:31:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:31:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:31:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:31:21.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.628+0000 7fbdffe00700 1 -- 172.21.15.47:0/2322357075 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5620328a0200 con 0x5620328ee1d0 2024-05-14T12:31:21.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.628+0000 7fbdffe00700 10 client.25801 handle_command_reply: tid=0 2024-05-14T12:31:21.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.628+0000 7fbe337c7b80 1 client.25801 shutdown 2024-05-14T12:31:21.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.628+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 msgr2=0x5620328de670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:21.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.628+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620328de670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009e20 tx=0x7fbe18004b40 comp rx=0 tx=0).stop 2024-05-14T12:31:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68e00b2920 msgr2=0x7f68e00b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68e00b2920 0x7f68e00b4e30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x56353f5e84d0 tx=0x7f68f4009500 comp rx=0 tx=0).stop 2024-05-14T12:31:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc103a80 msgr2=0x7f68fc076980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc103a80 0x7f68fc076980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00d740 tx=0x7f68ec00dc00 comp rx=0 tx=0).stop 2024-05-14T12:31:21.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 shutdown_connections 2024-05-14T12:31:21.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620328ee1d0 0x5620328f0670 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620328de670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbdffe00700 0 client.25801 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:21.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/2322357075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328de130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 >> 172.21.15.47:0/2322357075 conn(0x562032794c10 msgr2=0x5620328d92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 shutdown_connections 2024-05-14T12:31:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68e00b2920 0x7f68e00b4e30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68fc1099c0 0x7f68fc075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68fc104cc0 0x7f68fc075020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 --2- 172.21.15.47:0/3993034855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68fc103a80 0x7f68fc076980 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 >> 172.21.15.47:0/3993034855 conn(0x7f68fc0fec70 msgr2=0x7f68fc1059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:21.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 shutdown_connections 2024-05-14T12:31:21.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 1 -- 172.21.15.47:0/2322357075 wait complete. 2024-05-14T12:31:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 shutdown_connections 2024-05-14T12:31:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:21.629+0000 7f68fb200640 1 -- 172.21.15.47:0/3993034855 wait complete. 2024-05-14T12:31:21.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.629+0000 7fbe337c7b80 20 client.25801 trim_cache size 0 max 16384 2024-05-14T12:31:21.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.653+0000 7fbe337c7b80 1 Processor -- start 2024-05-14T12:31:21.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.653+0000 7fbe337c7b80 1 -- start start 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032755fd0 0x5620328d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d46a0 0x5620328de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328da2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201ac8d0 con 0x562032755fd0 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201ae590 con 0x5620328d8ea0 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201acfa0 con 0x5620328d46a0 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe1d400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d46a0 0x5620328de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe1d400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d46a0 0x5620328de4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45796/0 (socket says 172.21.15.47:45796) 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe1d400700 1 -- 172.21.15.47:0/3012887820 learned_addr learned my addr 172.21.15.47:0/3012887820 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:21.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032755fd0 0x5620328d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:21.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.654+0000 7fbe1e800700 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328da2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.655+0000 7fbe1d400700 1 -- 172.21.15.47:0/3012887820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 msgr2=0x5620328da2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.655+0000 7fbe1d400700 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328da2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.655+0000 7fbe1d400700 1 -- 172.21.15.47:0/3012887820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032755fd0 msgr2=0x5620328d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.655+0000 7fbe1d400700 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032755fd0 0x5620328d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.655+0000 7fbe1d400700 1 -- 172.21.15.47:0/3012887820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620328e0490 con 0x5620328d46a0 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.655+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032755fd0 0x5620328d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.655+0000 7fbe1d400700 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d46a0 0x5620328de4b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0099c0 tx=0x7fbe0c005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7108c60e2a2069a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.656+0000 7fbe0aa00700 1 -- 172.21.15.47:0/3012887820 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c028070 con 0x5620328d46a0 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.656+0000 7fbe0aa00700 1 -- 172.21.15.47:0/3012887820 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe0c0037c0 con 0x5620328d46a0 2024-05-14T12:31:21.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.656+0000 7fbe0aa00700 1 -- 172.21.15.47:0/3012887820 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00b9f0 con 0x5620328d46a0 2024-05-14T12:31:21.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3012887820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d46a0 msgr2=0x5620328de4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:21.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d46a0 0x5620328de4b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0099c0 tx=0x7fbe0c005040 comp rx=0 tx=0).stop 2024-05-14T12:31:21.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3012887820 shutdown_connections 2024-05-14T12:31:21.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620328d8ea0 0x5620328da2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562032755fd0 0x5620328d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3012887820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d46a0 0x5620328de4b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3012887820 >> 172.21.15.47:0/3012887820 conn(0x562032794c10 msgr2=0x5620328dc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:21.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3012887820 shutdown_connections 2024-05-14T12:31:21.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3012887820 wait complete. 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.658+0000 7fbe337c7b80 1 -- start start 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 1 Processor -- start 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328e2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620329579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201ade00 con 0x5620328d46a0 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201ad670 con 0x562032755fd0 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2010ee80 con 0x5620328d8ea0 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.659+0000 7fbe337c7b80 10 client.0 _ll_register_callbacks cb 0x562032789510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1de00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1de00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328e24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:43030/0 (socket says 172.21.15.47:43030) 2024-05-14T12:31:21.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1e800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620329579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1de00700 1 -- 172.21.15.47:0/3081551727 learned_addr learned my addr 172.21.15.47:0/3081551727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1d400700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328e2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1e800700 1 -- 172.21.15.47:0/3081551727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 msgr2=0x5620328e24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1e800700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328e24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1e800700 1 -- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 msgr2=0x5620328e2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1e800700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328e2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1e800700 1 -- 172.21.15.47:0/3081551727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562032957f20 con 0x5620328d8ea0 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328e24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:31:21.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1d400700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328e2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbe1e800700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620329579e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe1801aa50 tx=0x7fbe18013630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bfd1ddb1d7358e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.660+0000 7fbdffe00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.661+0000 7fbdffe00700 1 -- 172.21.15.47:0/3081551727 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1803d070 con 0x5620328d8ea0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.661+0000 7fbdffe00700 1 -- 172.21.15.47:0/3081551727 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbe18025620 con 0x5620328d8ea0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.661+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe0c0037c0 con 0x5620328d8ea0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.661+0000 7fbdffe00700 1 -- 172.21.15.47:0/3081551727 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbe18029050 con 0x5620328d8ea0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.661+0000 7fbe337c7b80 10 client.25807 fetch_fsmap learned FSMap version 33 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.661+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562032959050 con 0x5620328d8ea0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbdffe00700 1 -- 172.21.15.47:0/3081551727 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe0c0037c0 con 0x5620328d8ea0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbdffe00700 1 -- 172.21.15.47:0/3081551727 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fbe18040020 con 0x5620328d8ea0 2024-05-14T12:31:21.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbe337c7b80 10 client.25807 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbe337c7b80 10 client.25807 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbe337c7b80 20 client.25807 populate_metadata read hostname 'smithi047' 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620329597c0 0x56203295bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbe337c7b80 4 client.25807 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x562032803590 con 0x5620329597c0 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.662+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620329597c0 0x56203295bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.663+0000 7fbdffe00700 10 client.25807 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:21.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:21.663+0000 7fbe1de00700 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620329597c0 0x56203295bbe0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb26e66561284d2f server_cookie=738737c916a3b9d9 in_seq=0 out_seq=0 2024-05-14T12:31:21.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:21 smithi047 ceph-mon[31254]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 58 MiB/s wr, 6.63k op/s 2024-05-14T12:31:22.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:21 smithi073 ceph-mon[35809]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 58 MiB/s wr, 6.63k op/s 2024-05-14T12:31:22.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:21 smithi066 ceph-mon[35981]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 58 MiB/s wr, 6.63k op/s 2024-05-14T12:31:23.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:23 smithi047 ceph-mon[31254]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 59 MiB/s wr, 6.79k op/s 2024-05-14T12:31:24.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:23 smithi073 ceph-mon[35809]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 59 MiB/s wr, 6.79k op/s 2024-05-14T12:31:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:23 smithi066 ceph-mon[35981]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 59 MiB/s wr, 6.79k op/s 2024-05-14T12:31:25.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:25 smithi047 ceph-mon[31254]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 55 MiB/s wr, 6.46k op/s 2024-05-14T12:31:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:25 smithi073 ceph-mon[35809]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 55 MiB/s wr, 6.46k op/s 2024-05-14T12:31:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:25 smithi066 ceph-mon[35981]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 55 MiB/s wr, 6.46k op/s 2024-05-14T12:31:28.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:27 smithi073 ceph-mon[35809]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 59 MiB/s wr, 6.94k op/s 2024-05-14T12:31:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:27 smithi066 ceph-mon[35981]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 59 MiB/s wr, 6.94k op/s 2024-05-14T12:31:28.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:27 smithi047 ceph-mon[31254]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 59 MiB/s wr, 6.94k op/s 2024-05-14T12:31:30.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:29 smithi073 ceph-mon[35809]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 66 MiB/s wr, 7.81k op/s 2024-05-14T12:31:30.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:29 smithi066 ceph-mon[35981]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 66 MiB/s wr, 7.81k op/s 2024-05-14T12:31:30.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:29 smithi047 ceph-mon[31254]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 66 MiB/s wr, 7.81k op/s 2024-05-14T12:31:32.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:31 smithi073 ceph-mon[35809]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 74 MiB/s wr, 8.60k op/s 2024-05-14T12:31:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:31 smithi066 ceph-mon[35981]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 74 MiB/s wr, 8.60k op/s 2024-05-14T12:31:32.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:31 smithi047 ceph-mon[31254]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 74 MiB/s wr, 8.60k op/s 2024-05-14T12:31:33.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:32 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:31:33.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:32 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:31:33.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:32 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:31:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:33 smithi066 ceph-mon[35981]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 66 MiB/s wr, 7.66k op/s 2024-05-14T12:31:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:31:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:31:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:33 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:31:34.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:33 smithi047 ceph-mon[31254]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 66 MiB/s wr, 7.66k op/s 2024-05-14T12:31:34.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:31:34.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:31:34.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:33 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:31:34.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:33 smithi073 ceph-mon[35809]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 66 MiB/s wr, 7.66k op/s 2024-05-14T12:31:34.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:31:34.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:31:34.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:33 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:31:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.877+0000 7fdef8e00640 1 -- 172.21.15.47:0/2228125399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef41041e0 msgr2=0x7fdef4106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.877+0000 7fdef8e00640 1 --2- 172.21.15.47:0/2228125399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef41041e0 0x7fdef4106600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009900 tx=0x7fdee402a3f0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.878+0000 7fdef8e00640 1 -- 172.21.15.47:0/2228125399 shutdown_connections 2024-05-14T12:31:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.878+0000 7fdef8e00640 1 --2- 172.21.15.47:0/2228125399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdef4109700 0x7fdef410bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.878+0000 7fdef8e00640 1 --2- 172.21.15.47:0/2228125399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 0x7fdef4109070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.878+0000 7fdef8e00640 1 --2- 172.21.15.47:0/2228125399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef41041e0 0x7fdef4106600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.878+0000 7fdef8e00640 1 -- 172.21.15.47:0/2228125399 >> 172.21.15.47:0/2228125399 conn(0x7fdef40fdb60 msgr2=0x7fdef4100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.878+0000 7fdef8e00640 1 -- 172.21.15.47:0/2228125399 shutdown_connections 2024-05-14T12:31:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.878+0000 7fdef8e00640 1 -- 172.21.15.47:0/2228125399 wait complete. 2024-05-14T12:31:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.879+0000 7fdef8e00640 1 Processor -- start 2024-05-14T12:31:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.879+0000 7fdef8e00640 1 -- start start 2024-05-14T12:31:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdef41041e0 0x7fdef419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 0x7fdef419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef4109700 0x7fdef41a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef8e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdef410f630 con 0x7fdef4106bd0 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef8e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdef410f4b0 con 0x7fdef41041e0 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef8e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdef410f7b0 con 0x7fdef4109700 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 0x7fdef419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 0x7fdef419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52088/0 (socket says 172.21.15.47:52088) 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef2a00640 1 -- 172.21.15.47:0/1006525665 learned_addr learned my addr 172.21.15.47:0/1006525665 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.880+0000 7fdef3400640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdef41041e0 0x7fdef419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.881+0000 7fdef3e00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef4109700 0x7fdef41a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.881+0000 7fdef2a00640 1 -- 172.21.15.47:0/1006525665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef4109700 msgr2=0x7fdef41a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.881+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef4109700 0x7fdef41a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.881+0000 7fdef2a00640 1 -- 172.21.15.47:0/1006525665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdef41041e0 msgr2=0x7fdef419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.881+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdef41041e0 0x7fdef419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.881+0000 7fdef2a00640 1 -- 172.21.15.47:0/1006525665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef41a1b40 con 0x7fdef4106bd0 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.882+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 0x7fdef419a540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00e9f0 tx=0x7fdedc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.882+0000 7fdeebe00640 1 -- 172.21.15.47:0/1006525665 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00cd80 con 0x7fdef4106bd0 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.882+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef41a1e30 con 0x7fdef4106bd0 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.882+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef41a22f0 con 0x7fdef4106bd0 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.882+0000 7fdeebe00640 1 -- 172.21.15.47:0/1006525665 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc0108e0 con 0x7fdef4106bd0 2024-05-14T12:31:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.882+0000 7fdeebe00640 1 -- 172.21.15.47:0/1006525665 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc018980 con 0x7fdef4106bd0 2024-05-14T12:31:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.885+0000 7fdf013d6740 1 Processor -- start 2024-05-14T12:31:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdf013d6740 1 -- start start 2024-05-14T12:31:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e4d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e4dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e54b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdf013d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e062dad550 con 0x55e062a7e2f0 2024-05-14T12:31:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdf013d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e062d52bc0 con 0x55e062a864d0 2024-05-14T12:31:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdf013d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e062da9510 con 0x55e062aa71b0 2024-05-14T12:31:34.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e4d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e4d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43896/0 (socket says 172.21.15.47:43896) 2024-05-14T12:31:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.886+0000 7fdef3e00640 1 -- 172.21.15.47:0/324011781 learned_addr learned my addr 172.21.15.47:0/324011781 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdef3400640 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e4dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdef3e00640 1 -- 172.21.15.47:0/324011781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 msgr2=0x55e062e54b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdef3e00640 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e54b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdef3e00640 1 -- 172.21.15.47:0/324011781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 msgr2=0x55e062e4dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdef3e00640 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e4dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdef3e00640 1 -- 172.21.15.47:0/324011781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e062abf210 con 0x55e062aa71b0 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdef3e00640 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e4d710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0039f0 tx=0x7fdeec003eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fb07ca998d0804e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.887+0000 7fdee8c00640 1 -- 172.21.15.47:0/324011781 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec01a470 con 0x55e062aa71b0 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.888+0000 7fdee8c00640 1 -- 172.21.15.47:0/324011781 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec015070 con 0x55e062aa71b0 2024-05-14T12:31:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.888+0000 7fdee8c00640 1 -- 172.21.15.47:0/324011781 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec010800 con 0x55e062aa71b0 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.888+0000 7fdeebe00640 1 -- 172.21.15.47:0/1006525665 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdedc010430 con 0x7fdef4106bd0 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.889+0000 7fdf013d6740 1 -- 172.21.15.47:0/324011781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 msgr2=0x55e062e4d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.889+0000 7fdf013d6740 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e4d710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0039f0 tx=0x7fdeec003eb0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.889+0000 7fdf013d6740 1 -- 172.21.15.47:0/324011781 shutdown_connections 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.889+0000 7fdf013d6740 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e54b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.889+0000 7fdf013d6740 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e4dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.889+0000 7fdf013d6740 1 --2- 172.21.15.47:0/324011781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e4d710 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.889+0000 7fdf013d6740 1 -- 172.21.15.47:0/324011781 >> 172.21.15.47:0/324011781 conn(0x55e062a9b300 msgr2=0x55e062e490a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.890+0000 7fdeebe00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fded80b2920 0x7fded80b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.890+0000 7fdf013d6740 1 -- 172.21.15.47:0/324011781 shutdown_connections 2024-05-14T12:31:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.891+0000 7fdeebe00640 1 -- 172.21.15.47:0/1006525665 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fdedc0e23a0 con 0x7fdef4106bd0 2024-05-14T12:31:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.891+0000 7fdf013d6740 1 -- 172.21.15.47:0/324011781 wait complete. 2024-05-14T12:31:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.891+0000 7fdef3400640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fded80b2920 0x7fded80b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.892+0000 7fdf013d6740 1 -- start start 2024-05-14T12:31:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.892+0000 7fdf013d6740 1 Processor -- start 2024-05-14T12:31:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.892+0000 7fdef3400640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fded80b2920 0x7fded80b4e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdee402a910 tx=0x7fdee4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a7e2f0 0x55e062e47d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a864d0 0x55e062e48270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e448b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdf013d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e062e555e0 con 0x55e062a864d0 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdf013d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e062d66660 con 0x55e062a7e2f0 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdf013d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e062e55760 con 0x55e062aa71b0 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdf013d6740 10 client.0 _ll_register_callbacks cb 0x55e062d30400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdef3400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a7e2f0 0x55e062e47d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdef3400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a7e2f0 0x55e062e47d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56754/0 (socket says 172.21.15.47:56754) 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdef3400640 1 -- 172.21.15.47:0/1286379288 learned_addr learned my addr 172.21.15.47:0/1286379288 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a864d0 0x55e062e48270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.893+0000 7fdef3400640 1 -- 172.21.15.47:0/1286379288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 msgr2=0x55e062e448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:34.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdef3400640 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdef3400640 1 -- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a864d0 msgr2=0x55e062e48270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdef3400640 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a864d0 0x55e062e48270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdef3400640 1 -- 172.21.15.47:0/1286379288 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e062b8b620 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdef3400640 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a7e2f0 0x55e062e47d30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdee4033000 tx=0x7fdee4005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f7f6a472e4d6ce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdee1600640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdee1600640 1 -- 172.21.15.47:0/1286379288 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee404e070 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdee1600640 1 -- 172.21.15.47:0/1286379288 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fdee40037f0 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.894+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec015070 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdee1600640 1 -- 172.21.15.47:0/1286379288 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdee405a050 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 10 client.25796 fetch_fsmap learned FSMap version 33 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e062e65a50 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdee1600640 1 -- 172.21.15.47:0/1286379288 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec015070 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdee1600640 1 -- 172.21.15.47:0/1286379288 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fdee4032880 con 0x55e062a7e2f0 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 10 client.25796 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:31:34.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:31:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 20 client.25796 populate_metadata read hostname 'smithi047' 2024-05-14T12:31:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a65d80 0x55e062e69280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 4 client.25796 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:31:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.895+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e062dbb160 con 0x55e062a65d80 2024-05-14T12:31:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.896+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a65d80 0x55e062e69280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.896+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a65d80 0x55e062e69280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41432bfebcef3c9b server_cookie=4916c376c69b7552 in_seq=0 out_seq=0 2024-05-14T12:31:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.896+0000 7fdee1600640 10 client.25796 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.897+0000 7fdee1600640 1 -- 172.21.15.47:0/1286379288 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e062dbb160 con 0x55e062a65d80 2024-05-14T12:31:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.897+0000 7fdee1600640 10 client.25796 handle_command_reply: tid=0 2024-05-14T12:31:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.897+0000 7fdf013d6740 1 client.25796 shutdown 2024-05-14T12:31:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a7e2f0 msgr2=0x55e062e47d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a7e2f0 0x55e062e47d30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdee4033000 tx=0x7fdee4005fd0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 shutdown_connections 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a65d80 0x55e062e69280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a864d0 0x55e062e48270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1286379288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a7e2f0 0x55e062e47d30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdee1600640 0 client.25796 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 >> 172.21.15.47:0/1286379288 conn(0x55e062a9b300 msgr2=0x55e062e43c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 shutdown_connections 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 1 -- 172.21.15.47:0/1286379288 wait complete. 2024-05-14T12:31:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.898+0000 7fdf013d6740 20 client.25796 trim_cache size 0 max 16384 2024-05-14T12:31:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 Processor -- start 2024-05-14T12:31:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 -- start start 2024-05-14T12:31:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e49020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e6da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e6df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fded000e4d0 con 0x55e062a7e2f0 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fded0010190 con 0x55e062a864d0 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdf013d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fded000eba0 con 0x55e062aa71b0 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdef2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e6da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdef3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e49020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdef2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e6da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56766/0 (socket says 172.21.15.47:56766) 2024-05-14T12:31:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.920+0000 7fdef2a00640 1 -- 172.21.15.47:0/1001712504 learned_addr learned my addr 172.21.15.47:0/1001712504 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.921+0000 7fdef2a00640 1 -- 172.21.15.47:0/1001712504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 msgr2=0x55e062e6df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.921+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e6df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.921+0000 7fdef2a00640 1 -- 172.21.15.47:0/1001712504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 msgr2=0x55e062e49020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.921+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e49020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.921+0000 7fdef2a00640 1 -- 172.21.15.47:0/1001712504 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e062e404a0 con 0x55e062a864d0 2024-05-14T12:31:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.921+0000 7fdef3400640 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e49020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.921+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e6da30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0a6ca0 tx=0x7fdedc0dfd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=543ffdb41953cf0c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.922+0000 7fdee3e00640 1 -- 172.21.15.47:0/1001712504 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0a9a30 con 0x55e062a864d0 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.922+0000 7fdee3e00640 1 -- 172.21.15.47:0/1001712504 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc0add30 con 0x55e062a864d0 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.922+0000 7fdee3e00640 1 -- 172.21.15.47:0/1001712504 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0a9ef0 con 0x55e062a864d0 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 -- 172.21.15.47:0/1001712504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 msgr2=0x55e062e6da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e6da30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0a6ca0 tx=0x7fdedc0dfd30 comp rx=0 tx=0).stop 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 -- 172.21.15.47:0/1001712504 shutdown_connections 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e6df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e6da30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1001712504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e49020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 -- 172.21.15.47:0/1001712504 >> 172.21.15.47:0/1001712504 conn(0x55e062a9b300 msgr2=0x55e062e48910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 -- 172.21.15.47:0/1001712504 shutdown_connections 2024-05-14T12:31:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.923+0000 7fdf013d6740 1 -- 172.21.15.47:0/1001712504 wait complete. 2024-05-14T12:31:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.924+0000 7fdf013d6740 1 -- start start 2024-05-14T12:31:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.924+0000 7fdf013d6740 1 Processor -- start 2024-05-14T12:31:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e78260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e787a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdf013d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e79630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdf013d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fded000fa00 con 0x55e062a7e2f0 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdf013d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fded000f270 con 0x55e062a864d0 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdf013d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fded000c490 con 0x55e062aa71b0 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdf013d6740 10 client.0 _ll_register_callbacks cb 0x7fdee4005270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdef3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e78260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdef2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdef2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e787a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56778/0 (socket says 172.21.15.47:56778) 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.925+0000 7fdef2a00640 1 -- 172.21.15.47:0/1798486937 learned_addr learned my addr 172.21.15.47:0/1798486937 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.926+0000 7fdef2a00640 1 -- 172.21.15.47:0/1798486937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 msgr2=0x55e062e79630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.926+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e79630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.926+0000 7fdef2a00640 1 -- 172.21.15.47:0/1798486937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 msgr2=0x55e062e78260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.926+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e78260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.926+0000 7fdef2a00640 1 -- 172.21.15.47:0/1798486937 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e062e79bf0 con 0x55e062a864d0 2024-05-14T12:31:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.926+0000 7fdef2a00640 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e787a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdedc018530 tx=0x7fdedc0a5960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcc1b4aaaf74893d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:31:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.926+0000 7fdee1600640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:31:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.927+0000 7fdee1600640 1 -- 172.21.15.47:0/1798486937 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0b27e0 con 0x55e062a864d0 2024-05-14T12:31:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.927+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc0add30 con 0x55e062a864d0 2024-05-14T12:31:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.927+0000 7fdee1600640 1 -- 172.21.15.47:0/1798486937 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fdedc0a6020 con 0x55e062a864d0 2024-05-14T12:31:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.927+0000 7fdee1600640 1 -- 172.21.15.47:0/1798486937 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdedc0a9ea0 con 0x55e062a864d0 2024-05-14T12:31:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.927+0000 7fdf013d6740 10 client.25802 fetch_fsmap learned FSMap version 33 2024-05-14T12:31:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.927+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e062ed1260 con 0x55e062a864d0 2024-05-14T12:31:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.927+0000 7fdee1600640 1 -- 172.21.15.47:0/1798486937 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc0add30 con 0x55e062a864d0 2024-05-14T12:31:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.928+0000 7fdee1600640 1 -- 172.21.15.47:0/1798486937 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fdedc0a8c90 con 0x55e062a864d0 2024-05-14T12:31:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.929+0000 7fdf013d6740 10 client.25802 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T12:31:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.929+0000 7fdf013d6740 10 client.25802 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:31:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.929+0000 7fdf013d6740 20 client.25802 populate_metadata read hostname 'smithi047' 2024-05-14T12:31:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.929+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a3b1c0 0x55e062ed3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:31:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.929+0000 7fdf013d6740 4 client.25802 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:31:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.929+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e062db4fd0 con 0x55e062a3b1c0 2024-05-14T12:31:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.929+0000 7fdef3400640 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a3b1c0 0x55e062ed3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:31:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.930+0000 7fdef3400640 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a3b1c0 0x55e062ed3c30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bf1a6e71c43c845 server_cookie=e1fe1af65b43670e in_seq=0 out_seq=0 2024-05-14T12:31:34.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:31:34.930+0000 7fdee1600640 10 client.25802 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:36.074 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:35 smithi047 ceph-mon[31254]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 63 MiB/s wr, 7.28k op/s 2024-05-14T12:31:36.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:35 smithi066 ceph-mon[35981]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 63 MiB/s wr, 7.28k op/s 2024-05-14T12:31:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:35 smithi073 ceph-mon[35809]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 63 MiB/s wr, 7.28k op/s 2024-05-14T12:31:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:37 smithi066 ceph-mon[35981]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 60 MiB/s wr, 7.03k op/s 2024-05-14T12:31:38.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:37 smithi047 ceph-mon[31254]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 60 MiB/s wr, 7.03k op/s 2024-05-14T12:31:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:37 smithi073 ceph-mon[35809]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 60 MiB/s wr, 7.03k op/s 2024-05-14T12:31:39.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:38 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:39.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:38 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:39.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:38 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:39 smithi066 ceph-mon[35981]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 54 MiB/s wr, 6.27k op/s 2024-05-14T12:31:40.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:39 smithi047 ceph-mon[31254]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 54 MiB/s wr, 6.27k op/s 2024-05-14T12:31:40.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:39 smithi073 ceph-mon[35809]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 54 MiB/s wr, 6.27k op/s 2024-05-14T12:31:42.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:41 smithi066 ceph-mon[35981]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 51 MiB/s wr, 5.83k op/s 2024-05-14T12:31:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:41 smithi047 ceph-mon[31254]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 51 MiB/s wr, 5.83k op/s 2024-05-14T12:31:42.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:41 smithi073 ceph-mon[35809]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 51 MiB/s wr, 5.83k op/s 2024-05-14T12:31:42.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.891+0000 7fbdffe00700 1 -- 172.21.15.47:0/3081551727 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562032803590 con 0x5620329597c0 2024-05-14T12:31:42.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.891+0000 7fbdffe00700 10 client.25807 handle_command_reply: tid=0 2024-05-14T12:31:42.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.892+0000 7fbe337c7b80 1 client.25807 shutdown 2024-05-14T12:31:42.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.892+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 msgr2=0x5620329579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:42.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.892+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620329579e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe1801aa50 tx=0x7fbe18013630 comp rx=0 tx=0).stop 2024-05-14T12:31:42.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 shutdown_connections 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5620329597c0 0x56203295bbe0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620328d8ea0 0x5620329579e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562032755fd0 0x5620328e24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 --2- 172.21.15.47:0/3081551727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5620328d46a0 0x5620328e2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 >> 172.21.15.47:0/3081551727 conn(0x562032794c10 msgr2=0x5620328db2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbdffe00700 0 client.25807 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 shutdown_connections 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.893+0000 7fbe337c7b80 1 -- 172.21.15.47:0/3081551727 wait complete. 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.894+0000 7fbe337c7b80 20 client.25807 trim_cache size 0 max 16384 2024-05-14T12:31:42.895 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 34, 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 14, 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "db6e35f4": { 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 14, 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:31:42.896 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 90.0, 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:31:42.897 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.895+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe040b2900 msgr2=0x7fbe040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.895+0000 7fbe1f200700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe040b2900 0x7fbe040b4e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009ec0 tx=0x7fbe18013480 comp rx=0 tx=0).stop 2024-05-14T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.895+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20104400 msgr2=0x7fbe2019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.895+0000 7fbe1f200700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20104400 0x7fbe2019ceb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000e9a0 tx=0x7fbe1000ecb0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.896+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 shutdown_connections 2024-05-14T12:31:42.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.896+0000 7fbe1f200700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbe040b2900 0x7fbe040b4e10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.896+0000 7fbe1f200700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20109680 0x7fbe201a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.896+0000 7fbe1f200700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe20104400 0x7fbe2019ceb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.896+0000 7fbe1f200700 1 --2- 172.21.15.47:0/543739985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe20108d30 0x7fbe2019d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.896+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 >> 172.21.15.47:0/543739985 conn(0x7fbe20079d10 msgr2=0x7fbe2010f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.896+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 shutdown_connections 2024-05-14T12:31:42.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:31:42.897+0000 7fbe1f200700 1 -- 172.21.15.47:0/543739985 wait complete. 2024-05-14T12:31:43.910 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'db6e35f4', quiesce took 40.1 seconds. Will release after: 30.0 2024-05-14T12:31:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:43 smithi066 ceph-mon[35981]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 39 MiB/s wr, 4.60k op/s 2024-05-14T12:31:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:43 smithi047 ceph-mon[31254]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 39 MiB/s wr, 4.60k op/s 2024-05-14T12:31:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:43 smithi073 ceph-mon[35809]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 39 MiB/s wr, 4.60k op/s 2024-05-14T12:31:46.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:45 smithi066 ceph-mon[35981]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 MiB/s wr, 5.24k op/s 2024-05-14T12:31:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:45 smithi047 ceph-mon[31254]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 MiB/s wr, 5.24k op/s 2024-05-14T12:31:46.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:45 smithi073 ceph-mon[35809]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 MiB/s wr, 5.24k op/s 2024-05-14T12:31:48.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:47 smithi066 ceph-mon[35981]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 MiB/s wr, 4.96k op/s 2024-05-14T12:31:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:47 smithi047 ceph-mon[31254]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 MiB/s wr, 4.96k op/s 2024-05-14T12:31:48.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:47 smithi073 ceph-mon[35809]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 42 MiB/s wr, 4.96k op/s 2024-05-14T12:31:49.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:48 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:49.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:48 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:49.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:48 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:50.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:49 smithi066 ceph-mon[35981]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 MiB/s wr, 5.12k op/s 2024-05-14T12:31:50.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:49 smithi047 ceph-mon[31254]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 MiB/s wr, 5.12k op/s 2024-05-14T12:31:50.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:49 smithi073 ceph-mon[35809]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 MiB/s wr, 5.12k op/s 2024-05-14T12:31:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:51 smithi047 ceph-mon[31254]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 47 MiB/s wr, 5.55k op/s 2024-05-14T12:31:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:51 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:52.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:51 smithi073 ceph-mon[35809]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 47 MiB/s wr, 5.55k op/s 2024-05-14T12:31:52.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:51 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:52.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:51 smithi066 ceph-mon[35981]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 47 MiB/s wr, 5.55k op/s 2024-05-14T12:31:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:51 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:54.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:53 smithi047 ceph-mon[31254]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 42 MiB/s wr, 5.01k op/s 2024-05-14T12:31:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:53 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:54.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:53 smithi073 ceph-mon[35809]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 42 MiB/s wr, 5.01k op/s 2024-05-14T12:31:54.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:53 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:53 smithi066 ceph-mon[35981]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 42 MiB/s wr, 5.01k op/s 2024-05-14T12:31:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:53 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:31:56.201 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:55 smithi047 ceph-mon[31254]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 43 MiB/s wr, 5.03k op/s 2024-05-14T12:31:56.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:55 smithi073 ceph-mon[35809]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 43 MiB/s wr, 5.03k op/s 2024-05-14T12:31:56.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:55 smithi066 ceph-mon[35981]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 43 MiB/s wr, 5.03k op/s 2024-05-14T12:31:58.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:57 smithi047 ceph-mon[31254]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 38 MiB/s wr, 4.52k op/s 2024-05-14T12:31:58.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:57 smithi073 ceph-mon[35809]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 38 MiB/s wr, 4.52k op/s 2024-05-14T12:31:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:57 smithi066 ceph-mon[35981]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 38 MiB/s wr, 4.52k op/s 2024-05-14T12:32:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:31:59 smithi047 ceph-mon[31254]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 43 MiB/s wr, 5.22k op/s 2024-05-14T12:32:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:31:59 smithi073 ceph-mon[35809]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 43 MiB/s wr, 5.22k op/s 2024-05-14T12:32:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:31:59 smithi066 ceph-mon[35981]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 43 MiB/s wr, 5.22k op/s 2024-05-14T12:32:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.472+0000 7fdee1600640 1 -- 172.21.15.47:0/1798486937 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e062db4fd0 con 0x55e062a3b1c0 2024-05-14T12:32:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.472+0000 7fdee1600640 10 client.25802 handle_command_reply: tid=0 2024-05-14T12:32:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.472+0000 7fdf013d6740 1 client.25802 shutdown 2024-05-14T12:32:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.472+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 msgr2=0x55e062e787a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.472+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e787a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdedc018530 tx=0x7fdedc0a5960 comp rx=0 tx=0).stop 2024-05-14T12:32:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.474+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 shutdown_connections 2024-05-14T12:32:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.474+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e062a3b1c0 0x55e062ed3c30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.474+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e062aa71b0 0x55e062e79630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.474+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e062a864d0 0x55e062e787a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.474+0000 7fdf013d6740 1 --2- 172.21.15.47:0/1798486937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e062a7e2f0 0x55e062e78260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.474+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 >> 172.21.15.47:0/1798486937 conn(0x55e062a9b300 msgr2=0x55e062e4bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.474+0000 7fdee1600640 0 client.25802 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.475+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 shutdown_connections 2024-05-14T12:32:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.475+0000 7fdf013d6740 1 -- 172.21.15.47:0/1798486937 wait complete. 2024-05-14T12:32:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.475+0000 7fdf013d6740 20 client.25802 trim_cache size 0 max 16384 2024-05-14T12:32:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:32:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:32:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:32:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.476+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fded80b2920 msgr2=0x7fded80b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.476+0000 7fdef8e00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fded80b2920 0x7fded80b4e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdee402a910 tx=0x7fdee4000bc0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 msgr2=0x7fdef419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 0x7fdef419a540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00e9f0 tx=0x7fdedc00eeb0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 shutdown_connections 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fded80b2920 0x7fded80b4e30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef4109700 0x7fdef41a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4106bd0 0x7fdef419a540 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 --2- 172.21.15.47:0/1006525665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdef41041e0 0x7fdef419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 >> 172.21.15.47:0/1006525665 conn(0x7fdef40fdb60 msgr2=0x7fdef410a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 shutdown_connections 2024-05-14T12:32:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:00.477+0000 7fdef8e00640 1 -- 172.21.15.47:0/1006525665 wait complete. 2024-05-14T12:32:02.126 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:01 smithi066 ceph-mon[35981]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 43 MiB/s wr, 5.28k op/s 2024-05-14T12:32:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:01 smithi047 ceph-mon[31254]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 43 MiB/s wr, 5.28k op/s 2024-05-14T12:32:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:01 smithi073 ceph-mon[35809]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 43 MiB/s wr, 5.28k op/s 2024-05-14T12:32:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:03 smithi047 ceph-mon[31254]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 40 MiB/s wr, 4.88k op/s 2024-05-14T12:32:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:03 smithi073 ceph-mon[35809]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 40 MiB/s wr, 4.88k op/s 2024-05-14T12:32:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:03 smithi066 ceph-mon[35981]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 40 MiB/s wr, 4.88k op/s 2024-05-14T12:32:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:05 smithi047 ceph-mon[31254]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 4.74k op/s 2024-05-14T12:32:06.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:05 smithi073 ceph-mon[35809]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 4.74k op/s 2024-05-14T12:32:06.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:05 smithi066 ceph-mon[35981]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 4.74k op/s 2024-05-14T12:32:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:07 smithi047 ceph-mon[31254]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 35 MiB/s wr, 4.47k op/s 2024-05-14T12:32:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:07 smithi073 ceph-mon[35809]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 35 MiB/s wr, 4.47k op/s 2024-05-14T12:32:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:07 smithi066 ceph-mon[35981]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 35 MiB/s wr, 4.47k op/s 2024-05-14T12:32:09.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:08 smithi047 ceph-mon[31254]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 4.95k op/s 2024-05-14T12:32:09.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:08 smithi073 ceph-mon[35809]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 4.95k op/s 2024-05-14T12:32:09.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:08 smithi066 ceph-mon[35981]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 4.95k op/s 2024-05-14T12:32:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:10 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:11.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:10 smithi047 ceph-mon[31254]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 3.69k op/s 2024-05-14T12:32:11.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:10 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:11.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:10 smithi073 ceph-mon[35809]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 3.69k op/s 2024-05-14T12:32:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:10 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:11.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:10 smithi066 ceph-mon[35981]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 3.69k op/s 2024-05-14T12:32:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.894+0000 7f17b4400640 1 -- 172.21.15.47:0/2767949807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 msgr2=0x7f17ac10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.894+0000 7f17b4400640 1 --2- 172.21.15.47:0/2767949807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 0x7f17ac10b8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1798009860 tx=0x7f179802a340 comp rx=0 tx=0).stop 2024-05-14T12:32:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.895+0000 7f17b4400640 1 -- 172.21.15.47:0/2767949807 shutdown_connections 2024-05-14T12:32:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.895+0000 7f17b4400640 1 --2- 172.21.15.47:0/2767949807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac1101e0 0x7f17ac112600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.895+0000 7f17b4400640 1 --2- 172.21.15.47:0/2767949807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 0x7f17ac10b8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.895+0000 7f17b4400640 1 --2- 172.21.15.47:0/2767949807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17ac10a2a0 0x7f17ac10afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.895+0000 7f17b4400640 1 -- 172.21.15.47:0/2767949807 >> 172.21.15.47:0/2767949807 conn(0x7f17ac078eb0 msgr2=0x7f17ac107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.895+0000 7f17b4400640 1 -- 172.21.15.47:0/2767949807 shutdown_connections 2024-05-14T12:32:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.895+0000 7f17b4400640 1 -- 172.21.15.47:0/2767949807 wait complete. 2024-05-14T12:32:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.896+0000 7f17b4400640 1 Processor -- start 2024-05-14T12:32:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.897+0000 7f17b4400640 1 -- start start 2024-05-14T12:32:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.898+0000 7f17b4400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac10a2a0 0x7f17ac071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.898+0000 7f17b4400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 0x7f17ac0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.899+0000 7f17b1a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac10a2a0 0x7f17ac071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.899+0000 7f17b4400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17ac1101e0 0x7f17ac073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.900+0000 7f17b4400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac115dc0 con 0x7f17ac1101e0 2024-05-14T12:32:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.900+0000 7f17b4400640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac115c40 con 0x7f17ac10a2a0 2024-05-14T12:32:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.900+0000 7f17b4400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac115f40 con 0x7f17ac10b4e0 2024-05-14T12:32:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.900+0000 7f17b1a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac10a2a0 0x7f17ac071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57540/0 (socket says 172.21.15.47:57540) 2024-05-14T12:32:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.900+0000 7f17b1000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 0x7f17ac0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.900+0000 7f17b1000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 0x7f17ac0720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55278/0 (socket says 172.21.15.47:55278) 2024-05-14T12:32:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.900+0000 7f17b1000640 1 -- 172.21.15.47:0/2103306509 learned_addr learned my addr 172.21.15.47:0/2103306509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.902+0000 7f17b2400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17ac1101e0 0x7f17ac073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.902+0000 7f17b1a00640 1 -- 172.21.15.47:0/2103306509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 msgr2=0x7f17ac0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.902+0000 7f17b1a00640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 0x7f17ac0720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.902+0000 7f17b1a00640 1 -- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17ac1101e0 msgr2=0x7f17ac073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.902+0000 7f17b1a00640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17ac1101e0 0x7f17ac073010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.902+0000 7f17b1a00640 1 -- 172.21.15.47:0/2103306509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac073680 con 0x7f17ac10a2a0 2024-05-14T12:32:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.903+0000 7f17b1a00640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac10a2a0 0x7f17ac071b70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17ac10aea0 tx=0x7f17a000dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.906+0000 7f17aa000640 1 -- 172.21.15.47:0/2103306509 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a0017070 con 0x7f17ac10a2a0 2024-05-14T12:32:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.906+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac073970 con 0x7f17ac10a2a0 2024-05-14T12:32:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.906+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac073ec0 con 0x7f17ac10a2a0 2024-05-14T12:32:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.906+0000 7f17aa000640 1 -- 172.21.15.47:0/2103306509 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17a0010460 con 0x7f17ac10a2a0 2024-05-14T12:32:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.906+0000 7f17aa000640 1 -- 172.21.15.47:0/2103306509 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a000f600 con 0x7f17ac10a2a0 2024-05-14T12:32:13.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:32:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.918+0000 7f17bb418740 1 Processor -- start 2024-05-14T12:32:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.918+0000 7f17aa000640 1 -- 172.21.15.47:0/2103306509 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f17a001a070 con 0x7f17ac10a2a0 2024-05-14T12:32:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.920+0000 7f17bb418740 1 -- start start 2024-05-14T12:32:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.921+0000 7f17bb418740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841e44100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.921+0000 7f17bb418740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e44680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.921+0000 7f17bb418740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a814d0 0x561841e4b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.921+0000 7f17bb418740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561841da8550 con 0x561841a792f0 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.921+0000 7f17bb418740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561841d4dbc0 con 0x561841aa21b0 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.921+0000 7f17bb418740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561841da4510 con 0x561841a814d0 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.922+0000 7f17b2400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841e44100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.922+0000 7f17aa000640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f17940b2a70 0x7f17940b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.922+0000 7f17b2400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841e44100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57546/0 (socket says 172.21.15.47:57546) 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.922+0000 7f17b2400640 1 -- 172.21.15.47:0/1563372601 learned_addr learned my addr 172.21.15.47:0/1563372601 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.923+0000 7f17aa000640 1 -- 172.21.15.47:0/2103306509 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f17a00e1ab0 con 0x7f17ac10a2a0 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.923+0000 7f17b1000640 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a814d0 0x561841e4b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.924+0000 7f17b1a00640 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e44680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.924+0000 7f17b2400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f17940b2a70 0x7f17940b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.925+0000 7f17b2400640 1 -- 172.21.15.47:0/1563372601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a814d0 msgr2=0x561841e4b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.925+0000 7f17b2400640 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a814d0 0x561841e4b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.925+0000 7f17b2400640 1 -- 172.21.15.47:0/1563372601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 msgr2=0x561841e44680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.925+0000 7f17b2400640 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e44680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.925+0000 7f17b2400640 1 -- 172.21.15.47:0/1563372601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561841aba210 con 0x561841aa21b0 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.925+0000 7f17b1000640 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a814d0 0x561841e4b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.925+0000 7f17b1a00640 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e44680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.926+0000 7f17b2400640 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841e44100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f17a4005c40 tx=0x7f17a4013e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b6ea6b9ed823f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.926+0000 7f17b2400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f17940b2a70 0x7f17940b4f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17a4013fd0 tx=0x7f17a401c000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.927+0000 7f179ea00640 1 -- 172.21.15.47:0/1563372601 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4023070 con 0x561841aa21b0 2024-05-14T12:32:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.927+0000 7f179ea00640 1 -- 172.21.15.47:0/1563372601 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17a4013250 con 0x561841aa21b0 2024-05-14T12:32:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.927+0000 7f179ea00640 1 -- 172.21.15.47:0/1563372601 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4023070 con 0x561841aa21b0 2024-05-14T12:32:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.930+0000 7f17bb418740 1 -- 172.21.15.47:0/1563372601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 msgr2=0x561841e44100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.930+0000 7f17bb418740 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841e44100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f17a4005c40 tx=0x7f17a4013e40 comp rx=0 tx=0).stop 2024-05-14T12:32:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.930+0000 7f17bb418740 1 -- 172.21.15.47:0/1563372601 shutdown_connections 2024-05-14T12:32:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.930+0000 7f17bb418740 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a814d0 0x561841e4b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.930+0000 7f17bb418740 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e44680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.930+0000 7f17bb418740 1 --2- 172.21.15.47:0/1563372601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841e44100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.930+0000 7f17bb418740 1 -- 172.21.15.47:0/1563372601 >> 172.21.15.47:0/1563372601 conn(0x561841a96300 msgr2=0x561841e3fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.931+0000 7f17bb418740 1 -- 172.21.15.47:0/1563372601 shutdown_connections 2024-05-14T12:32:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.931+0000 7f17bb418740 1 -- 172.21.15.47:0/1563372601 wait complete. 2024-05-14T12:32:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.932+0000 7f17bb418740 1 -- start start 2024-05-14T12:32:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.932+0000 7f17bb418740 1 Processor -- start 2024-05-14T12:32:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.934+0000 7f17bb418740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a792f0 0x561841e4dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.935+0000 7f17bb418740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e4e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.935+0000 7f17bb418740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.935+0000 7f17b1a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a792f0 0x561841e4dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.935+0000 7f17bb418740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561841e4bf70 con 0x561841a814d0 2024-05-14T12:32:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.935+0000 7f17bb418740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561841d61660 con 0x561841a792f0 2024-05-14T12:32:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.935+0000 7f17bb418740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561841e4c0f0 con 0x561841aa21b0 2024-05-14T12:32:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.936+0000 7f17b2400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.936+0000 7f17b2400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55300/0 (socket says 172.21.15.47:55300) 2024-05-14T12:32:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.936+0000 7f17b2400640 1 -- 172.21.15.47:0/764203946 learned_addr learned my addr 172.21.15.47:0/764203946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.936+0000 7f17b1000640 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e4e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.936+0000 7f17bb418740 10 client.0 _ll_register_callbacks cb 0x561841d2b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.937+0000 7f17b2400640 1 -- 172.21.15.47:0/764203946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a792f0 msgr2=0x561841e4dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.937+0000 7f17b2400640 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a792f0 0x561841e4dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.937+0000 7f17b2400640 1 -- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 msgr2=0x561841e4e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.937+0000 7f17b2400640 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e4e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.937+0000 7f17b2400640 1 -- 172.21.15.47:0/764203946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561841b86620 con 0x561841aa21b0 2024-05-14T12:32:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.937+0000 7f1793400640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:32:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.938+0000 7f17b2400640 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e550c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f17a400a010 tx=0x7f17a4011fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b20b7cc758520de server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.938+0000 7f1793400640 1 -- 172.21.15.47:0/764203946 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4034060 con 0x561841aa21b0 2024-05-14T12:32:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.938+0000 7f1793400640 1 -- 172.21.15.47:0/764203946 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f17a4003970 con 0x561841aa21b0 2024-05-14T12:32:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.939+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17a4013250 con 0x561841aa21b0 2024-05-14T12:32:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.939+0000 7f1793400640 1 -- 172.21.15.47:0/764203946 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f17a4023040 con 0x561841aa21b0 2024-05-14T12:32:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.939+0000 7f17bb418740 10 client.25831 fetch_fsmap learned FSMap version 38 2024-05-14T12:32:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.940+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561841e58040 con 0x561841aa21b0 2024-05-14T12:32:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.940+0000 7f1793400640 1 -- 172.21.15.47:0/764203946 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17a4013250 con 0x561841aa21b0 2024-05-14T12:32:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.943+0000 7f1793400640 1 -- 172.21.15.47:0/764203946 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f17a401fab0 con 0x561841aa21b0 2024-05-14T12:32:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.943+0000 7f17bb418740 10 client.25831 fetch_fsmap finished waiting for FSMap version 38 2024-05-14T12:32:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.943+0000 7f17bb418740 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:32:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.944+0000 7f17bb418740 20 client.25831 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.944+0000 7f17bb418740 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a60d80 0x561841e5b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.944+0000 7f17bb418740 4 client.25831 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:32:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.944+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561841db6160 con 0x561841a60d80 2024-05-14T12:32:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.945+0000 7f17b1a00640 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a60d80 0x561841e5b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.946+0000 7f17b1a00640 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a60d80 0x561841e5b4c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=548f584a4b9f025f server_cookie=50deb6a957dae30c in_seq=0 out_seq=0 2024-05-14T12:32:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.946+0000 7f1793400640 10 client.25831 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.949+0000 7f1793400640 1 -- 172.21.15.47:0/764203946 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561841db6160 con 0x561841a60d80 2024-05-14T12:32:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.949+0000 7f1793400640 10 client.25831 handle_command_reply: tid=0 2024-05-14T12:32:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.949+0000 7f17bb418740 1 client.25831 shutdown 2024-05-14T12:32:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.950+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 msgr2=0x561841e550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.950+0000 7f17bb418740 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e550c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f17a400a010 tx=0x7f17a4011fa0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 shutdown_connections 2024-05-14T12:32:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f17bb418740 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a60d80 0x561841e5b4c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f17bb418740 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e550c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f17bb418740 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e4e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f17bb418740 1 --2- 172.21.15.47:0/764203946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a792f0 0x561841e4dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 >> 172.21.15.47:0/764203946 conn(0x561841a96300 msgr2=0x561841e3ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f1793400640 0 client.25831 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.951+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 shutdown_connections 2024-05-14T12:32:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.952+0000 7f17bb418740 1 -- 172.21.15.47:0/764203946 wait complete. 2024-05-14T12:32:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:13.952+0000 7f17bb418740 20 client.25831 trim_cache size 0 max 16384 2024-05-14T12:32:13.992 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:13 smithi047 ceph-mon[31254]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 2.79k op/s 2024-05-14T12:32:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.001+0000 7f17bb418740 1 Processor -- start 2024-05-14T12:32:14.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:13 smithi073 ceph-mon[35809]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 2.79k op/s 2024-05-14T12:32:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.001+0000 7f17bb418740 1 -- start start 2024-05-14T12:32:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.002+0000 7f17bb418740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e4d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.002+0000 7f17bb418740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a814d0 0x561841e54fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.002+0000 7f17bb418740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e5fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.003+0000 7f17b1000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a814d0 0x561841e54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.003+0000 7f17b1000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a814d0 0x561841e54fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57568/0 (socket says 172.21.15.47:57568) 2024-05-14T12:32:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.004+0000 7f17b1000640 1 -- 172.21.15.47:0/2285704445 learned_addr learned my addr 172.21.15.47:0/2285704445 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.004+0000 7f17b2400640 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e5fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.004+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f178c00e590 con 0x561841a792f0 2024-05-14T12:32:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.004+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f178c010100 con 0x561841a814d0 2024-05-14T12:32:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.004+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f178c00ec60 con 0x561841aa21b0 2024-05-14T12:32:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.005+0000 7f17b1000640 1 -- 172.21.15.47:0/2285704445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 msgr2=0x561841e5fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.005+0000 7f17b1000640 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e5fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.005+0000 7f17b1000640 1 -- 172.21.15.47:0/2285704445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 msgr2=0x561841e4d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.006+0000 7f17b1000640 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e4d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.006+0000 7f17b1000640 1 -- 172.21.15.47:0/2285704445 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561841e3b280 con 0x561841a814d0 2024-05-14T12:32:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.006+0000 7f17b2400640 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e5fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.007+0000 7f17b1000640 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a814d0 0x561841e54fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1798009250 tx=0x7f1798030450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b37c2f506e26973 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.007+0000 7f179e000640 1 -- 172.21.15.47:0/2285704445 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798037040 con 0x561841a814d0 2024-05-14T12:32:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.008+0000 7f179e000640 1 -- 172.21.15.47:0/2285704445 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1798004030 con 0x561841a814d0 2024-05-14T12:32:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.009+0000 7f179e000640 1 -- 172.21.15.47:0/2285704445 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798037040 con 0x561841a814d0 2024-05-14T12:32:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.010+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a814d0 msgr2=0x561841e54fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.011+0000 7f17bb418740 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a814d0 0x561841e54fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1798009250 tx=0x7f1798030450 comp rx=0 tx=0).stop 2024-05-14T12:32:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.012+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 shutdown_connections 2024-05-14T12:32:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.012+0000 7f17bb418740 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841aa21b0 0x561841e5fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.012+0000 7f17bb418740 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841a814d0 0x561841e54fe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.012+0000 7f17bb418740 1 --2- 172.21.15.47:0/2285704445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a792f0 0x561841e4d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.013+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 >> 172.21.15.47:0/2285704445 conn(0x561841a96300 msgr2=0x561841e4ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.013+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 shutdown_connections 2024-05-14T12:32:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.013+0000 7f17bb418740 1 -- 172.21.15.47:0/2285704445 wait complete. 2024-05-14T12:32:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.015+0000 7f17bb418740 1 -- start start 2024-05-14T12:32:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.016+0000 7f17bb418740 1 Processor -- start 2024-05-14T12:32:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.018+0000 7f17bb418740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a792f0 0x561841e54600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.018+0000 7f17bb418740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e54b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.018+0000 7f17bb418740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841ec1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.018+0000 7f17bb418740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f178c00fa30 con 0x561841a814d0 2024-05-14T12:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.018+0000 7f17bb418740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f178c00f330 con 0x561841aa21b0 2024-05-14T12:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.018+0000 7f17bb418740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f178c00c550 con 0x561841a792f0 2024-05-14T12:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.019+0000 7f17bb418740 10 client.0 _ll_register_callbacks cb 0x7f17a00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.020+0000 7f17b1a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a792f0 0x561841e54600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.020+0000 7f17b1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e54b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.020+0000 7f17b2400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841ec1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.020+0000 7f17b2400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841ec1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57574/0 (socket says 172.21.15.47:57574) 2024-05-14T12:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.020+0000 7f17b2400640 1 -- 172.21.15.47:0/157223028 learned_addr learned my addr 172.21.15.47:0/157223028 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.021+0000 7f17b2400640 1 -- 172.21.15.47:0/157223028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a792f0 msgr2=0x561841e54600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.021+0000 7f17b2400640 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a792f0 0x561841e54600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.021+0000 7f17b2400640 1 -- 172.21.15.47:0/157223028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 msgr2=0x561841e54b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.021+0000 7f17b2400640 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e54b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.021+0000 7f17b2400640 1 -- 172.21.15.47:0/157223028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561841ec2230 con 0x561841aa21b0 2024-05-14T12:32:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.024+0000 7f1793400640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:32:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.024+0000 7f17b2400640 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841ec1c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009540 tx=0x7f17a402c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4419a670cfc0c73 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.024+0000 7f1793400640 1 -- 172.21.15.47:0/157223028 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4034040 con 0x561841aa21b0 2024-05-14T12:32:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.025+0000 7f1793400640 1 -- 172.21.15.47:0/157223028 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f17a40123f0 con 0x561841aa21b0 2024-05-14T12:32:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.025+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1798004030 con 0x561841aa21b0 2024-05-14T12:32:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.026+0000 7f1793400640 1 -- 172.21.15.47:0/157223028 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f17a403e080 con 0x561841aa21b0 2024-05-14T12:32:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.026+0000 7f17bb418740 10 client.25820 fetch_fsmap learned FSMap version 38 2024-05-14T12:32:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.027+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561841ec34f0 con 0x561841aa21b0 2024-05-14T12:32:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.027+0000 7f1793400640 1 -- 172.21.15.47:0/157223028 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1798004030 con 0x561841aa21b0 2024-05-14T12:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.031+0000 7f1793400640 1 -- 172.21.15.47:0/157223028 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f17a401fab0 con 0x561841aa21b0 2024-05-14T12:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.031+0000 7f17bb418740 10 client.25820 fetch_fsmap finished waiting for FSMap version 38 2024-05-14T12:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.031+0000 7f17bb418740 10 client.25820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.032+0000 7f17bb418740 20 client.25820 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.032+0000 7f17bb418740 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a361c0 0x561841ec5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.032+0000 7f17bb418740 4 client.25820 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.032+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561841daffd0 con 0x561841a361c0 2024-05-14T12:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.033+0000 7f17b1a00640 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a361c0 0x561841ec5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:14.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.035+0000 7f17b1a00640 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a361c0 0x561841ec5df0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=992a6ac3fae7914f server_cookie=5137a5fb7407071b in_seq=0 out_seq=0 2024-05-14T12:32:14.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:14.035+0000 7f1793400640 10 client.25820 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:14.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:13 smithi066 ceph-mon[35981]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 2.79k op/s 2024-05-14T12:32:14.530 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:32:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:15 smithi047 ceph-mon[31254]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 2.16k op/s 2024-05-14T12:32:16.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:15 smithi073 ceph-mon[35809]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 2.16k op/s 2024-05-14T12:32:16.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:15 smithi066 ceph-mon[35981]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 2.16k op/s 2024-05-14T12:32:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.120+0000 7f1793400640 1 -- 172.21.15.47:0/157223028 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561841daffd0 con 0x561841a361c0 2024-05-14T12:32:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.120+0000 7f1793400640 10 client.25820 handle_command_reply: tid=0 2024-05-14T12:32:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.120+0000 7f17bb418740 1 client.25820 shutdown 2024-05-14T12:32:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 msgr2=0x561841ec1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841ec1c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009540 tx=0x7f17a402c000 comp rx=0 tx=0).stop 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 shutdown_connections 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x561841a361c0 0x561841ec5df0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561841aa21b0 0x561841ec1c40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561841a814d0 0x561841e54b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 --2- 172.21.15.47:0/157223028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561841a792f0 0x561841e54600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 >> 172.21.15.47:0/157223028 conn(0x561841a96300 msgr2=0x561841e42940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.121+0000 7f1793400640 0 client.25820 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.122+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 shutdown_connections 2024-05-14T12:32:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.122+0000 7f17bb418740 1 -- 172.21.15.47:0/157223028 wait complete. 2024-05-14T12:32:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.122+0000 7f17bb418740 20 client.25820 trim_cache size 0 max 16384 2024-05-14T12:32:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:32:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:32:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:32:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:32:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.123+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f17940b2a70 msgr2=0x7f17940b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f17940b2a70 0x7f17940b4f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17a4013fd0 tx=0x7f17a401c000 comp rx=0 tx=0).stop 2024-05-14T12:32:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac10a2a0 msgr2=0x7f17ac071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac10a2a0 0x7f17ac071b70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17ac10aea0 tx=0x7f17a000dbb0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 shutdown_connections 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f17940b2a70 0x7f17940b4f80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17ac1101e0 0x7f17ac073010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ac10b4e0 0x7f17ac0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 --2- 172.21.15.47:0/2103306509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17ac10a2a0 0x7f17ac071b70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 >> 172.21.15.47:0/2103306509 conn(0x7f17ac078eb0 msgr2=0x7f17ac10c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 shutdown_connections 2024-05-14T12:32:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:16.124+0000 7f17b4400640 1 -- 172.21.15.47:0/2103306509 wait complete. 2024-05-14T12:32:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.169+0000 7f6916800700 1 -- 172.21.15.47:0/2888686809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 msgr2=0x7f6910110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.169+0000 7f6916800700 1 --2- 172.21.15.47:0/2888686809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 0x7f6910110d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6900009990 tx=0x7f6900009ca0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.169+0000 7f6916800700 1 -- 172.21.15.47:0/2888686809 shutdown_connections 2024-05-14T12:32:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.170+0000 7f6916800700 1 --2- 172.21.15.47:0/2888686809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f691010b2e0 0x7f6910117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.170+0000 7f6916800700 1 --2- 172.21.15.47:0/2888686809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 0x7f6910110d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.170+0000 7f6916800700 1 --2- 172.21.15.47:0/2888686809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f691010a990 0x7f691010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.170+0000 7f6916800700 1 -- 172.21.15.47:0/2888686809 >> 172.21.15.47:0/2888686809 conn(0x7f6910077c80 msgr2=0x7f69100780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.170+0000 7f6916800700 1 -- 172.21.15.47:0/2888686809 shutdown_connections 2024-05-14T12:32:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.170+0000 7f6916800700 1 -- 172.21.15.47:0/2888686809 wait complete. 2024-05-14T12:32:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.171+0000 7f6916800700 1 Processor -- start 2024-05-14T12:32:17.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.172+0000 7f6916800700 1 -- start start 2024-05-14T12:32:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.172+0000 7f6916800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f691010a990 0x7f69101a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.172+0000 7f6916800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f691010b2e0 0x7f69101a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.172+0000 7f6916800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 0x7f69101a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.172+0000 7f6916800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f691011aac0 con 0x7f691010a990 2024-05-14T12:32:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.172+0000 7f6916800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f691011a940 con 0x7f6910110970 2024-05-14T12:32:17.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.172+0000 7f6916800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f691011ac40 con 0x7f691010b2e0 2024-05-14T12:32:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f691010a990 0x7f69101a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 0x7f69101a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f691010b2e0 0x7f69101a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:17.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 0x7f69101a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57592/0 (socket says 172.21.15.47:57592) 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690fe00700 1 -- 172.21.15.47:0/3700820570 learned_addr learned my addr 172.21.15.47:0/3700820570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690ea00700 1 -- 172.21.15.47:0/3700820570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 msgr2=0x7f69101a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690ea00700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 0x7f69101a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690ea00700 1 -- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f691010a990 msgr2=0x7f69101a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690ea00700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f691010a990 0x7f69101a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690ea00700 1 -- 172.21.15.47:0/3700820570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69101a6350 con 0x7f691010b2e0 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.173+0000 7f690f400700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f691010a990 0x7f69101a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:17.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.174+0000 7f690ea00700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f691010b2e0 0x7f69101a1a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e9c0 tx=0x7f68fc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.174+0000 7f6907e00700 1 -- 172.21.15.47:0/3700820570 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc00c9c0 con 0x7f691010b2e0 2024-05-14T12:32:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.174+0000 7f6907e00700 1 -- 172.21.15.47:0/3700820570 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68fc00cb60 con 0x7f691010b2e0 2024-05-14T12:32:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.174+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69101a6640 con 0x7f691010b2e0 2024-05-14T12:32:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.174+0000 7f6907e00700 1 -- 172.21.15.47:0/3700820570 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc018680 con 0x7f691010b2e0 2024-05-14T12:32:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.174+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101adf60 con 0x7f691010b2e0 2024-05-14T12:32:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.175+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69100512c0 con 0x7f691010b2e0 2024-05-14T12:32:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.179+0000 7f6907e00700 1 -- 172.21.15.47:0/3700820570 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f68fc010430 con 0x7f691010b2e0 2024-05-14T12:32:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.180+0000 7f6907e00700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68f40b2900 0x7f68f40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.180+0000 7f6907e00700 1 -- 172.21.15.47:0/3700820570 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f68fc0e2680 con 0x7f691010b2e0 2024-05-14T12:32:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.180+0000 7f690f400700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68f40b2900 0x7f68f40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.181+0000 7f690f400700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68f40b2900 0x7f68f40b4e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6900009750 tx=0x7f690000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.181+0000 7f6907e00700 1 -- 172.21.15.47:0/3700820570 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f68fc0aa360 con 0x7f691010b2e0 2024-05-14T12:32:17.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.469+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69101a27e0 con 0x7f691010b2e0 2024-05-14T12:32:17.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.470+0000 7f6907e00700 1 -- 172.21.15.47:0/3700820570 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11920 (secure 0 0 0) 0x7f68fc0a9c60 con 0x7f691010b2e0 2024-05-14T12:32:17.471 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:32:17.471 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:32:09.834663+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:32:17.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.474+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68f40b2900 msgr2=0x7f68f40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:17.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.474+0000 7f6916800700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68f40b2900 0x7f68f40b4e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6900009750 tx=0x7f690000b260 comp rx=0 tx=0).stop 2024-05-14T12:32:17.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.474+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f691010b2e0 msgr2=0x7f69101a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:17.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.474+0000 7f6916800700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f691010b2e0 0x7f69101a1a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e9c0 tx=0x7f68fc00ecd0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 shutdown_connections 2024-05-14T12:32:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f68f40b2900 0x7f68f40b4e10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6910110970 0x7f69101a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f691010a990 0x7f69101a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 --2- 172.21.15.47:0/3700820570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f691010b2e0 0x7f69101a1a70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 >> 172.21.15.47:0/3700820570 conn(0x7f6910077c80 msgr2=0x7f691007bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:17.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 shutdown_connections 2024-05-14T12:32:17.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:17.475+0000 7f6916800700 1 -- 172.21.15.47:0/3700820570 wait complete. 2024-05-14T12:32:17.478 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 38 2024-05-14T12:32:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:17 smithi047 ceph-mon[31254]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 2.00k op/s 2024-05-14T12:32:17.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:17 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3700820570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:32:18.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:17 smithi073 ceph-mon[35809]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 2.00k op/s 2024-05-14T12:32:18.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:17 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3700820570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:32:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:17 smithi066 ceph-mon[35981]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 2.00k op/s 2024-05-14T12:32:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:17 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3700820570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:32:18.345 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id db6e35f4 --release --await' 2024-05-14T12:32:18.346 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id db6e35f4 --release --await 2024-05-14T12:32:18.855 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:32:19.650 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:19 smithi047 ceph-mon[31254]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 2.13k op/s 2024-05-14T12:32:20.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:19 smithi073 ceph-mon[35809]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 2.13k op/s 2024-05-14T12:32:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:19 smithi066 ceph-mon[35981]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 2.13k op/s 2024-05-14T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.497+0000 7f303be00700 1 -- 172.21.15.47:0/2353940197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c104400 msgr2=0x7f303c104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.497+0000 7f303be00700 1 --2- 172.21.15.47:0/2353940197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c104400 0x7f303c104810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f302c0099c0 tx=0x7f302c009cd0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.497+0000 7f303be00700 1 -- 172.21.15.47:0/2353940197 shutdown_connections 2024-05-14T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.497+0000 7f303be00700 1 --2- 172.21.15.47:0/2353940197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c109680 0x7f303c110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.497+0000 7f303be00700 1 --2- 172.21.15.47:0/2353940197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c104400 0x7f303c104810 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.497+0000 7f303be00700 1 --2- 172.21.15.47:0/2353940197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 0x7f303c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.497+0000 7f303be00700 1 -- 172.21.15.47:0/2353940197 >> 172.21.15.47:0/2353940197 conn(0x7f303c079d50 msgr2=0x7f303c07a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.498+0000 7f303be00700 1 -- 172.21.15.47:0/2353940197 shutdown_connections 2024-05-14T12:32:21.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.498+0000 7f303be00700 1 -- 172.21.15.47:0/2353940197 wait complete. 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.499+0000 7f303be00700 1 Processor -- start 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.499+0000 7f303be00700 1 -- start start 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.499+0000 7f303be00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c104400 0x7f303c076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c108d30 0x7f303c077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c109680 0x7f303c077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f303c114300 con 0x7f303c109680 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303be00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f303c114180 con 0x7f303c104400 2024-05-14T12:32:21.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303be00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f303c114480 con 0x7f303c108d30 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c104400 0x7f303c076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c104400 0x7f303c076bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:55960/0 (socket says 172.21.15.47:55960) 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 -- 172.21.15.47:0/3635233987 learned_addr learned my addr 172.21.15.47:0/3635233987 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303b400700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c109680 0x7f303c077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f3032000700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c108d30 0x7f303c077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 -- 172.21.15.47:0/3635233987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c108d30 msgr2=0x7f303c077110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c108d30 0x7f303c077110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 -- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c109680 msgr2=0x7f303c077650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c109680 0x7f303c077650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303aa00700 1 -- 172.21.15.47:0/3635233987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c1a8ff0 con 0x7f303c104400 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.500+0000 7f303b400700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c109680 0x7f303c077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.501+0000 7f303aa00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c104400 0x7f303c076bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f302c005910 tx=0x7f302c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.501+0000 7f3033e00700 1 -- 172.21.15.47:0/3635233987 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c026070 con 0x7f303c104400 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.501+0000 7f3033e00700 1 -- 172.21.15.47:0/3635233987 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f302c003c70 con 0x7f303c104400 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.501+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303c1a9280 con 0x7f303c104400 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.501+0000 7f3033e00700 1 -- 172.21.15.47:0/3635233987 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c00fb50 con 0x7f303c104400 2024-05-14T12:32:21.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.501+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303c1a9730 con 0x7f303c104400 2024-05-14T12:32:21.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.505+0000 7f3033e00700 1 -- 172.21.15.47:0/3635233987 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f302c029070 con 0x7f303c104400 2024-05-14T12:32:21.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.506+0000 7f3050606b80 1 Processor -- start 2024-05-14T12:32:21.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.506+0000 7f3050606b80 1 -- start start 2024-05-14T12:32:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.506+0000 7f3033e00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f30200b2900 0x7f30200b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3050606b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b2675af40 0x563b268d90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3033e00700 1 -- 172.21.15.47:0/3635233987 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f302c0e2a50 con 0x7f303c104400 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3050606b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3050606b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268dde10 0x563b268de220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3050606b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563b267fab20 con 0x563b2675af40 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3050606b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563b26798860 con 0x563b268d9610 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3050606b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563b267f6ae0 con 0x563b268dde10 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f303b400700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f30200b2900 0x7f30200b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268dd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:55970/0 (socket says 172.21.15.47:55970) 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 -- 172.21.15.47:0/1199191883 learned_addr learned my addr 172.21.15.47:0/1199191883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f303aa00700 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b2675af40 0x563b268d90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f303b400700 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268dde10 0x563b268de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 -- 172.21.15.47:0/1199191883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268dde10 msgr2=0x563b268de220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268dde10 0x563b268de220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 -- 172.21.15.47:0/1199191883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b2675af40 msgr2=0x563b268d90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b2675af40 0x563b268d90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f3032000700 1 -- 172.21.15.47:0/1199191883 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b267479d0 con 0x563b268d9610 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.507+0000 7f303aa00700 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b2675af40 0x563b268d90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.508+0000 7f3032000700 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268dd8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3024009cf0 tx=0x7f3024011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee118e494ce68415 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.508+0000 7f303b400700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f30200b2900 0x7f30200b4e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f30340094f0 tx=0x7f3034009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:21.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.508+0000 7f302be00700 1 -- 172.21.15.47:0/1199191883 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024011d80 con 0x563b268d9610 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.508+0000 7f302be00700 1 -- 172.21.15.47:0/1199191883 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3024004500 con 0x563b268d9610 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.508+0000 7f302be00700 1 -- 172.21.15.47:0/1199191883 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024005310 con 0x563b268d9610 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 -- 172.21.15.47:0/1199191883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 msgr2=0x563b268dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268dd8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3024009cf0 tx=0x7f3024011440 comp rx=0 tx=0).stop 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 -- 172.21.15.47:0/1199191883 shutdown_connections 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268dde10 0x563b268de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b2675af40 0x563b268d90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 --2- 172.21.15.47:0/1199191883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268dd8d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 -- 172.21.15.47:0/1199191883 >> 172.21.15.47:0/1199191883 conn(0x563b26799b80 msgr2=0x563b268d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 -- 172.21.15.47:0/1199191883 shutdown_connections 2024-05-14T12:32:21.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.509+0000 7f3050606b80 1 -- 172.21.15.47:0/1199191883 wait complete. 2024-05-14T12:32:21.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.510+0000 7f3050606b80 1 -- start start 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.510+0000 7f3050606b80 1 Processor -- start 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3050606b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3050606b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268d9610 0x563b268e3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3050606b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268dde10 0x563b268e3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3050606b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563b268e5dc0 con 0x563b268d9610 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3050606b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563b26760c20 con 0x563b268dde10 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3050606b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563b268e5f40 con 0x563b2675af40 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3050606b80 10 client.0 _ll_register_callbacks cb 0x563b2678e480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55888/0 (socket says 172.21.15.47:55888) 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 -- 172.21.15.47:0/1276145715 learned_addr learned my addr 172.21.15.47:0/1276145715 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:21.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f3032000700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268d9610 0x563b268e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 -- 172.21.15.47:0/1276145715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268dde10 msgr2=0x563b268e3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303b400700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268dde10 0x563b268e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268dde10 0x563b268e3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 -- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268d9610 msgr2=0x563b268e3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268d9610 0x563b268e3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303aa00700 1 -- 172.21.15.47:0/1276145715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b267c0520 con 0x563b2675af40 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.511+0000 7f303b400700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268dde10 0x563b268e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f303aa00700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e2ac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f302c0a9dc0 tx=0x7f302c0a9830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ce14fddc5001fdc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3028c00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3028c00700 1 -- 172.21.15.47:0/1276145715 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0a9bd0 con 0x563b2675af40 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3028c00700 1 -- 172.21.15.47:0/1276145715 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f302c0b2c10 con 0x563b2675af40 2024-05-14T12:32:21.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3024004500 con 0x563b2675af40 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3028c00700 1 -- 172.21.15.47:0/1276145715 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f302c0aa7c0 con 0x563b2675af40 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3050606b80 10 client.25855 fetch_fsmap learned FSMap version 38 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563b268e5e20 con 0x563b2675af40 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.512+0000 7f3028c00700 1 -- 172.21.15.47:0/1276145715 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3024004500 con 0x563b2675af40 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3028c00700 1 -- 172.21.15.47:0/1276145715 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f302c0a9320 con 0x563b2675af40 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3050606b80 10 client.25855 fetch_fsmap finished waiting for FSMap version 38 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3050606b80 10 client.25855 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3050606b80 20 client.25855 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3050606b80 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b268f2ef0 0x563b268f5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3050606b80 4 client.25855 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b268a5170 con 0x563b268f2ef0 2024-05-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.513+0000 7f3032000700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b268f2ef0 0x563b268f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.514+0000 7f3028c00700 10 client.25855 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.514+0000 7f3032000700 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b268f2ef0 0x563b268f5350 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dee10a8f1577f117 server_cookie=8cb51d22da45b0fe in_seq=0 out_seq=0 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3028c00700 1 -- 172.21.15.47:0/1276145715 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b268a5170 con 0x563b268f2ef0 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3028c00700 10 client.25855 handle_command_reply: tid=0 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 client.25855 shutdown 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 msgr2=0x563b268e2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e2ac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f302c0a9dc0 tx=0x7f302c0a9830 comp rx=0 tx=0).stop 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 shutdown_connections 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b268f2ef0 0x563b268f5350 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268dde10 0x563b268e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e2ac0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 --2- 172.21.15.47:0/1276145715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268d9610 0x563b268e3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3028c00700 0 client.25855 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:21.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 >> 172.21.15.47:0/1276145715 conn(0x563b26799b80 msgr2=0x563b268de220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:21.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 shutdown_connections 2024-05-14T12:32:21.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 1 -- 172.21.15.47:0/1276145715 wait complete. 2024-05-14T12:32:21.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.515+0000 7f3050606b80 20 client.25855 trim_cache size 0 max 16384 2024-05-14T12:32:21.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.538+0000 7f3050606b80 1 Processor -- start 2024-05-14T12:32:21.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.538+0000 7f3050606b80 1 -- start start 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f3050606b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f3050606b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268de930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f3050606b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268eee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f3050606b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f303c1b0ba0 con 0x563b268dde10 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f3050606b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f303c1b2710 con 0x563b268d9610 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f3050606b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f303c1b1270 con 0x563b2675af40 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f303aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f303aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55902/0 (socket says 172.21.15.47:55902) 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f3032000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268de930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.539+0000 7f303aa00700 1 -- 172.21.15.47:0/3520102388 learned_addr learned my addr 172.21.15.47:0/3520102388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f303aa00700 1 -- 172.21.15.47:0/3520102388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 msgr2=0x563b268de930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f303aa00700 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268de930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f303b400700 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f303aa00700 1 -- 172.21.15.47:0/3520102388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 msgr2=0x563b268eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f303aa00700 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268eee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f303aa00700 1 -- 172.21.15.47:0/3520102388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b268e5310 con 0x563b2675af40 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f303aa00700 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e3380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f302c0a96e0 tx=0x7f302c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82dc41820932c75a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f302b400700 1 -- 172.21.15.47:0/3520102388 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0aa0c0 con 0x563b2675af40 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f302b400700 1 -- 172.21.15.47:0/3520102388 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f302c0b2e90 con 0x563b2675af40 2024-05-14T12:32:21.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.540+0000 7f302b400700 1 -- 172.21.15.47:0/3520102388 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0a9320 con 0x563b2675af40 2024-05-14T12:32:21.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 -- 172.21.15.47:0/3520102388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 msgr2=0x563b268e3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e3380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f302c0a96e0 tx=0x7f302c009310 comp rx=0 tx=0).stop 2024-05-14T12:32:21.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 -- 172.21.15.47:0/3520102388 shutdown_connections 2024-05-14T12:32:21.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b2675af40 0x563b268e3380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 --2- 172.21.15.47:0/3520102388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b268d9610 0x563b268de930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 -- 172.21.15.47:0/3520102388 >> 172.21.15.47:0/3520102388 conn(0x563b26799b80 msgr2=0x563b268de220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 -- 172.21.15.47:0/3520102388 shutdown_connections 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.541+0000 7f3050606b80 1 -- 172.21.15.47:0/3520102388 wait complete. 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.542+0000 7f3050606b80 1 -- start start 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.542+0000 7f3050606b80 1 Processor -- start 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.542+0000 7f3050606b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b2675af40 0x563b268eb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.542+0000 7f3050606b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268d9610 0x563b268e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.542+0000 7f3050606b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.542+0000 7f3050606b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f303c1b2040 con 0x563b268dde10 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f3050606b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f303c1b1940 con 0x563b2675af40 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f3050606b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f303c1aeb20 con 0x563b268d9610 2024-05-14T12:32:21.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f3050606b80 10 client.0 _ll_register_callbacks cb 0x563b2678e480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b2675af40 0x563b268eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f3032000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268d9610 0x563b268e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b2675af40 0x563b268eb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56000/0 (socket says 172.21.15.47:56000) 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 -- 172.21.15.47:0/2049903516 learned_addr learned my addr 172.21.15.47:0/2049903516 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f3032000700 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268d9610 0x563b268e7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55908/0 (socket says 172.21.15.47:55908) 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303b400700 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 -- 172.21.15.47:0/2049903516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268d9610 msgr2=0x563b268e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268d9610 0x563b268e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 -- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 msgr2=0x563b268e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268e7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 -- 172.21.15.47:0/2049903516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b268e8760 con 0x563b2675af40 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f303aa00700 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b2675af40 0x563b268eb730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f302c0a9b80 tx=0x7f302c0a5b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba70f995b497042 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:21.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.543+0000 7f3028c00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3028c00700 1 -- 172.21.15.47:0/2049903516 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0aa0c0 con 0x563b2675af40 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3028c00700 1 -- 172.21.15.47:0/2049903516 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f302c0a5bb0 con 0x563b2675af40 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f302c0b2e90 con 0x563b2675af40 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3028c00700 1 -- 172.21.15.47:0/2049903516 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f302c0a9320 con 0x563b2675af40 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 10 client.25841 fetch_fsmap learned FSMap version 38 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563b2695e610 con 0x563b2675af40 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3028c00700 1 -- 172.21.15.47:0/2049903516 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f302c0b2e90 con 0x563b2675af40 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3028c00700 1 -- 172.21.15.47:0/2049903516 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f302c0e09d0 con 0x563b2675af40 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 10 client.25841 fetch_fsmap finished waiting for FSMap version 38 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 10 client.25841 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 20 client.25841 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b2695e9d0 0x563b26960df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 4 client.25841 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "db6e35f4", "release": true, "await": true}] 2024-05-14T12:32:21.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.544+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "db6e35f4", "release": true, "await": true}) -- 0x563b26808500 con 0x563b2695e9d0 2024-05-14T12:32:21.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.545+0000 7f3032000700 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b2695e9d0 0x563b26960df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:21.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.545+0000 7f3032000700 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b2695e9d0 0x563b26960df0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea2f2943d3f9149 server_cookie=65f2d26eb9e11042 in_seq=0 out_seq=0 2024-05-14T12:32:21.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.545+0000 7f3028c00700 10 client.25841 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.593+0000 7f3028c00700 1 -- 172.21.15.47:0/2049903516 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x563b26808500 con 0x563b2695e9d0 2024-05-14T12:32:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.593+0000 7f3028c00700 10 client.25841 handle_command_reply: tid=0 2024-05-14T12:32:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.594+0000 7f3050606b80 1 client.25841 shutdown 2024-05-14T12:32:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.594+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b2675af40 msgr2=0x563b268eb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.594+0000 7f3050606b80 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b2675af40 0x563b268eb730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f302c0a9b80 tx=0x7f302c0a5b00 comp rx=0 tx=0).stop 2024-05-14T12:32:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.595+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 shutdown_connections 2024-05-14T12:32:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.595+0000 7f3050606b80 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563b2695e9d0 0x563b26960df0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.595+0000 7f3050606b80 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b268dde10 0x563b268e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.595+0000 7f3050606b80 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563b2675af40 0x563b268eb730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.595+0000 7f3050606b80 1 --2- 172.21.15.47:0/2049903516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b268d9610 0x563b268e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.595+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 >> 172.21.15.47:0/2049903516 conn(0x563b26799b80 msgr2=0x563b268e0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.595+0000 7f3028c00700 0 client.25841 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.600+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 shutdown_connections 2024-05-14T12:32:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.600+0000 7f3050606b80 1 -- 172.21.15.47:0/2049903516 wait complete. 2024-05-14T12:32:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.600+0000 7f3050606b80 20 client.25841 trim_cache size 0 max 16384 2024-05-14T12:32:21.601 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 38, 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 16, 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "db6e35f4": { 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 16, 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:32:21.602 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 90.0, 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:32:21.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:32:21.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:32:21.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:32:21.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:32:21.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:32:21.604 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:32:21.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.603+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f30200b2900 msgr2=0x7f30200b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.603+0000 7f303be00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f30200b2900 0x7f30200b4e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f30340094f0 tx=0x7f3034009920 comp rx=0 tx=0).stop 2024-05-14T12:32:21.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.603+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c104400 msgr2=0x7f303c076bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:21.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.603+0000 7f303be00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c104400 0x7f303c076bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f302c005910 tx=0x7f302c004270 comp rx=0 tx=0).stop 2024-05-14T12:32:21.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.608+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 shutdown_connections 2024-05-14T12:32:21.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.608+0000 7f303be00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f30200b2900 0x7f30200b4e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.608+0000 7f303be00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c109680 0x7f303c077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.608+0000 7f303be00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f303c104400 0x7f303c076bd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.608+0000 7f303be00700 1 --2- 172.21.15.47:0/3635233987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c108d30 0x7f303c077110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:21.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.608+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 >> 172.21.15.47:0/3635233987 conn(0x7f303c079d50 msgr2=0x7f303c1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:21.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.610+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 shutdown_connections 2024-05-14T12:32:21.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:21.612+0000 7f303be00700 1 -- 172.21.15.47:0/3635233987 wait complete. 2024-05-14T12:32:21.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:21 smithi047 ceph-mon[31254]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 1.36k op/s 2024-05-14T12:32:22.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:21 smithi073 ceph-mon[35809]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 1.36k op/s 2024-05-14T12:32:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:21 smithi066 ceph-mon[35981]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 1.36k op/s 2024-05-14T12:32:22.504 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'db6e35f4', seconds elapsed: 78.7 2024-05-14T12:32:22.505 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-14T12:32:22.505 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:32:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:32:23.738 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:23 smithi047 ceph-mon[31254]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 1.94k op/s 2024-05-14T12:32:24.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:23 smithi073 ceph-mon[35809]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 1.94k op/s 2024-05-14T12:32:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:23 smithi066 ceph-mon[35981]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 1.94k op/s 2024-05-14T12:32:25.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:25 smithi047 ceph-mon[31254]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 2.51k op/s 2024-05-14T12:32:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:25 smithi073 ceph-mon[35809]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 2.51k op/s 2024-05-14T12:32:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:25 smithi066 ceph-mon[35981]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 2.51k op/s 2024-05-14T12:32:26.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.965+0000 7f872ca00700 1 -- 172.21.15.47:0/2133932188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 msgr2=0x7f8728104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:26.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.965+0000 7f872ca00700 1 --2- 172.21.15.47:0/2133932188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f8728104a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f87180099c0 tx=0x7f8718009cd0 comp rx=0 tx=0).stop 2024-05-14T12:32:26.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.965+0000 7f872ca00700 1 -- 172.21.15.47:0/2133932188 shutdown_connections 2024-05-14T12:32:26.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.965+0000 7f872ca00700 1 --2- 172.21.15.47:0/2133932188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728109870 0x7f87281111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:26.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.965+0000 7f872ca00700 1 --2- 172.21.15.47:0/2133932188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f8728104a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:26.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.965+0000 7f872ca00700 1 --2- 172.21.15.47:0/2133932188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8728108f20 0x7f8728109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:26.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.965+0000 7f872ca00700 1 -- 172.21.15.47:0/2133932188 >> 172.21.15.47:0/2133932188 conn(0x7f8728100040 msgr2=0x7f8728102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:26.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.966+0000 7f872ca00700 1 -- 172.21.15.47:0/2133932188 shutdown_connections 2024-05-14T12:32:26.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.968+0000 7f872ca00700 1 -- 172.21.15.47:0/2133932188 wait complete. 2024-05-14T12:32:26.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.969+0000 7f872ca00700 1 Processor -- start 2024-05-14T12:32:26.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.970+0000 7f872ca00700 1 -- start start 2024-05-14T12:32:26.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.971+0000 7f872ca00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f87281a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:26.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.971+0000 7f872ca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728108f20 0x7f87281a2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:26.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.971+0000 7f872ca00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8728109870 0x7f87281ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:26.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.971+0000 7f8725e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f87281a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:26.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.971+0000 7f8725e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f87281a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55928/0 (socket says 172.21.15.47:55928) 2024-05-14T12:32:26.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.971+0000 7f8725400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728108f20 0x7f87281a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:26.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.971+0000 7f8725400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728108f20 0x7f87281a2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46566/0 (socket says 172.21.15.47:46566) 2024-05-14T12:32:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.972+0000 7f872ca00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8728114560 con 0x7f8728108f20 2024-05-14T12:32:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.972+0000 7f872ca00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f87281143e0 con 0x7f8728109870 2024-05-14T12:32:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.972+0000 7f872ca00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f87281146e0 con 0x7f87281045f0 2024-05-14T12:32:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.972+0000 7f8725e00700 1 -- 172.21.15.47:0/1202872700 learned_addr learned my addr 172.21.15.47:0/1202872700 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.972+0000 7f8726800700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8728109870 0x7f87281ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.972+0000 7f8725e00700 1 -- 172.21.15.47:0/1202872700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8728109870 msgr2=0x7f87281ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f8725e00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8728109870 0x7f87281ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f8725e00700 1 -- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728108f20 msgr2=0x7f87281a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f8725e00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728108f20 0x7f87281a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f8725e00700 1 -- 172.21.15.47:0/1202872700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87281a3060 con 0x7f87281045f0 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f8726800700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8728109870 0x7f87281ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f8725400700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728108f20 0x7f87281a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f8725e00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f87281a2240 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f871800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:26.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f871ea00700 1 -- 172.21.15.47:0/1202872700 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718026070 con 0x7f87281045f0 2024-05-14T12:32:26.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f871ea00700 1 -- 172.21.15.47:0/1202872700 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f871800fe30 con 0x7f87281045f0 2024-05-14T12:32:26.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.973+0000 7f871ea00700 1 -- 172.21.15.47:0/1202872700 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718004b90 con 0x7f87281045f0 2024-05-14T12:32:26.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.974+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87281ad8c0 con 0x7f87281045f0 2024-05-14T12:32:26.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.974+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87281adcc0 con 0x7f87281045f0 2024-05-14T12:32:26.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.976+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87280512c0 con 0x7f87281045f0 2024-05-14T12:32:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.978+0000 7f871ea00700 1 -- 172.21.15.47:0/1202872700 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8718029070 con 0x7f87281045f0 2024-05-14T12:32:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.981+0000 7f871ea00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f870c0b2900 0x7f870c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.982+0000 7f871ea00700 1 -- 172.21.15.47:0/1202872700 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f87180e2cc0 con 0x7f87281045f0 2024-05-14T12:32:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.982+0000 7f8725400700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f870c0b2900 0x7f870c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:26.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.983+0000 7f8725400700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f870c0b2900 0x7f870c0b4e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f87281037e0 tx=0x7f8714009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:26.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:26.985+0000 7f871ea00700 1 -- 172.21.15.47:0/1202872700 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f87180e9080 con 0x7f87281045f0 2024-05-14T12:32:27.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.306+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87281adf20 con 0x7f87281045f0 2024-05-14T12:32:27.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.307+0000 7f871ea00700 1 -- 172.21.15.47:0/1202872700 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11920 (secure 0 0 0) 0x7f8718013070 con 0x7f87281045f0 2024-05-14T12:32:27.307 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:32:27.307 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:32:09.834663+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:32:27.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f870c0b2900 msgr2=0x7f870c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:27.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f870c0b2900 0x7f870c0b4e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f87281037e0 tx=0x7f8714009190 comp rx=0 tx=0).stop 2024-05-14T12:32:27.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 msgr2=0x7f87281a2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:27.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f87281a2240 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f871800fa00 comp rx=0 tx=0).stop 2024-05-14T12:32:27.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 shutdown_connections 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f870c0b2900 0x7f870c0b4e10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8728109870 0x7f87281ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87281045f0 0x7f87281a2240 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 --2- 172.21.15.47:0/1202872700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8728108f20 0x7f87281a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 >> 172.21.15.47:0/1202872700 conn(0x7f8728100040 msgr2=0x7f8728102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 shutdown_connections 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:27.310+0000 7f872ca00700 1 -- 172.21.15.47:0/1202872700 wait complete. 2024-05-14T12:32:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 38 2024-05-14T12:32:27.718 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:27 smithi047 ceph-mon[31254]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 35 MiB/s wr, 3.65k op/s 2024-05-14T12:32:27.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:27 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1202872700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:32:28.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:27 smithi073 ceph-mon[35809]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 35 MiB/s wr, 3.65k op/s 2024-05-14T12:32:28.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:27 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1202872700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:32:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:27 smithi066 ceph-mon[35981]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 35 MiB/s wr, 3.65k op/s 2024-05-14T12:32:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:27 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1202872700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:32:28.203 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-14T12:32:28.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-14T12:32:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:32:29.071 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:28 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:29.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:28 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:29.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:28 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 -- 172.21.15.47:0/4131799885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8075a10 msgr2=0x7f62b810b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 --2- 172.21.15.47:0/4131799885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8075a10 0x7f62b810b6a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009900 tx=0x7f62a402a410 comp rx=0 tx=0).stop 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 -- 172.21.15.47:0/4131799885 shutdown_connections 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 --2- 172.21.15.47:0/4131799885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b810bbe0 0x7f62b810e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 --2- 172.21.15.47:0/4131799885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8075a10 0x7f62b810b6a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 --2- 172.21.15.47:0/4131799885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b80750c0 0x7f62b80754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 -- 172.21.15.47:0/4131799885 >> 172.21.15.47:0/4131799885 conn(0x7f62b80fee60 msgr2=0x7f62b8101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 -- 172.21.15.47:0/4131799885 shutdown_connections 2024-05-14T12:32:29.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.379+0000 7f62bfe00640 1 -- 172.21.15.47:0/4131799885 wait complete. 2024-05-14T12:32:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 Processor -- start 2024-05-14T12:32:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 -- start start 2024-05-14T12:32:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b80750c0 0x7f62b819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8075a10 0x7f62b819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b810bbe0 0x7f62b81a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81119f0 con 0x7f62b8075a10 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8111870 con 0x7f62b80750c0 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.380+0000 7f62bfe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8111b70 con 0x7f62b810bbe0 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8075a10 0x7f62b819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8075a10 0x7f62b819c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40366/0 (socket says 172.21.15.47:40366) 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bd400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b80750c0 0x7f62b819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b810bbe0 0x7f62b81a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 -- 172.21.15.47:0/560796202 learned_addr learned my addr 172.21.15.47:0/560796202 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 -- 172.21.15.47:0/560796202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b810bbe0 msgr2=0x7f62b81a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b810bbe0 0x7f62b81a3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 -- 172.21.15.47:0/560796202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b80750c0 msgr2=0x7f62b819c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b80750c0 0x7f62b819c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bca00640 1 -- 172.21.15.47:0/560796202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b81a3fc0 con 0x7f62b8075a10 2024-05-14T12:32:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bde00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b810bbe0 0x7f62b81a3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.381+0000 7f62bd400640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b80750c0 0x7f62b819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.382+0000 7f62bca00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8075a10 0x7f62b819c9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f62a4031440 tx=0x7f62a4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.382+0000 7f62b6000640 1 -- 172.21.15.47:0/560796202 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a403f070 con 0x7f62b8075a10 2024-05-14T12:32:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.382+0000 7f62b6000640 1 -- 172.21.15.47:0/560796202 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62a4031c50 con 0x7f62b8075a10 2024-05-14T12:32:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.382+0000 7f62b6000640 1 -- 172.21.15.47:0/560796202 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4035030 con 0x7f62b8075a10 2024-05-14T12:32:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.382+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b81a4250 con 0x7f62b8075a10 2024-05-14T12:32:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.382+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b81a4740 con 0x7f62b8075a10 2024-05-14T12:32:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.387+0000 7f62c6d66740 1 Processor -- start 2024-05-14T12:32:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.387+0000 7f62c6d66740 1 -- start start 2024-05-14T12:32:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc627f1b0 0x555cc6621100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc62562f0 0x555cc6621680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 0x555cc6628580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62c6d66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555cc6585550 con 0x555cc625e4d0 2024-05-14T12:32:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62c6d66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555cc652abc0 con 0x555cc62562f0 2024-05-14T12:32:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62c6d66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555cc6581510 con 0x555cc627f1b0 2024-05-14T12:32:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62bd400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc62562f0 0x555cc6621680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62bd400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc62562f0 0x555cc6621680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:47758/0 (socket says 172.21.15.47:47758) 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62bd400640 1 -- 172.21.15.47:0/3487753125 learned_addr learned my addr 172.21.15.47:0/3487753125 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.388+0000 7f62bde00640 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc627f1b0 0x555cc6621100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62bd400640 1 -- 172.21.15.47:0/3487753125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc627f1b0 msgr2=0x555cc6621100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62bd400640 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc627f1b0 0x555cc6621100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62bd400640 1 -- 172.21.15.47:0/3487753125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 msgr2=0x555cc6628580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62bd400640 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 0x555cc6628580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62bd400640 1 -- 172.21.15.47:0/3487753125 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc6297210 con 0x555cc62562f0 2024-05-14T12:32:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62b6000640 1 -- 172.21.15.47:0/560796202 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f62a4042070 con 0x7f62b8075a10 2024-05-14T12:32:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62bd400640 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc62562f0 0x555cc6621680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0114f0 tx=0x7f62ac0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e47f0c9c1031359c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62aa600640 1 -- 172.21.15.47:0/3487753125 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac01e070 con 0x555cc62562f0 2024-05-14T12:32:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62aa600640 1 -- 172.21.15.47:0/3487753125 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62ac0035f0 con 0x555cc62562f0 2024-05-14T12:32:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.389+0000 7f62aa600640 1 -- 172.21.15.47:0/3487753125 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00f820 con 0x555cc62562f0 2024-05-14T12:32:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.391+0000 7f62c6d66740 1 -- 172.21.15.47:0/3487753125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc62562f0 msgr2=0x555cc6621680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.391+0000 7f62c6d66740 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc62562f0 0x555cc6621680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0114f0 tx=0x7f62ac0119b0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.391+0000 7f62c6d66740 1 -- 172.21.15.47:0/3487753125 shutdown_connections 2024-05-14T12:32:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.391+0000 7f62c6d66740 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 0x555cc6628580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.391+0000 7f62c6d66740 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc62562f0 0x555cc6621680 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.391+0000 7f62c6d66740 1 --2- 172.21.15.47:0/3487753125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc627f1b0 0x555cc6621100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.391+0000 7f62c6d66740 1 -- 172.21.15.47:0/3487753125 >> 172.21.15.47:0/3487753125 conn(0x555cc6273300 msgr2=0x555cc661ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.392+0000 7f62c6d66740 1 -- 172.21.15.47:0/3487753125 shutdown_connections 2024-05-14T12:32:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.392+0000 7f62c6d66740 1 -- 172.21.15.47:0/3487753125 wait complete. 2024-05-14T12:32:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.392+0000 7f62b6000640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62a00b2830 0x7f62a00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.392+0000 7f62b6000640 1 -- 172.21.15.47:0/560796202 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f62a41029c0 con 0x7f62b8075a10 2024-05-14T12:32:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.392+0000 7f62bd400640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62a00b2830 0x7f62a00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.392+0000 7f62c6d66740 1 -- start start 2024-05-14T12:32:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 1 Processor -- start 2024-05-14T12:32:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62bd400640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62a00b2830 0x7f62a00b4d40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e20 tx=0x7f62ac005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 0x555cc662b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc66320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555cc6628fd0 con 0x555cc625e4d0 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555cc653e660 con 0x555cc627f1b0 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555cc6629150 con 0x555cc62562f0 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62c6d66740 10 client.0 _ll_register_callbacks cb 0x555cc6508400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62bd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62bd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56654/0 (socket says 172.21.15.47:56654) 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.393+0000 7f62bd400640 1 -- 172.21.15.47:0/898247676 learned_addr learned my addr 172.21.15.47:0/898247676 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bde00640 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc66320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bca00640 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 0x555cc662b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bd400640 1 -- 172.21.15.47:0/898247676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 msgr2=0x555cc66320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bd400640 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc66320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bd400640 1 -- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 msgr2=0x555cc662b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bd400640 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 0x555cc662b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bd400640 1 -- 172.21.15.47:0/898247676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc6363620 con 0x555cc62562f0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f62bd400640 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662ac20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0114f0 tx=0x7f62ac0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd46c6cbee589e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.394+0000 7f629ea00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.395+0000 7f629ea00640 1 -- 172.21.15.47:0/898247676 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac01e040 con 0x555cc62562f0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.395+0000 7f629ea00640 1 -- 172.21.15.47:0/898247676 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f62ac00fa90 con 0x555cc62562f0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.395+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62ac0035f0 con 0x555cc62562f0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.395+0000 7f629ea00640 1 -- 172.21.15.47:0/898247676 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f62ac00fc90 con 0x555cc62562f0 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.395+0000 7f62c6d66740 10 client.25879 fetch_fsmap learned FSMap version 39 2024-05-14T12:32:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.395+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555cc6635060 con 0x555cc62562f0 2024-05-14T12:32:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.395+0000 7f629ea00640 1 -- 172.21.15.47:0/898247676 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62ac0035f0 con 0x555cc62562f0 2024-05-14T12:32:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.396+0000 7f629ea00640 1 -- 172.21.15.47:0/898247676 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f62ac01a460 con 0x555cc62562f0 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.396+0000 7f62c6d66740 10 client.25879 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.396+0000 7f62c6d66740 10 client.25879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.397+0000 7f62c6d66740 20 client.25879 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.397+0000 7f62c6d66740 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc623dd80 0x555cc6638630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.397+0000 7f62c6d66740 4 client.25879 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.397+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cc6593160 con 0x555cc623dd80 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.397+0000 7f62bca00640 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc623dd80 0x555cc6638630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.398+0000 7f62bca00640 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc623dd80 0x555cc6638630 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0cec920ccd2364 server_cookie=2c07b6712c974020 in_seq=0 out_seq=0 2024-05-14T12:32:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.398+0000 7f629ea00640 10 client.25879 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f629ea00640 1 -- 172.21.15.47:0/898247676 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555cc6593160 con 0x555cc623dd80 2024-05-14T12:32:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f629ea00640 10 client.25879 handle_command_reply: tid=0 2024-05-14T12:32:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 client.25879 shutdown 2024-05-14T12:32:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 msgr2=0x555cc662ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662ac20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0114f0 tx=0x7f62ac0119b0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 shutdown_connections 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc623dd80 0x555cc6638630 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc66320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc625e4d0 0x555cc662b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 --2- 172.21.15.47:0/898247676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662ac20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.399+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 >> 172.21.15.47:0/898247676 conn(0x555cc6273300 msgr2=0x555cc661f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.400+0000 7f629ea00640 0 client.25879 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.400+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 shutdown_connections 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.400+0000 7f62c6d66740 1 -- 172.21.15.47:0/898247676 wait complete. 2024-05-14T12:32:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.400+0000 7f62c6d66740 20 client.25879 trim_cache size 0 max 16384 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 Processor -- start 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 -- start start 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc62562f0 0x555cc661c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc625e4d0 0x555cc6632050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc6632590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ad5a0 con 0x555cc62562f0 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81af140 con 0x555cc627f1b0 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62c6d66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81adc70 con 0x555cc625e4d0 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62bca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc625e4d0 0x555cc6632050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62bde00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc6632590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62bca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc625e4d0 0x555cc6632050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56668/0 (socket says 172.21.15.47:56668) 2024-05-14T12:32:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62bca00640 1 -- 172.21.15.47:0/2316848376 learned_addr learned my addr 172.21.15.47:0/2316848376 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.420+0000 7f62bd400640 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc62562f0 0x555cc661c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62bca00640 1 -- 172.21.15.47:0/2316848376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 msgr2=0x555cc6632590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62bca00640 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc6632590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62bca00640 1 -- 172.21.15.47:0/2316848376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc62562f0 msgr2=0x555cc661c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62bca00640 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc62562f0 0x555cc661c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62bca00640 1 -- 172.21.15.47:0/2316848376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc6618280 con 0x555cc625e4d0 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62bca00640 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc625e4d0 0x555cc6632050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000c00 tx=0x7f62a402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9ff34ba7bc40d19 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62a9c00640 1 -- 172.21.15.47:0/2316848376 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a40e9070 con 0x555cc625e4d0 2024-05-14T12:32:29.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62a9c00640 1 -- 172.21.15.47:0/2316848376 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62a40ce350 con 0x555cc625e4d0 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.421+0000 7f62a9c00640 1 -- 172.21.15.47:0/2316848376 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4049040 con 0x555cc625e4d0 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 -- 172.21.15.47:0/2316848376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc625e4d0 msgr2=0x555cc6632050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc625e4d0 0x555cc6632050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000c00 tx=0x7f62a402a410 comp rx=0 tx=0).stop 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 -- 172.21.15.47:0/2316848376 shutdown_connections 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc627f1b0 0x555cc6632590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc625e4d0 0x555cc6632050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 --2- 172.21.15.47:0/2316848376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc62562f0 0x555cc661c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 -- 172.21.15.47:0/2316848376 >> 172.21.15.47:0/2316848376 conn(0x555cc6273300 msgr2=0x555cc661c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 -- 172.21.15.47:0/2316848376 shutdown_connections 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.422+0000 7f62c6d66740 1 -- 172.21.15.47:0/2316848376 wait complete. 2024-05-14T12:32:29.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.423+0000 7f62c6d66740 1 -- start start 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.423+0000 7f62c6d66740 1 Processor -- start 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc625e4d0 0x555cc662fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62c6d66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc627f1b0 0x555cc6630e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62c6d66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81aea40 con 0x555cc627f1b0 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62c6d66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ae340 con 0x555cc625e4d0 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62c6d66740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ab560 con 0x555cc62562f0 2024-05-14T12:32:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62c6d66740 10 client.0 _ll_register_callbacks cb 0x7f62ac01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bca00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc625e4d0 0x555cc662fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:56676/0 (socket says 172.21.15.47:56676) 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 -- 172.21.15.47:0/147030199 learned_addr learned my addr 172.21.15.47:0/147030199 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bde00640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc627f1b0 0x555cc6630e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 -- 172.21.15.47:0/147030199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc625e4d0 msgr2=0x555cc662fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc625e4d0 0x555cc662fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 -- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc627f1b0 msgr2=0x555cc6630e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc627f1b0 0x555cc6630e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.424+0000 7f62bd400640 1 -- 172.21.15.47:0/147030199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc66313e0 con 0x555cc62562f0 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f62bde00640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc627f1b0 0x555cc6630e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f62bca00640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc625e4d0 0x555cc662fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f62bd400640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662f9b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009730 tx=0x7f62ac0036f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd0e54e43b98eaca server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f629ea00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f629ea00640 1 -- 172.21.15.47:0/147030199 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac01e040 con 0x555cc62562f0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f629ea00640 1 -- 172.21.15.47:0/147030199 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f62ac011240 con 0x555cc62562f0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a40ce350 con 0x555cc62562f0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f629ea00640 1 -- 172.21.15.47:0/147030199 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f62ac01a9d0 con 0x555cc62562f0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f62c6d66740 10 client.25885 fetch_fsmap learned FSMap version 39 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.425+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555cc6632670 con 0x555cc62562f0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f629ea00640 1 -- 172.21.15.47:0/147030199 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62a40ce350 con 0x555cc62562f0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f629ea00640 1 -- 172.21.15.47:0/147030199 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f62ac04a050 con 0x555cc62562f0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f62c6d66740 10 client.25885 fetch_fsmap finished waiting for FSMap version 39 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f62c6d66740 10 client.25885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f62c6d66740 20 client.25885 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f62c6d66740 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc62131c0 0x555cc66a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f62c6d66740 4 client.25885 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.426+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cc658cfd0 con 0x555cc62131c0 2024-05-14T12:32:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.427+0000 7f62bca00640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc62131c0 0x555cc66a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:29.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.427+0000 7f62bca00640 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc62131c0 0x555cc66a2d70 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd03ed59259a3772 server_cookie=8de135ef41b54129 in_seq=0 out_seq=0 2024-05-14T12:32:29.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:29.427+0000 7f629ea00640 10 client.25885 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:30.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:29 smithi066 ceph-mon[35981]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 42 MiB/s wr, 4.35k op/s 2024-05-14T12:32:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:29 smithi047 ceph-mon[31254]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 42 MiB/s wr, 4.35k op/s 2024-05-14T12:32:30.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:29 smithi073 ceph-mon[35809]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 42 MiB/s wr, 4.35k op/s 2024-05-14T12:32:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.494+0000 7f6001800700 1 -- 172.21.15.47:0/1136221538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 msgr2=0x7f5ffc112d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.494+0000 7f6001800700 1 --2- 172.21.15.47:0/1136221538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 0x7f5ffc112d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009990 tx=0x7f5fec009ca0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.494+0000 7f6001800700 1 -- 172.21.15.47:0/1136221538 shutdown_connections 2024-05-14T12:32:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.494+0000 7f6001800700 1 --2- 172.21.15.47:0/1136221538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10d2f0 0x7f5ffc119820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.494+0000 7f6001800700 1 --2- 172.21.15.47:0/1136221538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 0x7f5ffc112d90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.494+0000 7f6001800700 1 --2- 172.21.15.47:0/1136221538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ffc10c9a0 0x7f5ffc10cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.494+0000 7f6001800700 1 -- 172.21.15.47:0/1136221538 >> 172.21.15.47:0/1136221538 conn(0x7f5ffc0704d0 msgr2=0x7f5ffc0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.495+0000 7f6001800700 1 -- 172.21.15.47:0/1136221538 shutdown_connections 2024-05-14T12:32:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.496+0000 7f6001800700 1 -- 172.21.15.47:0/1136221538 wait complete. 2024-05-14T12:32:31.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.497+0000 7f6001800700 1 Processor -- start 2024-05-14T12:32:31.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.497+0000 7f6001800700 1 -- start start 2024-05-14T12:32:31.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f6001800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10c9a0 0x7f5ffc1a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f6001800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ffc10d2f0 0x7f5ffc1a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f6001800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 0x7f5ffc1a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f6001800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc11cb50 con 0x7f5ffc10d2f0 2024-05-14T12:32:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f6001800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc11c9d0 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f6001800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc11ccd0 con 0x7f5ffc112980 2024-05-14T12:32:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f5ffbe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10c9a0 0x7f5ffc1a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f5ffbe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10c9a0 0x7f5ffc1a3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:47808/0 (socket says 172.21.15.47:47808) 2024-05-14T12:32:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2230398483 learned_addr learned my addr 172.21.15.47:0/2230398483 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.498+0000 7f5ffb400700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ffc10d2f0 0x7f5ffc1a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.499+0000 7f6000e00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 0x7f5ffc1a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.499+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2230398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 msgr2=0x7f5ffc1a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.499+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 0x7f5ffc1a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.499+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ffc10d2f0 msgr2=0x7f5ffc1a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.499+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ffc10d2f0 0x7f5ffc1a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.499+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2230398483 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc1a8360 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.499+0000 7f6000e00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 0x7f5ffc1a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:32:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.500+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10c9a0 0x7f5ffc1a3540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5fec000c00 tx=0x7f5fec0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.500+0000 7f5ff8c00700 1 -- 172.21.15.47:0/2230398483 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec027070 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.500+0000 7f5ff8c00700 1 -- 172.21.15.47:0/2230398483 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fec003f20 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.500+0000 7f5ff8c00700 1 -- 172.21.15.47:0/2230398483 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec022cd0 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.500+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ffc1a85f0 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.500+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ffc1a8a80 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.505+0000 7f5ff8c00700 1 -- 172.21.15.47:0/2230398483 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5fec02a070 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.507+0000 7f6011a0ab80 1 Processor -- start 2024-05-14T12:32:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.507+0000 7f6011a0ab80 1 -- start start 2024-05-14T12:32:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.508+0000 7f5ff8c00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5fe00b2900 0x7f5fe00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.508+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fc7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.508+0000 7f5ff8c00700 1 -- 172.21.15.47:0/2230398483 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5fec0e3160 con 0x7f5ffc10c9a0 2024-05-14T12:32:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.508+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.508+0000 7f6000e00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5fe00b2900 0x7f5fe00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f5ffbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fc7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f5ffbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fc7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40414/0 (socket says 172.21.15.47:40414) 2024-05-14T12:32:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc88b0 0x558484fdd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558484eeabb0 con 0x558484e4afd0 2024-05-14T12:32:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558484e888f0 con 0x558484fc84a0 2024-05-14T12:32:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558484ee6b70 con 0x558484fc88b0 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2799814639 learned_addr learned my addr 172.21.15.47:0/2799814639 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.509+0000 7f5ffb400700 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2799814639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc88b0 msgr2=0x558484fdd9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc88b0 0x558484fdd9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2799814639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 msgr2=0x558484fdb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f5ffbe00700 1 -- 172.21.15.47:0/2799814639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558484e37a60 con 0x558484e4afd0 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f5ffb400700 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f6000e00700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5fe00b2900 0x7f5fe00b4e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400e350 tx=0x7f5ff4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.510+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fc7f60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5fec003800 tx=0x7f5fec0227a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef7032a9a08bc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:31.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.511+0000 7f5ff1600700 1 -- 172.21.15.47:0/2799814639 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0b35a0 con 0x558484e4afd0 2024-05-14T12:32:31.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.511+0000 7f5ff1600700 1 -- 172.21.15.47:0/2799814639 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fec0e0d30 con 0x558484e4afd0 2024-05-14T12:32:31.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.511+0000 7f5ff1600700 1 -- 172.21.15.47:0/2799814639 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0a9e30 con 0x558484e4afd0 2024-05-14T12:32:31.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 -- 172.21.15.47:0/2799814639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 msgr2=0x558484fc7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:31.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fc7f60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5fec003800 tx=0x7f5fec0227a0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 -- 172.21.15.47:0/2799814639 shutdown_connections 2024-05-14T12:32:31.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc88b0 0x558484fdd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fc7f60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/2799814639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 -- 172.21.15.47:0/2799814639 >> 172.21.15.47:0/2799814639 conn(0x558484e90100 msgr2=0x558484fc3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 -- 172.21.15.47:0/2799814639 shutdown_connections 2024-05-14T12:32:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.512+0000 7f6011a0ab80 1 -- 172.21.15.47:0/2799814639 wait complete. 2024-05-14T12:32:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.513+0000 7f6011a0ab80 1 -- start start 2024-05-14T12:32:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.513+0000 7f6011a0ab80 1 Processor -- start 2024-05-14T12:32:31.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.514+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fdaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.514+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.514+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc88b0 0x558484fdb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.514+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558484fde0d0 con 0x558484fc88b0 2024-05-14T12:32:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.514+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558484e50cb0 con 0x558484fc84a0 2024-05-14T12:32:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.514+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558484fde250 con 0x558484e4afd0 2024-05-14T12:32:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.514+0000 7f6011a0ab80 10 client.0 _ll_register_callbacks cb 0x558484e91e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.515+0000 7f6000e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc88b0 0x558484fdb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.515+0000 7f6000e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc88b0 0x558484fdb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40418/0 (socket says 172.21.15.47:40418) 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.515+0000 7f6000e00700 1 -- 172.21.15.47:0/340392236 learned_addr learned my addr 172.21.15.47:0/340392236 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.515+0000 7f5ffb400700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fdaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f6000e00700 1 -- 172.21.15.47:0/340392236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 msgr2=0x558484fdaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f6000e00700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fdaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f6000e00700 1 -- 172.21.15.47:0/340392236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 msgr2=0x558484fdb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f6000e00700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f6000e00700 1 -- 172.21.15.47:0/340392236 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558484eb05b0 con 0x558484fc88b0 2024-05-14T12:32:31.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fdaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:32:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.516+0000 7f6000e00700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc88b0 0x558484fdb9c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4015a10 tx=0x7f5ff4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef57f5f332835b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.517+0000 7f5fe6000700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:32:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.517+0000 7f5fe6000700 1 -- 172.21.15.47:0/340392236 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4003a00 con 0x558484fc88b0 2024-05-14T12:32:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.517+0000 7f5fe6000700 1 -- 172.21.15.47:0/340392236 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5ff4003ba0 con 0x558484fc88b0 2024-05-14T12:32:31.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.518+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fec0e0d30 con 0x558484fc88b0 2024-05-14T12:32:31.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.518+0000 7f5fe6000700 1 -- 172.21.15.47:0/340392236 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f5ff4003da0 con 0x558484fc88b0 2024-05-14T12:32:31.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.518+0000 7f6011a0ab80 10 client.15732 fetch_fsmap learned FSMap version 40 2024-05-14T12:32:31.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.518+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558484fe8d10 con 0x558484fc88b0 2024-05-14T12:32:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f5fe6000700 1 -- 172.21.15.47:0/340392236 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fec0e0d30 con 0x558484fc88b0 2024-05-14T12:32:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f5fe6000700 1 -- 172.21.15.47:0/340392236 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f5ff4014070 con 0x558484fc88b0 2024-05-14T12:32:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f6011a0ab80 10 client.15732 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:32:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f6011a0ab80 10 client.15732 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:32:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f6011a0ab80 20 client.15732 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558484feb3f0 0x558484fed810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f6011a0ab80 4 client.15732 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:32:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.519+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558484f95350 con 0x558484feb3f0 2024-05-14T12:32:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.520+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558484feb3f0 0x558484fed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:31.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.521+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558484feb3f0 0x558484fed810 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccc698fd51b55451 server_cookie=17e97e9765467879 in_seq=0 out_seq=0 2024-05-14T12:32:31.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:31.521+0000 7f5fe6000700 10 client.15732 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:31 smithi066 ceph-mon[35981]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 MiB/s wr, 5.33k op/s 2024-05-14T12:32:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:31 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:31 smithi047 ceph-mon[31254]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 MiB/s wr, 5.33k op/s 2024-05-14T12:32:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:31 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:32.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:31 smithi073 ceph-mon[35809]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 MiB/s wr, 5.33k op/s 2024-05-14T12:32:32.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:31 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:32:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:33 smithi066 ceph-mon[35981]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 55 MiB/s wr, 6.10k op/s 2024-05-14T12:32:34.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:33 smithi047 ceph-mon[31254]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 55 MiB/s wr, 6.10k op/s 2024-05-14T12:32:34.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:33 smithi073 ceph-mon[35809]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 55 MiB/s wr, 6.10k op/s 2024-05-14T12:32:35.238 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:34 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:32:35.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:34 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:32:35.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:34 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:32:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:35 smithi047 ceph-mon[31254]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 54 MiB/s wr, 6.34k op/s 2024-05-14T12:32:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:35 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:32:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:35 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:32:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:35 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:32:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:35 smithi073 ceph-mon[35809]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 54 MiB/s wr, 6.34k op/s 2024-05-14T12:32:36.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:35 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:32:36.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:35 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:32:36.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:35 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:32:36.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:35 smithi066 ceph-mon[35981]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 54 MiB/s wr, 6.34k op/s 2024-05-14T12:32:36.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:35 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:32:36.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:35 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:32:36.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:35 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:32:38.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:37 smithi047 ceph-mon[31254]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 55 MiB/s wr, 6.94k op/s 2024-05-14T12:32:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:37 smithi073 ceph-mon[35809]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 55 MiB/s wr, 6.94k op/s 2024-05-14T12:32:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:37 smithi066 ceph-mon[35981]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 55 MiB/s wr, 6.94k op/s 2024-05-14T12:32:40.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:39 smithi047 ceph-mon[31254]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 49 MiB/s wr, 6.46k op/s 2024-05-14T12:32:40.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:39 smithi073 ceph-mon[35809]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 49 MiB/s wr, 6.46k op/s 2024-05-14T12:32:40.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:39 smithi066 ceph-mon[35981]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 49 MiB/s wr, 6.46k op/s 2024-05-14T12:32:42.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:41 smithi047 ceph-mon[31254]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 48 MiB/s wr, 6.33k op/s 2024-05-14T12:32:42.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:41 smithi073 ceph-mon[35809]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 48 MiB/s wr, 6.33k op/s 2024-05-14T12:32:42.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:41 smithi066 ceph-mon[35981]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 48 MiB/s wr, 6.33k op/s 2024-05-14T12:32:43.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:42 smithi047 ceph-mon[31254]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 41 MiB/s wr, 5.46k op/s 2024-05-14T12:32:43.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:42 smithi073 ceph-mon[35809]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 41 MiB/s wr, 5.46k op/s 2024-05-14T12:32:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:42 smithi066 ceph-mon[35981]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 41 MiB/s wr, 5.46k op/s 2024-05-14T12:32:45.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:45 smithi047 ceph-mon[31254]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 38 MiB/s wr, 4.87k op/s 2024-05-14T12:32:46.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:45 smithi073 ceph-mon[35809]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 38 MiB/s wr, 4.87k op/s 2024-05-14T12:32:46.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:45 smithi066 ceph-mon[35981]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 38 MiB/s wr, 4.87k op/s 2024-05-14T12:32:47.989 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:47 smithi047 ceph-mon[31254]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 40 MiB/s wr, 4.85k op/s 2024-05-14T12:32:48.004 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:47 smithi073 ceph-mon[35809]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 40 MiB/s wr, 4.85k op/s 2024-05-14T12:32:48.076 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:47 smithi066 ceph-mon[35981]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 40 MiB/s wr, 4.85k op/s 2024-05-14T12:32:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.775+0000 7f629ea00640 1 -- 172.21.15.47:0/147030199 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cc658cfd0 con 0x555cc62131c0 2024-05-14T12:32:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.775+0000 7f629ea00640 10 client.25885 handle_command_reply: tid=0 2024-05-14T12:32:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.775+0000 7f62c6d66740 1 client.25885 shutdown 2024-05-14T12:32:48.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.775+0000 7f5fe6000700 1 -- 172.21.15.47:0/340392236 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f5fec08bc70 con 0x558484feb3f0 2024-05-14T12:32:48.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.775+0000 7f5fe6000700 10 client.15732 handle_command_reply: tid=0 2024-05-14T12:32:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 msgr2=0x555cc662f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662f9b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009730 tx=0x7f62ac0036f0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 shutdown_connections 2024-05-14T12:32:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x555cc62131c0 0x555cc66a2d70 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555cc627f1b0 0x555cc6630e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555cc625e4d0 0x555cc662fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 --2- 172.21.15.47:0/147030199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555cc62562f0 0x555cc662f9b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 >> 172.21.15.47:0/147030199 conn(0x555cc6273300 msgr2=0x555cc662aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.779+0000 7f629ea00640 0 client.25885 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:48.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.777+0000 7f6011a0ab80 1 client.15732 shutdown 2024-05-14T12:32:48.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc88b0 msgr2=0x558484fdb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:48.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc88b0 0x558484fdb9c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4015a10 tx=0x7f5ff4004ad0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.779+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 shutdown_connections 2024-05-14T12:32:48.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 shutdown_connections 2024-05-14T12:32:48.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.778+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558484feb3f0 0x558484fed810 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.779+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc88b0 0x558484fdb9c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.779+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fdaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.779+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/340392236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc84a0 0x558484fdb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.779+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 >> 172.21.15.47:0/340392236 conn(0x558484e90100 msgr2=0x558484fc9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:32:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:32:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:32:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:32:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.780+0000 7f62c6d66740 1 -- 172.21.15.47:0/147030199 wait complete. 2024-05-14T12:32:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.780+0000 7f62c6d66740 20 client.25885 trim_cache size 0 max 16384 2024-05-14T12:32:48.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.779+0000 7f5fe6000700 0 client.15732 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:48.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.780+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 shutdown_connections 2024-05-14T12:32:48.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.780+0000 7f6011a0ab80 1 -- 172.21.15.47:0/340392236 wait complete. 2024-05-14T12:32:48.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.781+0000 7f6011a0ab80 20 client.15732 trim_cache size 0 max 16384 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.781+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62a00b2830 msgr2=0x7f62a00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.781+0000 7f62bfe00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62a00b2830 0x7f62a00b4d40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e20 tx=0x7f62ac005040 comp rx=0 tx=0).stop 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.781+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8075a10 msgr2=0x7f62b819c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.781+0000 7f62bfe00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8075a10 0x7f62b819c9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f62a4031440 tx=0x7f62a4003c10 comp rx=0 tx=0).stop 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 shutdown_connections 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62a00b2830 0x7f62a00b4d40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b810bbe0 0x7f62b81a3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8075a10 0x7f62b819c9c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 --2- 172.21.15.47:0/560796202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b80750c0 0x7f62b819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 >> 172.21.15.47:0/560796202 conn(0x7f62b80fee60 msgr2=0x7f62b8107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 shutdown_connections 2024-05-14T12:32:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:32:48.782+0000 7f62bfe00640 1 -- 172.21.15.47:0/560796202 wait complete. 2024-05-14T12:32:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.824+0000 7f6011a0ab80 1 Processor -- start 2024-05-14T12:32:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.825+0000 7f6011a0ab80 1 -- start start 2024-05-14T12:32:48.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.826+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fdcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:48.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.826+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc84a0 0x558484fdb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:48.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.826+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:48.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.826+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1b4fc0 con 0x558484e4afd0 2024-05-14T12:32:48.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.826+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1b6b30 con 0x558484fc88b0 2024-05-14T12:32:48.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.826+0000 7f6011a0ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1b5690 con 0x558484fc84a0 2024-05-14T12:32:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.828+0000 7f5ffb400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc84a0 0x558484fdb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.828+0000 7f5ffb400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc84a0 0x558484fdb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:37974/0 (socket says 172.21.15.47:37974) 2024-05-14T12:32:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.828+0000 7f5ffb400700 1 -- 172.21.15.47:0/858698118 learned_addr learned my addr 172.21.15.47:0/858698118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.828+0000 7f6000e00700 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.828+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fdcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.829+0000 7f5ffb400700 1 -- 172.21.15.47:0/858698118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 msgr2=0x558484fe7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.829+0000 7f5ffb400700 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.830+0000 7f5ffb400700 1 -- 172.21.15.47:0/858698118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 msgr2=0x558484fdcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:48.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.830+0000 7f5ffb400700 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fdcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.830+0000 7f5ffb400700 1 -- 172.21.15.47:0/858698118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558484fc8ce0 con 0x558484fc84a0 2024-05-14T12:32:48.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.831+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fdcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:32:48.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.831+0000 7f6000e00700 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.832+0000 7f5ffb400700 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc84a0 0x558484fdb800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800dc90 tx=0x7f5fe800f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31d5a33aba8287c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.832+0000 7f5ff0c00700 1 -- 172.21.15.47:0/858698118 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800ca90 con 0x558484fc84a0 2024-05-14T12:32:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.832+0000 7f5ff0c00700 1 -- 172.21.15.47:0/858698118 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fe801c070 con 0x558484fc84a0 2024-05-14T12:32:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.832+0000 7f5ff0c00700 1 -- 172.21.15.47:0/858698118 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80165c0 con 0x558484fc84a0 2024-05-14T12:32:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.834+0000 7f6011a0ab80 1 -- 172.21.15.47:0/858698118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc84a0 msgr2=0x558484fdb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:32:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.834+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc84a0 0x558484fdb800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800dc90 tx=0x7f5fe800f040 comp rx=0 tx=0).stop 2024-05-14T12:32:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.835+0000 7f6011a0ab80 1 -- 172.21.15.47:0/858698118 shutdown_connections 2024-05-14T12:32:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.835+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.835+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484e4afd0 0x558484fdcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.835+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/858698118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484fc84a0 0x558484fdb800 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.835+0000 7f6011a0ab80 1 -- 172.21.15.47:0/858698118 >> 172.21.15.47:0/858698118 conn(0x558484e90100 msgr2=0x558484fc3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:32:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.836+0000 7f6011a0ab80 1 -- 172.21.15.47:0/858698118 shutdown_connections 2024-05-14T12:32:48.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.836+0000 7f6011a0ab80 1 -- 172.21.15.47:0/858698118 wait complete. 2024-05-14T12:32:48.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.837+0000 7f6011a0ab80 1 -- start start 2024-05-14T12:32:48.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.837+0000 7f6011a0ab80 1 Processor -- start 2024-05-14T12:32:48.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.839+0000 7f6011a0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fe3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:48.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.840+0000 7f5ffbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fe3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:48.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.840+0000 7f5ffbe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fe3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:37976/0 (socket says 172.21.15.47:37976) 2024-05-14T12:32:48.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.840+0000 7f5ffbe00700 1 -- 172.21.15.47:0/1735167052 learned_addr learned my addr 172.21.15.47:0/1735167052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:32:48.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.840+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc84a0 0x558484fdfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:48.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.841+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:48.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.842+0000 7f6000e00700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.842+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1b6430 con 0x558484fc84a0 2024-05-14T12:32:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.842+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1b5d60 con 0x558484fc88b0 2024-05-14T12:32:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.843+0000 7f5ffb400700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc84a0 0x558484fdfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:48.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.843+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1b2f60 con 0x558484e4afd0 2024-05-14T12:32:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.844+0000 7f6011a0ab80 10 client.0 _ll_register_callbacks cb 0x558484e91e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:32:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.845+0000 7f5ffbe00700 1 -- 172.21.15.47:0/1735167052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 msgr2=0x558484fe0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.846+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.846+0000 7f5ffbe00700 1 -- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc84a0 msgr2=0x558484fdfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:32:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.846+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc84a0 0x558484fdfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:32:48.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.846+0000 7f5ffbe00700 1 -- 172.21.15.47:0/1735167052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558484fe06c0 con 0x558484e4afd0 2024-05-14T12:32:48.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.847+0000 7f6000e00700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:48.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.847+0000 7f5ffb400700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc84a0 0x558484fdfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:32:48.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.848+0000 7f5ffbe00700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fe3830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0a6a10 tx=0x7f5fec0cd1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625913bb02da122e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:32:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.848+0000 7f5fe6000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:32:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.849+0000 7f5fe6000700 1 -- 172.21.15.47:0/1735167052 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0b35a0 con 0x558484e4afd0 2024-05-14T12:32:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.849+0000 7f5fe6000700 1 -- 172.21.15.47:0/1735167052 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5fec0abbe0 con 0x558484e4afd0 2024-05-14T12:32:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.849+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fe801c070 con 0x558484e4afd0 2024-05-14T12:32:48.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.850+0000 7f5fe6000700 1 -- 172.21.15.47:0/1735167052 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f5fec0abde0 con 0x558484e4afd0 2024-05-14T12:32:48.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.850+0000 7f6011a0ab80 10 client.25897 fetch_fsmap learned FSMap version 40 2024-05-14T12:32:48.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.850+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558485056820 con 0x558484e4afd0 2024-05-14T12:32:48.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.850+0000 7f5fe6000700 1 -- 172.21.15.47:0/1735167052 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fe801c070 con 0x558484e4afd0 2024-05-14T12:32:48.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.851+0000 7f5fe6000700 1 -- 172.21.15.47:0/1735167052 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f5fec0bfca0 con 0x558484e4afd0 2024-05-14T12:32:48.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.851+0000 7f6011a0ab80 10 client.25897 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:32:48.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.851+0000 7f6011a0ab80 10 client.25897 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:32:48.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.851+0000 7f6011a0ab80 20 client.25897 populate_metadata read hostname 'smithi047' 2024-05-14T12:32:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.851+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558485056dc0 0x5584850591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:32:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.851+0000 7f6011a0ab80 4 client.25897 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-14T12:32:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.851+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x558484ef8590 con 0x558485056dc0 2024-05-14T12:32:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.853+0000 7f5ffb400700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558485056dc0 0x5584850591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:32:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.855+0000 7f5ffb400700 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558485056dc0 0x5584850591e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d39bce35e98690 server_cookie=ffb3a88fd934420c in_seq=0 out_seq=0 2024-05-14T12:32:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:32:48.855+0000 7f5fe6000700 10 client.25897 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:32:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:49 smithi047 ceph-mon[31254]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 38 MiB/s wr, 4.40k op/s 2024-05-14T12:32:50.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:49 smithi073 ceph-mon[35809]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 38 MiB/s wr, 4.40k op/s 2024-05-14T12:32:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:49 smithi066 ceph-mon[35981]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 38 MiB/s wr, 4.40k op/s 2024-05-14T12:32:51.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:51 smithi047 ceph-mon[31254]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 40 MiB/s wr, 4.40k op/s 2024-05-14T12:32:52.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:51 smithi073 ceph-mon[35809]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 40 MiB/s wr, 4.40k op/s 2024-05-14T12:32:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:51 smithi066 ceph-mon[35981]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 40 MiB/s wr, 4.40k op/s 2024-05-14T12:32:53.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:53 smithi047 ceph-mon[31254]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 37 MiB/s wr, 4.15k op/s 2024-05-14T12:32:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:53 smithi073 ceph-mon[35809]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 37 MiB/s wr, 4.15k op/s 2024-05-14T12:32:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:53 smithi066 ceph-mon[35981]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 37 MiB/s wr, 4.15k op/s 2024-05-14T12:32:55.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:55 smithi047 ceph-mon[31254]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 35 MiB/s wr, 3.97k op/s 2024-05-14T12:32:56.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:55 smithi073 ceph-mon[35809]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 35 MiB/s wr, 3.97k op/s 2024-05-14T12:32:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:55 smithi066 ceph-mon[35981]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 35 MiB/s wr, 3.97k op/s 2024-05-14T12:32:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:57 smithi047 ceph-mon[31254]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 38 MiB/s wr, 4.59k op/s 2024-05-14T12:32:58.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:57 smithi073 ceph-mon[35809]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 38 MiB/s wr, 4.59k op/s 2024-05-14T12:32:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:57 smithi066 ceph-mon[35981]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 38 MiB/s wr, 4.59k op/s 2024-05-14T12:32:59.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:32:59 smithi047 ceph-mon[31254]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 38 MiB/s wr, 4.78k op/s 2024-05-14T12:33:00.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:32:59 smithi073 ceph-mon[35809]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 38 MiB/s wr, 4.78k op/s 2024-05-14T12:33:00.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:32:59 smithi066 ceph-mon[35981]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 38 MiB/s wr, 4.78k op/s 2024-05-14T12:33:01.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:01 smithi047 ceph-mon[31254]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 44 MiB/s wr, 6.04k op/s 2024-05-14T12:33:02.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:01 smithi073 ceph-mon[35809]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 44 MiB/s wr, 6.04k op/s 2024-05-14T12:33:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:01 smithi066 ceph-mon[35981]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 44 MiB/s wr, 6.04k op/s 2024-05-14T12:33:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.074+0000 7f76a6200640 1 -- 172.21.15.47:0/1710732033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a0110010 msgr2=0x7f76a0112430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.074+0000 7f76a6200640 1 --2- 172.21.15.47:0/1710732033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a0110010 0x7f76a0112430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7698009ca0 tx=0x7f769802a8c0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.074+0000 7f76a6200640 1 -- 172.21.15.47:0/1710732033 shutdown_connections 2024-05-14T12:33:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.074+0000 7f76a6200640 1 --2- 172.21.15.47:0/1710732033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a0110010 0x7f76a0112430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.074+0000 7f76a6200640 1 --2- 172.21.15.47:0/1710732033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010b310 0x7f76a010b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.074+0000 7f76a6200640 1 --2- 172.21.15.47:0/1710732033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a010a0d0 0x7f76a010add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.074+0000 7f76a6200640 1 -- 172.21.15.47:0/1710732033 >> 172.21.15.47:0/1710732033 conn(0x7f76a0078ce0 msgr2=0x7f76a0107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:02.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.076+0000 7f76a6200640 1 -- 172.21.15.47:0/1710732033 shutdown_connections 2024-05-14T12:33:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.076+0000 7f76a6200640 1 -- 172.21.15.47:0/1710732033 wait complete. 2024-05-14T12:33:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.077+0000 7f76a6200640 1 Processor -- start 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.077+0000 7f76a6200640 1 -- start start 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a6200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010a0d0 0x7f76a00808b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a6200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a010b310 0x7f76a0080df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a6200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a0110010 0x7f76a0081d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a6200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0115c90 con 0x7f76a0110010 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a6200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0115b10 con 0x7f76a010b310 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a6200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0115e10 con 0x7f76a010a0d0 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a5800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a0110010 0x7f76a0081d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a4e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010a0d0 0x7f76a00808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a4e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010a0d0 0x7f76a00808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:44382/0 (socket says 172.21.15.47:44382) 2024-05-14T12:33:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a4e00640 1 -- 172.21.15.47:0/871566352 learned_addr learned my addr 172.21.15.47:0/871566352 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.078+0000 7f76a5800640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a0110010 0x7f76a0081d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50956/0 (socket says 172.21.15.47:50956) 2024-05-14T12:33:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.079+0000 7f769fe00640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a010b310 0x7f76a0080df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.079+0000 7f76a4e00640 1 -- 172.21.15.47:0/871566352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a010b310 msgr2=0x7f76a0080df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.079+0000 7f76a4e00640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a010b310 0x7f76a0080df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.079+0000 7f76a4e00640 1 -- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a0110010 msgr2=0x7f76a0081d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.079+0000 7f76a4e00640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a0110010 0x7f76a0081d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.079+0000 7f76a4e00640 1 -- 172.21.15.47:0/871566352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a00823c0 con 0x7f76a010a0d0 2024-05-14T12:33:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.080+0000 7f76a5800640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a0110010 0x7f76a0081d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:33:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.080+0000 7f769fe00640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a010b310 0x7f76a0080df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:33:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.080+0000 7f76a4e00640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010a0d0 0x7f76a00808b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f768c005fd0 tx=0x7f768c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:02.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.080+0000 7f769d600640 1 -- 172.21.15.47:0/871566352 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c017070 con 0x7f76a010a0d0 2024-05-14T12:33:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.080+0000 7f769d600640 1 -- 172.21.15.47:0/871566352 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f768c009c30 con 0x7f76a010a0d0 2024-05-14T12:33:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.080+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a00826b0 con 0x7f76a010a0d0 2024-05-14T12:33:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.080+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a0082c50 con 0x7f76a010a0d0 2024-05-14T12:33:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.081+0000 7f769d600640 1 -- 172.21.15.47:0/871566352 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c003d10 con 0x7f76a010a0d0 2024-05-14T12:33:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.084+0000 7f76ae7a5740 1 Processor -- start 2024-05-14T12:33:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.085+0000 7f76ae7a5740 1 -- start start 2024-05-14T12:33:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.085+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366de300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.085+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366de880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.085+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 0x55c3366e5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.085+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c336642550 con 0x55c33631b4d0 2024-05-14T12:33:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.085+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c3365e7bc0 con 0x55c33633c1b0 2024-05-14T12:33:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.085+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c33663e510 con 0x55c3363132f0 2024-05-14T12:33:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.086+0000 7f76a5800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.086+0000 7f76a5800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366de300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56954/0 (socket says 172.21.15.47:56954) 2024-05-14T12:33:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.086+0000 7f76a5800640 1 -- 172.21.15.47:0/1411856885 learned_addr learned my addr 172.21.15.47:0/1411856885 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.087+0000 7f769d600640 1 -- 172.21.15.47:0/871566352 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f768c010460 con 0x7f76a010a0d0 2024-05-14T12:33:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.087+0000 7f76a4e00640 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.088+0000 7f76a4e00640 1 -- 172.21.15.47:0/1411856885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 msgr2=0x55c3366de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.088+0000 7f76a4e00640 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366de300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.088+0000 7f76a4e00640 1 -- 172.21.15.47:0/1411856885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 msgr2=0x55c3366e5780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:33:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.089+0000 7f76a4e00640 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 0x55c3366e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.089+0000 7f76a4e00640 1 -- 172.21.15.47:0/1411856885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c336354210 con 0x55c3363132f0 2024-05-14T12:33:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.089+0000 7f76a4e00640 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366de880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f768c0df8b0 tx=0x7f768c0e5f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ef63c7b542205cb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.089+0000 7f76a5800640 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:33:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.090+0000 7f7692000640 1 -- 172.21.15.47:0/1411856885 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c0f6070 con 0x55c3363132f0 2024-05-14T12:33:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.090+0000 7f7692000640 1 -- 172.21.15.47:0/1411856885 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f768c0e8d50 con 0x55c3363132f0 2024-05-14T12:33:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.090+0000 7f7692000640 1 -- 172.21.15.47:0/1411856885 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c0e46e0 con 0x55c3363132f0 2024-05-14T12:33:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.091+0000 7f76ae7a5740 1 -- 172.21.15.47:0/1411856885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 msgr2=0x55c3366de880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.091+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366de880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f768c0df8b0 tx=0x7f768c0e5f10 comp rx=0 tx=0).stop 2024-05-14T12:33:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.091+0000 7f769d600640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f76880b29a0 0x7f76880b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.091+0000 7f769d600640 1 -- 172.21.15.47:0/871566352 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f768c0e1e50 con 0x7f76a010a0d0 2024-05-14T12:33:02.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.093+0000 7f76ae7a5740 1 -- 172.21.15.47:0/1411856885 shutdown_connections 2024-05-14T12:33:02.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.093+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 0x55c3366e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.093+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366de880 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.093+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/1411856885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.093+0000 7f76a5800640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f76880b29a0 0x7f76880b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.093+0000 7f76ae7a5740 1 -- 172.21.15.47:0/1411856885 >> 172.21.15.47:0/1411856885 conn(0x55c336330300 msgr2=0x55c3366d9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:02.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.095+0000 7f76ae7a5740 1 -- 172.21.15.47:0/1411856885 shutdown_connections 2024-05-14T12:33:02.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.095+0000 7f76ae7a5740 1 -- 172.21.15.47:0/1411856885 wait complete. 2024-05-14T12:33:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.095+0000 7f76ae7a5740 1 -- start start 2024-05-14T12:33:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.095+0000 7f76ae7a5740 1 Processor -- start 2024-05-14T12:33:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.096+0000 7f76a5800640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f76880b29a0 0x7f76880b4eb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7698004af0 tx=0x7f7698004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:02.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3363132f0 0x55c3366e7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.097 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33631b4d0 0x55c3366e83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33633c1b0 0x55c3366ef330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c3366e61d0 con 0x55c3363132f0 2024-05-14T12:33:02.098 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76a4e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3363132f0 0x55c3366e7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c3365fb660 con 0x55c33631b4d0 2024-05-14T12:33:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76a4e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3363132f0 0x55c3366e7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50974/0 (socket says 172.21.15.47:50974) 2024-05-14T12:33:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c3366e6350 con 0x55c33633c1b0 2024-05-14T12:33:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76a4e00640 1 -- 172.21.15.47:0/369458308 learned_addr learned my addr 172.21.15.47:0/369458308 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f769fe00640 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33631b4d0 0x55c3366e83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76a5800640 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33633c1b0 0x55c3366ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.097+0000 7f76ae7a5740 10 client.0 _ll_register_callbacks cb 0x55c3365c5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.098+0000 7f769fe00640 1 -- 172.21.15.47:0/369458308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33633c1b0 msgr2=0x55c3366ef330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.098+0000 7f769fe00640 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33633c1b0 0x55c3366ef330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.098+0000 7f769fe00640 1 -- 172.21.15.47:0/369458308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3363132f0 msgr2=0x55c3366e7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.098+0000 7f769fe00640 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3363132f0 0x55c3366e7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.098+0000 7f769fe00640 1 -- 172.21.15.47:0/369458308 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c336420620 con 0x55c33631b4d0 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.098+0000 7f769fe00640 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33631b4d0 0x55c3366e83d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55c3366daa20 tx=0x7f7694010a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f48b88f21a3768 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.098+0000 7f7686a00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.099+0000 7f7686a00640 1 -- 172.21.15.47:0/369458308 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694004230 con 0x55c33631b4d0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.099+0000 7f7686a00640 1 -- 172.21.15.47:0/369458308 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f76940043d0 con 0x55c33631b4d0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.100+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f768c0e8d50 con 0x55c33631b4d0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.100+0000 7f7686a00640 1 -- 172.21.15.47:0/369458308 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7694012720 con 0x55c33631b4d0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.100+0000 7f76ae7a5740 10 client.25883 fetch_fsmap learned FSMap version 40 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.100+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c3366f2340 con 0x55c33631b4d0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f7686a00640 1 -- 172.21.15.47:0/369458308 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f768c0e8d50 con 0x55c33631b4d0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f7686a00640 1 -- 172.21.15.47:0/369458308 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f769400f040 con 0x55c33631b4d0 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f76ae7a5740 10 client.25883 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:33:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f76ae7a5740 10 client.25883 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:33:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f76ae7a5740 20 client.25883 populate_metadata read hostname 'smithi047' 2024-05-14T12:33:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362fad80 0x55c3366f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f76ae7a5740 4 client.25883 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:33:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c336650160 con 0x55c3362fad80 2024-05-14T12:33:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.101+0000 7f76a4e00640 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362fad80 0x55c3366f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.103 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.103+0000 7f76a4e00640 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362fad80 0x55c3366f5b40 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d61d38c258815bd7 server_cookie=b5e64615ea704c22 in_seq=0 out_seq=0 2024-05-14T12:33:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.103+0000 7f7686a00640 10 client.25883 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.104+0000 7f7686a00640 1 -- 172.21.15.47:0/369458308 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c336650160 con 0x55c3362fad80 2024-05-14T12:33:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.105+0000 7f7686a00640 10 client.25883 handle_command_reply: tid=0 2024-05-14T12:33:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.105+0000 7f76ae7a5740 1 client.25883 shutdown 2024-05-14T12:33:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33631b4d0 msgr2=0x55c3366e83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33631b4d0 0x55c3366e83d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55c3366daa20 tx=0x7f7694010a80 comp rx=0 tx=0).stop 2024-05-14T12:33:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 shutdown_connections 2024-05-14T12:33:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362fad80 0x55c3366f5b40 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33633c1b0 0x55c3366ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33631b4d0 0x55c3366e83d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/369458308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3363132f0 0x55c3366e7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 >> 172.21.15.47:0/369458308 conn(0x55c336330300 msgr2=0x55c3366dcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:02.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.106+0000 7f7686a00640 0 client.25883 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:02.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.107+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 shutdown_connections 2024-05-14T12:33:02.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.107+0000 7f76ae7a5740 1 -- 172.21.15.47:0/369458308 wait complete. 2024-05-14T12:33:02.108 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.107+0000 7f76ae7a5740 20 client.25883 trim_cache size 0 max 16384 2024-05-14T12:33:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.131+0000 7f76ae7a5740 1 Processor -- start 2024-05-14T12:33:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.132+0000 7f76ae7a5740 1 -- start start 2024-05-14T12:33:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.132+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3363132f0 0x55c3366d8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.132+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33631b4d0 0x55c3366d8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.132+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33633c1b0 0x55c3366d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.132+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f768000e4c0 con 0x55c33633c1b0 2024-05-14T12:33:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.132+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7680010030 con 0x55c3363132f0 2024-05-14T12:33:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.132+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f768000eb90 con 0x55c33631b4d0 2024-05-14T12:33:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33631b4d0 0x55c3366d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33631b4d0 0x55c3366d8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:44396/0 (socket says 172.21.15.47:44396) 2024-05-14T12:33:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 -- 172.21.15.47:0/736074039 learned_addr learned my addr 172.21.15.47:0/736074039 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f76a4e00640 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3363132f0 0x55c3366d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f76a5800640 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33633c1b0 0x55c3366d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 -- 172.21.15.47:0/736074039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3363132f0 msgr2=0x55c3366d8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3363132f0 0x55c3366d8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 -- 172.21.15.47:0/736074039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33633c1b0 msgr2=0x55c3366d8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33633c1b0 0x55c3366d8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.133+0000 7f769fe00640 1 -- 172.21.15.47:0/736074039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3366deff0 con 0x55c33631b4d0 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.134+0000 7f769fe00640 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33631b4d0 0x55c3366d8790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7694003eb0 tx=0x7f7694005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91838446dcb6f254 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.134+0000 7f7691600640 1 -- 172.21.15.47:0/736074039 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940037f0 con 0x55c33631b4d0 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.134+0000 7f7691600640 1 -- 172.21.15.47:0/736074039 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7694005520 con 0x55c33631b4d0 2024-05-14T12:33:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.134+0000 7f7691600640 1 -- 172.21.15.47:0/736074039 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769401a720 con 0x55c33631b4d0 2024-05-14T12:33:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 -- 172.21.15.47:0/736074039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33631b4d0 msgr2=0x55c3366d8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33631b4d0 0x55c3366d8790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7694003eb0 tx=0x7f7694005f10 comp rx=0 tx=0).stop 2024-05-14T12:33:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 -- 172.21.15.47:0/736074039 shutdown_connections 2024-05-14T12:33:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33633c1b0 0x55c3366d8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c33631b4d0 0x55c3366d8790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/736074039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3363132f0 0x55c3366d8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 -- 172.21.15.47:0/736074039 >> 172.21.15.47:0/736074039 conn(0x55c336330300 msgr2=0x55c3366de280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.136+0000 7f76ae7a5740 1 -- 172.21.15.47:0/736074039 shutdown_connections 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.137+0000 7f76ae7a5740 1 -- 172.21.15.47:0/736074039 wait complete. 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.137+0000 7f76ae7a5740 1 -- start start 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.138+0000 7f76ae7a5740 1 Processor -- start 2024-05-14T12:33:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.138+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.138+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 0x55c3366ed420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.138+0000 7f76ae7a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366ee350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.138+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f768000f930 con 0x55c33631b4d0 2024-05-14T12:33:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.138+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f768000f260 con 0x55c33633c1b0 2024-05-14T12:33:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.138+0000 7f76ae7a5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f768000c480 con 0x55c3363132f0 2024-05-14T12:33:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76ae7a5740 10 client.0 _ll_register_callbacks cb 0x7f7694009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:33:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366ecee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:44406/0 (socket says 172.21.15.47:44406) 2024-05-14T12:33:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 -- 172.21.15.47:0/137255603 learned_addr learned my addr 172.21.15.47:0/137255603 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 -- 172.21.15.47:0/137255603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 msgr2=0x55c3366ee350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:33:02.141 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366ee350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 -- 172.21.15.47:0/137255603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 msgr2=0x55c3366ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 0x55c3366ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.139+0000 7f76a4e00640 1 -- 172.21.15.47:0/137255603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3366ee910 con 0x55c3363132f0 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.140+0000 7f76a4e00640 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366ecee0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f768c009610 tx=0x7f768c0e5a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fdb7ebb674ef3ce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.140+0000 7f7686a00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.140+0000 7f7686a00640 1 -- 172.21.15.47:0/137255603 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c0a52f0 con 0x55c3363132f0 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.140+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7694005520 con 0x55c3363132f0 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.140+0000 7f7686a00640 1 -- 172.21.15.47:0/137255603 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f768c0a5a20 con 0x55c3363132f0 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.141+0000 7f7686a00640 1 -- 172.21.15.47:0/137255603 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f768c0a8ba0 con 0x55c3363132f0 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.141+0000 7f76ae7a5740 10 client.25915 fetch_fsmap learned FSMap version 40 2024-05-14T12:33:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.141+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c3366efbd0 con 0x55c3363132f0 2024-05-14T12:33:02.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.141+0000 7f7686a00640 1 -- 172.21.15.47:0/137255603 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7694005520 con 0x55c3363132f0 2024-05-14T12:33:02.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.141+0000 7f7686a00640 1 -- 172.21.15.47:0/137255603 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f768c0a56c0 con 0x55c3363132f0 2024-05-14T12:33:02.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.143+0000 7f76ae7a5740 10 client.25915 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:33:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.143+0000 7f76ae7a5740 10 client.25915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:33:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.143+0000 7f76ae7a5740 20 client.25915 populate_metadata read hostname 'smithi047' 2024-05-14T12:33:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.143+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362d01c0 0x55c336760010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.143+0000 7f76ae7a5740 4 client.25915 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:33:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.143+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c336649fd0 con 0x55c3362d01c0 2024-05-14T12:33:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.143+0000 7f769fe00640 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362d01c0 0x55c336760010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.145+0000 7f769fe00640 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362d01c0 0x55c336760010 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a49222e0da19ac64 server_cookie=eeef2b59f4555d3d in_seq=0 out_seq=0 2024-05-14T12:33:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:02.145+0000 7f7686a00640 10 client.25915 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:03.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:03 smithi047 ceph-mon[31254]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 44 MiB/s wr, 6.26k op/s 2024-05-14T12:33:04.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:03 smithi073 ceph-mon[35809]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 44 MiB/s wr, 6.26k op/s 2024-05-14T12:33:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:03 smithi066 ceph-mon[35981]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 44 MiB/s wr, 6.26k op/s 2024-05-14T12:33:05.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:05 smithi047 ceph-mon[31254]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 41 MiB/s wr, 5.97k op/s 2024-05-14T12:33:06.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:05 smithi073 ceph-mon[35809]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 41 MiB/s wr, 5.97k op/s 2024-05-14T12:33:06.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:05 smithi066 ceph-mon[35981]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 41 MiB/s wr, 5.97k op/s 2024-05-14T12:33:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.412+0000 7f5fe6000700 1 -- 172.21.15.47:0/1735167052 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x558484ef8590 con 0x558485056dc0 2024-05-14T12:33:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.412+0000 7f5fe6000700 10 client.25897 handle_command_reply: tid=0 2024-05-14T12:33:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.413+0000 7f6011a0ab80 1 client.25897 shutdown 2024-05-14T12:33:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 msgr2=0x558484fe3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fe3830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0a6a10 tx=0x7f5fec0cd1a0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 shutdown_connections 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558485056dc0 0x5584850591e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558484fc88b0 0x558484fe0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f5fe6000700 0 client.25897 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558484e4afd0 0x558484fe3830 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 --2- 172.21.15.47:0/1735167052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558484fc84a0 0x558484fdfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 >> 172.21.15.47:0/1735167052 conn(0x558484e90100 msgr2=0x558484fda7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 shutdown_connections 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.414+0000 7f6011a0ab80 1 -- 172.21.15.47:0/1735167052 wait complete. 2024-05-14T12:33:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.415+0000 7f6011a0ab80 20 client.25897 trim_cache size 0 max 16384 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 40, 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 18, 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "9b9ec3b6": { 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 18, 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:33:07.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 90.0, 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:07.418 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:33:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.417+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5fe00b2900 msgr2=0x7f5fe00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.417+0000 7f6001800700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5fe00b2900 0x7f5fe00b4e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400e350 tx=0x7f5ff4009040 comp rx=0 tx=0).stop 2024-05-14T12:33:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.417+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10c9a0 msgr2=0x7f5ffc1a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.417+0000 7f6001800700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10c9a0 0x7f5ffc1a3540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5fec000c00 tx=0x7f5fec0057c0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 shutdown_connections 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5fe00b2900 0x7f5fe00b4e10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ffc112980 0x7f5ffc1a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ffc10c9a0 0x7f5ffc1a3540 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 --2- 172.21.15.47:0/2230398483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ffc10d2f0 0x7f5ffc1a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 >> 172.21.15.47:0/2230398483 conn(0x7f5ffc0704d0 msgr2=0x7f5ffc10b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 shutdown_connections 2024-05-14T12:33:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:07.418+0000 7f6001800700 1 -- 172.21.15.47:0/2230398483 wait complete. 2024-05-14T12:33:07.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:07 smithi047 ceph-mon[31254]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 50 MiB/s wr, 7.29k op/s 2024-05-14T12:33:08.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:07 smithi073 ceph-mon[35809]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 50 MiB/s wr, 7.29k op/s 2024-05-14T12:33:08.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:07 smithi066 ceph-mon[35981]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 50 MiB/s wr, 7.29k op/s 2024-05-14T12:33:08.410 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9b9ec3b6', quiesce took 45.9 seconds. Will release after: 30.0 2024-05-14T12:33:09.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:09 smithi047 ceph-mon[31254]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 48 MiB/s wr, 7.07k op/s 2024-05-14T12:33:10.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:09 smithi073 ceph-mon[35809]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 48 MiB/s wr, 7.07k op/s 2024-05-14T12:33:10.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:09 smithi066 ceph-mon[35981]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 48 MiB/s wr, 7.07k op/s 2024-05-14T12:33:11.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:11 smithi047 ceph-mon[31254]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 49 MiB/s wr, 7.16k op/s 2024-05-14T12:33:12.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:11 smithi073 ceph-mon[35809]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 49 MiB/s wr, 7.16k op/s 2024-05-14T12:33:12.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:11 smithi066 ceph-mon[35981]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 49 MiB/s wr, 7.16k op/s 2024-05-14T12:33:13.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:13 smithi047 ceph-mon[31254]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 40 MiB/s wr, 5.66k op/s 2024-05-14T12:33:14.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:13 smithi073 ceph-mon[35809]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 40 MiB/s wr, 5.66k op/s 2024-05-14T12:33:14.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:13 smithi066 ceph-mon[35981]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 40 MiB/s wr, 5.66k op/s 2024-05-14T12:33:15.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:15 smithi047 ceph-mon[31254]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 34 MiB/s wr, 4.91k op/s 2024-05-14T12:33:16.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:15 smithi073 ceph-mon[35809]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 34 MiB/s wr, 4.91k op/s 2024-05-14T12:33:16.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:15 smithi066 ceph-mon[35981]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 34 MiB/s wr, 4.91k op/s 2024-05-14T12:33:17.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:17 smithi047 ceph-mon[31254]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 40 MiB/s wr, 5.67k op/s 2024-05-14T12:33:18.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:17 smithi073 ceph-mon[35809]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 40 MiB/s wr, 5.67k op/s 2024-05-14T12:33:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:17 smithi066 ceph-mon[35981]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 40 MiB/s wr, 5.67k op/s 2024-05-14T12:33:20.004 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:19 smithi073 ceph-mon[35809]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 4.40k op/s 2024-05-14T12:33:20.079 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:19 smithi066 ceph-mon[35981]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 4.40k op/s 2024-05-14T12:33:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:19 smithi047 ceph-mon[31254]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 4.40k op/s 2024-05-14T12:33:22.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:21 smithi073 ceph-mon[35809]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-05-14T12:33:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:21 smithi066 ceph-mon[35981]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-05-14T12:33:22.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:21 smithi047 ceph-mon[31254]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-05-14T12:33:24.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:23 smithi073 ceph-mon[35809]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 4.13k op/s 2024-05-14T12:33:24.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:23 smithi066 ceph-mon[35981]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 4.13k op/s 2024-05-14T12:33:24.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:23 smithi047 ceph-mon[31254]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 4.13k op/s 2024-05-14T12:33:26.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:25 smithi073 ceph-mon[35809]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 3.90k op/s 2024-05-14T12:33:26.037 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:25 smithi047 ceph-mon[31254]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 3.90k op/s 2024-05-14T12:33:26.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:25 smithi066 ceph-mon[35981]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 3.90k op/s 2024-05-14T12:33:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:27 smithi066 ceph-mon[35981]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 4.23k op/s 2024-05-14T12:33:28.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:27 smithi047 ceph-mon[31254]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 4.23k op/s 2024-05-14T12:33:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:27 smithi073 ceph-mon[35809]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 4.23k op/s 2024-05-14T12:33:30.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:29 smithi066 ceph-mon[35981]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 MiB/s wr, 4.05k op/s 2024-05-14T12:33:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:29 smithi047 ceph-mon[31254]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 MiB/s wr, 4.05k op/s 2024-05-14T12:33:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:29 smithi073 ceph-mon[35809]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 MiB/s wr, 4.05k op/s 2024-05-14T12:33:32.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:31 smithi066 ceph-mon[35981]: pgmap v700: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 30 MiB/s wr, 4.22k op/s 2024-05-14T12:33:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:31 smithi047 ceph-mon[31254]: pgmap v700: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 30 MiB/s wr, 4.22k op/s 2024-05-14T12:33:32.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:31 smithi073 ceph-mon[35809]: pgmap v700: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 30 MiB/s wr, 4.22k op/s 2024-05-14T12:33:34.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:33 smithi066 ceph-mon[35981]: pgmap v701: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 28 MiB/s wr, 3.99k op/s 2024-05-14T12:33:34.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:33 smithi047 ceph-mon[31254]: pgmap v701: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 28 MiB/s wr, 3.99k op/s 2024-05-14T12:33:34.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:33 smithi073 ceph-mon[35809]: pgmap v701: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 28 MiB/s wr, 3.99k op/s 2024-05-14T12:33:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:35 smithi066 ceph-mon[35981]: pgmap v702: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 28 MiB/s wr, 4k op/s 2024-05-14T12:33:36.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:35 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:33:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:35 smithi047 ceph-mon[31254]: pgmap v702: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 28 MiB/s wr, 4k op/s 2024-05-14T12:33:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:35 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:33:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:35 smithi073 ceph-mon[35809]: pgmap v702: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 28 MiB/s wr, 4k op/s 2024-05-14T12:33:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:35 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:33:37.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:37 smithi047 ceph-mon[31254]: pgmap v703: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 28 MiB/s wr, 4.07k op/s 2024-05-14T12:33:37.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:37.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:37 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:37 smithi073 ceph-mon[35809]: pgmap v703: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 28 MiB/s wr, 4.07k op/s 2024-05-14T12:33:38.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:37 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:37 smithi066 ceph-mon[35981]: pgmap v703: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 28 MiB/s wr, 4.07k op/s 2024-05-14T12:33:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:37 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.411 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:33:38.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:38.735 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:38 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:38 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:38 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:39.137 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:33:39.987 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:39 smithi047 ceph-mon[31254]: pgmap v704: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 30 MiB/s wr, 4.30k op/s 2024-05-14T12:33:40.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:39 smithi073 ceph-mon[35809]: pgmap v704: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 30 MiB/s wr, 4.30k op/s 2024-05-14T12:33:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:39 smithi066 ceph-mon[35981]: pgmap v704: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 30 MiB/s wr, 4.30k op/s 2024-05-14T12:33:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f7686a00640 1 -- 172.21.15.47:0/137255603 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c336649fd0 con 0x55c3362d01c0 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f7686a00640 10 client.25915 handle_command_reply: tid=0 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 client.25915 shutdown 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 msgr2=0x55c3366ecee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366ecee0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f768c009610 tx=0x7f768c0e5a90 comp rx=0 tx=0).stop 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 shutdown_connections 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55c3362d01c0 0x55c336760010 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c33633c1b0 0x55c3366ee350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c33631b4d0 0x55c3366ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 --2- 172.21.15.47:0/137255603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c3363132f0 0x55c3366ecee0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.077+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 >> 172.21.15.47:0/137255603 conn(0x55c336330300 msgr2=0x55c3366dca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.078+0000 7f7686a00640 0 client.25915 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.078+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 shutdown_connections 2024-05-14T12:33:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.078+0000 7f76ae7a5740 1 -- 172.21.15.47:0/137255603 wait complete. 2024-05-14T12:33:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.078+0000 7f76ae7a5740 20 client.25915 trim_cache size 0 max 16384 2024-05-14T12:33:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:33:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:33:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:33:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f76880b29a0 msgr2=0x7f76880b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f76880b29a0 0x7f76880b4eb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7698004af0 tx=0x7f7698004a40 comp rx=0 tx=0).stop 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010a0d0 msgr2=0x7f76a00808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010a0d0 0x7f76a00808b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f768c005fd0 tx=0x7f768c00dde0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 shutdown_connections 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f76880b29a0 0x7f76880b4eb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76a0110010 0x7f76a0081d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76a010b310 0x7f76a0080df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 --2- 172.21.15.47:0/871566352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76a010a0d0 0x7f76a00808b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.079+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 >> 172.21.15.47:0/871566352 conn(0x7f76a0078ce0 msgr2=0x7f76a010bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.080+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 shutdown_connections 2024-05-14T12:33:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:41.080+0000 7f76a6200640 1 -- 172.21.15.47:0/871566352 wait complete. 2024-05-14T12:33:41.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.980+0000 7f578ec00700 1 -- 172.21.15.47:0/1552003811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5788106ed0 msgr2=0x7f5788113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:41.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.980+0000 7f578ec00700 1 --2- 172.21.15.47:0/1552003811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5788106ed0 0x7f5788113360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5780009f90 tx=0x7f578000b330 comp rx=0 tx=0).stop 2024-05-14T12:33:41.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:41 smithi047 ceph-mon[31254]: pgmap v705: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 29 MiB/s wr, 4.04k op/s 2024-05-14T12:33:41.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.981+0000 7f578ec00700 1 -- 172.21.15.47:0/1552003811 shutdown_connections 2024-05-14T12:33:41.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.981+0000 7f578ec00700 1 --2- 172.21.15.47:0/1552003811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5788106ed0 0x7f5788113360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.981+0000 7f578ec00700 1 --2- 172.21.15.47:0/1552003811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f578810c5c0 0x7f578810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.981+0000 7f578ec00700 1 --2- 172.21.15.47:0/1552003811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5788106580 0x7f5788106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.981+0000 7f578ec00700 1 -- 172.21.15.47:0/1552003811 >> 172.21.15.47:0/1552003811 conn(0x7f5788102080 msgr2=0x7f57881044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:41.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.981+0000 7f578ec00700 1 -- 172.21.15.47:0/1552003811 shutdown_connections 2024-05-14T12:33:41.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.982+0000 7f578ec00700 1 -- 172.21.15.47:0/1552003811 wait complete. 2024-05-14T12:33:41.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.984+0000 7f578ec00700 1 Processor -- start 2024-05-14T12:33:41.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.984+0000 7f578ec00700 1 -- start start 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.985+0000 7f578ec00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5788106580 0x7f578819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.985+0000 7f578ec00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5788106ed0 0x7f578819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.985+0000 7f578ec00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f578810c5c0 0x7f57881a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.985+0000 7f578ec00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5788116740 con 0x7f5788106ed0 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.985+0000 7f578ec00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57881165c0 con 0x7f5788106580 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.985+0000 7f578ec00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f57881168c0 con 0x7f578810c5c0 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.986+0000 7f5787e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5788106580 0x7f578819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:41.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.986+0000 7f5787e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5788106580 0x7f578819cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52694/0 (socket says 172.21.15.47:52694) 2024-05-14T12:33:41.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.986+0000 7f5787e00700 1 -- 172.21.15.47:0/220162678 learned_addr learned my addr 172.21.15.47:0/220162678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:41.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.986+0000 7f578cc00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f578810c5c0 0x7f57881a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:41.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.987+0000 7f5787e00700 1 -- 172.21.15.47:0/220162678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f578810c5c0 msgr2=0x7f57881a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:41.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.987+0000 7f5787e00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f578810c5c0 0x7f57881a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.987+0000 7f5787e00700 1 -- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5788106ed0 msgr2=0x7f578819d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.987+0000 7f5787e00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5788106ed0 0x7f578819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.987+0000 7f5787e00700 1 -- 172.21.15.47:0/220162678 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57881a1ec0 con 0x7f5788106580 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.987+0000 7f5787e00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5788106580 0x7f578819cff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f577800e9f0 tx=0x7f577800edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.988+0000 7f5784c00700 1 -- 172.21.15.47:0/220162678 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577800cbd0 con 0x7f5788106580 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.988+0000 7f5784c00700 1 -- 172.21.15.47:0/220162678 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f577800cd70 con 0x7f5788106580 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.988+0000 7f5784c00700 1 -- 172.21.15.47:0/220162678 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57780187a0 con 0x7f5788106580 2024-05-14T12:33:41.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.988+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57881a21b0 con 0x7f5788106580 2024-05-14T12:33:41.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.988+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57881a9ad0 con 0x7f5788106580 2024-05-14T12:33:41.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.990+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57880512c0 con 0x7f5788106580 2024-05-14T12:33:41.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.992+0000 7f5784c00700 1 -- 172.21.15.47:0/220162678 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5778010430 con 0x7f5788106580 2024-05-14T12:33:41.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.994+0000 7f5784c00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f576c0b2900 0x7f576c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:41.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.994+0000 7f5784c00700 1 -- 172.21.15.47:0/220162678 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f57780e24a0 con 0x7f5788106580 2024-05-14T12:33:41.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.995+0000 7f5787400700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f576c0b2900 0x7f576c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:41.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.996+0000 7f5787400700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f576c0b2900 0x7f576c0b4e10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5774005d90 tx=0x7f5774005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:41.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:41.998+0000 7f5784c00700 1 -- 172.21.15.47:0/220162678 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f57780aa1c0 con 0x7f5788106580 2024-05-14T12:33:42.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:41 smithi073 ceph-mon[35809]: pgmap v705: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 29 MiB/s wr, 4.04k op/s 2024-05-14T12:33:42.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:41 smithi066 ceph-mon[35981]: pgmap v705: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 29 MiB/s wr, 4.04k op/s 2024-05-14T12:33:42.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.393+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f578802e5f0 con 0x7f5788106580 2024-05-14T12:33:42.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.394+0000 7f5784c00700 1 -- 172.21.15.47:0/220162678 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11920 (secure 0 0 0) 0x7f57780b2240 con 0x7f5788106580 2024-05-14T12:33:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:33:42.396 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:32:29.835083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:33:42.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.397+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f576c0b2900 msgr2=0x7f576c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:42.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.397+0000 7f578ec00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f576c0b2900 0x7f576c0b4e10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5774005d90 tx=0x7f5774005ce0 comp rx=0 tx=0).stop 2024-05-14T12:33:42.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.397+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5788106580 msgr2=0x7f578819cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.397+0000 7f578ec00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5788106580 0x7f578819cff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f577800e9f0 tx=0x7f577800edb0 comp rx=0 tx=0).stop 2024-05-14T12:33:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 shutdown_connections 2024-05-14T12:33:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f576c0b2900 0x7f576c0b4e10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f578810c5c0 0x7f57881a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5788106580 0x7f578819cff0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 --2- 172.21.15.47:0/220162678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5788106ed0 0x7f578819d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 >> 172.21.15.47:0/220162678 conn(0x7f5788102080 msgr2=0x7f57881045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:42.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 shutdown_connections 2024-05-14T12:33:42.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:42.398+0000 7f578ec00700 1 -- 172.21.15.47:0/220162678 wait complete. 2024-05-14T12:33:42.400 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 40 2024-05-14T12:33:43.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:42 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:43.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:42 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:43.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:42 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/220162678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:33:43.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:42 smithi047 ceph-mon[31254]: pgmap v706: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 28 MiB/s wr, 3.91k op/s 2024-05-14T12:33:43.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:42 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:43.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:42 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:42 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/220162678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:33:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:42 smithi073 ceph-mon[35809]: pgmap v706: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 28 MiB/s wr, 3.91k op/s 2024-05-14T12:33:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:42 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:42 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:42 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/220162678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:33:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:42 smithi066 ceph-mon[35981]: pgmap v706: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 28 MiB/s wr, 3.91k op/s 2024-05-14T12:33:43.382 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id 9b9ec3b6 --release --await' 2024-05-14T12:33:43.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id 9b9ec3b6 --release --await 2024-05-14T12:33:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:33:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:33:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:33:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:44.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:33:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:33:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:33:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:33:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:33:45.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:44 smithi073 ceph-mon[35809]: pgmap v707: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 26 MiB/s wr, 3.55k op/s 2024-05-14T12:33:45.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:44 smithi066 ceph-mon[35981]: pgmap v707: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 26 MiB/s wr, 3.55k op/s 2024-05-14T12:33:45.430 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:44 smithi047 ceph-mon[31254]: pgmap v707: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 26 MiB/s wr, 3.55k op/s 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.665+0000 7f43a6e00700 1 -- 172.21.15.47:0/1790842753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 msgr2=0x7f43a0109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.665+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1790842753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 0x7f43a0109330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f438c009920 tx=0x7f438c009c30 comp rx=0 tx=0).stop 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.665+0000 7f43a6e00700 1 -- 172.21.15.47:0/1790842753 shutdown_connections 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.665+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1790842753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a0109870 0x7f43a01111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.665+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1790842753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43a01045f0 0x7f43a0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.665+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1790842753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 0x7f43a0109330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.665+0000 7f43a6e00700 1 -- 172.21.15.47:0/1790842753 >> 172.21.15.47:0/1790842753 conn(0x7f43a00ffec0 msgr2=0x7f43a0102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:46.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.666+0000 7f43a6e00700 1 -- 172.21.15.47:0/1790842753 shutdown_connections 2024-05-14T12:33:46.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.666+0000 7f43a6e00700 1 -- 172.21.15.47:0/1790842753 wait complete. 2024-05-14T12:33:46.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.667+0000 7f43a6e00700 1 Processor -- start 2024-05-14T12:33:46.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.668+0000 7f43a6e00700 1 -- start start 2024-05-14T12:33:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.668+0000 7f43a6e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a01045f0 0x7f43a0076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.668+0000 7f43a6e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 0x7f43a0077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.668+0000 7f43a6e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43a0109870 0x7f43a0077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.668+0000 7f43a6e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0114480 con 0x7f43a0109870 2024-05-14T12:33:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.668+0000 7f43a6e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0114300 con 0x7f43a01045f0 2024-05-14T12:33:46.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.668+0000 7f43a6e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0114600 con 0x7f43a0108f20 2024-05-14T12:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a01045f0 0x7f43a0076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a01045f0 0x7f43a0076bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52720/0 (socket says 172.21.15.47:52720) 2024-05-14T12:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439fe00700 1 -- 172.21.15.47:0/1496092586 learned_addr learned my addr 172.21.15.47:0/1496092586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439f400700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 0x7f43a0077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f43a4e00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43a0109870 0x7f43a0077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439f400700 1 -- 172.21.15.47:0/1496092586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a01045f0 msgr2=0x7f43a0076bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439f400700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a01045f0 0x7f43a0076bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439f400700 1 -- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43a0109870 msgr2=0x7f43a0077650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439f400700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43a0109870 0x7f43a0077650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439f400700 1 -- 172.21.15.47:0/1496092586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a01a9250 con 0x7f43a0108f20 2024-05-14T12:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.669+0000 7f439f400700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 0x7f43a0077110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f438c000c00 tx=0x7f438c00f950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.670+0000 7f439cc00700 1 -- 172.21.15.47:0/1496092586 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c027070 con 0x7f43a0108f20 2024-05-14T12:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.670+0000 7f439cc00700 1 -- 172.21.15.47:0/1496092586 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f438c0054f0 con 0x7f43a0108f20 2024-05-14T12:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.670+0000 7f439cc00700 1 -- 172.21.15.47:0/1496092586 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c004930 con 0x7f43a0108f20 2024-05-14T12:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.670+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a01a94e0 con 0x7f43a0108f20 2024-05-14T12:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.670+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a01a98e0 con 0x7f43a0108f20 2024-05-14T12:33:46.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.676+0000 7f43b5852b80 1 Processor -- start 2024-05-14T12:33:46.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.676+0000 7f43b5852b80 1 -- start start 2024-05-14T12:33:46.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd29ffe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a008cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43b5852b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bd29f20b20 con 0x55bd29ffe600 2024-05-14T12:33:46.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43b5852b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd29ebe860 con 0x55bd29ffea10 2024-05-14T12:33:46.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43b5852b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bd29f1cae0 con 0x55bd29e80f40 2024-05-14T12:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f439cc00700 1 -- 172.21.15.47:0/1496092586 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f438c02a070 con 0x7f43a0108f20 2024-05-14T12:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43a4e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd29ffe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43a4e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd29ffe0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43436/0 (socket says 172.21.15.47:43436) 2024-05-14T12:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f43a4e00700 1 -- 172.21.15.47:0/209860055 learned_addr learned my addr 172.21.15.47:0/209860055 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f439f400700 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.677+0000 7f439fe00700 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a008cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f43a4e00700 1 -- 172.21.15.47:0/209860055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 msgr2=0x55bd2a00b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f43a4e00700 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f43a4e00700 1 -- 172.21.15.47:0/209860055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 msgr2=0x55bd2a008cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f43a4e00700 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a008cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f43a4e00700 1 -- 172.21.15.47:0/209860055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29e6d9d0 con 0x55bd29e80f40 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f43a4e00700 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd29ffe0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4398011670 tx=0x7f43980099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6adc97e3c953a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f4395600700 1 -- 172.21.15.47:0/209860055 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398019030 con 0x55bd29e80f40 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f4395600700 1 -- 172.21.15.47:0/209860055 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43980093a0 con 0x55bd29e80f40 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.678+0000 7f4395600700 1 -- 172.21.15.47:0/209860055 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43980075c0 con 0x55bd29e80f40 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.679+0000 7f439cc00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f43840b2900 0x7f43840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f439cc00700 1 -- 172.21.15.47:0/1496092586 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f438c0e2a30 con 0x7f43a0108f20 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 -- 172.21.15.47:0/209860055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 msgr2=0x55bd29ffe0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd29ffe0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4398011670 tx=0x7f43980099e0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f439fe00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f43840b2900 0x7f43840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 -- 172.21.15.47:0/209860055 shutdown_connections 2024-05-14T12:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd29ffe0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 --2- 172.21.15.47:0/209860055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a008cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 -- 172.21.15.47:0/209860055 >> 172.21.15.47:0/209860055 conn(0x55bd29ebfb80 msgr2=0x55bd29ff9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:46.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 -- 172.21.15.47:0/209860055 shutdown_connections 2024-05-14T12:33:46.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.680+0000 7f43b5852b80 1 -- 172.21.15.47:0/209860055 wait complete. 2024-05-14T12:33:46.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.681+0000 7f439fe00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f43840b2900 0x7f43840b4e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55bd29fff620 tx=0x7f4390009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:46.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.681+0000 7f43b5852b80 1 -- start start 2024-05-14T12:33:46.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.681+0000 7f43b5852b80 1 Processor -- start 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a0087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a008cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffea10 0x55bd2a009230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43b5852b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bd2a00bb80 con 0x55bd29ffea10 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43b5852b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd29e86c20 con 0x55bd29ffe600 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43b5852b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bd2a00bd00 con 0x55bd29e80f40 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43b5852b80 10 client.0 _ll_register_callbacks cb 0x55bd29eb4480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a008cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43a4e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffea10 0x55bd2a009230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a0087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a008cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52746/0 (socket says 172.21.15.47:52746) 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 -- 172.21.15.47:0/2067880200 learned_addr learned my addr 172.21.15.47:0/2067880200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:46.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 -- 172.21.15.47:0/2067880200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 msgr2=0x55bd2a0087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a0087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 -- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffea10 msgr2=0x55bd2a009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffea10 0x55bd2a009230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439f400700 1 -- 172.21.15.47:0/2067880200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd29ee6520 con 0x55bd29ffe600 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f439fe00700 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a0087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.682+0000 7f43a4e00700 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffea10 0x55bd2a009230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f439f400700 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a008cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f438c0aa030 tx=0x7f438c0a9ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a12c41a83c791bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f438a000700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f438a000700 1 -- 172.21.15.47:0/2067880200 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c0a9bb0 con 0x55bd29ffe600 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f438a000700 1 -- 172.21.15.47:0/2067880200 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f438c00b5f0 con 0x55bd29ffe600 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43980093a0 con 0x55bd29ffe600 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f438a000700 1 -- 172.21.15.47:0/2067880200 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f438c0aa7a0 con 0x55bd29ffe600 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f43b5852b80 10 client.25904 fetch_fsmap learned FSMap version 40 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55bd2a016880 con 0x55bd29ffe600 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.683+0000 7f438a000700 1 -- 172.21.15.47:0/2067880200 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43980093a0 con 0x55bd29ffe600 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f438a000700 1 -- 172.21.15.47:0/2067880200 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f438c0aa300 con 0x55bd29ffe600 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f43b5852b80 10 client.25904 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f43b5852b80 10 client.25904 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f43b5852b80 20 client.25904 populate_metadata read hostname 'smithi047' 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f43b5852b80 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a018e40 0x55bd2a01b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f43b5852b80 4 client.25904 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd29fcb170 con 0x55bd2a018e40 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.684+0000 7f439fe00700 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a018e40 0x55bd2a01b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.685+0000 7f439fe00700 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a018e40 0x55bd2a01b2d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba2638fb5e37f755 server_cookie=48a2834ea82c714b in_seq=0 out_seq=0 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.685+0000 7f438a000700 10 client.25904 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f438a000700 1 -- 172.21.15.47:0/2067880200 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bd29fcb170 con 0x55bd2a018e40 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f438a000700 10 client.25904 handle_command_reply: tid=0 2024-05-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 client.25904 shutdown 2024-05-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 msgr2=0x55bd2a008cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a008cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f438c0aa030 tx=0x7f438c0a9ef0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 shutdown_connections 2024-05-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a018e40 0x55bd2a01b2d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffea10 0x55bd2a009230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a0087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 --2- 172.21.15.47:0/2067880200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a008cf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f438a000700 0 client.25904 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.686+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 >> 172.21.15.47:0/2067880200 conn(0x55bd29ebfb80 msgr2=0x55bd29ff91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.687+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 shutdown_connections 2024-05-14T12:33:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.687+0000 7f43b5852b80 1 -- 172.21.15.47:0/2067880200 wait complete. 2024-05-14T12:33:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.687+0000 7f43b5852b80 20 client.25904 trim_cache size 0 max 16384 2024-05-14T12:33:46.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 Processor -- start 2024-05-14T12:33:46.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 -- start start 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29e80f40 0x55bd2a004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a009070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29ffea10 0x55bd2a014690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01b0e40 con 0x55bd29e80f40 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01b29b0 con 0x55bd29ffe600 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.710+0000 7f43b5852b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01b1510 con 0x55bd29ffea10 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a009070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29e80f40 0x55bd2a004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a009070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52756/0 (socket says 172.21.15.47:52756) 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 -- 172.21.15.47:0/3108804532 learned_addr learned my addr 172.21.15.47:0/3108804532 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:46.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f43a4e00700 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29ffea10 0x55bd2a014690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 -- 172.21.15.47:0/3108804532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29ffea10 msgr2=0x55bd2a014690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29ffea10 0x55bd2a014690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 -- 172.21.15.47:0/3108804532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29e80f40 msgr2=0x55bd2a004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29e80f40 0x55bd2a004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439f400700 1 -- 172.21.15.47:0/3108804532 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd29fff650 con 0x55bd29ffe600 2024-05-14T12:33:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.711+0000 7f439fe00700 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29e80f40 0x55bd2a004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:33:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.712+0000 7f439f400700 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a009070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f438c0a9da0 tx=0x7f438c00b560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da4b3bde9965dbde server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.712+0000 7f4394c00700 1 -- 172.21.15.47:0/3108804532 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c0a9bb0 con 0x55bd29ffe600 2024-05-14T12:33:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.712+0000 7f4394c00700 1 -- 172.21.15.47:0/3108804532 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f438c0ae0c0 con 0x55bd29ffe600 2024-05-14T12:33:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.712+0000 7f4394c00700 1 -- 172.21.15.47:0/3108804532 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c00b5f0 con 0x55bd29ffe600 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 -- 172.21.15.47:0/3108804532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 msgr2=0x55bd2a009070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a009070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f438c0a9da0 tx=0x7f438c00b560 comp rx=0 tx=0).stop 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 -- 172.21.15.47:0/3108804532 shutdown_connections 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29ffea10 0x55bd2a014690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29e80f40 0x55bd2a004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3108804532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffe600 0x55bd2a009070 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 -- 172.21.15.47:0/3108804532 >> 172.21.15.47:0/3108804532 conn(0x55bd29ebfb80 msgr2=0x55bd2a000230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 -- 172.21.15.47:0/3108804532 shutdown_connections 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.713+0000 7f43b5852b80 1 -- 172.21.15.47:0/3108804532 wait complete. 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.714+0000 7f43b5852b80 1 -- start start 2024-05-14T12:33:46.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.714+0000 7f43b5852b80 1 Processor -- start 2024-05-14T12:33:46.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.714+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a011520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.714+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a00d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f43b5852b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f43b5852b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01b22b0 con 0x55bd29ffe600 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f43b5852b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01b1be0 con 0x55bd29ffea10 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f43b5852b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43a01aedc0 con 0x55bd29e80f40 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f43b5852b80 10 client.0 _ll_register_callbacks cb 0x55bd29eb4480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a011520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a011520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43482/0 (socket says 172.21.15.47:43482) 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 -- 172.21.15.47:0/3718541756 learned_addr learned my addr 172.21.15.47:0/3718541756 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f43a4e00700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439f400700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a00d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 -- 172.21.15.47:0/3718541756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 msgr2=0x55bd2a00ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 -- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 msgr2=0x55bd2a00d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a00d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439fe00700 1 -- 172.21.15.47:0/3718541756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd2a00ba60 con 0x55bd29e80f40 2024-05-14T12:33:46.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.715+0000 7f439f400700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a00d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:33:46.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f439fe00700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a011520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55bd2a01ba70 tx=0x7f4390004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa71aaf16f57ba55 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:46.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f438a000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:33:46.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f438a000700 1 -- 172.21.15.47:0/3718541756 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390004020 con 0x55bd29e80f40 2024-05-14T12:33:46.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f438a000700 1 -- 172.21.15.47:0/3718541756 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f43900041c0 con 0x55bd29e80f40 2024-05-14T12:33:46.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f438c0ae0c0 con 0x55bd29e80f40 2024-05-14T12:33:46.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f438a000700 1 -- 172.21.15.47:0/3718541756 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f43900043c0 con 0x55bd29e80f40 2024-05-14T12:33:46.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f43b5852b80 10 client.25939 fetch_fsmap learned FSMap version 40 2024-05-14T12:33:46.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.716+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55bd2a084450 con 0x55bd29e80f40 2024-05-14T12:33:46.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.717+0000 7f438a000700 1 -- 172.21.15.47:0/3718541756 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f438c0ae0c0 con 0x55bd29e80f40 2024-05-14T12:33:46.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.717+0000 7f438a000700 1 -- 172.21.15.47:0/3718541756 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f43900039e0 con 0x55bd29e80f40 2024-05-14T12:33:46.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.718+0000 7f43b5852b80 10 client.25939 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:33:46.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.718+0000 7f43b5852b80 10 client.25939 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:33:46.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.718+0000 7f43b5852b80 20 client.25939 populate_metadata read hostname 'smithi047' 2024-05-14T12:33:46.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.718+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a084b30 0x55bd2a086f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:46.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.718+0000 7f43b5852b80 4 client.25939 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9b9ec3b6", "release": true, "await": true}] 2024-05-14T12:33:46.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.718+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9b9ec3b6", "release": true, "await": true}) -- 0x55bd29f2e500 con 0x55bd2a084b30 2024-05-14T12:33:46.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.718+0000 7f439f400700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a084b30 0x55bd2a086f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:46.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.719+0000 7f439f400700 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a084b30 0x55bd2a086f50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b86c01b5941b2953 server_cookie=769022660745a3c in_seq=0 out_seq=0 2024-05-14T12:33:46.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.719+0000 7f438a000700 10 client.25939 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:46.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f438a000700 1 -- 172.21.15.47:0/3718541756 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55bd29f2e500 con 0x55bd2a084b30 2024-05-14T12:33:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f438a000700 10 client.25939 handle_command_reply: tid=0 2024-05-14T12:33:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 client.25939 shutdown 2024-05-14T12:33:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 msgr2=0x55bd2a011520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a011520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55bd2a01ba70 tx=0x7f4390004750 comp rx=0 tx=0).stop 2024-05-14T12:33:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 shutdown_connections 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bd2a084b30 0x55bd2a086f50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f438a000700 0 client.25939 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd29ffea10 0x55bd2a00ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bd29e80f40 0x55bd2a011520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 --2- 172.21.15.47:0/3718541756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bd29ffe600 0x55bd2a00d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.782+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 >> 172.21.15.47:0/3718541756 conn(0x55bd29ebfb80 msgr2=0x55bd2a006c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.783+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 shutdown_connections 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.783+0000 7f43b5852b80 1 -- 172.21.15.47:0/3718541756 wait complete. 2024-05-14T12:33:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.783+0000 7f43b5852b80 20 client.25939 trim_cache size 0 max 16384 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 40, 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 20, 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "9b9ec3b6": { 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 20, 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:33:46.785 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 90.0, 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:46.786 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:46.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:46.787 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:33:46.787 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:33:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f43840b2900 msgr2=0x7f43840b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f43840b2900 0x7f43840b4e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55bd29fff620 tx=0x7f4390009260 comp rx=0 tx=0).stop 2024-05-14T12:33:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 msgr2=0x7f43a0077110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 0x7f43a0077110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f438c000c00 tx=0x7f438c00f950 comp rx=0 tx=0).stop 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 shutdown_connections 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f43840b2900 0x7f43840b4e10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43a0109870 0x7f43a0077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43a01045f0 0x7f43a0076bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 --2- 172.21.15.47:0/1496092586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43a0108f20 0x7f43a0077110 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f438c000c00 tx=0x7f438c00f950 comp rx=0 tx=0).stop 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.784+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 >> 172.21.15.47:0/1496092586 conn(0x7f43a00ffec0 msgr2=0x7f43a01022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.785+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 shutdown_connections 2024-05-14T12:33:46.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:33:46.785+0000 7f43a6e00700 1 -- 172.21.15.47:0/1496092586 wait complete. 2024-05-14T12:33:47.633 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9b9ec3b6', seconds elapsed: 85.1 2024-05-14T12:33:47.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:47 smithi047 ceph-mon[31254]: pgmap v708: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 24 MiB/s wr, 3.26k op/s 2024-05-14T12:33:48.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:47 smithi073 ceph-mon[35809]: pgmap v708: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 24 MiB/s wr, 3.26k op/s 2024-05-14T12:33:48.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:47 smithi066 ceph-mon[35981]: pgmap v708: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 24 MiB/s wr, 3.26k op/s 2024-05-14T12:33:49.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:49 smithi047 ceph-mon[31254]: pgmap v709: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 3.90k op/s 2024-05-14T12:33:50.005 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:49 smithi073 ceph-mon[35809]: pgmap v709: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 3.90k op/s 2024-05-14T12:33:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:49 smithi066 ceph-mon[35981]: pgmap v709: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 3.90k op/s 2024-05-14T12:33:51.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:51 smithi047 ceph-mon[31254]: pgmap v710: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 4.31k op/s 2024-05-14T12:33:52.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:51 smithi073 ceph-mon[35809]: pgmap v710: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 4.31k op/s 2024-05-14T12:33:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:51 smithi066 ceph-mon[35981]: pgmap v710: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 4.31k op/s 2024-05-14T12:33:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:53 smithi047 ceph-mon[31254]: pgmap v711: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 4.21k op/s 2024-05-14T12:33:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:53 smithi073 ceph-mon[35809]: pgmap v711: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 4.21k op/s 2024-05-14T12:33:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:53 smithi066 ceph-mon[35981]: pgmap v711: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 4.21k op/s 2024-05-14T12:33:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.290+0000 7f1cf3e00640 1 -- 172.21.15.47:0/1458538508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf410a0d0 msgr2=0x7f1cf410add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.290+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/1458538508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf410a0d0 0x7f1cf410add0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009900 tx=0x7f1ce402a3f0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.290+0000 7f1cf3e00640 1 -- 172.21.15.47:0/1458538508 shutdown_connections 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.290+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/1458538508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf4110010 0x7f1cf4112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.290+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/1458538508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cf410b310 0x7f1cf410b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.290+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/1458538508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf410a0d0 0x7f1cf410add0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.290+0000 7f1cf3e00640 1 -- 172.21.15.47:0/1458538508 >> 172.21.15.47:0/1458538508 conn(0x7f1cf4078ce0 msgr2=0x7f1cf4107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.291+0000 7f1cf3e00640 1 -- 172.21.15.47:0/1458538508 shutdown_connections 2024-05-14T12:33:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.291+0000 7f1cf3e00640 1 -- 172.21.15.47:0/1458538508 wait complete. 2024-05-14T12:33:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 Processor -- start 2024-05-14T12:33:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 -- start start 2024-05-14T12:33:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cf410a0d0 0x7f1cf41a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf410b310 0x7f1cf41a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf4110010 0x7f1cf41a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf4115c90 con 0x7f1cf4110010 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf4115b10 con 0x7f1cf410a0d0 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf3e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf4115e10 con 0x7f1cf410b310 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cea000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf410b310 0x7f1cf41a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cf410a0d0 0x7f1cf41a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.292+0000 7f1cea000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf410b310 0x7f1cf41a0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55084/0 (socket says 172.21.15.47:55084) 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cea000640 1 -- 172.21.15.47:0/3683256216 learned_addr learned my addr 172.21.15.47:0/3683256216 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cf3400640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf4110010 0x7f1cf41a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cea000640 1 -- 172.21.15.47:0/3683256216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cf410a0d0 msgr2=0x7f1cf41a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cea000640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cf410a0d0 0x7f1cf41a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cea000640 1 -- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf4110010 msgr2=0x7f1cf41a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cea000640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf4110010 0x7f1cf41a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cea000640 1 -- 172.21.15.47:0/3683256216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf41a8300 con 0x7f1cf410b310 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cf3400640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf4110010 0x7f1cf41a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cea000640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf410b310 0x7f1cf41a0d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009d50 tx=0x7f1cdc00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cebe00640 1 -- 172.21.15.47:0/3683256216 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc003b70 con 0x7f1cf410b310 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf41a85f0 con 0x7f1cf410b310 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cebe00640 1 -- 172.21.15.47:0/3683256216 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cdc003d10 con 0x7f1cf410b310 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.293+0000 7f1cebe00640 1 -- 172.21.15.47:0/3683256216 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0108b0 con 0x7f1cf410b310 2024-05-14T12:33:54.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.294+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf41a8b40 con 0x7f1cf410b310 2024-05-14T12:33:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 Processor -- start 2024-05-14T12:33:54.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 -- start start 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36ee1b0 0x5640e3a90300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36c52f0 0x5640e3a90880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a97780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5640e39f4550 con 0x5640e36ee1b0 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5640e3999bc0 con 0x5640e36c52f0 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1d009b5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5640e39f0510 con 0x5640e36cd4d0 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1cebe00640 1 -- 172.21.15.47:0/3683256216 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1cdc004000 con 0x7f1cf410b310 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1cf3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36ee1b0 0x5640e3a90300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36c52f0 0x5640e3a90880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1cf3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36ee1b0 0x5640e3a90300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36390/0 (socket says 172.21.15.47:36390) 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36c52f0 0x5640e3a90880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:45070/0 (socket says 172.21.15.47:45070) 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1cf3400640 1 -- 172.21.15.47:0/143104129 learned_addr learned my addr 172.21.15.47:0/143104129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.297+0000 7f1cea000640 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a97780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1cf2a00640 1 -- 172.21.15.47:0/143104129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 msgr2=0x5640e3a97780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a97780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1cf2a00640 1 -- 172.21.15.47:0/143104129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36ee1b0 msgr2=0x5640e3a90300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36ee1b0 0x5640e3a90300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1cf2a00640 1 -- 172.21.15.47:0/143104129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640e3706210 con 0x5640e36c52f0 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36c52f0 0x5640e3a90880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ce402a910 tx=0x7f1ce4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=181ec337b6ca7095 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1ce3e00640 1 -- 172.21.15.47:0/143104129 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4035030 con 0x5640e36c52f0 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1ce3e00640 1 -- 172.21.15.47:0/143104129 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce4040070 con 0x5640e36c52f0 2024-05-14T12:33:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.298+0000 7f1ce3e00640 1 -- 172.21.15.47:0/143104129 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4003850 con 0x5640e36c52f0 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.299+0000 7f1cebe00640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cd80b28a0 0x7f1cd80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.299+0000 7f1cebe00640 1 -- 172.21.15.47:0/3683256216 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1cdc0e2990 con 0x7f1cf410b310 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.299+0000 7f1d009b5740 1 -- 172.21.15.47:0/143104129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36c52f0 msgr2=0x5640e3a90880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.299+0000 7f1d009b5740 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36c52f0 0x5640e3a90880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ce402a910 tx=0x7f1ce4000bc0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.299+0000 7f1cf3400640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cd80b28a0 0x7f1cd80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 -- 172.21.15.47:0/143104129 shutdown_connections 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a97780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36c52f0 0x5640e3a90880 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 --2- 172.21.15.47:0/143104129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36ee1b0 0x5640e3a90300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 -- 172.21.15.47:0/143104129 >> 172.21.15.47:0/143104129 conn(0x5640e36e2300 msgr2=0x5640e3a8bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 -- 172.21.15.47:0/143104129 shutdown_connections 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 -- 172.21.15.47:0/143104129 wait complete. 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1cf3400640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cd80b28a0 0x7f1cd80b4db0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5640e3a914d0 tx=0x7f1cec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.300+0000 7f1d009b5740 1 -- start start 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 1 Processor -- start 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a99da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a9a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36ee1b0 0x5640e3aa1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5640e3a98170 con 0x5640e36c52f0 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5640e39ad660 con 0x5640e36ee1b0 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5640e3a982f0 con 0x5640e36cd4d0 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1d009b5740 10 client.0 _ll_register_callbacks cb 0x5640e3977400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1cea000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a9a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1cf3400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36ee1b0 0x5640e3aa1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a99da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1cea000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a9a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55104/0 (socket says 172.21.15.47:55104) 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.301+0000 7f1cea000640 1 -- 172.21.15.47:0/4175634594 learned_addr learned my addr 172.21.15.47:0/4175634594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1cea000640 1 -- 172.21.15.47:0/4175634594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36ee1b0 msgr2=0x5640e3aa1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1cea000640 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36ee1b0 0x5640e3aa1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1cea000640 1 -- 172.21.15.47:0/4175634594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 msgr2=0x5640e3a99da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1cea000640 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a99da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1cea000640 1 -- 172.21.15.47:0/4175634594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640e37d2620 con 0x5640e36cd4d0 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1cea000640 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a9a2e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0a71e0 tx=0x7f1cdc0a99b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a69311016a8779 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1ce0c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1ce0c00640 1 -- 172.21.15.47:0/4175634594 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0a9f70 con 0x5640e36cd4d0 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1ce0c00640 1 -- 172.21.15.47:0/4175634594 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1cdc004560 con 0x5640e36cd4d0 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ce4040070 con 0x5640e36cd4d0 2024-05-14T12:33:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1ce0c00640 1 -- 172.21.15.47:0/4175634594 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f1cdc06e050 con 0x5640e36cd4d0 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1d009b5740 10 client.25951 fetch_fsmap learned FSMap version 40 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.302+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5640e3aa41e0 con 0x5640e36cd4d0 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1ce0c00640 1 -- 172.21.15.47:0/4175634594 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce4040070 con 0x5640e36cd4d0 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1ce0c00640 1 -- 172.21.15.47:0/4175634594 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f1cdc0a58e0 con 0x5640e36cd4d0 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1d009b5740 10 client.25951 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1d009b5740 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1d009b5740 20 client.25951 populate_metadata read hostname 'smithi047' 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1d009b5740 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36acd80 0x5640e3aa78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1d009b5740 4 client.25951 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640e3a02160 con 0x5640e36acd80 2024-05-14T12:33:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.303+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36acd80 0x5640e3aa78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.304+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36acd80 0x5640e3aa78f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e1a67cd96f7de2 server_cookie=bb2dc6fe88128e41 in_seq=0 out_seq=0 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.304+0000 7f1ce0c00640 10 client.25951 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.304+0000 7f1ce0c00640 1 -- 172.21.15.47:0/4175634594 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5640e3a02160 con 0x5640e36acd80 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.304+0000 7f1ce0c00640 10 client.25951 handle_command_reply: tid=0 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.304+0000 7f1d009b5740 1 client.25951 shutdown 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 msgr2=0x5640e3a9a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a9a2e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0a71e0 tx=0x7f1cdc0a99b0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 shutdown_connections 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36acd80 0x5640e3aa78f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36ee1b0 0x5640e3aa1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a9a2e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1ce0c00640 0 client.25951 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 --2- 172.21.15.47:0/4175634594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a99da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 >> 172.21.15.47:0/4175634594 conn(0x5640e36e2300 msgr2=0x5640e3a8eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 shutdown_connections 2024-05-14T12:33:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 1 -- 172.21.15.47:0/4175634594 wait complete. 2024-05-14T12:33:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.305+0000 7f1d009b5740 20 client.25951 trim_cache size 0 max 16384 2024-05-14T12:33:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 Processor -- start 2024-05-14T12:33:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 -- start start 2024-05-14T12:33:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a8a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3aa1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a8a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf41b17a0 con 0x5640e36c52f0 2024-05-14T12:33:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf41b3310 con 0x5640e36acd80 2024-05-14T12:33:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1d009b5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf41b1e70 con 0x5640e36cd4d0 2024-05-14T12:33:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1cf3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a8a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1cf3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a8a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55112/0 (socket says 172.21.15.47:55112) 2024-05-14T12:33:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.322+0000 7f1cf3400640 1 -- 172.21.15.47:0/488821452 learned_addr learned my addr 172.21.15.47:0/488821452 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a8a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cea000640 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3aa1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cf3400640 1 -- 172.21.15.47:0/488821452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 msgr2=0x5640e3a8a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cf3400640 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a8a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cf3400640 1 -- 172.21.15.47:0/488821452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 msgr2=0x5640e3aa1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cf3400640 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3aa1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cf3400640 1 -- 172.21.15.47:0/488821452 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640e3a874a0 con 0x5640e36cd4d0 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1cf3400640 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a8a790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1cec01f5e0 tx=0x7f1cec01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa7c34ead725c6e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.323+0000 7f1ce3400640 1 -- 172.21.15.47:0/488821452 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec011600 con 0x5640e36cd4d0 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1ce3400640 1 -- 172.21.15.47:0/488821452 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cec011c50 con 0x5640e36cd4d0 2024-05-14T12:33:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1ce3400640 1 -- 172.21.15.47:0/488821452 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec01dd40 con 0x5640e36cd4d0 2024-05-14T12:33:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1d009b5740 1 -- 172.21.15.47:0/488821452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 msgr2=0x5640e3a8a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:33:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1d009b5740 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a8a790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1cec01f5e0 tx=0x7f1cec01a000 comp rx=0 tx=0).stop 2024-05-14T12:33:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1d009b5740 1 -- 172.21.15.47:0/488821452 shutdown_connections 2024-05-14T12:33:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1d009b5740 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3a8a790 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1d009b5740 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3aa1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1d009b5740 1 --2- 172.21.15.47:0/488821452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a8a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.324+0000 7f1d009b5740 1 -- 172.21.15.47:0/488821452 >> 172.21.15.47:0/488821452 conn(0x5640e36e2300 msgr2=0x5640e3a94260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.325+0000 7f1d009b5740 1 -- 172.21.15.47:0/488821452 shutdown_connections 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.325+0000 7f1d009b5740 1 -- 172.21.15.47:0/488821452 wait complete. 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.325+0000 7f1d009b5740 1 -- start start 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.325+0000 7f1d009b5740 1 Processor -- start 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.325+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a9f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1d009b5740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3aa0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1d009b5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf41b2c10 con 0x5640e36c52f0 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1d009b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf41b2540 con 0x5640e36acd80 2024-05-14T12:33:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1d009b5740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf41af760 con 0x5640e36cd4d0 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1d009b5740 10 client.0 _ll_register_callbacks cb 0x7f1cdc004830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a9eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:45084/0 (socket says 172.21.15.47:45084) 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 -- 172.21.15.47:0/2005440653 learned_addr learned my addr 172.21.15.47:0/2005440653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cea000640 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a9f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf3400640 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3aa0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 -- 172.21.15.47:0/2005440653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 msgr2=0x5640e3aa0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3aa0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 -- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 msgr2=0x5640e3a9f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a9f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 -- 172.21.15.47:0/2005440653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640e3aa05c0 con 0x5640e36acd80 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1cf2a00640 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a9eb90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009900 tx=0x7f1ce40318a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57e8f3319dca0194 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:33:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.326+0000 7f1ce0c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1ce0c00640 1 -- 172.21.15.47:0/2005440653 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4055020 con 0x5640e36acd80 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1ce0c00640 1 -- 172.21.15.47:0/2005440653 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1ce4004450 con 0x5640e36acd80 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cec011c50 con 0x5640e36acd80 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1ce0c00640 1 -- 172.21.15.47:0/2005440653 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f1ce4035040 con 0x5640e36acd80 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1d009b5740 10 client.25928 fetch_fsmap learned FSMap version 40 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5640e3b0fef0 con 0x5640e36acd80 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1ce0c00640 1 -- 172.21.15.47:0/2005440653 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cec011c50 con 0x5640e36acd80 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1ce0c00640 1 -- 172.21.15.47:0/2005440653 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8358+0+0 (secure 0 0 0) 0x7f1ce4003ab0 con 0x5640e36acd80 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1d009b5740 10 client.25928 fetch_fsmap finished waiting for FSMap version 40 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1d009b5740 10 client.25928 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1d009b5740 20 client.25928 populate_metadata read hostname 'smithi047' 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.327+0000 7f1d009b5740 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36ee1b0 0x5640e3b12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.328+0000 7f1d009b5740 4 client.25928 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:33:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.328+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5640e39fbfd0 con 0x5640e36ee1b0 2024-05-14T12:33:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.328+0000 7f1cea000640 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36ee1b0 0x5640e3b12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:33:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.328+0000 7f1cea000640 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36ee1b0 0x5640e3b12580 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ecee527c71216d1 server_cookie=ebbbcc8fbdfa53eb in_seq=0 out_seq=0 2024-05-14T12:33:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:33:54.328+0000 7f1ce0c00640 10 client.25928 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:33:55.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:55 smithi047 ceph-mon[31254]: pgmap v712: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 4.04k op/s 2024-05-14T12:33:56.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:55 smithi073 ceph-mon[35809]: pgmap v712: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 4.04k op/s 2024-05-14T12:33:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:55 smithi066 ceph-mon[35981]: pgmap v712: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 4.04k op/s 2024-05-14T12:33:57.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:57 smithi047 ceph-mon[31254]: pgmap v713: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 MiB/s wr, 4.34k op/s 2024-05-14T12:33:58.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:57 smithi073 ceph-mon[35809]: pgmap v713: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 MiB/s wr, 4.34k op/s 2024-05-14T12:33:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:57 smithi066 ceph-mon[35981]: pgmap v713: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 MiB/s wr, 4.34k op/s 2024-05-14T12:33:59.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:33:59 smithi047 ceph-mon[31254]: pgmap v714: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 4.68k op/s 2024-05-14T12:34:00.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:33:59 smithi073 ceph-mon[35809]: pgmap v714: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 4.68k op/s 2024-05-14T12:34:00.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:33:59 smithi066 ceph-mon[35981]: pgmap v714: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 4.68k op/s 2024-05-14T12:34:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:01 smithi066 ceph-mon[35981]: pgmap v715: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 4.58k op/s 2024-05-14T12:34:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:01 smithi047 ceph-mon[31254]: pgmap v715: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 4.58k op/s 2024-05-14T12:34:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:01 smithi073 ceph-mon[35809]: pgmap v715: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 4.58k op/s 2024-05-14T12:34:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:03 smithi066 ceph-mon[35981]: pgmap v716: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 4.88k op/s 2024-05-14T12:34:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:03 smithi047 ceph-mon[31254]: pgmap v716: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 4.88k op/s 2024-05-14T12:34:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:03 smithi073 ceph-mon[35809]: pgmap v716: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 4.88k op/s 2024-05-14T12:34:06.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:05 smithi066 ceph-mon[35981]: pgmap v717: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 32 MiB/s wr, 4.67k op/s 2024-05-14T12:34:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:05 smithi047 ceph-mon[31254]: pgmap v717: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 32 MiB/s wr, 4.67k op/s 2024-05-14T12:34:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:05 smithi073 ceph-mon[35809]: pgmap v717: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 32 MiB/s wr, 4.67k op/s 2024-05-14T12:34:07.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:06 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:07.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:06 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:07.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:06 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:08.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:07 smithi066 ceph-mon[35981]: pgmap v718: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 6.02k op/s 2024-05-14T12:34:08.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:07 smithi047 ceph-mon[31254]: pgmap v718: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 6.02k op/s 2024-05-14T12:34:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:07 smithi073 ceph-mon[35809]: pgmap v718: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 6.02k op/s 2024-05-14T12:34:09.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:08 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:09.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:08 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:09.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:08 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:10.153 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:09 smithi047 ceph-mon[31254]: pgmap v719: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 36 MiB/s wr, 6.26k op/s 2024-05-14T12:34:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:09 smithi073 ceph-mon[35809]: pgmap v719: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 36 MiB/s wr, 6.26k op/s 2024-05-14T12:34:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:09 smithi066 ceph-mon[35981]: pgmap v719: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 36 MiB/s wr, 6.26k op/s 2024-05-14T12:34:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:11 smithi047 ceph-mon[31254]: pgmap v720: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 6.79k op/s 2024-05-14T12:34:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:11 smithi073 ceph-mon[35809]: pgmap v720: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 6.79k op/s 2024-05-14T12:34:12.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:11 smithi066 ceph-mon[35981]: pgmap v720: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 6.79k op/s 2024-05-14T12:34:14.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:13 smithi047 ceph-mon[31254]: pgmap v721: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 35 MiB/s wr, 6.87k op/s 2024-05-14T12:34:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:13 smithi073 ceph-mon[35809]: pgmap v721: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 35 MiB/s wr, 6.87k op/s 2024-05-14T12:34:14.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:13 smithi066 ceph-mon[35981]: pgmap v721: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 35 MiB/s wr, 6.87k op/s 2024-05-14T12:34:16.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:15 smithi047 ceph-mon[31254]: pgmap v722: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 29 MiB/s wr, 5.68k op/s 2024-05-14T12:34:16.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:15 smithi073 ceph-mon[35809]: pgmap v722: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 29 MiB/s wr, 5.68k op/s 2024-05-14T12:34:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:15 smithi066 ceph-mon[35981]: pgmap v722: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 29 MiB/s wr, 5.68k op/s 2024-05-14T12:34:18.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:17 smithi047 ceph-mon[31254]: pgmap v723: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 34 MiB/s wr, 6.43k op/s 2024-05-14T12:34:18.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:17 smithi073 ceph-mon[35809]: pgmap v723: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 34 MiB/s wr, 6.43k op/s 2024-05-14T12:34:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:17 smithi066 ceph-mon[35981]: pgmap v723: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 34 MiB/s wr, 6.43k op/s 2024-05-14T12:34:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.364+0000 7f1ce0c00640 1 -- 172.21.15.47:0/2005440653 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5640e39fbfd0 con 0x5640e36ee1b0 2024-05-14T12:34:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.364+0000 7f1ce0c00640 10 client.25928 handle_command_reply: tid=0 2024-05-14T12:34:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.364+0000 7f1d009b5740 1 client.25928 shutdown 2024-05-14T12:34:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.364+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 msgr2=0x5640e3a9eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.364+0000 7f1d009b5740 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a9eb90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009900 tx=0x7f1ce40318a0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.365+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 shutdown_connections 2024-05-14T12:34:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.365+0000 7f1d009b5740 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5640e36ee1b0 0x5640e3b12580 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.365+0000 7f1d009b5740 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640e36cd4d0 0x5640e3aa0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.365+0000 7f1d009b5740 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5640e36c52f0 0x5640e3a9f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.365+0000 7f1d009b5740 1 --2- 172.21.15.47:0/2005440653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640e36acd80 0x5640e3a9eb90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.365+0000 7f1ce0c00640 0 client.25928 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:34:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.365+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 >> 172.21.15.47:0/2005440653 conn(0x5640e36e2300 msgr2=0x5640e3a8ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.366+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 shutdown_connections 2024-05-14T12:34:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.366+0000 7f1d009b5740 1 -- 172.21.15.47:0/2005440653 wait complete. 2024-05-14T12:34:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.367+0000 7f1d009b5740 20 client.25928 trim_cache size 0 max 16384 2024-05-14T12:34:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:34:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:34:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:34:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:34:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cd80b28a0 msgr2=0x7f1cd80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cd80b28a0 0x7f1cd80b4db0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5640e3a914d0 tx=0x7f1cec005f90 comp rx=0 tx=0).stop 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf410b310 msgr2=0x7f1cf41a0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf410b310 0x7f1cf41a0d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009d50 tx=0x7f1cdc00c6a0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 shutdown_connections 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1cd80b28a0 0x7f1cd80b4db0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cf4110010 0x7f1cf41a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cf410b310 0x7f1cf41a0d00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 --2- 172.21.15.47:0/3683256216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cf410a0d0 0x7f1cf41a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.369+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 >> 172.21.15.47:0/3683256216 conn(0x7f1cf4078ce0 msgr2=0x7f1cf410bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.373+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 shutdown_connections 2024-05-14T12:34:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:18.373+0000 7f1cf3e00640 1 -- 172.21.15.47:0/3683256216 wait complete. 2024-05-14T12:34:19.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:18 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:19.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:18 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:19.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:18 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:19 smithi047 ceph-mon[31254]: pgmap v724: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 30 MiB/s wr, 5.39k op/s 2024-05-14T12:34:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:19 smithi073 ceph-mon[35809]: pgmap v724: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 30 MiB/s wr, 5.39k op/s 2024-05-14T12:34:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:19 smithi066 ceph-mon[35981]: pgmap v724: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 30 MiB/s wr, 5.39k op/s 2024-05-14T12:34:22.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:21 smithi047 ceph-mon[31254]: pgmap v725: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 30 MiB/s wr, 5.16k op/s 2024-05-14T12:34:22.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:21 smithi073 ceph-mon[35809]: pgmap v725: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 30 MiB/s wr, 5.16k op/s 2024-05-14T12:34:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:21 smithi066 ceph-mon[35981]: pgmap v725: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 30 MiB/s wr, 5.16k op/s 2024-05-14T12:34:24.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:23 smithi047 ceph-mon[31254]: pgmap v726: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 28 MiB/s wr, 4.66k op/s 2024-05-14T12:34:24.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:23 smithi073 ceph-mon[35809]: pgmap v726: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 28 MiB/s wr, 4.66k op/s 2024-05-14T12:34:24.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:23 smithi066 ceph-mon[35981]: pgmap v726: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 28 MiB/s wr, 4.66k op/s 2024-05-14T12:34:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:25 smithi047 ceph-mon[31254]: pgmap v727: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 26 MiB/s wr, 4.08k op/s 2024-05-14T12:34:26.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:25 smithi073 ceph-mon[35809]: pgmap v727: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 26 MiB/s wr, 4.08k op/s 2024-05-14T12:34:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:25 smithi066 ceph-mon[35981]: pgmap v727: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 26 MiB/s wr, 4.08k op/s 2024-05-14T12:34:28.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:27 smithi047 ceph-mon[31254]: pgmap v728: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-05-14T12:34:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:27 smithi073 ceph-mon[35809]: pgmap v728: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-05-14T12:34:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:27 smithi066 ceph-mon[35981]: pgmap v728: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-05-14T12:34:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:29 smithi047 ceph-mon[31254]: pgmap v729: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 32 MiB/s wr, 4.11k op/s 2024-05-14T12:34:30.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:29 smithi073 ceph-mon[35809]: pgmap v729: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 32 MiB/s wr, 4.11k op/s 2024-05-14T12:34:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:29 smithi066 ceph-mon[35981]: pgmap v729: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 32 MiB/s wr, 4.11k op/s 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.632+0000 7f0ba2200640 1 -- 172.21.15.47:0/627406976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c102b50 msgr2=0x7f0b9c103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.632+0000 7f0ba2200640 1 --2- 172.21.15.47:0/627406976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c102b50 0x7f0b9c103850 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009900 tx=0x7f0b8c02a3f0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.633+0000 7f0ba2200640 1 -- 172.21.15.47:0/627406976 shutdown_connections 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.633+0000 7f0ba2200640 1 --2- 172.21.15.47:0/627406976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b9c108a90 0x7f0b9c10aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.633+0000 7f0ba2200640 1 --2- 172.21.15.47:0/627406976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b9c103d90 0x7f0b9c1041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.633+0000 7f0ba2200640 1 --2- 172.21.15.47:0/627406976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c102b50 0x7f0b9c103850 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.633+0000 7f0ba2200640 1 -- 172.21.15.47:0/627406976 >> 172.21.15.47:0/627406976 conn(0x7f0b9c0fdd40 msgr2=0x7f0b9c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.633+0000 7f0ba2200640 1 -- 172.21.15.47:0/627406976 shutdown_connections 2024-05-14T12:34:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.633+0000 7f0ba2200640 1 -- 172.21.15.47:0/627406976 wait complete. 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 Processor -- start 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 -- start start 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b9c102b50 0x7f0b9c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c103d90 0x7f0b9c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b9c108a90 0x7f0b9c1a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10e6a0 con 0x7f0b9c102b50 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10e520 con 0x7f0b9c108a90 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.634+0000 7f0ba2200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c10e820 con 0x7f0b9c103d90 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c103d90 0x7f0b9c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b9b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b9c102b50 0x7f0b9c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c103d90 0x7f0b9c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39226/0 (socket says 172.21.15.47:39226) 2024-05-14T12:34:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 -- 172.21.15.47:0/4158028581 learned_addr learned my addr 172.21.15.47:0/4158028581 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:34:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b9be00640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b9c108a90 0x7f0b9c1a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 -- 172.21.15.47:0/4158028581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b9c108a90 msgr2=0x7f0b9c1a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b9c108a90 0x7f0b9c1a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 -- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b9c102b50 msgr2=0x7f0b9c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b9c102b50 0x7f0b9c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 -- 172.21.15.47:0/4158028581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c1a1e70 con 0x7f0b9c103d90 2024-05-14T12:34:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b93e00640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c103d90 0x7f0b9c19a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e9f0 tx=0x7f0b8400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:34:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.635+0000 7f0b98c00640 1 -- 172.21.15.47:0/4158028581 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400cd80 con 0x7f0b9c103d90 2024-05-14T12:34:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.636+0000 7f0b98c00640 1 -- 172.21.15.47:0/4158028581 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b840054d0 con 0x7f0b9c103d90 2024-05-14T12:34:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.636+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c1a2160 con 0x7f0b9c103d90 2024-05-14T12:34:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.636+0000 7f0b98c00640 1 -- 172.21.15.47:0/4158028581 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84010690 con 0x7f0b9c103d90 2024-05-14T12:34:31.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.636+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c1a26b0 con 0x7f0b9c103d90 2024-05-14T12:34:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.639+0000 7f0ba9191740 1 Processor -- start 2024-05-14T12:34:31.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.639+0000 7f0ba9191740 1 -- start start 2024-05-14T12:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e72b51b0 0x5642e7657100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e728c2f0 0x5642e7657680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e765e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0ba9191740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5642e75bb550 con 0x5642e728c2f0 2024-05-14T12:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0ba9191740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5642e7560bc0 con 0x5642e72944d0 2024-05-14T12:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0ba9191740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5642e75b7510 con 0x5642e72b51b0 2024-05-14T12:34:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e72b51b0 0x5642e7657100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b98c00640 1 -- 172.21.15.47:0/4158028581 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0b84010830 con 0x7f0b9c103d90 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e72b51b0 0x5642e7657100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39230/0 (socket says 172.21.15.47:39230) 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 -- 172.21.15.47:0/2302379134 learned_addr learned my addr 172.21.15.47:0/2302379134 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9b400640 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e728c2f0 0x5642e7657680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b93e00640 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e765e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 -- 172.21.15.47:0/2302379134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 msgr2=0x5642e765e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e765e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 -- 172.21.15.47:0/2302379134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e728c2f0 msgr2=0x5642e7657680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e728c2f0 0x5642e7657680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b9be00640 1 -- 172.21.15.47:0/2302379134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642e72cd210 con 0x5642e72b51b0 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.640+0000 7f0b93e00640 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e765e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.641+0000 7f0b9be00640 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e72b51b0 0x5642e7657100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009fd0 tx=0x7f0b940118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6208a0fcc11e73a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.641+0000 7f0b8be00640 1 -- 172.21.15.47:0/2302379134 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004d20 con 0x5642e72b51b0 2024-05-14T12:34:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.641+0000 7f0b8be00640 1 -- 172.21.15.47:0/2302379134 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b94004050 con 0x5642e72b51b0 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.641+0000 7f0b8be00640 1 -- 172.21.15.47:0/2302379134 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94005220 con 0x5642e72b51b0 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0b98c00640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b800b2920 0x7f0b800b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 -- 172.21.15.47:0/2302379134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e72b51b0 msgr2=0x5642e7657100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e72b51b0 0x5642e7657100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009fd0 tx=0x7f0b940118d0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0b98c00640 1 -- 172.21.15.47:0/4158028581 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0b840e2620 con 0x7f0b9c103d90 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 -- 172.21.15.47:0/2302379134 shutdown_connections 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0b9b400640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b800b2920 0x7f0b800b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e765e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e728c2f0 0x5642e7657680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2302379134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e72b51b0 0x5642e7657100 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 -- 172.21.15.47:0/2302379134 >> 172.21.15.47:0/2302379134 conn(0x5642e72a9300 msgr2=0x5642e7652a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 -- 172.21.15.47:0/2302379134 shutdown_connections 2024-05-14T12:34:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.642+0000 7f0ba9191740 1 -- 172.21.15.47:0/2302379134 wait complete. 2024-05-14T12:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0b9b400640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b800b2920 0x7f0b800b4e30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c02a9e0 tx=0x7f0b8c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 -- start start 2024-05-14T12:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 Processor -- start 2024-05-14T12:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72944d0 0x5642e76610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72b51b0 0x5642e7668040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5642e765efd0 con 0x5642e72944d0 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5642e7574660 con 0x5642e72b51b0 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.643+0000 7f0ba9191740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5642e765f150 con 0x5642e728c2f0 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0ba9191740 10 client.0 _ll_register_callbacks cb 0x5642e753e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39246/0 (socket says 172.21.15.47:39246) 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 -- 172.21.15.47:0/4224598359 learned_addr learned my addr 172.21.15.47:0/4224598359 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b93e00640 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72944d0 0x5642e76610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9be00640 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72b51b0 0x5642e7668040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 -- 172.21.15.47:0/4224598359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72b51b0 msgr2=0x5642e7668040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72b51b0 0x5642e7668040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 -- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72944d0 msgr2=0x5642e76610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72944d0 0x5642e76610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 -- 172.21.15.47:0/4224598359 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642e7399620 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b9b400640 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c031440 tx=0x7f0b8c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6f1e166a86f30b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.644+0000 7f0b88c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.645+0000 7f0b88c00640 1 -- 172.21.15.47:0/4224598359 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c035040 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.645+0000 7f0b88c00640 1 -- 172.21.15.47:0/4224598359 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0b8c0317a0 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.645+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b94004050 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.645+0000 7f0b88c00640 1 -- 172.21.15.47:0/4224598359 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0b8c0319a0 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.645+0000 7f0ba9191740 10 client.25969 fetch_fsmap learned FSMap version 43 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.645+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5642e766af50 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.645+0000 7f0b88c00640 1 -- 172.21.15.47:0/4224598359 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b94004050 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0b88c00640 1 -- 172.21.15.47:0/4224598359 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f0b8c044030 con 0x5642e728c2f0 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0ba9191740 10 client.25969 fetch_fsmap finished waiting for FSMap version 43 2024-05-14T12:34:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0ba9191740 10 client.25969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0ba9191740 20 client.25969 populate_metadata read hostname 'smithi047' 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0ba9191740 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e7273d80 0x5642e766e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0ba9191740 4 client.25969 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642e75c9160 con 0x5642e7273d80 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.646+0000 7f0b93e00640 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e7273d80 0x5642e766e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.647+0000 7f0b93e00640 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e7273d80 0x5642e766e5f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b142a788d9024b9e server_cookie=d046a489daa19405 in_seq=0 out_seq=0 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.647+0000 7f0b88c00640 10 client.25969 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.647+0000 7f0b88c00640 1 -- 172.21.15.47:0/4224598359 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5642e75c9160 con 0x5642e7273d80 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.647+0000 7f0b88c00640 10 client.25969 handle_command_reply: tid=0 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 client.25969 shutdown 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 msgr2=0x5642e7660ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c031440 tx=0x7f0b8c009260 comp rx=0 tx=0).stop 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 shutdown_connections 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e7273d80 0x5642e766e5f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72b51b0 0x5642e7668040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72944d0 0x5642e76610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 --2- 172.21.15.47:0/4224598359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660ba0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 >> 172.21.15.47:0/4224598359 conn(0x5642e72a9300 msgr2=0x5642e76559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0b88c00640 0 client.25969 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 shutdown_connections 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 1 -- 172.21.15.47:0/4224598359 wait complete. 2024-05-14T12:34:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.648+0000 7f0ba9191740 20 client.25969 trim_cache size 0 max 16384 2024-05-14T12:34:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.664+0000 7f0ba9191740 1 Processor -- start 2024-05-14T12:34:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.664+0000 7f0ba9191740 1 -- start start 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7667fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7668510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0ba9191740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c1ab3b0 con 0x5642e72b51b0 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0ba9191740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c1acf20 con 0x5642e72944d0 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0ba9191740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c1aba80 con 0x5642e728c2f0 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0b93e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7667fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0b93e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7667fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:45278/0 (socket says 172.21.15.47:45278) 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0b93e00640 1 -- 172.21.15.47:0/2521966926 learned_addr learned my addr 172.21.15.47:0/2521966926 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0b9b400640 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.665+0000 7f0b9be00640 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7668510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b9b400640 1 -- 172.21.15.47:0/2521966926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 msgr2=0x5642e7667fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b9b400640 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7667fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b9b400640 1 -- 172.21.15.47:0/2521966926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 msgr2=0x5642e7668510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b9b400640 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7668510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b9b400640 1 -- 172.21.15.47:0/2521966926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642e76613c0 con 0x5642e728c2f0 2024-05-14T12:34:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b93e00640 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7667fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:34:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b9b400640 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660e80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c042040 tx=0x7f0b8c003b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=964b73340dc5907 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:34:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b8b400640 1 -- 172.21.15.47:0/2521966926 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c035070 con 0x5642e728c2f0 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b8b400640 1 -- 172.21.15.47:0/2521966926 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b8c04c070 con 0x5642e728c2f0 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.666+0000 7f0b8b400640 1 -- 172.21.15.47:0/2521966926 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c051470 con 0x5642e728c2f0 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 -- 172.21.15.47:0/2521966926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 msgr2=0x5642e7660e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660e80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c042040 tx=0x7f0b8c003b50 comp rx=0 tx=0).stop 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 -- 172.21.15.47:0/2521966926 shutdown_connections 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7668510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7667fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 --2- 172.21.15.47:0/2521966926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7660e80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 -- 172.21.15.47:0/2521966926 >> 172.21.15.47:0/2521966926 conn(0x5642e72a9300 msgr2=0x5642e7660770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 -- 172.21.15.47:0/2521966926 shutdown_connections 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.667+0000 7f0ba9191740 1 -- 172.21.15.47:0/2521966926 wait complete. 2024-05-14T12:34:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 -- start start 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 Processor -- start 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7665900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7665e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7666d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c1ac850 con 0x5642e72b51b0 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c1ac150 con 0x5642e72944d0 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c1a9370 con 0x5642e728c2f0 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.668+0000 7f0ba9191740 10 client.0 _ll_register_callbacks cb 0x7f0b8c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b93e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7665e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7666d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b93e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7665e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:45284/0 (socket says 172.21.15.47:45284) 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b93e00640 1 -- 172.21.15.47:0/802705719 learned_addr learned my addr 172.21.15.47:0/802705719 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7665900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9b400640 1 -- 172.21.15.47:0/802705719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 msgr2=0x5642e7665e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9b400640 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7665e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9b400640 1 -- 172.21.15.47:0/802705719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 msgr2=0x5642e7666d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9b400640 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7666d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9b400640 1 -- 172.21.15.47:0/802705719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642e7667330 con 0x5642e728c2f0 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b93e00640 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7665e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b9b400640 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7665900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c000c00 tx=0x7f0b8c03dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f4841580457a94 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.669+0000 7f0b88c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0b88c00640 1 -- 172.21.15.47:0/802705719 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c05e070 con 0x5642e728c2f0 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b8c04c070 con 0x5642e728c2f0 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0b88c00640 1 -- 172.21.15.47:0/802705719 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0b8c031d40 con 0x5642e728c2f0 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0b88c00640 1 -- 172.21.15.47:0/802705719 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0b8c035040 con 0x5642e728c2f0 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0ba9191740 10 client.25975 fetch_fsmap learned FSMap version 43 2024-05-14T12:34:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5642e76685c0 con 0x5642e728c2f0 2024-05-14T12:34:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0b88c00640 1 -- 172.21.15.47:0/802705719 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b8c04c070 con 0x5642e728c2f0 2024-05-14T12:34:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0b88c00640 1 -- 172.21.15.47:0/802705719 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f0b8c044070 con 0x5642e728c2f0 2024-05-14T12:34:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0ba9191740 10 client.25975 fetch_fsmap finished waiting for FSMap version 43 2024-05-14T12:34:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.670+0000 7f0ba9191740 10 client.25975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:34:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.671+0000 7f0ba9191740 20 client.25975 populate_metadata read hostname 'smithi047' 2024-05-14T12:34:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.671+0000 7f0ba9191740 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e72491c0 0x5642e76d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:34:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.671+0000 7f0ba9191740 4 client.25975 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:34:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.671+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5642e75c2fd0 con 0x5642e72491c0 2024-05-14T12:34:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.671+0000 7f0b93e00640 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e72491c0 0x5642e76d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:34:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.671+0000 7f0b88c00640 10 client.25975 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:34:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:31.671+0000 7f0b93e00640 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e72491c0 0x5642e76d8e10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2754b71bb863b43 server_cookie=e20a6adbabb4eff2 in_seq=0 out_seq=0 2024-05-14T12:34:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:31 smithi047 ceph-mon[31254]: pgmap v730: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 31 MiB/s wr, 3.85k op/s 2024-05-14T12:34:32.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:31 smithi073 ceph-mon[35809]: pgmap v730: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 31 MiB/s wr, 3.85k op/s 2024-05-14T12:34:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:31 smithi066 ceph-mon[35981]: pgmap v730: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 31 MiB/s wr, 3.85k op/s 2024-05-14T12:34:33.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:32 smithi073 ceph-mon[35809]: pgmap v731: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 34 MiB/s wr, 3.99k op/s 2024-05-14T12:34:33.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:32 smithi066 ceph-mon[35981]: pgmap v731: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 34 MiB/s wr, 3.99k op/s 2024-05-14T12:34:33.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:32 smithi047 ceph-mon[31254]: pgmap v731: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 34 MiB/s wr, 3.99k op/s 2024-05-14T12:34:35.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:35 smithi047 ceph-mon[31254]: pgmap v732: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 32 MiB/s wr, 3.71k op/s 2024-05-14T12:34:36.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:35 smithi073 ceph-mon[35809]: pgmap v732: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 32 MiB/s wr, 3.71k op/s 2024-05-14T12:34:36.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:35 smithi066 ceph-mon[35981]: pgmap v732: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 32 MiB/s wr, 3.71k op/s 2024-05-14T12:34:37.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:37 smithi047 ceph-mon[31254]: pgmap v733: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 34 MiB/s wr, 4.22k op/s 2024-05-14T12:34:38.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:37 smithi073 ceph-mon[35809]: pgmap v733: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 34 MiB/s wr, 4.22k op/s 2024-05-14T12:34:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:37 smithi066 ceph-mon[35981]: pgmap v733: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 34 MiB/s wr, 4.22k op/s 2024-05-14T12:34:38.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:38 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:39.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:38 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:39.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:38 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:34:40.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:39 smithi073 ceph-mon[35809]: pgmap v734: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 33 MiB/s wr, 4.37k op/s 2024-05-14T12:34:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:39 smithi066 ceph-mon[35981]: pgmap v734: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 33 MiB/s wr, 4.37k op/s 2024-05-14T12:34:40.252 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:39 smithi047 ceph-mon[31254]: pgmap v734: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 33 MiB/s wr, 4.37k op/s 2024-05-14T12:34:42.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:41 smithi073 ceph-mon[35809]: pgmap v735: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 31 MiB/s wr, 4.57k op/s 2024-05-14T12:34:42.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:41 smithi066 ceph-mon[35981]: pgmap v735: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 31 MiB/s wr, 4.57k op/s 2024-05-14T12:34:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:41 smithi047 ceph-mon[31254]: pgmap v735: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 31 MiB/s wr, 4.57k op/s 2024-05-14T12:34:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:43 smithi066 ceph-mon[35981]: pgmap v736: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 35 MiB/s wr, 5.03k op/s 2024-05-14T12:34:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:43 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:34:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:43 smithi047 ceph-mon[31254]: pgmap v736: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 35 MiB/s wr, 5.03k op/s 2024-05-14T12:34:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:43 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:34:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:43 smithi073 ceph-mon[35809]: pgmap v736: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 35 MiB/s wr, 5.03k op/s 2024-05-14T12:34:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:43 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:34:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: pgmap v737: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 31 MiB/s wr, 4.48k op/s 2024-05-14T12:34:45.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:34:45.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:34:45.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: pgmap v737: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 31 MiB/s wr, 4.48k op/s 2024-05-14T12:34:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:34:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:34:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: pgmap v737: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 31 MiB/s wr, 4.48k op/s 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:34:45.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:34:47.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:47 smithi047 ceph-mon[31254]: pgmap v738: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 33 MiB/s wr, 4.65k op/s 2024-05-14T12:34:48.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:47 smithi073 ceph-mon[35809]: pgmap v738: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 33 MiB/s wr, 4.65k op/s 2024-05-14T12:34:48.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:47 smithi066 ceph-mon[35981]: pgmap v738: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 33 MiB/s wr, 4.65k op/s 2024-05-14T12:34:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.116+0000 7f0b88c00640 1 -- 172.21.15.47:0/802705719 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5642e75c2fd0 con 0x5642e72491c0 2024-05-14T12:34:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0b88c00640 10 client.25975 handle_command_reply: tid=0 2024-05-14T12:34:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 client.25975 shutdown 2024-05-14T12:34:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 msgr2=0x5642e7665900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7665900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c000c00 tx=0x7f0b8c03dc00 comp rx=0 tx=0).stop 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 shutdown_connections 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5642e72491c0 0x5642e76d8e10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5642e72b51b0 0x5642e7666d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e72944d0 0x5642e7665e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.117+0000 7f0ba9191740 1 --2- 172.21.15.47:0/802705719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642e728c2f0 0x5642e7665900 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.118+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 >> 172.21.15.47:0/802705719 conn(0x5642e72a9300 msgr2=0x5642e7655890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.118+0000 7f0b88c00640 0 client.25975 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:34:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.118+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 shutdown_connections 2024-05-14T12:34:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.118+0000 7f0ba9191740 1 -- 172.21.15.47:0/802705719 wait complete. 2024-05-14T12:34:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.119+0000 7f0ba9191740 20 client.25975 trim_cache size 0 max 16384 2024-05-14T12:34:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:34:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:34:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:34:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:34:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b800b2920 msgr2=0x7f0b800b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b800b2920 0x7f0b800b4e30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c02a9e0 tx=0x7f0b8c0314a0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c103d90 msgr2=0x7f0b9c19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:34:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c103d90 0x7f0b9c19a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e9f0 tx=0x7f0b8400edf0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 shutdown_connections 2024-05-14T12:34:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0b800b2920 0x7f0b800b4e30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b9c108a90 0x7f0b9c1a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b9c103d90 0x7f0b9c19a870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.120+0000 7f0ba2200640 1 --2- 172.21.15.47:0/4158028581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b9c102b50 0x7f0b9c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:34:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.121+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 >> 172.21.15.47:0/4158028581 conn(0x7f0b9c0fdd40 msgr2=0x7f0b9c109ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:34:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.121+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 shutdown_connections 2024-05-14T12:34:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:34:48.121+0000 7f0ba2200640 1 -- 172.21.15.47:0/4158028581 wait complete. 2024-05-14T12:34:49.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:49 smithi047 ceph-mon[31254]: pgmap v739: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 34 MiB/s wr, 4.45k op/s 2024-05-14T12:34:50.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:49 smithi073 ceph-mon[35809]: pgmap v739: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 34 MiB/s wr, 4.45k op/s 2024-05-14T12:34:50.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:49 smithi066 ceph-mon[35981]: pgmap v739: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 34 MiB/s wr, 4.45k op/s 2024-05-14T12:34:51.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:51 smithi047 ceph-mon[31254]: pgmap v740: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 32 MiB/s wr, 3.86k op/s 2024-05-14T12:34:52.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:51 smithi073 ceph-mon[35809]: pgmap v740: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 32 MiB/s wr, 3.86k op/s 2024-05-14T12:34:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:51 smithi066 ceph-mon[35981]: pgmap v740: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 32 MiB/s wr, 3.86k op/s 2024-05-14T12:34:53.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:53 smithi047 ceph-mon[31254]: pgmap v741: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 32 MiB/s wr, 3.69k op/s 2024-05-14T12:34:54.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:53 smithi073 ceph-mon[35809]: pgmap v741: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 32 MiB/s wr, 3.69k op/s 2024-05-14T12:34:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:53 smithi066 ceph-mon[35981]: pgmap v741: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 32 MiB/s wr, 3.69k op/s 2024-05-14T12:34:56.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:55 smithi073 ceph-mon[35809]: pgmap v742: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 26 MiB/s wr, 2.88k op/s 2024-05-14T12:34:56.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:55 smithi066 ceph-mon[35981]: pgmap v742: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 26 MiB/s wr, 2.88k op/s 2024-05-14T12:34:56.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:55 smithi047 ceph-mon[31254]: pgmap v742: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 26 MiB/s wr, 2.88k op/s 2024-05-14T12:34:58.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:57 smithi073 ceph-mon[35809]: pgmap v743: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 38 MiB/s wr, 3.96k op/s 2024-05-14T12:34:58.037 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:57 smithi047 ceph-mon[31254]: pgmap v743: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 38 MiB/s wr, 3.96k op/s 2024-05-14T12:34:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:57 smithi066 ceph-mon[35981]: pgmap v743: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 38 MiB/s wr, 3.96k op/s 2024-05-14T12:35:00.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:34:59 smithi073 ceph-mon[35809]: pgmap v744: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 49 MiB/s wr, 5.01k op/s 2024-05-14T12:35:00.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:34:59 smithi066 ceph-mon[35981]: pgmap v744: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 49 MiB/s wr, 5.01k op/s 2024-05-14T12:35:00.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:34:59 smithi047 ceph-mon[31254]: pgmap v744: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 49 MiB/s wr, 5.01k op/s 2024-05-14T12:35:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 -- 172.21.15.47:0/2597098567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 msgr2=0x7f916810bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 --2- 172.21.15.47:0/2597098567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f916810bfd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9160009ca0 tx=0x7f916002a8b0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 -- 172.21.15.47:0/2597098567 shutdown_connections 2024-05-14T12:35:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 --2- 172.21.15.47:0/2597098567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f916810bfd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 --2- 172.21.15.47:0/2597098567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9168104eb0 0x7f91681052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 --2- 172.21.15.47:0/2597098567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9168103c70 0x7f9168104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 -- 172.21.15.47:0/2597098567 >> 172.21.15.47:0/2597098567 conn(0x7f91680fee60 msgr2=0x7f9168101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 -- 172.21.15.47:0/2597098567 shutdown_connections 2024-05-14T12:35:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.397+0000 7f916da00640 1 -- 172.21.15.47:0/2597098567 wait complete. 2024-05-14T12:35:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.399+0000 7f916da00640 1 Processor -- start 2024-05-14T12:35:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.399+0000 7f916da00640 1 -- start start 2024-05-14T12:35:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f916da00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9168103c70 0x7f916819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f916da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9168104eb0 0x7f916819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f916da00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f91681a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f916da00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f916810f780 con 0x7f9168104eb0 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f916da00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f916810f600 con 0x7f9168103c70 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f916da00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f916810f900 con 0x7f9168109bb0 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f9167400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f91681a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f9167400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f91681a38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34110/0 (socket says 172.21.15.47:34110) 2024-05-14T12:35:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.400+0000 7f9167400640 1 -- 172.21.15.47:0/479915618 learned_addr learned my addr 172.21.15.47:0/479915618 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9166000640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9168104eb0 0x7f916819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9166a00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9168103c70 0x7f916819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9167400640 1 -- 172.21.15.47:0/479915618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9168103c70 msgr2=0x7f916819c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9167400640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9168103c70 0x7f916819c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9167400640 1 -- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9168104eb0 msgr2=0x7f916819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9167400640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9168104eb0 0x7f916819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9167400640 1 -- 172.21.15.47:0/479915618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91681a3f60 con 0x7f9168109bb0 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9166a00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9168103c70 0x7f916819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:35:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.401+0000 7f9167400640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f91681a38f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9160006010 tx=0x7f9160003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.402+0000 7f915f400640 1 -- 172.21.15.47:0/479915618 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160004240 con 0x7f9168109bb0 2024-05-14T12:35:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.402+0000 7f915f400640 1 -- 172.21.15.47:0/479915618 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9160040070 con 0x7f9168109bb0 2024-05-14T12:35:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.402+0000 7f915f400640 1 -- 172.21.15.47:0/479915618 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160031da0 con 0x7f9168109bb0 2024-05-14T12:35:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.402+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9168194e60 con 0x7f9168109bb0 2024-05-14T12:35:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.402+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9168195400 con 0x7f9168109bb0 2024-05-14T12:35:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.407+0000 7f9174722740 1 Processor -- start 2024-05-14T12:35:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.408+0000 7f915f400640 1 -- 172.21.15.47:0/479915618 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f91600314d0 con 0x7f9168109bb0 2024-05-14T12:35:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.409+0000 7f9174722740 1 -- start start 2024-05-14T12:35:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9174722740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a732100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9174722740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a732680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9174722740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a739580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9174722740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e9a696550 con 0x559e9a3672f0 2024-05-14T12:35:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9174722740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e9a63bbc0 con 0x559e9a36f4d0 2024-05-14T12:35:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9174722740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559e9a692510 con 0x559e9a3901b0 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9166000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a732100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9166000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a732100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34116/0 (socket says 172.21.15.47:34116) 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.411+0000 7f9166000640 1 -- 172.21.15.47:0/787006266 learned_addr learned my addr 172.21.15.47:0/787006266 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166000640 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a739580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166a00640 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a732680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166000640 1 -- 172.21.15.47:0/787006266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 msgr2=0x559e9a739580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166000640 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a739580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166000640 1 -- 172.21.15.47:0/787006266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 msgr2=0x559e9a732680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166000640 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a732680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166000640 1 -- 172.21.15.47:0/787006266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9a3a8210 con 0x559e9a3901b0 2024-05-14T12:35:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f9166a00640 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a732680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:35:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.412+0000 7f915f400640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f914c0b2920 0x7f914c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.413+0000 7f915f400640 1 -- 172.21.15.47:0/479915618 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f9160103530 con 0x7f9168109bb0 2024-05-14T12:35:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.413+0000 7f9166000640 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a732100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9154005bc0 tx=0x7f9154004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60fc48012200b1f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.413+0000 7f9167400640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f914c0b2920 0x7f914c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.414+0000 7f9153e00640 1 -- 172.21.15.47:0/787006266 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154004030 con 0x559e9a3901b0 2024-05-14T12:35:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.414+0000 7f9153e00640 1 -- 172.21.15.47:0/787006266 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91540054d0 con 0x559e9a3901b0 2024-05-14T12:35:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.414+0000 7f9153e00640 1 -- 172.21.15.47:0/787006266 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154004030 con 0x559e9a3901b0 2024-05-14T12:35:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.415+0000 7f9174722740 1 -- 172.21.15.47:0/787006266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 msgr2=0x559e9a732100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.415+0000 7f9167400640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f914c0b2920 0x7f914c0b4e30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9160030860 tx=0x7f9160031440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.415+0000 7f9174722740 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a732100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9154005bc0 tx=0x7f9154004730 comp rx=0 tx=0).stop 2024-05-14T12:35:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.416+0000 7f9174722740 1 -- 172.21.15.47:0/787006266 shutdown_connections 2024-05-14T12:35:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.416+0000 7f9174722740 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a739580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.416+0000 7f9174722740 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a732680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.416+0000 7f9174722740 1 --2- 172.21.15.47:0/787006266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a732100 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.416+0000 7f9174722740 1 -- 172.21.15.47:0/787006266 >> 172.21.15.47:0/787006266 conn(0x559e9a384300 msgr2=0x559e9a72da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.416+0000 7f9174722740 1 -- 172.21.15.47:0/787006266 shutdown_connections 2024-05-14T12:35:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.417+0000 7f9174722740 1 -- 172.21.15.47:0/787006266 wait complete. 2024-05-14T12:35:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.417+0000 7f9174722740 1 -- start start 2024-05-14T12:35:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.418+0000 7f9174722740 1 Processor -- start 2024-05-14T12:35:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.419+0000 7f9174722740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.419+0000 7f9174722740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a36f4d0 0x559e9a73c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9174722740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3901b0 0x559e9a743120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9174722740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e9a739fd0 con 0x559e9a3672f0 2024-05-14T12:35:01.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9166a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a36f4d0 0x559e9a73c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9166a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a36f4d0 0x559e9a73c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34122/0 (socket says 172.21.15.47:34122) 2024-05-14T12:35:01.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9166a00640 1 -- 172.21.15.47:0/2984985359 learned_addr learned my addr 172.21.15.47:0/2984985359 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:01.420 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e9a64f660 con 0x559e9a3901b0 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559e9a73a150 con 0x559e9a36f4d0 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9166000640 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.420+0000 7f9174722740 10 client.0 _ll_register_callbacks cb 0x559e9a619400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.421+0000 7f9166000640 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3901b0 0x559e9a743120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.422+0000 7f9166000640 1 -- 172.21.15.47:0/2984985359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a36f4d0 msgr2=0x559e9a73c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.422+0000 7f9166000640 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a36f4d0 0x559e9a73c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.422+0000 7f9166000640 1 -- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 msgr2=0x559e9a73bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.422+0000 7f9166000640 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.422+0000 7f9166000640 1 -- 172.21.15.47:0/2984985359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e9a474620 con 0x559e9a3901b0 2024-05-14T12:35:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.422+0000 7f9166000640 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3901b0 0x559e9a743120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9154006010 tx=0x7f9154009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b35205a0ceacc2b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.422+0000 7f9150c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:35:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.423+0000 7f9150c00640 1 -- 172.21.15.47:0/2984985359 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154028050 con 0x559e9a3901b0 2024-05-14T12:35:01.422 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.423+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91540054d0 con 0x559e9a3901b0 2024-05-14T12:35:01.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.423+0000 7f9150c00640 1 -- 172.21.15.47:0/2984985359 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f915400f7c0 con 0x559e9a3901b0 2024-05-14T12:35:01.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.423+0000 7f9150c00640 1 -- 172.21.15.47:0/2984985359 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f915400f9c0 con 0x559e9a3901b0 2024-05-14T12:35:01.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.424+0000 7f9174722740 10 client.25955 fetch_fsmap learned FSMap version 44 2024-05-14T12:35:01.423 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.424+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559e9a745ff0 con 0x559e9a3901b0 2024-05-14T12:35:01.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.424+0000 7f9150c00640 1 -- 172.21.15.47:0/2984985359 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91540054d0 con 0x559e9a3901b0 2024-05-14T12:35:01.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.424+0000 7f9150c00640 1 -- 172.21.15.47:0/2984985359 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8366+0+0 (secure 0 0 0) 0x7f915402f8f0 con 0x559e9a3901b0 2024-05-14T12:35:01.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.425+0000 7f9174722740 10 client.25955 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T12:35:01.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.425+0000 7f9174722740 10 client.25955 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:35:01.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.425+0000 7f9174722740 20 client.25955 populate_metadata read hostname 'smithi047' 2024-05-14T12:35:01.424 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.425+0000 7f9174722740 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a34ed80 0x559e9a7494e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.425+0000 7f9174722740 4 client.25955 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:35:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.425+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e9a6a4160 con 0x559e9a34ed80 2024-05-14T12:35:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.425+0000 7f9166a00640 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a34ed80 0x559e9a7494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.425 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.426+0000 7f9166a00640 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a34ed80 0x559e9a7494e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ad259d484ce15a server_cookie=cc46f0fe59d74718 in_seq=0 out_seq=0 2024-05-14T12:35:01.426 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.426+0000 7f9150c00640 10 client.25955 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:35:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.427+0000 7f9150c00640 1 -- 172.21.15.47:0/2984985359 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559e9a6a4160 con 0x559e9a34ed80 2024-05-14T12:35:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.427+0000 7f9150c00640 10 client.25955 handle_command_reply: tid=0 2024-05-14T12:35:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.427+0000 7f9174722740 1 client.25955 shutdown 2024-05-14T12:35:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3901b0 msgr2=0x559e9a743120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3901b0 0x559e9a743120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9154006010 tx=0x7f9154009b80 comp rx=0 tx=0).stop 2024-05-14T12:35:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 shutdown_connections 2024-05-14T12:35:01.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a34ed80 0x559e9a7494e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3901b0 0x559e9a743120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a36f4d0 0x559e9a73c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 --2- 172.21.15.47:0/2984985359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9150c00640 0 client.25955 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 >> 172.21.15.47:0/2984985359 conn(0x559e9a384300 msgr2=0x559e9a7309a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.428+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 shutdown_connections 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.429+0000 7f9174722740 1 -- 172.21.15.47:0/2984985359 wait complete. 2024-05-14T12:35:01.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.429+0000 7f9174722740 20 client.25955 trim_cache size 0 max 16384 2024-05-14T12:35:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.456+0000 7f9174722740 1 Processor -- start 2024-05-14T12:35:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.456+0000 7f9174722740 1 -- start start 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9174722740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3672f0 0x559e9a735170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9174722740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a36f4d0 0x559e9a743040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9174722740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a7356b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9174722740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a90c0 con 0x559e9a36f4d0 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9174722740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f91681aac30 con 0x559e9a3672f0 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9174722740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a9790 con 0x559e9a3901b0 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9166000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3672f0 0x559e9a735170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9166000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3672f0 0x559e9a735170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54790/0 (socket says 172.21.15.47:54790) 2024-05-14T12:35:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.457+0000 7f9166000640 1 -- 172.21.15.47:0/3581650451 learned_addr learned my addr 172.21.15.47:0/3581650451 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.458+0000 7f9166000640 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a7356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.458+0000 7f9166a00640 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a36f4d0 0x559e9a743040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.458+0000 7f9166000640 1 -- 172.21.15.47:0/3581650451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 msgr2=0x559e9a7356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.458+0000 7f9166000640 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a7356b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.458+0000 7f9166000640 1 -- 172.21.15.47:0/3581650451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a36f4d0 msgr2=0x559e9a743040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.458+0000 7f9166000640 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a36f4d0 0x559e9a743040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.458+0000 7f9166000640 1 -- 172.21.15.47:0/3581650451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9a729280 con 0x559e9a3672f0 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.459+0000 7f9166000640 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3672f0 0x559e9a735170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9154004cf0 tx=0x7f915402f460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a29124b543bfef43 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.459+0000 7f9153400640 1 -- 172.21.15.47:0/3581650451 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154028040 con 0x559e9a3672f0 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.459+0000 7f9153400640 1 -- 172.21.15.47:0/3581650451 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9154023030 con 0x559e9a3672f0 2024-05-14T12:35:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.459+0000 7f9153400640 1 -- 172.21.15.47:0/3581650451 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915402f730 con 0x559e9a3672f0 2024-05-14T12:35:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.460+0000 7f9174722740 1 -- 172.21.15.47:0/3581650451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3672f0 msgr2=0x559e9a735170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.460+0000 7f9174722740 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3672f0 0x559e9a735170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9154004cf0 tx=0x7f915402f460 comp rx=0 tx=0).stop 2024-05-14T12:35:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.460+0000 7f9174722740 1 -- 172.21.15.47:0/3581650451 shutdown_connections 2024-05-14T12:35:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.460+0000 7f9174722740 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a7356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.460+0000 7f9174722740 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a36f4d0 0x559e9a743040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.460+0000 7f9174722740 1 --2- 172.21.15.47:0/3581650451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a3672f0 0x559e9a735170 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.460+0000 7f9174722740 1 -- 172.21.15.47:0/3581650451 >> 172.21.15.47:0/3581650451 conn(0x559e9a384300 msgr2=0x559e9a7360c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:01.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.461+0000 7f9174722740 1 -- 172.21.15.47:0/3581650451 shutdown_connections 2024-05-14T12:35:01.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.461+0000 7f9174722740 1 -- 172.21.15.47:0/3581650451 wait complete. 2024-05-14T12:35:01.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.461+0000 7f9174722740 1 -- start start 2024-05-14T12:35:01.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.461+0000 7f9174722740 1 Processor -- start 2024-05-14T12:35:01.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.462+0000 7f9174722740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.462+0000 7f9174722740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a740390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.462+0000 7f9174722740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a7af880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.462+0000 7f9174722740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91681aa560 con 0x559e9a3672f0 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.462+0000 7f9174722740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a9e60 con 0x559e9a36f4d0 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.462+0000 7f9174722740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a70c0 con 0x559e9a3901b0 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.462+0000 7f9174722740 10 client.0 _ll_register_callbacks cb 0x7f9154009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a740390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a740390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54794/0 (socket says 172.21.15.47:54794) 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 -- 172.21.15.47:0/1612814130 learned_addr learned my addr 172.21.15.47:0/1612814130 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166000640 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 -- 172.21.15.47:0/1612814130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 msgr2=0x559e9a7af880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a7af880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 -- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 msgr2=0x559e9a73fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166a00640 1 -- 172.21.15.47:0/1612814130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e9a740950 con 0x559e9a36f4d0 2024-05-14T12:35:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.463+0000 7f9166000640 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.464+0000 7f9166a00640 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a740390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x559e9a749c80 tx=0x7f9158022910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab56acfee1ba9f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.464+0000 7f9150c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.464+0000 7f9150c00640 1 -- 172.21.15.47:0/1612814130 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915802e980 con 0x559e9a36f4d0 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.464+0000 7f9150c00640 1 -- 172.21.15.47:0/1612814130 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f9158004020 con 0x559e9a36f4d0 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.465+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9154023030 con 0x559e9a36f4d0 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.465+0000 7f9150c00640 1 -- 172.21.15.47:0/1612814130 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9158004220 con 0x559e9a36f4d0 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.465+0000 7f9174722740 10 client.25961 fetch_fsmap learned FSMap version 44 2024-05-14T12:35:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.465+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559e9a7b0ee0 con 0x559e9a36f4d0 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.465+0000 7f9150c00640 1 -- 172.21.15.47:0/1612814130 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9154023030 con 0x559e9a36f4d0 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9150c00640 1 -- 172.21.15.47:0/1612814130 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8366+0+0 (secure 0 0 0) 0x7f915801f040 con 0x559e9a36f4d0 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9174722740 10 client.25961 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9174722740 10 client.25961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9174722740 20 client.25961 populate_metadata read hostname 'smithi047' 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9174722740 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a3241c0 0x559e9a7b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9174722740 4 client.25961 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:35:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e9a69dfd0 con 0x559e9a3241c0 2024-05-14T12:35:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.466+0000 7f9166000640 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a3241c0 0x559e9a7b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.467+0000 7f9166000640 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a3241c0 0x559e9a7b38c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cc98f6496a491ca server_cookie=c5eb7bfb3686a30f in_seq=0 out_seq=0 2024-05-14T12:35:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:35:01.467+0000 7f9150c00640 10 client.25961 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:35:02.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:01 smithi066 ceph-mon[35981]: pgmap v745: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 56 MiB/s wr, 5.81k op/s 2024-05-14T12:35:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:01 smithi047 ceph-mon[31254]: pgmap v745: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 56 MiB/s wr, 5.81k op/s 2024-05-14T12:35:02.257 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:01 smithi073 ceph-mon[35809]: pgmap v745: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 56 MiB/s wr, 5.81k op/s 2024-05-14T12:35:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:03 smithi066 ceph-mon[35981]: pgmap v746: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 64 MiB/s wr, 6.38k op/s 2024-05-14T12:35:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:03 smithi047 ceph-mon[31254]: pgmap v746: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 64 MiB/s wr, 6.38k op/s 2024-05-14T12:35:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:03 smithi073 ceph-mon[35809]: pgmap v746: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 64 MiB/s wr, 6.38k op/s 2024-05-14T12:35:06.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:05 smithi066 ceph-mon[35981]: pgmap v747: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 61 MiB/s wr, 6.04k op/s 2024-05-14T12:35:06.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:05 smithi047 ceph-mon[31254]: pgmap v747: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 61 MiB/s wr, 6.04k op/s 2024-05-14T12:35:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:05 smithi073 ceph-mon[35809]: pgmap v747: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 61 MiB/s wr, 6.04k op/s 2024-05-14T12:35:08.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:07 smithi066 ceph-mon[35981]: pgmap v748: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 69 MiB/s wr, 6.89k op/s 2024-05-14T12:35:08.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:07 smithi047 ceph-mon[31254]: pgmap v748: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 69 MiB/s wr, 6.89k op/s 2024-05-14T12:35:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:07 smithi073 ceph-mon[35809]: pgmap v748: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 69 MiB/s wr, 6.89k op/s 2024-05-14T12:35:10.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:09 smithi066 ceph-mon[35981]: pgmap v749: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 60 MiB/s wr, 6.02k op/s 2024-05-14T12:35:10.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:09 smithi047 ceph-mon[31254]: pgmap v749: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 60 MiB/s wr, 6.02k op/s 2024-05-14T12:35:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:09 smithi073 ceph-mon[35809]: pgmap v749: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 60 MiB/s wr, 6.02k op/s 2024-05-14T12:35:12.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:11 smithi066 ceph-mon[35981]: pgmap v750: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 49 MiB/s wr, 5.06k op/s 2024-05-14T12:35:12.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:11 smithi047 ceph-mon[31254]: pgmap v750: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 49 MiB/s wr, 5.06k op/s 2024-05-14T12:35:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:11 smithi073 ceph-mon[35809]: pgmap v750: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 49 MiB/s wr, 5.06k op/s 2024-05-14T12:35:14.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:13 smithi066 ceph-mon[35981]: pgmap v751: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 39 MiB/s wr, 4.04k op/s 2024-05-14T12:35:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:13 smithi047 ceph-mon[31254]: pgmap v751: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 39 MiB/s wr, 4.04k op/s 2024-05-14T12:35:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:13 smithi073 ceph-mon[35809]: pgmap v751: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 39 MiB/s wr, 4.04k op/s 2024-05-14T12:35:16.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:15 smithi066 ceph-mon[35981]: pgmap v752: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 28 MiB/s wr, 2.98k op/s 2024-05-14T12:35:16.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:15 smithi047 ceph-mon[31254]: pgmap v752: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 28 MiB/s wr, 2.98k op/s 2024-05-14T12:35:16.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:15 smithi073 ceph-mon[35809]: pgmap v752: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 28 MiB/s wr, 2.98k op/s 2024-05-14T12:35:18.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:17 smithi066 ceph-mon[35981]: pgmap v753: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 34 MiB/s wr, 3.77k op/s 2024-05-14T12:35:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:17 smithi047 ceph-mon[31254]: pgmap v753: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 34 MiB/s wr, 3.77k op/s 2024-05-14T12:35:18.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:17 smithi073 ceph-mon[35809]: pgmap v753: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 34 MiB/s wr, 3.77k op/s 2024-05-14T12:35:20.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:19 smithi066 ceph-mon[35981]: pgmap v754: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 31 MiB/s wr, 3.49k op/s 2024-05-14T12:35:20.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:19 smithi047 ceph-mon[31254]: pgmap v754: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 31 MiB/s wr, 3.49k op/s 2024-05-14T12:35:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:19 smithi073 ceph-mon[35809]: pgmap v754: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 31 MiB/s wr, 3.49k op/s 2024-05-14T12:35:22.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:21 smithi066 ceph-mon[35981]: pgmap v755: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 33 MiB/s wr, 3.74k op/s 2024-05-14T12:35:22.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:21 smithi047 ceph-mon[31254]: pgmap v755: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 33 MiB/s wr, 3.74k op/s 2024-05-14T12:35:22.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:21 smithi073 ceph-mon[35809]: pgmap v755: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 33 MiB/s wr, 3.74k op/s 2024-05-14T12:35:24.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:23 smithi066 ceph-mon[35981]: pgmap v756: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 33 MiB/s wr, 3.64k op/s 2024-05-14T12:35:24.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:23 smithi047 ceph-mon[31254]: pgmap v756: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 33 MiB/s wr, 3.64k op/s 2024-05-14T12:35:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:23 smithi073 ceph-mon[35809]: pgmap v756: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 33 MiB/s wr, 3.64k op/s 2024-05-14T12:35:26.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:25 smithi066 ceph-mon[35981]: pgmap v757: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 31 MiB/s wr, 3.49k op/s 2024-05-14T12:35:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:25 smithi047 ceph-mon[31254]: pgmap v757: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 31 MiB/s wr, 3.49k op/s 2024-05-14T12:35:26.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:25 smithi073 ceph-mon[35809]: pgmap v757: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 31 MiB/s wr, 3.49k op/s 2024-05-14T12:35:28.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:27 smithi066 ceph-mon[35981]: pgmap v758: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 36 MiB/s wr, 4.08k op/s 2024-05-14T12:35:28.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:27 smithi047 ceph-mon[31254]: pgmap v758: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 36 MiB/s wr, 4.08k op/s 2024-05-14T12:35:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:27 smithi073 ceph-mon[35809]: pgmap v758: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 36 MiB/s wr, 4.08k op/s 2024-05-14T12:35:30.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:29 smithi066 ceph-mon[35981]: pgmap v759: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 33 MiB/s wr, 3.80k op/s 2024-05-14T12:35:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:29 smithi047 ceph-mon[31254]: pgmap v759: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 33 MiB/s wr, 3.80k op/s 2024-05-14T12:35:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:29 smithi073 ceph-mon[35809]: pgmap v759: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 33 MiB/s wr, 3.80k op/s 2024-05-14T12:35:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:31 smithi047 ceph-mon[31254]: pgmap v760: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 34 MiB/s wr, 3.96k op/s 2024-05-14T12:35:32.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:31 smithi073 ceph-mon[35809]: pgmap v760: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 34 MiB/s wr, 3.96k op/s 2024-05-14T12:35:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:31 smithi066 ceph-mon[35981]: pgmap v760: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 34 MiB/s wr, 3.96k op/s 2024-05-14T12:35:34.126 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:33 smithi066 ceph-mon[35981]: pgmap v761: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 34 MiB/s wr, 3.96k op/s 2024-05-14T12:35:34.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:33 smithi047 ceph-mon[31254]: pgmap v761: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 34 MiB/s wr, 3.96k op/s 2024-05-14T12:35:34.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:33 smithi073 ceph-mon[35809]: pgmap v761: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 34 MiB/s wr, 3.96k op/s 2024-05-14T12:35:36.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:35 smithi047 ceph-mon[31254]: pgmap v762: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 30 MiB/s wr, 3.68k op/s 2024-05-14T12:35:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:35 smithi073 ceph-mon[35809]: pgmap v762: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 30 MiB/s wr, 3.68k op/s 2024-05-14T12:35:36.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:35 smithi066 ceph-mon[35981]: pgmap v762: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 30 MiB/s wr, 3.68k op/s 2024-05-14T12:35:38.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:37 smithi047 ceph-mon[31254]: pgmap v763: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 35 MiB/s wr, 4.20k op/s 2024-05-14T12:35:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:37 smithi073 ceph-mon[35809]: pgmap v763: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 35 MiB/s wr, 4.20k op/s 2024-05-14T12:35:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:37 smithi066 ceph-mon[35981]: pgmap v763: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 35 MiB/s wr, 4.20k op/s 2024-05-14T12:35:39.063 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.4 2024-05-14T12:35:39.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:35:39.604 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:35:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:39 smithi047 ceph-mon[31254]: pgmap v764: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 4.00k op/s 2024-05-14T12:35:40.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:39 smithi073 ceph-mon[35809]: pgmap v764: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 4.00k op/s 2024-05-14T12:35:40.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:39 smithi066 ceph-mon[35981]: pgmap v764: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 4.00k op/s 2024-05-14T12:35:41.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:41 smithi047 ceph-mon[31254]: pgmap v765: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 33 MiB/s wr, 4.11k op/s 2024-05-14T12:35:42.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.178+0000 7ffb82800700 1 -- 172.21.15.47:0/149885644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c110660 msgr2=0x7ffb7c110a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:42.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.178+0000 7ffb82800700 1 --2- 172.21.15.47:0/149885644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c110660 0x7ffb7c110a70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffb680099c0 tx=0x7ffb68009cd0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.179+0000 7ffb82800700 1 -- 172.21.15.47:0/149885644 shutdown_connections 2024-05-14T12:35:42.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.179+0000 7ffb82800700 1 --2- 172.21.15.47:0/149885644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb7c110fb0 0x7ffb7c1177e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.179+0000 7ffb82800700 1 --2- 172.21.15.47:0/149885644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb7c10b8a0 0x7ffb7c10bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.179+0000 7ffb82800700 1 --2- 172.21.15.47:0/149885644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c110660 0x7ffb7c110a70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.179+0000 7ffb82800700 1 -- 172.21.15.47:0/149885644 >> 172.21.15.47:0/149885644 conn(0x7ffb7c07a020 msgr2=0x7ffb7c07c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:42.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.179+0000 7ffb82800700 1 -- 172.21.15.47:0/149885644 shutdown_connections 2024-05-14T12:35:42.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.179+0000 7ffb82800700 1 -- 172.21.15.47:0/149885644 wait complete. 2024-05-14T12:35:42.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.181+0000 7ffb82800700 1 Processor -- start 2024-05-14T12:35:42.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.182+0000 7ffb82800700 1 -- start start 2024-05-14T12:35:42.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.182+0000 7ffb82800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c10b8a0 0x7ffb7c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:42.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.182+0000 7ffb82800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb7c110660 0x7ffb7c1a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:42.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.182+0000 7ffb82800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb7c110fb0 0x7ffb7c1a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:42.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.182+0000 7ffb82800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c11aaf0 con 0x7ffb7c110fb0 2024-05-14T12:35:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.182+0000 7ffb82800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c11a970 con 0x7ffb7c110660 2024-05-14T12:35:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.182+0000 7ffb82800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c11ac70 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.183+0000 7ffb7b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c10b8a0 0x7ffb7c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.183+0000 7ffb7b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c10b8a0 0x7ffb7c1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49402/0 (socket says 172.21.15.47:49402) 2024-05-14T12:35:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.183+0000 7ffb7b400700 1 -- 172.21.15.47:0/3024487613 learned_addr learned my addr 172.21.15.47:0/3024487613 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.183+0000 7ffb7aa00700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb7c110660 0x7ffb7c1a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.183+0000 7ffb7be00700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb7c110fb0 0x7ffb7c1a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.184+0000 7ffb7b400700 1 -- 172.21.15.47:0/3024487613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb7c110660 msgr2=0x7ffb7c1a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.184+0000 7ffb7b400700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb7c110660 0x7ffb7c1a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.184+0000 7ffb7b400700 1 -- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb7c110fb0 msgr2=0x7ffb7c1a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.184+0000 7ffb7b400700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb7c110fb0 0x7ffb7c1a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.184+0000 7ffb7b400700 1 -- 172.21.15.47:0/3024487613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c1a63f0 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.184+0000 7ffb7be00700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb7c110fb0 0x7ffb7c1a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:35:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.184+0000 7ffb7b400700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c10b8a0 0x7ffb7c1a1520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00e970 tx=0x7ffb6c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.185+0000 7ffb73e00700 1 -- 172.21.15.47:0/3024487613 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00cbd0 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.185+0000 7ffb73e00700 1 -- 172.21.15.47:0/3024487613 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb6c00cd70 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.185+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c1a66e0 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.185+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c1ae000 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.185+0000 7ffb73e00700 1 -- 172.21.15.47:0/3024487613 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c005680 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.188+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c005330 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.190+0000 7ffb73e00700 1 -- 172.21.15.47:0/3024487613 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ffb6c021440 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.193+0000 7ffb73e00700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb600b2900 0x7ffb600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:42.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.193+0000 7ffb73e00700 1 -- 172.21.15.47:0/3024487613 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ffb6c0a5f30 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.194+0000 7ffb7aa00700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb600b2900 0x7ffb600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:42.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.195+0000 7ffb7aa00700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb600b2900 0x7ffb600b4e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009990 tx=0x7ffb6801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:42.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.201+0000 7ffb73e00700 1 -- 172.21.15.47:0/3024487613 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffb6c0aa040 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:41 smithi073 ceph-mon[35809]: pgmap v765: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 33 MiB/s wr, 4.11k op/s 2024-05-14T12:35:42.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:41 smithi066 ceph-mon[35981]: pgmap v765: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 33 MiB/s wr, 4.11k op/s 2024-05-14T12:35:42.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.612+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb5c0058f0 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.613+0000 7ffb73e00700 1 -- 172.21.15.47:0/3024487613 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11923 (secure 0 0 0) 0x7ffb6c0adcf0 con 0x7ffb7c10b8a0 2024-05-14T12:35:42.614 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:35:42.614 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:34:36.988034+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24490,24502,24517,24521,24535]},"id":1}]} 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.617+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb600b2900 msgr2=0x7ffb600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.617+0000 7ffb82800700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb600b2900 0x7ffb600b4e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009990 tx=0x7ffb6801a040 comp rx=0 tx=0).stop 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c10b8a0 msgr2=0x7ffb7c1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c10b8a0 0x7ffb7c1a1520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00e970 tx=0x7ffb6c00ec80 comp rx=0 tx=0).stop 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 shutdown_connections 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb600b2900 0x7ffb600b4e10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb7c110fb0 0x7ffb7c1a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb7c10b8a0 0x7ffb7c1a1520 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 --2- 172.21.15.47:0/3024487613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb7c110660 0x7ffb7c1a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:42.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 >> 172.21.15.47:0/3024487613 conn(0x7ffb7c07a020 msgr2=0x7ffb7c07c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:42.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 shutdown_connections 2024-05-14T12:35:42.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:42.618+0000 7ffb82800700 1 -- 172.21.15.47:0/3024487613 wait complete. 2024-05-14T12:35:42.619 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 44 2024-05-14T12:35:42.866 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:42 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3024487613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:35:43.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:42 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3024487613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:35:43.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:42 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3024487613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:35:43.436 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 80.4 --await-for 42.0' 2024-05-14T12:35:43.436 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 80.4 --await-for 42.0 2024-05-14T12:35:44.026 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:35:44.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:43 smithi047 ceph-mon[31254]: pgmap v766: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 31 MiB/s wr, 3.93k op/s 2024-05-14T12:35:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:43 smithi073 ceph-mon[35809]: pgmap v766: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 31 MiB/s wr, 3.93k op/s 2024-05-14T12:35:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:43 smithi066 ceph-mon[35981]: pgmap v766: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 31 MiB/s wr, 3.93k op/s 2024-05-14T12:35:46.072 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:45 smithi047 ceph-mon[31254]: pgmap v767: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 25 MiB/s wr, 3.31k op/s 2024-05-14T12:35:46.073 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:45 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:35:46.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:45 smithi073 ceph-mon[35809]: pgmap v767: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 25 MiB/s wr, 3.31k op/s 2024-05-14T12:35:46.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:45 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:35:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:45 smithi066 ceph-mon[35981]: pgmap v767: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 25 MiB/s wr, 3.31k op/s 2024-05-14T12:35:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:45 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.585+0000 7f88c9000700 1 -- 172.21.15.47:0/1368057250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105e70 msgr2=0x7f88c410e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.586+0000 7f88c9000700 1 --2- 172.21.15.47:0/1368057250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105e70 0x7f88c410e3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009990 tx=0x7f88b0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.586+0000 7f88c9000700 1 -- 172.21.15.47:0/1368057250 shutdown_connections 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.586+0000 7f88c9000700 1 --2- 172.21.15.47:0/1368057250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88c410e900 0x7f88c4110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.586+0000 7f88c9000700 1 --2- 172.21.15.47:0/1368057250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c4105520 0x7f88c4105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.586+0000 7f88c9000700 1 --2- 172.21.15.47:0/1368057250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105e70 0x7f88c410e3c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.586+0000 7f88c9000700 1 -- 172.21.15.47:0/1368057250 >> 172.21.15.47:0/1368057250 conn(0x7f88c40fedc0 msgr2=0x7f88c41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.587+0000 7f88c9000700 1 -- 172.21.15.47:0/1368057250 shutdown_connections 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.587+0000 7f88c9000700 1 -- 172.21.15.47:0/1368057250 wait complete. 2024-05-14T12:35:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 Processor -- start 2024-05-14T12:35:46.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 -- start start 2024-05-14T12:35:46.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105520 0x7f88c40751a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c4105e70 0x7f88c406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88c410e900 0x7f88c406e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4114490 con 0x7f88c410e900 2024-05-14T12:35:46.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4114310 con 0x7f88c4105520 2024-05-14T12:35:46.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.589+0000 7f88c9000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4114610 con 0x7f88c4105e70 2024-05-14T12:35:46.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.591+0000 7f88c1400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c4105e70 0x7f88c406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.591+0000 7f88c1400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c4105e70 0x7f88c406e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49422/0 (socket says 172.21.15.47:49422) 2024-05-14T12:35:46.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.591+0000 7f88c1400700 1 -- 172.21.15.47:0/3518984533 learned_addr learned my addr 172.21.15.47:0/3518984533 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:46.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.592+0000 7f88c2800700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88c410e900 0x7f88c406e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.593+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105520 0x7f88c40751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.593+0000 7f88c1e00700 1 -- 172.21.15.47:0/3518984533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c4105e70 msgr2=0x7f88c406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:46.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.593+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c4105e70 0x7f88c406e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.593+0000 7f88c1e00700 1 -- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88c410e900 msgr2=0x7f88c406e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:46.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.593+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88c410e900 0x7f88c406e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.593+0000 7f88c1e00700 1 -- 172.21.15.47:0/3518984533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c406ef40 con 0x7f88c4105520 2024-05-14T12:35:46.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.595+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105520 0x7f88c40751a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009fa0 tx=0x7f88b400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:46.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.595+0000 7f88baa00700 1 -- 172.21.15.47:0/3518984533 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4020070 con 0x7f88c4105520 2024-05-14T12:35:46.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.595+0000 7f88baa00700 1 -- 172.21.15.47:0/3518984533 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88b400ee60 con 0x7f88c4105520 2024-05-14T12:35:46.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.595+0000 7f88baa00700 1 -- 172.21.15.47:0/3518984533 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b401b900 con 0x7f88c4105520 2024-05-14T12:35:46.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.595+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c4072cd0 con 0x7f88c4105520 2024-05-14T12:35:46.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.596+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c40731c0 con 0x7f88c4105520 2024-05-14T12:35:46.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.602+0000 7f88d7c40b80 1 Processor -- start 2024-05-14T12:35:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.603+0000 7f88baa00700 1 -- 172.21.15.47:0/3518984533 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f88b4023070 con 0x7f88c4105520 2024-05-14T12:35:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.603+0000 7f88d7c40b80 1 -- start start 2024-05-14T12:35:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c770f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7719d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c771c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5647c7631bb0 con 0x5647c770faa0 2024-05-14T12:35:46.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5647c75cf8f0 con 0x5647c770f690 2024-05-14T12:35:46.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5647c762db70 con 0x5647c7591fd0 2024-05-14T12:35:46.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88c2800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c770f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88c2800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c770f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49432/0 (socket says 172.21.15.47:49432) 2024-05-14T12:35:46.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88c2800700 1 -- 172.21.15.47:0/3493777493 learned_addr learned my addr 172.21.15.47:0/3493777493 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:46.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.604+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7719d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88c1400700 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c771c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88c2800700 1 -- 172.21.15.47:0/3493777493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 msgr2=0x5647c7719d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:46.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88c2800700 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7719d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88c2800700 1 -- 172.21.15.47:0/3493777493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 msgr2=0x5647c771c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:46.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88c2800700 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c771c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88baa00700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f88a80b29d0 0x7f88a80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88c2800700 1 -- 172.21.15.47:0/3493777493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c757ea60 con 0x5647c7591fd0 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.605+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7719d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.606+0000 7f88baa00700 1 -- 172.21.15.47:0/3518984533 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f88b40e5fb0 con 0x7f88c4105520 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.607+0000 7f88c2800700 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c770f150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009440 tx=0x7f88bc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cac3446a88939a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.607+0000 7f88c2800700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f88a80b29d0 0x7f88a80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.607+0000 7f88af400700 1 -- 172.21.15.47:0/3493777493 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc012910 con 0x5647c7591fd0 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.607+0000 7f88af400700 1 -- 172.21.15.47:0/3493777493 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88bc017470 con 0x5647c7591fd0 2024-05-14T12:35:46.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.607+0000 7f88af400700 1 -- 172.21.15.47:0/3493777493 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc014640 con 0x5647c7591fd0 2024-05-14T12:35:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3493777493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 msgr2=0x5647c770f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:35:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c770f150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009440 tx=0x7f88bc009920 comp rx=0 tx=0).stop 2024-05-14T12:35:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88c2800700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f88a80b29d0 0x7f88a80b4ee0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f88bc017fd0 tx=0x7f88bc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3493777493 shutdown_connections 2024-05-14T12:35:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c771c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c770f150 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3493777493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7719d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.610+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3493777493 >> 172.21.15.47:0/3493777493 conn(0x5647c75d0c10 msgr2=0x5647c770afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:35:46.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.611+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3493777493 shutdown_connections 2024-05-14T12:35:46.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.611+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3493777493 wait complete. 2024-05-14T12:35:46.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.612+0000 7f88d7c40b80 1 -- start start 2024-05-14T12:35:46.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.613+0000 7f88d7c40b80 1 Processor -- start 2024-05-14T12:35:46.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.613+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c7591fd0 0x5647c77197c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.613+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770f690 0x5647c7719d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.613+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c771a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.613+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5647c77252c0 con 0x5647c770faa0 2024-05-14T12:35:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.613+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5647c7597cb0 con 0x5647c7591fd0 2024-05-14T12:35:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.613+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5647c7725440 con 0x5647c770f690 2024-05-14T12:35:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.614+0000 7f88d7c40b80 10 client.0 _ll_register_callbacks cb 0x5647c75c5510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:35:46.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.614+0000 7f88c1400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770f690 0x5647c7719d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.614+0000 7f88c1400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770f690 0x5647c7719d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:49442/0 (socket says 172.21.15.47:49442) 2024-05-14T12:35:46.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.614+0000 7f88c1400700 1 -- 172.21.15.47:0/3741750839 learned_addr learned my addr 172.21.15.47:0/3741750839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:35:46.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88c1400700 1 -- 172.21.15.47:0/3741750839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c7591fd0 msgr2=0x5647c77197c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:35:46.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88c1400700 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c7591fd0 0x5647c77197c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88c1400700 1 -- 172.21.15.47:0/3741750839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 msgr2=0x5647c771a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88c1400700 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c771a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88c1400700 1 -- 172.21.15.47:0/3741750839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c75f75b0 con 0x5647c770f690 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88c1400700 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770f690 0x5647c7719d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88b00098e0 tx=0x7f88b000ba00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7347915ef249f2f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88a3e00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.615+0000 7f88a3e00700 1 -- 172.21.15.47:0/3741750839 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0027060 con 0x5647c770f690 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.616+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88bc017470 con 0x5647c770f690 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.616+0000 7f88a3e00700 1 -- 172.21.15.47:0/3741750839 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f88b0009510 con 0x5647c770f690 2024-05-14T12:35:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.616+0000 7f88a3e00700 1 -- 172.21.15.47:0/3741750839 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f88b0027060 con 0x5647c770f690 2024-05-14T12:35:46.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.616+0000 7f88d7c40b80 10 client.26008 fetch_fsmap learned FSMap version 44 2024-05-14T12:35:46.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.616+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5647c7730120 con 0x5647c770f690 2024-05-14T12:35:46.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.617+0000 7f88a3e00700 1 -- 172.21.15.47:0/3741750839 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88bc017470 con 0x5647c770f690 2024-05-14T12:35:46.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.617+0000 7f88a3e00700 1 -- 172.21.15.47:0/3741750839 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 44) ==== 8366+0+0 (secure 0 0 0) 0x7f88b002c070 con 0x5647c770f690 2024-05-14T12:35:46.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.618+0000 7f88d7c40b80 10 client.26008 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T12:35:46.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.618+0000 7f88d7c40b80 10 client.26008 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:35:46.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.618+0000 7f88d7c40b80 20 client.26008 populate_metadata read hostname 'smithi047' 2024-05-14T12:35:46.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.618+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c77326b0 0x5647c7734af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:35:46.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.618+0000 7f88d7c40b80 4 client.26008 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:35:46.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.618+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647c76dc200 con 0x5647c77326b0 2024-05-14T12:35:46.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.618+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c77326b0 0x5647c7734af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:35:46.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.619+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c77326b0 0x5647c7734af0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f03a35ebba6ee11f server_cookie=b808a820208c04dc in_seq=0 out_seq=0 2024-05-14T12:35:46.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:35:46.619+0000 7f88a3e00700 10 client.26008 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:35:48.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:47 smithi047 ceph-mon[31254]: pgmap v768: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 3.79k op/s 2024-05-14T12:35:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:35:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:35:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:35:48.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:47 smithi073 ceph-mon[35809]: pgmap v768: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 3.79k op/s 2024-05-14T12:35:48.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:35:48.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:35:48.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:35:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:47 smithi066 ceph-mon[35981]: pgmap v768: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 3.79k op/s 2024-05-14T12:35:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:35:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:35:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:35:50.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:49 smithi047 ceph-mon[31254]: pgmap v769: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 27 MiB/s wr, 3.70k op/s 2024-05-14T12:35:50.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:49 smithi073 ceph-mon[35809]: pgmap v769: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 27 MiB/s wr, 3.70k op/s 2024-05-14T12:35:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:49 smithi066 ceph-mon[35981]: pgmap v769: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 27 MiB/s wr, 3.70k op/s 2024-05-14T12:35:52.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:51 smithi047 ceph-mon[31254]: pgmap v770: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 30 MiB/s wr, 4.26k op/s 2024-05-14T12:35:52.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:51 smithi073 ceph-mon[35809]: pgmap v770: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 30 MiB/s wr, 4.26k op/s 2024-05-14T12:35:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:51 smithi066 ceph-mon[35981]: pgmap v770: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 30 MiB/s wr, 4.26k op/s 2024-05-14T12:35:54.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:53 smithi047 ceph-mon[31254]: pgmap v771: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 31 MiB/s wr, 4.30k op/s 2024-05-14T12:35:54.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:53 smithi073 ceph-mon[35809]: pgmap v771: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 31 MiB/s wr, 4.30k op/s 2024-05-14T12:35:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:53 smithi066 ceph-mon[35981]: pgmap v771: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 31 MiB/s wr, 4.30k op/s 2024-05-14T12:35:56.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:55 smithi047 ceph-mon[31254]: pgmap v772: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 29 MiB/s wr, 3.91k op/s 2024-05-14T12:35:56.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:55 smithi073 ceph-mon[35809]: pgmap v772: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 29 MiB/s wr, 3.91k op/s 2024-05-14T12:35:56.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:55 smithi066 ceph-mon[35981]: pgmap v772: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 29 MiB/s wr, 3.91k op/s 2024-05-14T12:35:58.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:57 smithi047 ceph-mon[31254]: pgmap v773: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 34 MiB/s wr, 4.72k op/s 2024-05-14T12:35:58.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:57 smithi073 ceph-mon[35809]: pgmap v773: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 34 MiB/s wr, 4.72k op/s 2024-05-14T12:35:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:57 smithi066 ceph-mon[35981]: pgmap v773: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 34 MiB/s wr, 4.72k op/s 2024-05-14T12:36:00.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:35:59 smithi047 ceph-mon[31254]: pgmap v774: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 31 MiB/s wr, 4.24k op/s 2024-05-14T12:36:00.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:35:59 smithi073 ceph-mon[35809]: pgmap v774: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 31 MiB/s wr, 4.24k op/s 2024-05-14T12:36:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:35:59 smithi066 ceph-mon[35981]: pgmap v774: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 31 MiB/s wr, 4.24k op/s 2024-05-14T12:36:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:01 smithi047 ceph-mon[31254]: pgmap v775: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 31 MiB/s wr, 4.43k op/s 2024-05-14T12:36:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:01 smithi073 ceph-mon[35809]: pgmap v775: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 31 MiB/s wr, 4.43k op/s 2024-05-14T12:36:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:01 smithi066 ceph-mon[35981]: pgmap v775: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 31 MiB/s wr, 4.43k op/s 2024-05-14T12:36:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:03 smithi047 ceph-mon[31254]: pgmap v776: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 31 MiB/s wr, 4.38k op/s 2024-05-14T12:36:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:03 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:36:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:03 smithi073 ceph-mon[35809]: pgmap v776: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 31 MiB/s wr, 4.38k op/s 2024-05-14T12:36:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:03 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:36:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:03 smithi066 ceph-mon[35981]: pgmap v776: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 31 MiB/s wr, 4.38k op/s 2024-05-14T12:36:04.349 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:03 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:36:06.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:05 smithi047 ceph-mon[31254]: pgmap v777: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 26 MiB/s wr, 3.73k op/s 2024-05-14T12:36:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:05 smithi073 ceph-mon[35809]: pgmap v777: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 26 MiB/s wr, 3.73k op/s 2024-05-14T12:36:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:05 smithi066 ceph-mon[35981]: pgmap v777: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 26 MiB/s wr, 3.73k op/s 2024-05-14T12:36:08.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:07 smithi047 ceph-mon[31254]: pgmap v778: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 31 MiB/s wr, 4.63k op/s 2024-05-14T12:36:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:07 smithi073 ceph-mon[35809]: pgmap v778: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 31 MiB/s wr, 4.63k op/s 2024-05-14T12:36:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:07 smithi066 ceph-mon[35981]: pgmap v778: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 31 MiB/s wr, 4.63k op/s 2024-05-14T12:36:10.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:09 smithi047 ceph-mon[31254]: pgmap v779: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 29 MiB/s wr, 4.38k op/s 2024-05-14T12:36:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:09 smithi073 ceph-mon[35809]: pgmap v779: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 29 MiB/s wr, 4.38k op/s 2024-05-14T12:36:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:09 smithi066 ceph-mon[35981]: pgmap v779: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 29 MiB/s wr, 4.38k op/s 2024-05-14T12:36:12.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:11 smithi047 ceph-mon[31254]: pgmap v780: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 33 MiB/s wr, 5.04k op/s 2024-05-14T12:36:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:11 smithi073 ceph-mon[35809]: pgmap v780: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 33 MiB/s wr, 5.04k op/s 2024-05-14T12:36:12.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:11 smithi066 ceph-mon[35981]: pgmap v780: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 33 MiB/s wr, 5.04k op/s 2024-05-14T12:36:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:13 smithi047 ceph-mon[31254]: pgmap v781: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 5.13k op/s 2024-05-14T12:36:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:13 smithi073 ceph-mon[35809]: pgmap v781: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 5.13k op/s 2024-05-14T12:36:14.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:13 smithi066 ceph-mon[35981]: pgmap v781: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 5.13k op/s 2024-05-14T12:36:16.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:15 smithi047 ceph-mon[31254]: pgmap v782: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 MiB/s wr, 4.23k op/s 2024-05-14T12:36:16.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:15 smithi073 ceph-mon[35809]: pgmap v782: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 MiB/s wr, 4.23k op/s 2024-05-14T12:36:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:15 smithi066 ceph-mon[35981]: pgmap v782: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 MiB/s wr, 4.23k op/s 2024-05-14T12:36:18.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:17 smithi047 ceph-mon[31254]: pgmap v783: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 5.28k op/s 2024-05-14T12:36:18.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:17 smithi073 ceph-mon[35809]: pgmap v783: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 5.28k op/s 2024-05-14T12:36:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:17 smithi066 ceph-mon[35981]: pgmap v783: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 33 MiB/s wr, 5.28k op/s 2024-05-14T12:36:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:19 smithi047 ceph-mon[31254]: pgmap v784: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 30 MiB/s wr, 4.89k op/s 2024-05-14T12:36:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:19 smithi073 ceph-mon[35809]: pgmap v784: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 30 MiB/s wr, 4.89k op/s 2024-05-14T12:36:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:19 smithi066 ceph-mon[35981]: pgmap v784: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 30 MiB/s wr, 4.89k op/s 2024-05-14T12:36:22.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:21 smithi047 ceph-mon[31254]: pgmap v785: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 28 MiB/s wr, 4.59k op/s 2024-05-14T12:36:22.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:21 smithi073 ceph-mon[35809]: pgmap v785: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 28 MiB/s wr, 4.59k op/s 2024-05-14T12:36:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:21 smithi066 ceph-mon[35981]: pgmap v785: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 28 MiB/s wr, 4.59k op/s 2024-05-14T12:36:24.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:23 smithi047 ceph-mon[31254]: pgmap v786: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 28 MiB/s wr, 4.68k op/s 2024-05-14T12:36:24.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:23 smithi073 ceph-mon[35809]: pgmap v786: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 28 MiB/s wr, 4.68k op/s 2024-05-14T12:36:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:23 smithi066 ceph-mon[35981]: pgmap v786: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 28 MiB/s wr, 4.68k op/s 2024-05-14T12:36:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:25 smithi047 ceph-mon[31254]: pgmap v787: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 23 MiB/s wr, 3.94k op/s 2024-05-14T12:36:26.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:25 smithi073 ceph-mon[35809]: pgmap v787: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 23 MiB/s wr, 3.94k op/s 2024-05-14T12:36:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:25 smithi066 ceph-mon[35981]: pgmap v787: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 23 MiB/s wr, 3.94k op/s 2024-05-14T12:36:28.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:27 smithi047 ceph-mon[31254]: pgmap v788: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 4.96k op/s 2024-05-14T12:36:28.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:27 smithi073 ceph-mon[35809]: pgmap v788: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 4.96k op/s 2024-05-14T12:36:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:27 smithi066 ceph-mon[35981]: pgmap v788: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 4.96k op/s 2024-05-14T12:36:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:29 smithi047 ceph-mon[31254]: pgmap v789: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 26 MiB/s wr, 4.48k op/s 2024-05-14T12:36:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:29 smithi073 ceph-mon[35809]: pgmap v789: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 26 MiB/s wr, 4.48k op/s 2024-05-14T12:36:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:29 smithi066 ceph-mon[35981]: pgmap v789: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 26 MiB/s wr, 4.48k op/s 2024-05-14T12:36:31.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:31 smithi066 ceph-mon[35981]: pgmap v790: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 24 MiB/s wr, 4.15k op/s 2024-05-14T12:36:31.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:31 smithi047 ceph-mon[31254]: pgmap v790: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 24 MiB/s wr, 4.15k op/s 2024-05-14T12:36:31.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:31 smithi073 ceph-mon[35809]: pgmap v790: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 24 MiB/s wr, 4.15k op/s 2024-05-14T12:36:34.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:33 smithi073 ceph-mon[35809]: pgmap v791: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 28 MiB/s wr, 4.87k op/s 2024-05-14T12:36:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.006+0000 7f9150c00640 1 -- 172.21.15.47:0/1612814130 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e9a69dfd0 con 0x559e9a3241c0 2024-05-14T12:36:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.006+0000 7f9150c00640 10 client.25961 handle_command_reply: tid=0 2024-05-14T12:36:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.006+0000 7f9174722740 1 client.25961 shutdown 2024-05-14T12:36:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 msgr2=0x559e9a740390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a740390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x559e9a749c80 tx=0x7f9158022910 comp rx=0 tx=0).stop 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 shutdown_connections 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559e9a3241c0 0x559e9a7b38c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e9a3901b0 0x559e9a7af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e9a36f4d0 0x559e9a740390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 --2- 172.21.15.47:0/1612814130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e9a3672f0 0x559e9a73fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 >> 172.21.15.47:0/1612814130 conn(0x559e9a384300 msgr2=0x559e9a735170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f9150c00640 0 client.25961 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 shutdown_connections 2024-05-14T12:36:34.008 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:33 smithi047 ceph-mon[31254]: pgmap v791: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 28 MiB/s wr, 4.87k op/s 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f88a3e00700 1 -- 172.21.15.47:0/3741750839 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5647c76dc200 con 0x5647c77326b0 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f88a3e00700 10 client.26008 handle_command_reply: tid=0 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.007+0000 7f88d7c40b80 1 client.26008 shutdown 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770f690 msgr2=0x5647c7719d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770f690 0x5647c7719d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88b00098e0 tx=0x7f88b000ba00 comp rx=0 tx=0).stop 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 shutdown_connections 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c77326b0 0x5647c7734af0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c771a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c7591fd0 0x5647c77197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3741750839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770f690 0x5647c7719d00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.008+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 >> 172.21.15.47:0/3741750839 conn(0x5647c75d0c10 msgr2=0x5647c770a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.009+0000 7f9174722740 1 -- 172.21.15.47:0/1612814130 wait complete. 2024-05-14T12:36:34.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.009+0000 7f88a3e00700 0 client.26008 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:34.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.009+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 shutdown_connections 2024-05-14T12:36:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.009+0000 7f9174722740 20 client.25961 trim_cache size 0 max 16384 2024-05-14T12:36:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.010+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3741750839 wait complete. 2024-05-14T12:36:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:36:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:36:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:36:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:36:34.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.010+0000 7f88d7c40b80 20 client.26008 trim_cache size 0 max 16384 2024-05-14T12:36:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f914c0b2920 msgr2=0x7f914c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f914c0b2920 0x7f914c0b4e30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9160030860 tx=0x7f9160031440 comp rx=0 tx=0).stop 2024-05-14T12:36:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 msgr2=0x7f91681a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f91681a38f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9160006010 tx=0x7f9160003ba0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 shutdown_connections 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f914c0b2920 0x7f914c0b4e30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9168109bb0 0x7f91681a38f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9168104eb0 0x7f916819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 --2- 172.21.15.47:0/479915618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9168103c70 0x7f916819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.011+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 >> 172.21.15.47:0/479915618 conn(0x7f91680fee60 msgr2=0x7f91680ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.012+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 shutdown_connections 2024-05-14T12:36:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:34.012+0000 7f916da00640 1 -- 172.21.15.47:0/479915618 wait complete. 2024-05-14T12:36:34.026 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:33 smithi066 ceph-mon[35981]: pgmap v791: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 28 MiB/s wr, 4.87k op/s 2024-05-14T12:36:34.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.052+0000 7f88d7c40b80 1 Processor -- start 2024-05-14T12:36:34.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.052+0000 7f88d7c40b80 1 -- start start 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.052+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c7591fd0 0x5647c7714f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.052+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c772e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.052+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770faa0 0x5647c773a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41b5050 con 0x5647c7591fd0 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41b6bc0 con 0x5647c770f690 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41b5720 con 0x5647c770faa0 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c772e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c2800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770faa0 0x5647c773a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c772e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:53016/0 (socket says 172.21.15.47:53016) 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c2800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770faa0 0x5647c773a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50030/0 (socket says 172.21.15.47:50030) 2024-05-14T12:36:34.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1400700 1 -- 172.21.15.47:0/3790137388 learned_addr learned my addr 172.21.15.47:0/3790137388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c7591fd0 0x5647c7714f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1400700 1 -- 172.21.15.47:0/3790137388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770faa0 msgr2=0x5647c773a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1400700 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770faa0 0x5647c773a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1400700 1 -- 172.21.15.47:0/3790137388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c7591fd0 msgr2=0x5647c7714f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.053+0000 7f88c1400700 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c7591fd0 0x5647c7714f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.054+0000 7f88c1400700 1 -- 172.21.15.47:0/3790137388 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c770c5d0 con 0x5647c770f690 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.054+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c7591fd0 0x5647c7714f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:36:34.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.054+0000 7f88c1400700 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c772e540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f88b0000c00 tx=0x7f88b0038000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c65fc0825733878c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.054+0000 7f88aea00700 1 -- 172.21.15.47:0/3790137388 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0032070 con 0x5647c770f690 2024-05-14T12:36:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.055+0000 7f88aea00700 1 -- 172.21.15.47:0/3790137388 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88b003a070 con 0x5647c770f690 2024-05-14T12:36:34.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.055+0000 7f88aea00700 1 -- 172.21.15.47:0/3790137388 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0032070 con 0x5647c770f690 2024-05-14T12:36:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.056+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3790137388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 msgr2=0x5647c772e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.056+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c772e540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f88b0000c00 tx=0x7f88b0038000 comp rx=0 tx=0).stop 2024-05-14T12:36:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.056+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3790137388 shutdown_connections 2024-05-14T12:36:34.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.056+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c770faa0 0x5647c773a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.056+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c7591fd0 0x5647c7714f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.056+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3790137388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c772e540 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.056+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3790137388 >> 172.21.15.47:0/3790137388 conn(0x5647c75d0c10 msgr2=0x5647c7712b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.057+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3790137388 shutdown_connections 2024-05-14T12:36:34.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.057+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3790137388 wait complete. 2024-05-14T12:36:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.058+0000 7f88d7c40b80 1 -- start start 2024-05-14T12:36:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.058+0000 7f88d7c40b80 1 Processor -- start 2024-05-14T12:36:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c7726d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7727260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:34.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88d7c40b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c7795ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41b64f0 con 0x5647c770faa0 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41b5df0 con 0x5647c770f690 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88d7c40b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41b2fd0 con 0x5647c7591fd0 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88d7c40b80 10 client.0 _ll_register_callbacks cb 0x5647c75c5510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88c1e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c7726d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88c1e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c7726d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50046/0 (socket says 172.21.15.47:50046) 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88c1400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7727260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:34.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88c1e00700 1 -- 172.21.15.47:0/3332466107 learned_addr learned my addr 172.21.15.47:0/3332466107 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:36:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.059+0000 7f88c2800700 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c7795ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.060+0000 7f88c1400700 1 -- 172.21.15.47:0/3332466107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 msgr2=0x5647c7726d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.060+0000 7f88c1400700 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c7726d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.060+0000 7f88c1400700 1 -- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 msgr2=0x5647c7795ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.060+0000 7f88c1400700 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c7795ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.060+0000 7f88c1400700 1 -- 172.21.15.47:0/3332466107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c77043b0 con 0x5647c770f690 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.060+0000 7f88c1400700 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7727260 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f88b000f910 tx=0x7f88b00096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775af12089af1791 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.060+0000 7f88a3e00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.061+0000 7f88a3e00700 1 -- 172.21.15.47:0/3332466107 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0032070 con 0x5647c770f690 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.061+0000 7f88a3e00700 1 -- 172.21.15.47:0/3332466107 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f88b0003ca0 con 0x5647c770f690 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.061+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88b003a070 con 0x5647c770f690 2024-05-14T12:36:34.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.062+0000 7f88a3e00700 1 -- 172.21.15.47:0/3332466107 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f88b002e460 con 0x5647c770f690 2024-05-14T12:36:34.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.062+0000 7f88d7c40b80 10 client.25982 fetch_fsmap learned FSMap version 45 2024-05-14T12:36:34.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.062+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5647c779d500 con 0x5647c770f690 2024-05-14T12:36:34.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.062+0000 7f88a3e00700 1 -- 172.21.15.47:0/3332466107 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88b003a070 con 0x5647c770f690 2024-05-14T12:36:34.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.063+0000 7f88a3e00700 1 -- 172.21.15.47:0/3332466107 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f88b002c030 con 0x5647c770f690 2024-05-14T12:36:34.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.063+0000 7f88d7c40b80 10 client.25982 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T12:36:34.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.063+0000 7f88d7c40b80 10 client.25982 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:36:34.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.063+0000 7f88d7c40b80 20 client.25982 populate_metadata read hostname 'smithi047' 2024-05-14T12:36:34.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.063+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c779dc40 0x5647c77a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:34.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.063+0000 7f88d7c40b80 4 client.25982 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.4, "await_for": 42.0}] 2024-05-14T12:36:34.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.063+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.4, "await_for": 42.0}) -- 0x5647c763f590 con 0x5647c779dc40 2024-05-14T12:36:34.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.064+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c779dc40 0x5647c77a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:34.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.065+0000 7f88c1e00700 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c779dc40 0x5647c77a0060 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a8f763a572d6dc server_cookie=f578bae8bc8f1048 in_seq=0 out_seq=0 2024-05-14T12:36:34.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:34.065+0000 7f88a3e00700 10 client.25982 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:36.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:35 smithi073 ceph-mon[35809]: pgmap v792: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 24 MiB/s wr, 4.21k op/s 2024-05-14T12:36:36.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:35 smithi066 ceph-mon[35981]: pgmap v792: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 24 MiB/s wr, 4.21k op/s 2024-05-14T12:36:36.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:35 smithi047 ceph-mon[31254]: pgmap v792: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 24 MiB/s wr, 4.21k op/s 2024-05-14T12:36:38.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:37 smithi066 ceph-mon[35981]: pgmap v793: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 27 MiB/s wr, 4.77k op/s 2024-05-14T12:36:38.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:37 smithi047 ceph-mon[31254]: pgmap v793: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 27 MiB/s wr, 4.77k op/s 2024-05-14T12:36:38.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:37 smithi073 ceph-mon[35809]: pgmap v793: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 27 MiB/s wr, 4.77k op/s 2024-05-14T12:36:40.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:39 smithi066 ceph-mon[35981]: pgmap v794: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 27 MiB/s wr, 4.80k op/s 2024-05-14T12:36:40.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:39 smithi047 ceph-mon[31254]: pgmap v794: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 27 MiB/s wr, 4.80k op/s 2024-05-14T12:36:40.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:39 smithi073 ceph-mon[35809]: pgmap v794: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 27 MiB/s wr, 4.80k op/s 2024-05-14T12:36:42.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:41 smithi066 ceph-mon[35981]: pgmap v795: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 26 MiB/s wr, 4.51k op/s 2024-05-14T12:36:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:41 smithi047 ceph-mon[31254]: pgmap v795: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 26 MiB/s wr, 4.51k op/s 2024-05-14T12:36:42.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:41 smithi073 ceph-mon[35809]: pgmap v795: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 26 MiB/s wr, 4.51k op/s 2024-05-14T12:36:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:43 smithi066 ceph-mon[35981]: pgmap v796: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 29 MiB/s wr, 5.30k op/s 2024-05-14T12:36:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:43 smithi047 ceph-mon[31254]: pgmap v796: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 29 MiB/s wr, 5.30k op/s 2024-05-14T12:36:44.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:43 smithi073 ceph-mon[35809]: pgmap v796: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 29 MiB/s wr, 5.30k op/s 2024-05-14T12:36:46.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:45 smithi066 ceph-mon[35981]: pgmap v797: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 24 MiB/s wr, 4.36k op/s 2024-05-14T12:36:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:45 smithi047 ceph-mon[31254]: pgmap v797: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 24 MiB/s wr, 4.36k op/s 2024-05-14T12:36:46.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:45 smithi073 ceph-mon[35809]: pgmap v797: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 24 MiB/s wr, 4.36k op/s 2024-05-14T12:36:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 -- 172.21.15.47:0/4088665541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c06a660 msgr2=0x7f646c06aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 --2- 172.21.15.47:0/4088665541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c06a660 0x7f646c06aa70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6468009be0 tx=0x7f646802a6d0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 -- 172.21.15.47:0/4088665541 shutdown_connections 2024-05-14T12:36:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 --2- 172.21.15.47:0/4088665541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c06a660 0x7f646c06aa70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 --2- 172.21.15.47:0/4088665541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646c103d90 0x7f646c1041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 --2- 172.21.15.47:0/4088665541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f646c102b50 0x7f646c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 -- 172.21.15.47:0/4088665541 >> 172.21.15.47:0/4088665541 conn(0x7f646c0fdd40 msgr2=0x7f646c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.269+0000 7f6474800640 1 -- 172.21.15.47:0/4088665541 shutdown_connections 2024-05-14T12:36:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.270+0000 7f6474800640 1 -- 172.21.15.47:0/4088665541 wait complete. 2024-05-14T12:36:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 Processor -- start 2024-05-14T12:36:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 -- start start 2024-05-14T12:36:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646c06a660 0x7f646c19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c102b50 0x7f646c19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f646c103d90 0x7f646c1a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f646c111990 con 0x7f646c103d90 2024-05-14T12:36:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f646c111810 con 0x7f646c102b50 2024-05-14T12:36:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6474800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f646c111b10 con 0x7f646c06a660 2024-05-14T12:36:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6471400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c102b50 0x7f646c19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.271+0000 7f6471e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646c06a660 0x7f646c19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c102b50 0x7f646c19c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52762/0 (socket says 172.21.15.47:52762) 2024-05-14T12:36:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 -- 172.21.15.47:0/307898251 learned_addr learned my addr 172.21.15.47:0/307898251 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:36:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6472800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f646c103d90 0x7f646c1a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 -- 172.21.15.47:0/307898251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646c06a660 msgr2=0x7f646c19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646c06a660 0x7f646c19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 -- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f646c103d90 msgr2=0x7f646c1a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f646c103d90 0x7f646c1a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 -- 172.21.15.47:0/307898251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c1a3f70 con 0x7f646c102b50 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6472800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f646c103d90 0x7f646c1a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.272+0000 7f6471400640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c102b50 0x7f646c19c970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f645c00e9c0 tx=0x7f645c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.273+0000 7f6466a00640 1 -- 172.21.15.47:0/307898251 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c00ccc0 con 0x7f646c102b50 2024-05-14T12:36:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.273+0000 7f6466a00640 1 -- 172.21.15.47:0/307898251 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f645c0054d0 con 0x7f646c102b50 2024-05-14T12:36:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.273+0000 7f6466a00640 1 -- 172.21.15.47:0/307898251 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c010430 con 0x7f646c102b50 2024-05-14T12:36:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.273+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646c1a4260 con 0x7f646c102b50 2024-05-14T12:36:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.273+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646c1a4760 con 0x7f646c102b50 2024-05-14T12:36:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.276+0000 7f647b7c6740 1 Processor -- start 2024-05-14T12:36:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.276+0000 7f647b7c6740 1 -- start start 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dc2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dc2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dc9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f647b7c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5581a7d26550 con 0x5581a79ff4d0 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f647b7c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5581a7ccbbc0 con 0x5581a7a201b0 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f647b7c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5581a7d22510 con 0x5581a79f72f0 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f6472800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dc2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f6471e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f6472800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dc2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52772/0 (socket says 172.21.15.47:52772) 2024-05-14T12:36:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.277+0000 7f6472800640 1 -- 172.21.15.47:0/2030861218 learned_addr learned my addr 172.21.15.47:0/2030861218 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:36:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f6471e00640 1 -- 172.21.15.47:0/2030861218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 msgr2=0x5581a7dc2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f6471e00640 1 --2- 172.21.15.47:0/2030861218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dc2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f6471e00640 1 -- 172.21.15.47:0/2030861218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 msgr2=0x5581a7dc9580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f6471e00640 1 --2- 172.21.15.47:0/2030861218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dc9580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f6471e00640 1 -- 172.21.15.47:0/2030861218 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a7a38210 con 0x5581a79f72f0 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f6466a00640 1 -- 172.21.15.47:0/307898251 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f645c0105d0 con 0x7f646c102b50 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f6471e00640 1 --2- 172.21.15.47:0/2030861218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dc2680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f646c102420 tx=0x7f6460011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c494f2188af3deb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.278+0000 7f645b000640 1 -- 172.21.15.47:0/2030861218 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646001e070 con 0x5581a79f72f0 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.279+0000 7f645b000640 1 -- 172.21.15.47:0/2030861218 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6460009d70 con 0x5581a79f72f0 2024-05-14T12:36:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.279+0000 7f645b000640 1 -- 172.21.15.47:0/2030861218 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6460003e40 con 0x5581a79f72f0 2024-05-14T12:36:47.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 -- 172.21.15.47:0/2030861218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 msgr2=0x5581a7dc2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:47.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2030861218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dc2680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f646c102420 tx=0x7f6460011810 comp rx=0 tx=0).stop 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 -- 172.21.15.47:0/2030861218 shutdown_connections 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2030861218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dc9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2030861218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dc2680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2030861218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dc2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 -- 172.21.15.47:0/2030861218 >> 172.21.15.47:0/2030861218 conn(0x5581a7a14300 msgr2=0x5581a7dbda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 -- 172.21.15.47:0/2030861218 shutdown_connections 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 -- 172.21.15.47:0/2030861218 wait complete. 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f6466a00640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64540b2830 0x7f64540b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f6466a00640 1 -- 172.21.15.47:0/307898251 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f645c0e25f0 con 0x7f646c102b50 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.280+0000 7f647b7c6740 1 -- start start 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f647b7c6740 1 Processor -- start 2024-05-14T12:36:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f6471e00640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64540b2830 0x7f64540b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dcc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f647b7c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5581a7dca020 con 0x5581a79ff4d0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f647b7c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5581a7cdf660 con 0x5581a7a201b0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.281+0000 7f647b7c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5581a7dca1a0 con 0x5581a79f72f0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.282+0000 7f647b7c6740 10 client.0 _ll_register_callbacks cb 0x5581a7ca9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.282+0000 7f6471e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.282+0000 7f6471e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34212/0 (socket says 172.21.15.47:34212) 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.282+0000 7f6471e00640 1 -- 172.21.15.47:0/3015570399 learned_addr learned my addr 172.21.15.47:0/3015570399 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.282+0000 7f6471400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dcc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.282+0000 7f6472800640 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.282+0000 7f6471e00640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64540b2830 0x7f64540b4d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f64600099b0 tx=0x7f6460000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f6471400640 1 -- 172.21.15.47:0/3015570399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 msgr2=0x5581a7dcbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f6471400640 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f6471400640 1 -- 172.21.15.47:0/3015570399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 msgr2=0x5581a7dd30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f6471400640 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f6471400640 1 -- 172.21.15.47:0/3015570399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a7b04620 con 0x5581a79ff4d0 2024-05-14T12:36:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f6471400640 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dcc1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f645c0a98d0 tx=0x7f645c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ad9272241f0ae6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f644f400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:36:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f644f400640 1 -- 172.21.15.47:0/3015570399 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c0aa2d0 con 0x5581a79ff4d0 2024-05-14T12:36:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f644f400640 1 -- 172.21.15.47:0/3015570399 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f645c0c41e0 con 0x5581a79ff4d0 2024-05-14T12:36:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.283+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6460009d70 con 0x5581a79ff4d0 2024-05-14T12:36:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.284+0000 7f644f400640 1 -- 172.21.15.47:0/3015570399 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f645c0a9bd0 con 0x5581a79ff4d0 2024-05-14T12:36:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.284+0000 7f647b7c6740 10 client.15843 fetch_fsmap learned FSMap version 45 2024-05-14T12:36:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.284+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5581a7dd60a0 con 0x5581a79ff4d0 2024-05-14T12:36:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.284+0000 7f644f400640 1 -- 172.21.15.47:0/3015570399 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6460009d70 con 0x5581a79ff4d0 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f644f400640 1 -- 172.21.15.47:0/3015570399 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f645c0a5040 con 0x5581a79ff4d0 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f647b7c6740 10 client.15843 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f647b7c6740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f647b7c6740 20 client.15843 populate_metadata read hostname 'smithi047' 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f647b7c6740 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79ded80 0x5581a7dd96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f647b7c6740 4 client.15843 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581a7d34160 con 0x5581a79ded80 2024-05-14T12:36:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.285+0000 7f6471e00640 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79ded80 0x5581a7dd96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.286+0000 7f6471e00640 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79ded80 0x5581a7dd96e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc4661f9707dccef server_cookie=bd751feb33338c1a in_seq=0 out_seq=0 2024-05-14T12:36:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.286+0000 7f644f400640 10 client.15843 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f644f400640 1 -- 172.21.15.47:0/3015570399 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5581a7d34160 con 0x5581a79ded80 2024-05-14T12:36:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f644f400640 10 client.15843 handle_command_reply: tid=0 2024-05-14T12:36:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 client.15843 shutdown 2024-05-14T12:36:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 msgr2=0x5581a7dcc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dcc1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f645c0a98d0 tx=0x7f645c00ce60 comp rx=0 tx=0).stop 2024-05-14T12:36:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 shutdown_connections 2024-05-14T12:36:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79ded80 0x5581a7dd96e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dcc1c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 --2- 172.21.15.47:0/3015570399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f644f400640 0 client.15843 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 >> 172.21.15.47:0/3015570399 conn(0x5581a7a14300 msgr2=0x5581a7dc09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.288+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 shutdown_connections 2024-05-14T12:36:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.289+0000 7f647b7c6740 1 -- 172.21.15.47:0/3015570399 wait complete. 2024-05-14T12:36:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.289+0000 7f647b7c6740 20 client.15843 trim_cache size 0 max 16384 2024-05-14T12:36:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.312+0000 7f647b7c6740 1 Processor -- start 2024-05-14T12:36:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.312+0000 7f647b7c6740 1 -- start start 2024-05-14T12:36:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.312+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.312+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dd3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dbd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f647b7c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f646c1ad510 con 0x5581a79ff4d0 2024-05-14T12:36:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f647b7c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f646c1af080 con 0x5581a7a201b0 2024-05-14T12:36:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f647b7c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f646c1adbe0 con 0x5581a79f72f0 2024-05-14T12:36:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f6471e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f6471e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34214/0 (socket says 172.21.15.47:34214) 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f6471e00640 1 -- 172.21.15.47:0/2078274980 learned_addr learned my addr 172.21.15.47:0/2078274980 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f6472800640 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dbd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.313+0000 7f6471400640 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dd3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6471e00640 1 -- 172.21.15.47:0/2078274980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 msgr2=0x5581a7dbd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6471e00640 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dbd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6471e00640 1 -- 172.21.15.47:0/2078274980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 msgr2=0x5581a7dd3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6471e00640 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dd3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6472800640 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dbd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6471e00640 1 -- 172.21.15.47:0/2078274980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a7db7ca0 con 0x5581a79f72f0 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6471400640 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dd3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:36:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f6471e00640 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcb640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6460011d10 tx=0x7f6460029000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f598e78ebcb4ea65 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f645a600640 1 -- 172.21.15.47:0/2078274980 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646003c070 con 0x5581a79f72f0 2024-05-14T12:36:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f645a600640 1 -- 172.21.15.47:0/2078274980 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6460009d70 con 0x5581a79f72f0 2024-05-14T12:36:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.314+0000 7f645a600640 1 -- 172.21.15.47:0/2078274980 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646001e040 con 0x5581a79f72f0 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 -- 172.21.15.47:0/2078274980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 msgr2=0x5581a7dcb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcb640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6460011d10 tx=0x7f6460029000 comp rx=0 tx=0).stop 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 -- 172.21.15.47:0/2078274980 shutdown_connections 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dbd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79ff4d0 0x5581a7dd3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 --2- 172.21.15.47:0/2078274980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79f72f0 0x5581a7dcb640 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 -- 172.21.15.47:0/2078274980 >> 172.21.15.47:0/2078274980 conn(0x5581a7a14300 msgr2=0x5581a7dcaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 -- 172.21.15.47:0/2078274980 shutdown_connections 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.316+0000 7f647b7c6740 1 -- 172.21.15.47:0/2078274980 wait complete. 2024-05-14T12:36:47.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.317+0000 7f647b7c6740 1 -- start start 2024-05-14T12:36:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.317+0000 7f647b7c6740 1 Processor -- start 2024-05-14T12:36:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79f72f0 0x5581a7dd0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79ff4d0 0x5581a7dd0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f647b7c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f647b7c6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f646c1ae9b0 con 0x5581a79f72f0 2024-05-14T12:36:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f647b7c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f646c1ae2b0 con 0x5581a7a201b0 2024-05-14T12:36:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f647b7c6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f646c1ab4d0 con 0x5581a79ff4d0 2024-05-14T12:36:47.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f647b7c6740 10 client.0 _ll_register_callbacks cb 0x7f645c005680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:36:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f6471e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79f72f0 0x5581a7dd0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f6471400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79ff4d0 0x5581a7dd0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f6472800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f6471400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79ff4d0 0x5581a7dd0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34220/0 (socket says 172.21.15.47:34220) 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f6472800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52792/0 (socket says 172.21.15.47:52792) 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.318+0000 7f6471400640 1 -- 172.21.15.47:0/776456206 learned_addr learned my addr 172.21.15.47:0/776456206 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6472800640 1 -- 172.21.15.47:0/776456206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79ff4d0 msgr2=0x5581a7dd0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6472800640 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79ff4d0 0x5581a7dd0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6472800640 1 -- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79f72f0 msgr2=0x5581a7dd0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6472800640 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79f72f0 0x5581a7dd0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6472800640 1 -- 172.21.15.47:0/776456206 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a7dd20b0 con 0x5581a7a201b0 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6471400640 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79ff4d0 0x5581a7dd0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6471e00640 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79f72f0 0x5581a7dd0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f6472800640 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd1af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6468004af0 tx=0x7f6468030cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5440332b385ef5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:36:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.319+0000 7f644f400640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:36:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.320+0000 7f644f400640 1 -- 172.21.15.47:0/776456206 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6468036040 con 0x5581a7a201b0 2024-05-14T12:36:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.320+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6460009d70 con 0x5581a7a201b0 2024-05-14T12:36:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.320+0000 7f644f400640 1 -- 172.21.15.47:0/776456206 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6468003b80 con 0x5581a7a201b0 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.321+0000 7f644f400640 1 -- 172.21.15.47:0/776456206 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f6468030ea0 con 0x5581a7a201b0 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.321+0000 7f647b7c6740 10 client.26000 fetch_fsmap learned FSMap version 45 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.321+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5581a7e41ab0 con 0x5581a7a201b0 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.321+0000 7f644f400640 1 -- 172.21.15.47:0/776456206 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6460009d70 con 0x5581a7a201b0 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.322+0000 7f644f400640 1 -- 172.21.15.47:0/776456206 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f6468051050 con 0x5581a7a201b0 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.322+0000 7f647b7c6740 10 client.26000 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.322+0000 7f647b7c6740 10 client.26000 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.322+0000 7f647b7c6740 20 client.26000 populate_metadata read hostname 'smithi047' 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.322+0000 7f647b7c6740 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79b41c0 0x5581a7e44330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:36:47.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.322+0000 7f647b7c6740 4 client.26000 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:36:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.322+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581a7d2dfd0 con 0x5581a79b41c0 2024-05-14T12:36:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.323+0000 7f6471e00640 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79b41c0 0x5581a7e44330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:36:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.324+0000 7f6471e00640 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79b41c0 0x5581a7e44330 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75eafa9c542c47f0 server_cookie=fd19313a8d7d41cf in_seq=0 out_seq=0 2024-05-14T12:36:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:47.324+0000 7f644f400640 10 client.26000 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:48.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:47 smithi066 ceph-mon[35981]: pgmap v798: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 4.61k op/s 2024-05-14T12:36:48.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:47 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:36:48.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:47 smithi047 ceph-mon[31254]: pgmap v798: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 4.61k op/s 2024-05-14T12:36:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:47 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:36:48.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:47 smithi073 ceph-mon[35809]: pgmap v798: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 4.61k op/s 2024-05-14T12:36:48.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:47 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:36:49.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:48 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:36:49.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:48 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:36:49.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:48 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:36:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:36:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:36:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:48 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:36:49.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:36:49.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:36:49.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:48 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:36:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:49 smithi066 ceph-mon[35981]: pgmap v799: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 5.06k op/s 2024-05-14T12:36:50.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:49 smithi047 ceph-mon[31254]: pgmap v799: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 5.06k op/s 2024-05-14T12:36:50.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:49 smithi073 ceph-mon[35809]: pgmap v799: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 5.06k op/s 2024-05-14T12:36:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:51 smithi066 ceph-mon[35981]: pgmap v800: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 4.46k op/s 2024-05-14T12:36:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:51 smithi047 ceph-mon[31254]: pgmap v800: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 4.46k op/s 2024-05-14T12:36:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:51 smithi073 ceph-mon[35809]: pgmap v800: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 4.46k op/s 2024-05-14T12:36:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:53 smithi066 ceph-mon[35981]: pgmap v801: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 MiB/s wr, 4.51k op/s 2024-05-14T12:36:54.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:53 smithi047 ceph-mon[31254]: pgmap v801: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 MiB/s wr, 4.51k op/s 2024-05-14T12:36:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:53 smithi073 ceph-mon[35809]: pgmap v801: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 23 MiB/s wr, 4.51k op/s 2024-05-14T12:36:56.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:55 smithi066 ceph-mon[35981]: pgmap v802: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 20 MiB/s wr, 3.84k op/s 2024-05-14T12:36:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:55 smithi047 ceph-mon[31254]: pgmap v802: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 20 MiB/s wr, 3.84k op/s 2024-05-14T12:36:56.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:55 smithi073 ceph-mon[35809]: pgmap v802: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 20 MiB/s wr, 3.84k op/s 2024-05-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.323+0000 7f88a3e00700 1 -- 172.21.15.47:0/3332466107 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5647c763f590 con 0x5647c779dc40 2024-05-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.323+0000 7f88a3e00700 10 client.25982 handle_command_reply: tid=0 2024-05-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.323+0000 7f88d7c40b80 1 client.25982 shutdown 2024-05-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 msgr2=0x5647c7727260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7727260 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f88b000f910 tx=0x7f88b00096c0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 shutdown_connections 2024-05-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5647c779dc40 0x5647c77a0060 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647c770faa0 0x5647c7795ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5647c7591fd0 0x5647c7726d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 --2- 172.21.15.47:0/3332466107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c770f690 0x5647c7727260 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 >> 172.21.15.47:0/3332466107 conn(0x5647c75d0c10 msgr2=0x5647c7719a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88a3e00700 0 client.25982 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 shutdown_connections 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 1 -- 172.21.15.47:0/3332466107 wait complete. 2024-05-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.324+0000 7f88d7c40b80 20 client.25982 trim_cache size 0 max 16384 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 45, 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 22, 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "4cb5e3ff": { 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 22, 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 80.4, 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f88a80b29d0 msgr2=0x7f88a80b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f88a80b29d0 0x7f88a80b4ee0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f88bc017fd0 tx=0x7f88bc019040 comp rx=0 tx=0).stop 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105520 msgr2=0x7f88c40751a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105520 0x7f88c40751a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009fa0 tx=0x7f88b400ec20 comp rx=0 tx=0).stop 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 shutdown_connections 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f88a80b29d0 0x7f88a80b4ee0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88c410e900 0x7f88c406e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c4105520 0x7f88c40751a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 --2- 172.21.15.47:0/3518984533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88c4105e70 0x7f88c406e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 >> 172.21.15.47:0/3518984533 conn(0x7f88c40fedc0 msgr2=0x7f88c4106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 shutdown_connections 2024-05-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:36:56.326+0000 7f88c9000700 1 -- 172.21.15.47:0/3518984533 wait complete. 2024-05-14T12:36:56.347 INFO:tasks.workunit.client.0.smithi047.stdout:Syncing()...124 sec 2024-05-14T12:36:56.347 INFO:tasks.workunit.client.0.smithi047.stdout:FFSB benchmark finished at: Tue May 14 12:36:56 2024 2024-05-14T12:36:56.347 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.347 INFO:tasks.workunit.client.0.smithi047.stdout:Results: 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:Benchmark took 436.73 sec 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:Total Results 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:=============== 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout: ======= ============ ========= ======= =========== ========== 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout: write : 6403840 14663.16 100.000% 100.000% 57.3MB/sec 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:- 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:14663.16 Transactions per Second 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:Throughput Results 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:=================== 2024-05-14T12:36:56.348 INFO:tasks.workunit.client.0.smithi047.stdout:Write Throughput: 57.3MB/sec 2024-05-14T12:36:56.416 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.416 INFO:tasks.workunit.client.0.smithi047.stdout:System Call Latency statistics in millisecs 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout:===== 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: Min Avg Max Total Calls 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: ======== ======== ======== ============ 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout:[ open] 0.019000 43.433344 32595.261719 5003 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 6 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 6 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 5 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 1 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 39 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 42 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 50 2024-05-14T12:36:56.417 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 60 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 166 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 201 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 103 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 41 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 329 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 1201 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 2744 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 2 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout:[ write] 0.004000 1.471463 65578.382812 6403840 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 74 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 286 2024-05-14T12:36:56.418 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 279 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 188 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 3350 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 2211 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 27212 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 14119 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 3386 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 3133 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 4102 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 2119 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 2300 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 6186 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 23270 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 122586 2024-05-14T12:36:56.419 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 964606 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 3382020 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 1842336 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout:[ lseek] 0.000000 0.002912 71.019997 6403840 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 17 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 61 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 249 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 224 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 287 2024-05-14T12:36:56.420 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 148 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 148 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 269 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 458 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 1390 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 4852 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 4064 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 6391673 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout:[ close] 0.004000 0.018175 22.023001 5003 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-14T12:36:56.421 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 1 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 1 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 4 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 10 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 279 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 2430 2024-05-14T12:36:56.422 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 2275 2024-05-14T12:36:56.423 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.423 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.423 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.423 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-14T12:36:56.423 INFO:tasks.workunit.client.0.smithi047.stdout:1.4% User Time 2024-05-14T12:36:56.423 INFO:tasks.workunit.client.0.smithi047.stdout:25.4% System Time 2024-05-14T12:36:56.423 INFO:tasks.workunit.client.0.smithi047.stdout:26.8% CPU Utilization 2024-05-14T12:36:56.433 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd .. 2024-05-14T12:36:56.438 INFO:tasks.workunit.client.0.smithi047.stderr:+ rm -r tmp ffsb 2024-05-14T12:36:57.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.071+0000 7f644f400640 1 -- 172.21.15.47:0/776456206 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581a7d2dfd0 con 0x5581a79b41c0 2024-05-14T12:36:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.071+0000 7f644f400640 10 client.26000 handle_command_reply: tid=0 2024-05-14T12:36:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.072+0000 7f647b7c6740 1 client.26000 shutdown 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 msgr2=0x5581a7dd1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd1af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6468004af0 tx=0x7f6468030cf0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 shutdown_connections 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5581a79b41c0 0x5581a7e44330 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581a7a201b0 0x5581a7dd1af0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a79ff4d0 0x5581a7dd0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 --2- 172.21.15.47:0/776456206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5581a79f72f0 0x5581a7dd0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 >> 172.21.15.47:0/776456206 conn(0x5581a7a14300 msgr2=0x5581a7dbd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f644f400640 0 client.26000 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:36:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 shutdown_connections 2024-05-14T12:36:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.073+0000 7f647b7c6740 1 -- 172.21.15.47:0/776456206 wait complete. 2024-05-14T12:36:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.074+0000 7f647b7c6740 20 client.26000 trim_cache size 0 max 16384 2024-05-14T12:36:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:36:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:36:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:36:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64540b2830 msgr2=0x7f64540b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64540b2830 0x7f64540b4d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f64600099b0 tx=0x7f6460000bc0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c102b50 msgr2=0x7f646c19c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c102b50 0x7f646c19c970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f645c00e9c0 tx=0x7f645c00ee80 comp rx=0 tx=0).stop 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 shutdown_connections 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f64540b2830 0x7f64540b4d40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f646c103d90 0x7f646c1a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f646c102b50 0x7f646c19c970 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 --2- 172.21.15.47:0/307898251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646c06a660 0x7f646c19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:36:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.075+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 >> 172.21.15.47:0/307898251 conn(0x7f646c0fdd40 msgr2=0x7f646c104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:36:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.076+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 shutdown_connections 2024-05-14T12:36:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:36:57.076+0000 7f6474800640 1 -- 172.21.15.47:0/307898251 wait complete. 2024-05-14T12:36:57.282 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4cb5e3ff', quiesce took 78.2 seconds. Will release after: 20.4 2024-05-14T12:36:58.054 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:57 smithi073 ceph-mon[35809]: pgmap v803: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 3.88k op/s 2024-05-14T12:36:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:57 smithi066 ceph-mon[35981]: pgmap v803: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 3.88k op/s 2024-05-14T12:36:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:57 smithi047 ceph-mon[31254]: pgmap v803: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 3.88k op/s 2024-05-14T12:37:00.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:36:59 smithi066 ceph-mon[35981]: pgmap v804: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 4.33k op/s 2024-05-14T12:37:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:36:59 smithi047 ceph-mon[31254]: pgmap v804: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 4.33k op/s 2024-05-14T12:37:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:36:59 smithi073 ceph-mon[35809]: pgmap v804: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 4.33k op/s 2024-05-14T12:37:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:01 smithi066 ceph-mon[35981]: pgmap v805: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.07k op/s 2024-05-14T12:37:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:01 smithi047 ceph-mon[31254]: pgmap v805: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.07k op/s 2024-05-14T12:37:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:01 smithi073 ceph-mon[35809]: pgmap v805: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.07k op/s 2024-05-14T12:37:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:03 smithi066 ceph-mon[35981]: pgmap v806: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 2.50k op/s 2024-05-14T12:37:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:03 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:03 smithi047 ceph-mon[31254]: pgmap v806: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 2.50k op/s 2024-05-14T12:37:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:03 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:03 smithi073 ceph-mon[35809]: pgmap v806: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 2.50k op/s 2024-05-14T12:37:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:03 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:05 smithi047 ceph-mon[31254]: pgmap v807: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 1.98k op/s 2024-05-14T12:37:06.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:05 smithi073 ceph-mon[35809]: pgmap v807: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 1.98k op/s 2024-05-14T12:37:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:05 smithi066 ceph-mon[35981]: pgmap v807: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 1.98k op/s 2024-05-14T12:37:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:07 smithi047 ceph-mon[31254]: pgmap v808: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 1.39k op/s 2024-05-14T12:37:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:07 smithi073 ceph-mon[35809]: pgmap v808: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 1.39k op/s 2024-05-14T12:37:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:07 smithi066 ceph-mon[35981]: pgmap v808: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 1.39k op/s 2024-05-14T12:37:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:09 smithi047 ceph-mon[31254]: pgmap v809: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 1.12k op/s 2024-05-14T12:37:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:09 smithi073 ceph-mon[35809]: pgmap v809: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 1.12k op/s 2024-05-14T12:37:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:09 smithi066 ceph-mon[35981]: pgmap v809: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 1.12k op/s 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 -- 172.21.15.47:0/1597228411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 msgr2=0x7f44e01050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 --2- 172.21.15.47:0/1597228411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e01050d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009900 tx=0x7f44cc02a3f0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 -- 172.21.15.47:0/1597228411 shutdown_connections 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 --2- 172.21.15.47:0/1597228411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44e01099c0 0x7f44e010bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 --2- 172.21.15.47:0/1597228411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e01050d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 --2- 172.21.15.47:0/1597228411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44e0103a80 0x7f44e0104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 -- 172.21.15.47:0/1597228411 >> 172.21.15.47:0/1597228411 conn(0x7f44e00fec70 msgr2=0x7f44e0101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 -- 172.21.15.47:0/1597228411 shutdown_connections 2024-05-14T12:37:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.327+0000 7f44e5000640 1 -- 172.21.15.47:0/1597228411 wait complete. 2024-05-14T12:37:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 Processor -- start 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 -- start start 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44e0103a80 0x7f44e019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44e01099c0 0x7f44e01a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010f650 con 0x7f44e0104cc0 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010f4d0 con 0x7f44e01099c0 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.328+0000 7f44e5000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010f7d0 con 0x7f44e0103a80 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52512/0 (socket says 172.21.15.47:52512) 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 -- 172.21.15.47:0/3294758415 learned_addr learned my addr 172.21.15.47:0/3294758415 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dfe00640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44e01099c0 0x7f44e01a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44df400640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44e0103a80 0x7f44e019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 -- 172.21.15.47:0/3294758415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44e0103a80 msgr2=0x7f44e019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44e0103a80 0x7f44e019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 -- 172.21.15.47:0/3294758415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44e01099c0 msgr2=0x7f44e01a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44e01099c0 0x7f44e01a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dea00640 1 -- 172.21.15.47:0/3294758415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e01a1cb0 con 0x7f44e0104cc0 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.329+0000 7f44dfe00640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44e01099c0 0x7f44e01a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.330+0000 7f44dea00640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e019a6b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f44cc006010 tx=0x7f44cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.330+0000 7f44d7e00640 1 -- 172.21.15.47:0/3294758415 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc03f030 con 0x7f44e0104cc0 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.330+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e01a1f40 con 0x7f44e0104cc0 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.330+0000 7f44d7e00640 1 -- 172.21.15.47:0/3294758415 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44cc031910 con 0x7f44e0104cc0 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.330+0000 7f44d7e00640 1 -- 172.21.15.47:0/3294758415 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc035070 con 0x7f44e0104cc0 2024-05-14T12:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.330+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01a23a0 con 0x7f44e0104cc0 2024-05-14T12:37:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 Processor -- start 2024-05-14T12:37:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 -- start start 2024-05-14T12:37:10.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360de1b0 0x55bc3648b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc3648d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360bd4d0 0x55bc3648fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bc363e4550 con 0x55bc360b52f0 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bc36389bc0 con 0x55bc360de1b0 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44ed580740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bc363e0510 con 0x55bc360bd4d0 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.334+0000 7f44d7e00640 1 -- 172.21.15.47:0/3294758415 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f44cc042030 con 0x7f44e0104cc0 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44df400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc3648d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44dfe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360de1b0 0x55bc3648b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44df400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc3648d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52516/0 (socket says 172.21.15.47:52516) 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44df400640 1 -- 172.21.15.47:0/2851229941 learned_addr learned my addr 172.21.15.47:0/2851229941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44dea00640 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360bd4d0 0x55bc3648fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44dfe00640 1 -- 172.21.15.47:0/2851229941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360bd4d0 msgr2=0x55bc3648fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44dfe00640 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360bd4d0 0x55bc3648fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44dfe00640 1 -- 172.21.15.47:0/2851229941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 msgr2=0x55bc3648d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44dfe00640 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc3648d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44dfe00640 1 -- 172.21.15.47:0/2851229941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc360f6210 con 0x55bc360de1b0 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.335+0000 7f44df400640 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc3648d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.336+0000 7f44dfe00640 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360de1b0 0x55bc3648b180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005fd0 tx=0x7f44d8011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1bd707d31552e3a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.336+0000 7f44d4c00640 1 -- 172.21.15.47:0/2851229941 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8004d20 con 0x55bc360de1b0 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.336+0000 7f44d4c00640 1 -- 172.21.15.47:0/2851229941 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d800f9a0 con 0x55bc360de1b0 2024-05-14T12:37:10.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.336+0000 7f44d4c00640 1 -- 172.21.15.47:0/2851229941 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d80043e0 con 0x55bc360de1b0 2024-05-14T12:37:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44d7e00640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44c40b28a0 0x7f44c40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44d7e00640 1 -- 172.21.15.47:0/3294758415 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f44cc102750 con 0x7f44e0104cc0 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44df400640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44c40b28a0 0x7f44c40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 -- 172.21.15.47:0/2851229941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360de1b0 msgr2=0x55bc3648b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360de1b0 0x55bc3648b180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005fd0 tx=0x7f44d8011bf0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 -- 172.21.15.47:0/2851229941 shutdown_connections 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360bd4d0 0x55bc3648fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc3648d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 --2- 172.21.15.47:0/2851229941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360de1b0 0x55bc3648b180 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 -- 172.21.15.47:0/2851229941 >> 172.21.15.47:0/2851229941 conn(0x55bc360d2300 msgr2=0x55bc3647bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 -- 172.21.15.47:0/2851229941 shutdown_connections 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.337+0000 7f44ed580740 1 -- 172.21.15.47:0/2851229941 wait complete. 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.338+0000 7f44df400640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44c40b28a0 0x7f44c40b4db0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55bc3647c9a0 tx=0x7f44d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.338+0000 7f44ed580740 1 -- start start 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.338+0000 7f44ed580740 1 Processor -- start 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44ed580740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36492620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44ed580740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36492b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44ed580740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36499ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44ed580740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bc364909c0 con 0x55bc360b52f0 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44ed580740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bc3639d660 con 0x55bc360bd4d0 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44ed580740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bc36490b40 con 0x55bc360de1b0 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44ed580740 10 client.0 _ll_register_callbacks cb 0x55bc36367400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44df400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36492620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44df400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36492620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52524/0 (socket says 172.21.15.47:52524) 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44dea00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36492b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44df400640 1 -- 172.21.15.47:0/3925380570 learned_addr learned my addr 172.21.15.47:0/3925380570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44dfe00640 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36499ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44dea00640 1 -- 172.21.15.47:0/3925380570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 msgr2=0x55bc36499ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.339+0000 7f44dea00640 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36499ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44dea00640 1 -- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 msgr2=0x55bc36492620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44dea00640 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36492620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44dea00640 1 -- 172.21.15.47:0/3925380570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc361c2620 con 0x55bc360bd4d0 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44df400640 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36492620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44dea00640 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36492b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0c5e60 tx=0x7f44cc0c9c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6317afd1c3d2b4f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44c9600640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44c9600640 1 -- 172.21.15.47:0/3925380570 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc049040 con 0x55bc360bd4d0 2024-05-14T12:37:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44d800f9a0 con 0x55bc360bd4d0 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44c9600640 1 -- 172.21.15.47:0/3925380570 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f44cc0d2700 con 0x55bc360bd4d0 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44c9600640 1 -- 172.21.15.47:0/3925380570 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f44cc0c98f0 con 0x55bc360bd4d0 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44ed580740 10 client.26012 fetch_fsmap learned FSMap version 46 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.340+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55bc3649c9f0 con 0x55bc360bd4d0 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44c9600640 1 -- 172.21.15.47:0/3925380570 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d800f9a0 con 0x55bc360bd4d0 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44c9600640 1 -- 172.21.15.47:0/3925380570 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7f44cc0e3020 con 0x55bc360bd4d0 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44ed580740 10 client.26012 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44ed580740 10 client.26012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44ed580740 20 client.26012 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44ed580740 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc3609cd80 0x55bc364a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44ed580740 4 client.26012 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc363f2160 con 0x55bc3609cd80 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.341+0000 7f44df400640 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc3609cd80 0x55bc364a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.342+0000 7f44df400640 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc3609cd80 0x55bc364a0200 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e92f3a49927e3712 server_cookie=595d660d2039caab in_seq=0 out_seq=0 2024-05-14T12:37:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.342+0000 7f44c9600640 10 client.26012 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44c9600640 1 -- 172.21.15.47:0/3925380570 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc363f2160 con 0x55bc3609cd80 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44c9600640 10 client.26012 handle_command_reply: tid=0 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 client.26012 shutdown 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 msgr2=0x55bc36492b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36492b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0c5e60 tx=0x7f44cc0c9c70 comp rx=0 tx=0).stop 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 shutdown_connections 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc3609cd80 0x55bc364a0200 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36499ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36492b60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44c9600640 0 client.26012 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 --2- 172.21.15.47:0/3925380570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36492620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 >> 172.21.15.47:0/3925380570 conn(0x55bc360d2300 msgr2=0x55bc3647ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.343+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 shutdown_connections 2024-05-14T12:37:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.344+0000 7f44ed580740 1 -- 172.21.15.47:0/3925380570 wait complete. 2024-05-14T12:37:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.344+0000 7f44ed580740 20 client.26012 trim_cache size 0 max 16384 2024-05-14T12:37:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.360+0000 7f44ed580740 1 Processor -- start 2024-05-14T12:37:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.360+0000 7f44ed580740 1 -- start start 2024-05-14T12:37:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44ed580740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc364a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44ed580740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc364a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44ed580740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc364999e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44ed580740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01a8e10 con 0x55bc360b52f0 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44ed580740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01aa980 con 0x55bc360bd4d0 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44ed580740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01a94e0 con 0x55bc360de1b0 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44dea00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc364a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44dea00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc364a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:38094/0 (socket says 172.21.15.47:38094) 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44dea00640 1 -- 172.21.15.47:0/2718090069 learned_addr learned my addr 172.21.15.47:0/2718090069 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44df400640 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc364a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.361+0000 7f44dfe00640 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc364999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44dea00640 1 -- 172.21.15.47:0/2718090069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 msgr2=0x55bc364999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44dea00640 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc364999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44dea00640 1 -- 172.21.15.47:0/2718090069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 msgr2=0x55bc364a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44dea00640 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc364a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44dea00640 1 -- 172.21.15.47:0/2718090069 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc364774a0 con 0x55bc360bd4d0 2024-05-14T12:37:10.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44dea00640 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc364a6040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009320 tx=0x7f44cc1029d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fae6628a6b092f08 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:10.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44cbe00640 1 -- 172.21.15.47:0/2718090069 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0e8070 con 0x55bc360bd4d0 2024-05-14T12:37:10.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44cbe00640 1 -- 172.21.15.47:0/2718090069 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44cc0e0070 con 0x55bc360bd4d0 2024-05-14T12:37:10.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.362+0000 7f44cbe00640 1 -- 172.21.15.47:0/2718090069 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc049070 con 0x55bc360bd4d0 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 -- 172.21.15.47:0/2718090069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 msgr2=0x55bc364a6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc364a6040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009320 tx=0x7f44cc1029d0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 -- 172.21.15.47:0/2718090069 shutdown_connections 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc364999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc364a6040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 --2- 172.21.15.47:0/2718090069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc364a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 -- 172.21.15.47:0/2718090069 >> 172.21.15.47:0/2718090069 conn(0x55bc360d2300 msgr2=0x55bc364a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 -- 172.21.15.47:0/2718090069 shutdown_connections 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.363+0000 7f44ed580740 1 -- 172.21.15.47:0/2718090069 wait complete. 2024-05-14T12:37:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 -- start start 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 Processor -- start 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36499950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36504560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36506b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01aa2b0 con 0x55bc360b52f0 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01a9bb0 con 0x55bc360bd4d0 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.364+0000 7f44ed580740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01a6dd0 con 0x55bc360de1b0 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44ed580740 10 client.0 _ll_register_callbacks cb 0x7f44cc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44dea00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36504560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44df400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36499950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44dfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36506b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44dea00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36504560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:38106/0 (socket says 172.21.15.47:38106) 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44dea00640 1 -- 172.21.15.47:0/16718735 learned_addr learned my addr 172.21.15.47:0/16718735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44df400640 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36499950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52540/0 (socket says 172.21.15.47:52540) 2024-05-14T12:37:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44df400640 1 -- 172.21.15.47:0/16718735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 msgr2=0x55bc36506b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44df400640 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36506b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44df400640 1 -- 172.21.15.47:0/16718735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 msgr2=0x55bc36504560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44df400640 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36504560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.365+0000 7f44df400640 1 -- 172.21.15.47:0/16718735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc364930f0 con 0x55bc360b52f0 2024-05-14T12:37:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44df400640 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36499950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55bc364a0970 tx=0x7f44d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74748499c98ae237 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44c9600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44c9600640 1 -- 172.21.15.47:0/16718735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0035070 con 0x55bc360b52f0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44c9600640 1 -- 172.21.15.47:0/16718735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f44d0004020 con 0x55bc360b52f0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc0e0070 con 0x55bc360b52f0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44c9600640 1 -- 172.21.15.47:0/16718735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f44d0004220 con 0x55bc360b52f0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44ed580740 10 client.15867 fetch_fsmap learned FSMap version 46 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.366+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55bc36508400 con 0x55bc360b52f0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44c9600640 1 -- 172.21.15.47:0/16718735 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44cc0e0070 con 0x55bc360b52f0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44c9600640 1 -- 172.21.15.47:0/16718735 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7f44d0003710 con 0x55bc360b52f0 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44ed580740 10 client.15867 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44ed580740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44ed580740 20 client.15867 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44ed580740 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc360721c0 0x55bc3650ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44ed580740 4 client.15867 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:37:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc363ebfd0 con 0x55bc360721c0 2024-05-14T12:37:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.367+0000 7f44dea00640 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc360721c0 0x55bc3650ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.368+0000 7f44dea00640 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc360721c0 0x55bc3650ad70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3098d8a2450470 server_cookie=8958b5e018b88b2d in_seq=0 out_seq=0 2024-05-14T12:37:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.368+0000 7f44c9600640 10 client.15867 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44c9600640 1 -- 172.21.15.47:0/16718735 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc363ebfd0 con 0x55bc360721c0 2024-05-14T12:37:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44c9600640 10 client.15867 handle_command_reply: tid=0 2024-05-14T12:37:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 client.15867 shutdown 2024-05-14T12:37:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 msgr2=0x55bc36499950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36499950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55bc364a0970 tx=0x7f44d00046c0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 shutdown_connections 2024-05-14T12:37:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55bc360721c0 0x55bc3650ad70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bc360de1b0 0x55bc36506b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc360bd4d0 0x55bc36504560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 --2- 172.21.15.47:0/16718735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bc360b52f0 0x55bc36499950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44c9600640 0 client.15867 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 >> 172.21.15.47:0/16718735 conn(0x55bc360d2300 msgr2=0x55bc364a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 shutdown_connections 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.379+0000 7f44ed580740 1 -- 172.21.15.47:0/16718735 wait complete. 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.380+0000 7f44ed580740 20 client.15867 trim_cache size 0 max 16384 2024-05-14T12:37:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:37:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:37:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:37:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.380+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44c40b28a0 msgr2=0x7f44c40b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.380+0000 7f44e5000640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44c40b28a0 0x7f44c40b4db0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55bc3647c9a0 tx=0x7f44d0005f90 comp rx=0 tx=0).stop 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.380+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 msgr2=0x7f44e019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.380+0000 7f44e5000640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e019a6b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f44cc006010 tx=0x7f44cc0042f0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 shutdown_connections 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f44c40b28a0 0x7f44c40b4db0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44e01099c0 0x7f44e01a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e0104cc0 0x7f44e019a6b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 --2- 172.21.15.47:0/3294758415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44e0103a80 0x7f44e019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 >> 172.21.15.47:0/3294758415 conn(0x7f44e00fec70 msgr2=0x7f44e01059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 shutdown_connections 2024-05-14T12:37:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:10.381+0000 7f44e5000640 1 -- 172.21.15.47:0/3294758415 wait complete. 2024-05-14T12:37:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:11 smithi047 ceph-mon[31254]: pgmap v810: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-05-14T12:37:12.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:11 smithi073 ceph-mon[35809]: pgmap v810: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-05-14T12:37:12.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:11 smithi066 ceph-mon[35981]: pgmap v810: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-05-14T12:37:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:13 smithi047 ceph-mon[31254]: pgmap v811: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2024-05-14T12:37:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:13 smithi073 ceph-mon[35809]: pgmap v811: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2024-05-14T12:37:14.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:13 smithi066 ceph-mon[35981]: pgmap v811: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2024-05-14T12:37:16.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:15 smithi047 ceph-mon[31254]: pgmap v812: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-05-14T12:37:16.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:15 smithi073 ceph-mon[35809]: pgmap v812: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-05-14T12:37:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:15 smithi066 ceph-mon[35981]: pgmap v812: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-05-14T12:37:17.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:37:18.160 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:37:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:17 smithi047 ceph-mon[31254]: pgmap v813: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-05-14T12:37:18.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:17 smithi073 ceph-mon[35809]: pgmap v813: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-05-14T12:37:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:17 smithi066 ceph-mon[35981]: pgmap v813: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-05-14T12:37:19.962 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:19 smithi047 ceph-mon[31254]: pgmap v814: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-14T12:37:20.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:19 smithi073 ceph-mon[35809]: pgmap v814: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-14T12:37:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:19 smithi066 ceph-mon[35981]: pgmap v814: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.554+0000 7f625fe00700 1 -- 172.21.15.47:0/3114020028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260104400 msgr2=0x7f6260104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.554+0000 7f625fe00700 1 --2- 172.21.15.47:0/3114020028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260104400 0x7f6260104810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6250009990 tx=0x7f6250009ca0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.555+0000 7f625fe00700 1 -- 172.21.15.47:0/3114020028 shutdown_connections 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.555+0000 7f625fe00700 1 --2- 172.21.15.47:0/3114020028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260109680 0x7f6260110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.555+0000 7f625fe00700 1 --2- 172.21.15.47:0/3114020028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260104400 0x7f6260104810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.555+0000 7f625fe00700 1 --2- 172.21.15.47:0/3114020028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260108d30 0x7f6260109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.555+0000 7f625fe00700 1 -- 172.21.15.47:0/3114020028 >> 172.21.15.47:0/3114020028 conn(0x7f6260079d10 msgr2=0x7f626007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:20.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.555+0000 7f625fe00700 1 -- 172.21.15.47:0/3114020028 shutdown_connections 2024-05-14T12:37:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.555+0000 7f625fe00700 1 -- 172.21.15.47:0/3114020028 wait complete. 2024-05-14T12:37:20.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.557+0000 7f625fe00700 1 Processor -- start 2024-05-14T12:37:20.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.557+0000 7f625fe00700 1 -- start start 2024-05-14T12:37:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260104400 0x7f62601a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625fe00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260108d30 0x7f62601a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109680 0x7f626019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625fe00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62601142b0 con 0x7f6260109680 2024-05-14T12:37:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625fe00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6260114130 con 0x7f6260108d30 2024-05-14T12:37:20.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625fe00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6260114430 con 0x7f6260104400 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260104400 0x7f62601a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260104400 0x7f62601a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50520/0 (socket says 172.21.15.47:50520) 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625ea00700 1 -- 172.21.15.47:0/144988965 learned_addr learned my addr 172.21.15.47:0/144988965 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625e000700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260108d30 0x7f62601a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.558+0000 7f625f400700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109680 0x7f626019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.559+0000 7f625ea00700 1 -- 172.21.15.47:0/144988965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260108d30 msgr2=0x7f62601a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.559+0000 7f625ea00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260108d30 0x7f62601a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.559+0000 7f625ea00700 1 -- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109680 msgr2=0x7f626019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.559+0000 7f625ea00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109680 0x7f626019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.559+0000 7f625ea00700 1 -- 172.21.15.47:0/144988965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626019b0e0 con 0x7f6260104400 2024-05-14T12:37:20.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.559+0000 7f625ea00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260104400 0x7f62601a0810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f62500057c0 tx=0x7f62500057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:20.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.560+0000 7f6257400700 1 -- 172.21.15.47:0/144988965 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250027070 con 0x7f6260104400 2024-05-14T12:37:20.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.560+0000 7f6257400700 1 -- 172.21.15.47:0/144988965 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f625000b610 con 0x7f6260104400 2024-05-14T12:37:20.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.560+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626019b370 con 0x7f6260104400 2024-05-14T12:37:20.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.560+0000 7f6257400700 1 -- 172.21.15.47:0/144988965 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500173f0 con 0x7f6260104400 2024-05-14T12:37:20.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.560+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601a76a0 con 0x7f6260104400 2024-05-14T12:37:20.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.561+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62601058b0 con 0x7f6260104400 2024-05-14T12:37:20.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.564+0000 7f6257400700 1 -- 172.21.15.47:0/144988965 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f625002a070 con 0x7f6260104400 2024-05-14T12:37:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.565+0000 7f6257400700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62440b2900 0x7f62440b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.566+0000 7f6257400700 1 -- 172.21.15.47:0/144988965 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f62500e31c0 con 0x7f6260104400 2024-05-14T12:37:20.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.566+0000 7f625e000700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62440b2900 0x7f62440b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:20.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.566+0000 7f625e000700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62440b2900 0x7f62440b4e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6260101d30 tx=0x7f624c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:20.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.570+0000 7f6257400700 1 -- 172.21.15.47:0/144988965 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6250013070 con 0x7f6260104400 2024-05-14T12:37:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.857+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f626002e5f0 con 0x7f6260104400 2024-05-14T12:37:20.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.858+0000 7f6257400700 1 -- 172.21.15.47:0/144988965 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11920 (secure 0 0 0) 0x7f62500aaf30 con 0x7f6260104400 2024-05-14T12:37:20.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:37:20.858 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:37:01.989862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:37:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62440b2900 msgr2=0x7f62440b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62440b2900 0x7f62440b4e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6260101d30 tx=0x7f624c009260 comp rx=0 tx=0).stop 2024-05-14T12:37:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260104400 msgr2=0x7f62601a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260104400 0x7f62601a0810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f62500057c0 tx=0x7f62500057f0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 shutdown_connections 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f62440b2900 0x7f62440b4e10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6260109680 0x7f626019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6260104400 0x7f62601a0810 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 --2- 172.21.15.47:0/144988965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6260108d30 0x7f62601a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.861+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 >> 172.21.15.47:0/144988965 conn(0x7f6260079d10 msgr2=0x7f62601027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.862+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 shutdown_connections 2024-05-14T12:37:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:20.862+0000 7f625fe00700 1 -- 172.21.15.47:0/144988965 wait complete. 2024-05-14T12:37:20.864 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 46 2024-05-14T12:37:21.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:20 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/144988965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:37:21.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:20 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/144988965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:37:21.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:20 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/144988965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:37:21.795 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id 4cb5e3ff --release --await' 2024-05-14T12:37:21.796 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id 4cb5e3ff --release --await 2024-05-14T12:37:21.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:21 smithi047 ceph-mon[31254]: pgmap v815: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-05-14T12:37:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:21 smithi073 ceph-mon[35809]: pgmap v815: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-05-14T12:37:22.262 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:37:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:21 smithi066 ceph-mon[35981]: pgmap v815: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-05-14T12:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 -- 172.21.15.47:0/2116190693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 msgr2=0x7fc25c10e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 --2- 172.21.15.47:0/2116190693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 0x7fc25c10e050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc254009be0 tx=0x7fc25402a6c0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 -- 172.21.15.47:0/2116190693 shutdown_connections 2024-05-14T12:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 --2- 172.21.15.47:0/2116190693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 0x7fc25c10e050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 --2- 172.21.15.47:0/2116190693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c106f30 0x7fc25c107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 --2- 172.21.15.47:0/2116190693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc25c105cf0 0x7fc25c1069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 -- 172.21.15.47:0/2116190693 >> 172.21.15.47:0/2116190693 conn(0x7fc25c100f00 msgr2=0x7fc25c103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 -- 172.21.15.47:0/2116190693 shutdown_connections 2024-05-14T12:37:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.618+0000 7fc25be00640 1 -- 172.21.15.47:0/2116190693 wait complete. 2024-05-14T12:37:23.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 Processor -- start 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 -- start start 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c105cf0 0x7fc25c19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc25c106f30 0x7fc25c19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 0x7fc25c1a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1118c0 con 0x7fc25c10bc30 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c111740 con 0x7fc25c105cf0 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.620+0000 7fc25be00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c111a40 con 0x7fc25c106f30 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c105cf0 0x7fc25c19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c105cf0 0x7fc25c19c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50374/0 (socket says 172.21.15.47:50374) 2024-05-14T12:37:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 -- 172.21.15.47:0/4078468736 learned_addr learned my addr 172.21.15.47:0/4078468736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25a000640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc25c106f30 0x7fc25c19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25b400640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 0x7fc25c1a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 -- 172.21.15.47:0/4078468736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc25c106f30 msgr2=0x7fc25c19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc25c106f30 0x7fc25c19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 -- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 msgr2=0x7fc25c1a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 0x7fc25c1a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 -- 172.21.15.47:0/4078468736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c1a3f20 con 0x7fc25c105cf0 2024-05-14T12:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.621+0000 7fc25aa00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c105cf0 0x7fc25c19c3e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00e9f0 tx=0x7fc24c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.622+0000 7fc253400640 1 -- 172.21.15.47:0/4078468736 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00ccc0 con 0x7fc25c105cf0 2024-05-14T12:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.622+0000 7fc253400640 1 -- 172.21.15.47:0/4078468736 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc24c0035f0 con 0x7fc25c105cf0 2024-05-14T12:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.622+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c1a4210 con 0x7fc25c105cf0 2024-05-14T12:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.622+0000 7fc253400640 1 -- 172.21.15.47:0/4078468736 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00ce60 con 0x7fc25c105cf0 2024-05-14T12:37:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.622+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1a4710 con 0x7fc25c105cf0 2024-05-14T12:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.625+0000 7fc268662740 1 Processor -- start 2024-05-14T12:37:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.625+0000 7fc268662740 1 -- start start 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc268662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0c93300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc268662740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c93880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc268662740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc268662740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4e0bf7550 con 0x55e4e08d04d0 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc268662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e4e0b9cbc0 con 0x55e4e08f11b0 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc268662740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e4e0bf3510 con 0x55e4e08c82f0 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc253400640 1 -- 172.21.15.47:0/4078468736 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc24c003aa0 con 0x7fc25c105cf0 2024-05-14T12:37:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc25a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc25b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0c93300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc25b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0c93300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50390/0 (socket says 172.21.15.47:50390) 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc25b400640 1 -- 172.21.15.47:0/1296632577 learned_addr learned my addr 172.21.15.47:0/1296632577 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.626+0000 7fc25aa00640 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c93880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc25a000640 1 -- 172.21.15.47:0/1296632577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 msgr2=0x55e4e0c93880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc25a000640 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c93880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc25a000640 1 -- 172.21.15.47:0/1296632577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 msgr2=0x55e4e0c93300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc25a000640 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0c93300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc25a000640 1 -- 172.21.15.47:0/1296632577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e0909210 con 0x55e4e08d04d0 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc25b400640 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0c93300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:37:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc25a000640 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9a780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc248009530 tx=0x7fc248011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dfc2f931777792 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.627+0000 7fc247400640 1 -- 172.21.15.47:0/1296632577 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248004220 con 0x55e4e08d04d0 2024-05-14T12:37:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.628+0000 7fc247400640 1 -- 172.21.15.47:0/1296632577 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2480043c0 con 0x55e4e08d04d0 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.628+0000 7fc247400640 1 -- 172.21.15.47:0/1296632577 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248019740 con 0x55e4e08d04d0 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.628+0000 7fc253400640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2400b28a0 0x7fc2400b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.628+0000 7fc253400640 1 -- 172.21.15.47:0/4078468736 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc24c0e2590 con 0x7fc25c105cf0 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.628+0000 7fc25b400640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2400b28a0 0x7fc2400b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.628+0000 7fc268662740 1 -- 172.21.15.47:0/1296632577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 msgr2=0x55e4e0c9a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.628+0000 7fc268662740 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9a780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc248009530 tx=0x7fc248011810 comp rx=0 tx=0).stop 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 -- 172.21.15.47:0/1296632577 shutdown_connections 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9a780 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c93880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 --2- 172.21.15.47:0/1296632577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0c93300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 -- 172.21.15.47:0/1296632577 >> 172.21.15.47:0/1296632577 conn(0x55e4e08e5300 msgr2=0x55e4e0c8ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 -- 172.21.15.47:0/1296632577 shutdown_connections 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 -- 172.21.15.47:0/1296632577 wait complete. 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc25b400640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2400b28a0 0x7fc2400b4db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55e4e0c944d0 tx=0x7fc254030970 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.629+0000 7fc268662740 1 -- start start 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 1 Processor -- start 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c9cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4e0c9b1d0 con 0x55e4e08d04d0 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e4e0bb0660 con 0x55e4e08f11b0 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e4e0c9b350 con 0x55e4e08c82f0 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc268662740 10 client.0 _ll_register_callbacks cb 0x55e4e0b7a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.630+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c9cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c9cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50564/0 (socket says 172.21.15.47:50564) 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 -- 172.21.15.47:0/2982017432 learned_addr learned my addr 172.21.15.47:0/2982017432 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25b400640 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 -- 172.21.15.47:0/2982017432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 msgr2=0x55e4e0ca4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 -- 172.21.15.47:0/2982017432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 msgr2=0x55e4e0c9d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 -- 172.21.15.47:0/2982017432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4e09d5620 con 0x55e4e08c82f0 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc25aa00640 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c9cd90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0a5bf0 tx=0x7fc24c0a9940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643ccd7416b76e98 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc23be00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.631+0000 7fc23be00640 1 -- 172.21.15.47:0/2982017432 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0b2310 con 0x55e4e08c82f0 2024-05-14T12:37:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2480043c0 con 0x55e4e08c82f0 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc23be00640 1 -- 172.21.15.47:0/2982017432 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc24c0b2750 con 0x55e4e08c82f0 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc23be00640 1 -- 172.21.15.47:0/2982017432 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fc24c0a9680 con 0x55e4e08c82f0 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc268662740 10 client.26068 fetch_fsmap learned FSMap version 46 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55e4e0ca71d0 con 0x55e4e08c82f0 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc23be00640 1 -- 172.21.15.47:0/2982017432 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2480043c0 con 0x55e4e08c82f0 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc23be00640 1 -- 172.21.15.47:0/2982017432 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7fc24c0e20d0 con 0x55e4e08c82f0 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc268662740 10 client.26068 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc268662740 10 client.26068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc268662740 20 client.26068 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.632+0000 7fc268662740 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08afd80 0x55e4e0caa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.633+0000 7fc268662740 4 client.26068 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.633+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4e0c05160 con 0x55e4e08afd80 2024-05-14T12:37:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.633+0000 7fc25a000640 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08afd80 0x55e4e0caa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.634+0000 7fc23be00640 10 client.26068 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.633+0000 7fc25a000640 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08afd80 0x55e4e0caa860 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc15341537ff6ed server_cookie=70c9f782f40b50ce in_seq=0 out_seq=0 2024-05-14T12:37:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc23be00640 1 -- 172.21.15.47:0/2982017432 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e4e0c05160 con 0x55e4e08afd80 2024-05-14T12:37:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc23be00640 10 client.26068 handle_command_reply: tid=0 2024-05-14T12:37:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 client.26068 shutdown 2024-05-14T12:37:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 msgr2=0x55e4e0c9cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c9cd90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0a5bf0 tx=0x7fc24c0a9940 comp rx=0 tx=0).stop 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 shutdown_connections 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08afd80 0x55e4e0caa860 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0c9d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 --2- 172.21.15.47:0/2982017432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0c9cd90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc23be00640 0 client.26068 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.635+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 >> 172.21.15.47:0/2982017432 conn(0x55e4e08e5300 msgr2=0x55e4e0c91ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.636+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 shutdown_connections 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.636+0000 7fc268662740 1 -- 172.21.15.47:0/2982017432 wait complete. 2024-05-14T12:37:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.636+0000 7fc268662740 20 client.26068 trim_cache size 0 max 16384 2024-05-14T12:37:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.657+0000 7fc268662740 1 Processor -- start 2024-05-14T12:37:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.657+0000 7fc268662740 1 -- start start 2024-05-14T12:37:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc268662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08c82f0 0x55e4e0c97830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc268662740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc268662740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08f11b0 0x55e4e0c8d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc268662740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1ad410 con 0x55e4e08d04d0 2024-05-14T12:37:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc268662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1aef80 con 0x55e4e08c82f0 2024-05-14T12:37:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc268662740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1adae0 con 0x55e4e08f11b0 2024-05-14T12:37:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08c82f0 0x55e4e0c97830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc25a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc25b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08f11b0 0x55e4e0c8d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08c82f0 0x55e4e0c97830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50408/0 (socket says 172.21.15.47:50408) 2024-05-14T12:37:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc25aa00640 1 -- 172.21.15.47:0/2643014686 learned_addr learned my addr 172.21.15.47:0/2643014686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc25b400640 1 -- 172.21.15.47:0/2643014686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08c82f0 msgr2=0x55e4e0c97830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.658+0000 7fc25b400640 1 --2- 172.21.15.47:0/2643014686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08c82f0 0x55e4e0c97830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.659+0000 7fc25b400640 1 -- 172.21.15.47:0/2643014686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 msgr2=0x55e4e0ca41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.659+0000 7fc25b400640 1 --2- 172.21.15.47:0/2643014686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.659+0000 7fc25b400640 1 -- 172.21.15.47:0/2643014686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e0c8a4a0 con 0x55e4e08f11b0 2024-05-14T12:37:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.659+0000 7fc25b400640 1 --2- 172.21.15.47:0/2643014686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08f11b0 0x55e4e0c8d960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc254034040 tx=0x7fc254040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96635fc1d2bc59e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.659+0000 7fc246a00640 1 -- 172.21.15.47:0/2643014686 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254036040 con 0x55e4e08f11b0 2024-05-14T12:37:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.659+0000 7fc246a00640 1 -- 172.21.15.47:0/2643014686 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc254050070 con 0x55e4e08f11b0 2024-05-14T12:37:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.659+0000 7fc246a00640 1 -- 172.21.15.47:0/2643014686 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254055790 con 0x55e4e08f11b0 2024-05-14T12:37:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 -- 172.21.15.47:0/2643014686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08f11b0 msgr2=0x55e4e0c8d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 --2- 172.21.15.47:0/2643014686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08f11b0 0x55e4e0c8d960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc254034040 tx=0x7fc254040000 comp rx=0 tx=0).stop 2024-05-14T12:37:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 -- 172.21.15.47:0/2643014686 shutdown_connections 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 --2- 172.21.15.47:0/2643014686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08f11b0 0x55e4e0c8d960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 --2- 172.21.15.47:0/2643014686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 --2- 172.21.15.47:0/2643014686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08c82f0 0x55e4e0c97830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 -- 172.21.15.47:0/2643014686 >> 172.21.15.47:0/2643014686 conn(0x55e4e08e5300 msgr2=0x55e4e0c8d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 -- 172.21.15.47:0/2643014686 shutdown_connections 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 -- 172.21.15.47:0/2643014686 wait complete. 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.661+0000 7fc268662740 1 -- start start 2024-05-14T12:37:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 1 Processor -- start 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0ca18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1ae8b0 con 0x55e4e08d04d0 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1ae1b0 con 0x55e4e08f11b0 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1ab3d0 con 0x55e4e08c82f0 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.662+0000 7fc268662740 10 client.0 _ll_register_callbacks cb 0x7fc24c0045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0ca18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0ca18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50572/0 (socket says 172.21.15.47:50572) 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 -- 172.21.15.47:0/1362529873 learned_addr learned my addr 172.21.15.47:0/1362529873 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25b400640 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 -- 172.21.15.47:0/1362529873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 msgr2=0x55e4e0ca2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 -- 172.21.15.47:0/1362529873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 msgr2=0x55e4e0ca1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 -- 172.21.15.47:0/1362529873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4e0ca32f0 con 0x55e4e08c82f0 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc25aa00640 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0ca18c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0a6110 tx=0x7fc24c0e23e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db3852ef30bbf916 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.663+0000 7fc23be00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:37:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc23be00640 1 -- 172.21.15.47:0/1362529873 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0b2310 con 0x55e4e08c82f0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc23be00640 1 -- 172.21.15.47:0/1362529873 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc24c0a8dd0 con 0x55e4e08c82f0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc254050070 con 0x55e4e08c82f0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc23be00640 1 -- 172.21.15.47:0/1362529873 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fc24c0aa270 con 0x55e4e08c82f0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc268662740 10 client.26074 fetch_fsmap learned FSMap version 46 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55e4e0d12c10 con 0x55e4e08c82f0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc23be00640 1 -- 172.21.15.47:0/1362529873 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc254050070 con 0x55e4e08c82f0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc23be00640 1 -- 172.21.15.47:0/1362529873 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7fc24c0a8840 con 0x55e4e08c82f0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc268662740 10 client.26074 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc268662740 10 client.26074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.664+0000 7fc268662740 20 client.26074 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.665+0000 7fc268662740 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08851c0 0x55e4e0d154b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.665+0000 7fc268662740 4 client.26074 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.665+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e4e0bfefd0 con 0x55e4e08851c0 2024-05-14T12:37:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.665+0000 7fc25a000640 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08851c0 0x55e4e0d154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.665+0000 7fc25a000640 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08851c0 0x55e4e0d154b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a081407d095f4cf6 server_cookie=232854dbcd15814f in_seq=0 out_seq=0 2024-05-14T12:37:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.665+0000 7fc23be00640 10 client.26074 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.671+0000 7fc23be00640 1 -- 172.21.15.47:0/1362529873 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e4e0bfefd0 con 0x55e4e08851c0 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.671+0000 7fc23be00640 10 client.26074 handle_command_reply: tid=0 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.671+0000 7fc268662740 1 client.26074 shutdown 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 msgr2=0x55e4e0ca18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0ca18c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0a6110 tx=0x7fc24c0e23e0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 shutdown_connections 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e4e08851c0 0x55e4e0d154b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e4e08f11b0 0x55e4e0ca2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4e08d04d0 0x55e4e0ca1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 --2- 172.21.15.47:0/1362529873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4e08c82f0 0x55e4e0ca18c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc23be00640 0 client.26074 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 >> 172.21.15.47:0/1362529873 conn(0x55e4e08e5300 msgr2=0x55e4e0c924c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 shutdown_connections 2024-05-14T12:37:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 1 -- 172.21.15.47:0/1362529873 wait complete. 2024-05-14T12:37:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.672+0000 7fc268662740 20 client.26074 trim_cache size 0 max 16384 2024-05-14T12:37:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:37:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:37:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:37:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:37:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2400b28a0 msgr2=0x7fc2400b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2400b28a0 0x7fc2400b4db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55e4e0c944d0 tx=0x7fc254030970 comp rx=0 tx=0).stop 2024-05-14T12:37:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c105cf0 msgr2=0x7fc25c19c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c105cf0 0x7fc25c19c3e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00e9f0 tx=0x7fc24c00eeb0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 shutdown_connections 2024-05-14T12:37:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc2400b28a0 0x7fc2400b4db0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc25c10bc30 0x7fc25c1a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc25c106f30 0x7fc25c19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 --2- 172.21.15.47:0/4078468736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25c105cf0 0x7fc25c19c3e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 >> 172.21.15.47:0/4078468736 conn(0x7fc25c100f00 msgr2=0x7fc25c107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 shutdown_connections 2024-05-14T12:37:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:23.673+0000 7fc25be00640 1 -- 172.21.15.47:0/4078468736 wait complete. 2024-05-14T12:37:23.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:23 smithi047 ceph-mon[31254]: pgmap v816: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-14T12:37:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:23 smithi073 ceph-mon[35809]: pgmap v816: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-14T12:37:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:23 smithi066 ceph-mon[35981]: pgmap v816: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-14T12:37:24.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 -- 172.21.15.47:0/3162541110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c115010 msgr2=0x7f4d3c117430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 --2- 172.21.15.47:0/3162541110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c115010 0x7f4d3c117430 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400b0a0 tx=0x7f4d3400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 -- 172.21.15.47:0/3162541110 shutdown_connections 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 --2- 172.21.15.47:0/3162541110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c115010 0x7f4d3c117430 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 --2- 172.21.15.47:0/3162541110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d3c077cf0 0x7f4d3c078100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 --2- 172.21.15.47:0/3162541110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c078640 0x7f4d3c114ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 -- 172.21.15.47:0/3162541110 >> 172.21.15.47:0/3162541110 conn(0x7f4d3c102030 msgr2=0x7f4d3c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 -- 172.21.15.47:0/3162541110 shutdown_connections 2024-05-14T12:37:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.573+0000 7f4d41800700 1 -- 172.21.15.47:0/3162541110 wait complete. 2024-05-14T12:37:24.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.575+0000 7f4d41800700 1 Processor -- start 2024-05-14T12:37:24.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.575+0000 7f4d41800700 1 -- start start 2024-05-14T12:37:24.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d41800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d3c077cf0 0x7f4d3c1a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d41800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c078640 0x7f4d3c1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d41800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c115010 0x7f4d3c1a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d41800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c11a900 con 0x7f4d3c078640 2024-05-14T12:37:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d41800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c11a780 con 0x7f4d3c115010 2024-05-14T12:37:24.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d41800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c11aa80 con 0x7f4d3c077cf0 2024-05-14T12:37:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d3b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c078640 0x7f4d3c1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d40e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c115010 0x7f4d3c1a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d40e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c115010 0x7f4d3c1a5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50436/0 (socket says 172.21.15.47:50436) 2024-05-14T12:37:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d40e00700 1 -- 172.21.15.47:0/139434991 learned_addr learned my addr 172.21.15.47:0/139434991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.576+0000 7f4d3be00700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d3c077cf0 0x7f4d3c1a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d40e00700 1 -- 172.21.15.47:0/139434991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d3c077cf0 msgr2=0x7f4d3c1a11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d40e00700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d3c077cf0 0x7f4d3c1a11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d40e00700 1 -- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c078640 msgr2=0x7f4d3c1a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d40e00700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c078640 0x7f4d3c1a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d40e00700 1 -- 172.21.15.47:0/139434991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c1a60a0 con 0x7f4d3c115010 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d40e00700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c115010 0x7f4d3c1a5a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400b070 tx=0x7f4d34009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d38c00700 1 -- 172.21.15.47:0/139434991 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34021070 con 0x7f4d3c115010 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3c1a6330 con 0x7f4d3c115010 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d38c00700 1 -- 172.21.15.47:0/139434991 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d34004e40 con 0x7f4d3c115010 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.577+0000 7f4d38c00700 1 -- 172.21.15.47:0/139434991 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004630 con 0x7f4d3c115010 2024-05-14T12:37:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.578+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3c1adcb0 con 0x7f4d3c115010 2024-05-14T12:37:24.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.581+0000 7f4d38c00700 1 -- 172.21.15.47:0/139434991 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4d34007980 con 0x7f4d3c115010 2024-05-14T12:37:24.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.582+0000 7f4d51916b80 1 Processor -- start 2024-05-14T12:37:24.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.582+0000 7f4d51916b80 1 -- start start 2024-05-14T12:37:24.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ece1f40 0x55740ee600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee64e10 0x55740ee65220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d51916b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55740ed81b20 con 0x55740ee64e10 2024-05-14T12:37:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d51916b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55740ed1f860 con 0x55740ee60610 2024-05-14T12:37:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d51916b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55740ed7dae0 con 0x55740ece1f40 2024-05-14T12:37:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d38c00700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4d200b2880 0x7f4d200b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.583+0000 7f4d3be00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee648d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50448/0 (socket says 172.21.15.47:50448) 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 -- 172.21.15.47:0/57339898 learned_addr learned my addr 172.21.15.47:0/57339898 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d38c00700 1 -- 172.21.15.47:0/139434991 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4d3400f020 con 0x7f4d3c115010 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3b400700 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ece1f40 0x55740ee600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3b400700 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee64e10 0x55740ee65220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d40e00700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4d200b2880 0x7f4d200b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 -- 172.21.15.47:0/57339898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ece1f40 msgr2=0x55740ee600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ece1f40 0x55740ee600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 -- 172.21.15.47:0/57339898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee64e10 msgr2=0x55740ee65220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee64e10 0x55740ee65220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 -- 172.21.15.47:0/57339898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55740ecce9d0 con 0x55740ee60610 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3b400700 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee64e10 0x55740ee65220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.584+0000 7f4d3be00700 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee648d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009d80 tx=0x7f4d2c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78f61d0d680412b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.585+0000 7f4d31600700 1 -- 172.21.15.47:0/57339898 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c004230 con 0x55740ee60610 2024-05-14T12:37:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.585+0000 7f4d31600700 1 -- 172.21.15.47:0/57339898 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c0043d0 con 0x55740ee60610 2024-05-14T12:37:24.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.585+0000 7f4d31600700 1 -- 172.21.15.47:0/57339898 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c019830 con 0x55740ee60610 2024-05-14T12:37:24.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.585+0000 7f4d40e00700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4d200b2880 0x7f4d200b4d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4d340c46f0 tx=0x7f4d34009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:24.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 -- 172.21.15.47:0/57339898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 msgr2=0x55740ee648d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee648d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009d80 tx=0x7f4d2c011720 comp rx=0 tx=0).stop 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 -- 172.21.15.47:0/57339898 shutdown_connections 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee64e10 0x55740ee65220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ece1f40 0x55740ee600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 --2- 172.21.15.47:0/57339898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee648d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 -- 172.21.15.47:0/57339898 >> 172.21.15.47:0/57339898 conn(0x55740ed20b80 msgr2=0x55740ee5adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 -- 172.21.15.47:0/57339898 shutdown_connections 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.586+0000 7f4d51916b80 1 -- 172.21.15.47:0/57339898 wait complete. 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.587+0000 7f4d51916b80 1 -- start start 2024-05-14T12:37:24.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.587+0000 7f4d51916b80 1 Processor -- start 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.587+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee69a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.587+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee69fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ee64e10 0x55740ee6a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d51916b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55740ee6cdc0 con 0x55740ee60610 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d51916b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55740ece7c20 con 0x55740ece1f40 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d51916b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55740ee6cf40 con 0x55740ee64e10 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d51916b80 10 client.0 _ll_register_callbacks cb 0x55740ed15480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d3b400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee69a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d3b400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee69a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50462/0 (socket says 172.21.15.47:50462) 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d3b400700 1 -- 172.21.15.47:0/3273722498 learned_addr learned my addr 172.21.15.47:0/3273722498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d3be00700 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee69fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d3b400700 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ee64e10 0x55740ee6a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d3b400700 1 -- 172.21.15.47:0/3273722498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 msgr2=0x55740ee69a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.588+0000 7f4d3b400700 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee69a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d3b400700 1 -- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 msgr2=0x55740ee69fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d3b400700 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee69fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d3b400700 1 -- 172.21.15.47:0/3273722498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55740ed47520 con 0x55740ee64e10 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d3b400700 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ee64e10 0x55740ee6a510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009fd0 tx=0x7f4d28009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dda350caa3a1191 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d26000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d26000700 1 -- 172.21.15.47:0/3273722498 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800ec10 con 0x55740ee64e10 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d2c0043d0 con 0x55740ee64e10 2024-05-14T12:37:24.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d26000700 1 -- 172.21.15.47:0/3273722498 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4d28009040 con 0x55740ee64e10 2024-05-14T12:37:24.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d26000700 1 -- 172.21.15.47:0/3273722498 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f4d28012700 con 0x55740ee64e10 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.589+0000 7f4d51916b80 10 client.26086 fetch_fsmap learned FSMap version 46 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55740ee77a70 con 0x55740ee64e10 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d26000700 1 -- 172.21.15.47:0/3273722498 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c0043d0 con 0x55740ee64e10 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d26000700 1 -- 172.21.15.47:0/3273722498 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7f4d280052c0 con 0x55740ee64e10 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d51916b80 10 client.26086 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d51916b80 10 client.26086 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d51916b80 20 client.26086 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d51916b80 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee7a0b0 0x55740ee7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d51916b80 4 client.26086 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.590+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55740ee2c170 con 0x55740ee7a0b0 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.591+0000 7f4d3be00700 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee7a0b0 0x55740ee7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.591+0000 7f4d3be00700 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee7a0b0 0x55740ee7c4d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca43327cda4a098 server_cookie=d2144c5f9cf65a15 in_seq=0 out_seq=0 2024-05-14T12:37:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.591+0000 7f4d26000700 10 client.26086 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:24.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d26000700 1 -- 172.21.15.47:0/3273722498 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55740ee2c170 con 0x55740ee7a0b0 2024-05-14T12:37:24.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d26000700 10 client.26086 handle_command_reply: tid=0 2024-05-14T12:37:24.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 client.26086 shutdown 2024-05-14T12:37:24.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ee64e10 msgr2=0x55740ee6a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ee64e10 0x55740ee6a510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009fd0 tx=0x7f4d28009260 comp rx=0 tx=0).stop 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 shutdown_connections 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee7a0b0 0x55740ee7c4d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ee64e10 0x55740ee6a510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee69a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 --2- 172.21.15.47:0/3273722498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee69fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d26000700 0 client.26086 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.592+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 >> 172.21.15.47:0/3273722498 conn(0x55740ed20b80 msgr2=0x55740ee5aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.593+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 shutdown_connections 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.593+0000 7f4d51916b80 1 -- 172.21.15.47:0/3273722498 wait complete. 2024-05-14T12:37:24.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.593+0000 7f4d51916b80 20 client.26086 trim_cache size 0 max 16384 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 Processor -- start 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 -- start start 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee5f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ece1f40 0x55740ee64810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee75ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b4f00 con 0x55740ece1f40 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b6a70 con 0x55740ee60610 2024-05-14T12:37:24.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.619+0000 7f4d51916b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b55d0 con 0x55740ed20b80 2024-05-14T12:37:24.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ece1f40 0x55740ee64810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee5f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee5f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50630/0 (socket says 172.21.15.47:50630) 2024-05-14T12:37:24.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3b400700 1 -- 172.21.15.47:0/2638980656 learned_addr learned my addr 172.21.15.47:0/2638980656 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:24.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3b400700 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee75ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3be00700 1 -- 172.21.15.47:0/2638980656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 msgr2=0x55740ee5f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3be00700 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee5f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3be00700 1 -- 172.21.15.47:0/2638980656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 msgr2=0x55740ee75ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3be00700 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee75ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3be00700 1 -- 172.21.15.47:0/2638980656 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55740ee55b30 con 0x55740ece1f40 2024-05-14T12:37:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.620+0000 7f4d3b400700 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee5f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:37:24.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.621+0000 7f4d3be00700 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ece1f40 0x55740ee64810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009fa0 tx=0x7f4d2c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26341073afb1b60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.621+0000 7f4d30c00700 1 -- 172.21.15.47:0/2638980656 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c005040 con 0x55740ece1f40 2024-05-14T12:37:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.621+0000 7f4d30c00700 1 -- 172.21.15.47:0/2638980656 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c005690 con 0x55740ece1f40 2024-05-14T12:37:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.621+0000 7f4d30c00700 1 -- 172.21.15.47:0/2638980656 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c004ab0 con 0x55740ece1f40 2024-05-14T12:37:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 -- 172.21.15.47:0/2638980656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ece1f40 msgr2=0x55740ee64810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ece1f40 0x55740ee64810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009fa0 tx=0x7f4d2c009ed0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 -- 172.21.15.47:0/2638980656 shutdown_connections 2024-05-14T12:37:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ee60610 0x55740ee75ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee5f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 --2- 172.21.15.47:0/2638980656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ece1f40 0x55740ee64810 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 -- 172.21.15.47:0/2638980656 >> 172.21.15.47:0/2638980656 conn(0x55740ee5b0f0 msgr2=0x55740ee65df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 -- 172.21.15.47:0/2638980656 shutdown_connections 2024-05-14T12:37:24.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.622+0000 7f4d51916b80 1 -- 172.21.15.47:0/2638980656 wait complete. 2024-05-14T12:37:24.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.623+0000 7f4d51916b80 1 -- start start 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.623+0000 7f4d51916b80 1 Processor -- start 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee6f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee6f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d51916b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee6fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d51916b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b63a0 con 0x55740ee60610 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d51916b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b5ca0 con 0x55740ece1f40 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d51916b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b2e80 con 0x55740ed20b80 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d51916b80 10 client.0 _ll_register_callbacks cb 0x55740ed15480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d3be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee6f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d3be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee6f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50640/0 (socket says 172.21.15.47:50640) 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d3be00700 1 -- 172.21.15.47:0/1189926911 learned_addr learned my addr 172.21.15.47:0/1189926911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d3b400700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee6f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.624+0000 7f4d3b400700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee6fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d3be00700 1 -- 172.21.15.47:0/1189926911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 msgr2=0x55740ee6f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d3be00700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee6f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d3be00700 1 -- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 msgr2=0x55740ee6fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d3be00700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee6fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d3be00700 1 -- 172.21.15.47:0/1189926911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55740eee4840 con 0x55740ed20b80 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d3b400700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee6fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d3be00700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee6f770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c01b040 tx=0x7f4d2c004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8cc4c91764067e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d26000700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:37:24.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d26000700 1 -- 172.21.15.47:0/1189926911 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c039060 con 0x55740ed20b80 2024-05-14T12:37:24.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d2c005690 con 0x55740ed20b80 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.625+0000 7f4d26000700 1 -- 172.21.15.47:0/1189926911 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4d2c02a040 con 0x55740ed20b80 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.626+0000 7f4d26000700 1 -- 172.21.15.47:0/1189926911 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f4d2c02b5a0 con 0x55740ed20b80 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.626+0000 7f4d51916b80 10 client.26092 fetch_fsmap learned FSMap version 46 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.626+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55740eee5970 con 0x55740ed20b80 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.626+0000 7f4d26000700 1 -- 172.21.15.47:0/1189926911 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c005690 con 0x55740ed20b80 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.626+0000 7f4d26000700 1 -- 172.21.15.47:0/1189926911 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7f4d2c02bce0 con 0x55740ed20b80 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d51916b80 10 client.26092 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d51916b80 10 client.26092 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d51916b80 20 client.26092 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d51916b80 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee64e10 0x55740eee7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d51916b80 4 client.26092 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4cb5e3ff", "release": true, "await": true}] 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4cb5e3ff", "release": true, "await": true}) -- 0x55740ed8f500 con 0x55740ee64e10 2024-05-14T12:37:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d3b400700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee64e10 0x55740eee7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d3b400700 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee64e10 0x55740eee7e70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4d545c8885f1fd9 server_cookie=a11c752ca23256d0 in_seq=0 out_seq=0 2024-05-14T12:37:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.627+0000 7f4d26000700 10 client.26092 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:24.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.651+0000 7f4d26000700 1 -- 172.21.15.47:0/1189926911 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55740ed8f500 con 0x55740ee64e10 2024-05-14T12:37:24.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.651+0000 7f4d26000700 10 client.26092 handle_command_reply: tid=0 2024-05-14T12:37:24.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.651+0000 7f4d51916b80 1 client.26092 shutdown 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.651+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 msgr2=0x55740ee6f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.651+0000 7f4d51916b80 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee6f770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c01b040 tx=0x7f4d2c004530 comp rx=0 tx=0).stop 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 shutdown_connections 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55740ee64e10 0x55740eee7e70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ee60610 0x55740ee6fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55740ece1f40 0x55740ee6f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 --2- 172.21.15.47:0/1189926911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55740ed20b80 0x55740ee6f770 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d26000700 0 client.26092 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 >> 172.21.15.47:0/1189926911 conn(0x55740ee5b0f0 msgr2=0x55740ee65df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 shutdown_connections 2024-05-14T12:37:24.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 1 -- 172.21.15.47:0/1189926911 wait complete. 2024-05-14T12:37:24.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.652+0000 7f4d51916b80 20 client.26092 trim_cache size 0 max 16384 2024-05-14T12:37:24.653 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:37:24.653 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 46, 2024-05-14T12:37:24.653 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:37:24.653 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 24, 2024-05-14T12:37:24.653 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:37:24.653 INFO:teuthology.orchestra.run.smithi047.stdout: "4cb5e3ff": { 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 24, 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 80.4, 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:37:24.654 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:37:24.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:37:24.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:37:24.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:37:24.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:37:24.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:37:24.655 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:37:24.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.653+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4d200b2880 msgr2=0x7f4d200b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.653+0000 7f4d41800700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4d200b2880 0x7f4d200b4d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4d340c46f0 tx=0x7f4d34009040 comp rx=0 tx=0).stop 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.653+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c115010 msgr2=0x7f4d3c1a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.653+0000 7f4d41800700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c115010 0x7f4d3c1a5a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400b070 tx=0x7f4d34009c90 comp rx=0 tx=0).stop 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 shutdown_connections 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4d200b2880 0x7f4d200b4d90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d3c115010 0x7f4d3c1a5a00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d3c077cf0 0x7f4d3c1a11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 --2- 172.21.15.47:0/139434991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d3c078640 0x7f4d3c1a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 >> 172.21.15.47:0/139434991 conn(0x7f4d3c102030 msgr2=0x7f4d3c07ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 shutdown_connections 2024-05-14T12:37:24.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:37:24.654+0000 7f4d41800700 1 -- 172.21.15.47:0/139434991 wait complete. 2024-05-14T12:37:25.551 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4cb5e3ff', seconds elapsed: 106.5 2024-05-14T12:37:26.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:25 smithi047 ceph-mon[31254]: pgmap v817: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:37:26.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:25 smithi073 ceph-mon[35809]: pgmap v817: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:37:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:25 smithi066 ceph-mon[35981]: pgmap v817: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-14T12:37:28.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:27 smithi047 ceph-mon[31254]: pgmap v818: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-05-14T12:37:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:27 smithi073 ceph-mon[35809]: pgmap v818: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-05-14T12:37:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:27 smithi066 ceph-mon[35981]: pgmap v818: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-05-14T12:37:29.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:28 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:29.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:28 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:29.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:28 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:30.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:29 smithi047 ceph-mon[31254]: pgmap v819: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-05-14T12:37:30.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:29 smithi073 ceph-mon[35809]: pgmap v819: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-05-14T12:37:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:29 smithi066 ceph-mon[35981]: pgmap v819: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-05-14T12:37:31.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:30 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:31.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:30 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:31.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:30 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:31 smithi047 ceph-mon[31254]: pgmap v820: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-05-14T12:37:32.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:31 smithi073 ceph-mon[35809]: pgmap v820: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-05-14T12:37:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:31 smithi066 ceph-mon[35981]: pgmap v820: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-05-14T12:37:34.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:33 smithi047 ceph-mon[31254]: pgmap v821: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-14T12:37:34.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:33 smithi073 ceph-mon[35809]: pgmap v821: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-14T12:37:34.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:33 smithi066 ceph-mon[35981]: pgmap v821: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-14T12:37:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:35 smithi047 ceph-mon[31254]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 18 op/s 2024-05-14T12:37:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:35 smithi073 ceph-mon[35809]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 18 op/s 2024-05-14T12:37:36.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:35 smithi066 ceph-mon[35981]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 18 op/s 2024-05-14T12:37:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.913+0000 7fe6a7000640 1 -- 172.21.15.47:0/353148895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a010d670 msgr2=0x7fe6a010da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.913+0000 7fe6a7000640 1 --2- 172.21.15.47:0/353148895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a010d670 0x7fe6a010da80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe688009900 tx=0x7fe68802a410 comp rx=0 tx=0).stop 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.913+0000 7fe6a7000640 1 -- 172.21.15.47:0/353148895 shutdown_connections 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.913+0000 7fe6a7000640 1 --2- 172.21.15.47:0/353148895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a0112370 0x7fe6a0114790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.913+0000 7fe6a7000640 1 --2- 172.21.15.47:0/353148895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a010d670 0x7fe6a010da80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.913+0000 7fe6a7000640 1 --2- 172.21.15.47:0/353148895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6a006c150 0x7fe6a010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.913+0000 7fe6a7000640 1 -- 172.21.15.47:0/353148895 >> 172.21.15.47:0/353148895 conn(0x7fe6a0071750 msgr2=0x7fe6a0073c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.914+0000 7fe6a7000640 1 -- 172.21.15.47:0/353148895 shutdown_connections 2024-05-14T12:37:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.914+0000 7fe6a7000640 1 -- 172.21.15.47:0/353148895 wait complete. 2024-05-14T12:37:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.915+0000 7fe6a7000640 1 Processor -- start 2024-05-14T12:37:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.915+0000 7fe6a7000640 1 -- start start 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe6a7000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a006c150 0x7fe6a010c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe6a7000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d670 0x7fe6a010ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe6a7000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6a0112370 0x7fe6a010b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe6a7000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0118060 con 0x7fe6a010d670 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe6a7000640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a0117ee0 con 0x7fe6a0112370 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe6a7000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01181e0 con 0x7fe6a006c150 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe69fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a006c150 0x7fe6a010c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe69fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a006c150 0x7fe6a010c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51938/0 (socket says 172.21.15.47:51938) 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe69fe00640 1 -- 172.21.15.47:0/1694036166 learned_addr learned my addr 172.21.15.47:0/1694036166 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe697400640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d670 0x7fe6a010ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.916+0000 7fe6a5000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6a0112370 0x7fe6a010b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69fe00640 1 -- 172.21.15.47:0/1694036166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6a0112370 msgr2=0x7fe6a010b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69fe00640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6a0112370 0x7fe6a010b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69fe00640 1 -- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d670 msgr2=0x7fe6a010ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69fe00640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d670 0x7fe6a010ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69fe00640 1 -- 172.21.15.47:0/1694036166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a010ba70 con 0x7fe6a006c150 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe697400640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d670 0x7fe6a010ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69fe00640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a006c150 0x7fe6a010c760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe69000e9f0 tx=0x7fe69000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69d600640 1 -- 172.21.15.47:0/1694036166 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69000ccc0 con 0x7fe6a006c150 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69d600640 1 -- 172.21.15.47:0/1694036166 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6900108e0 con 0x7fe6a006c150 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe69d600640 1 -- 172.21.15.47:0/1694036166 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690018860 con 0x7fe6a006c150 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a01acc30 con 0x7fe6a006c150 2024-05-14T12:37:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.917+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a01ad0a0 con 0x7fe6a006c150 2024-05-14T12:37:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.922+0000 7fe6ae172740 1 Processor -- start 2024-05-14T12:37:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.922+0000 7fe6ae172740 1 -- start start 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9891b0 0x55a5bcd2b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd2b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9684d0 0x55a5bcd32580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6ae172740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a5bcc8f550 con 0x55a5bc9602f0 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6ae172740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5bcc34bc0 con 0x55a5bc9891b0 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6ae172740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a5bcc8b510 con 0x55a5bc9684d0 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe69d600640 1 -- 172.21.15.47:0/1694036166 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe690010430 con 0x7fe6a006c150 2024-05-14T12:37:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6a5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9891b0 0x55a5bcd2b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe697400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9684d0 0x55a5bcd32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6a5000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9891b0 0x55a5bcd2b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54370/0 (socket says 172.21.15.47:54370) 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe6a5000640 1 -- 172.21.15.47:0/2399504183 learned_addr learned my addr 172.21.15.47:0/2399504183 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe697400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9684d0 0x55a5bcd32580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51948/0 (socket says 172.21.15.47:51948) 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe69fe00640 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd2b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe697400640 1 -- 172.21.15.47:0/2399504183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9891b0 msgr2=0x55a5bcd2b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe697400640 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9891b0 0x55a5bcd2b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe697400640 1 -- 172.21.15.47:0/2399504183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 msgr2=0x55a5bcd2b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe697400640 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd2b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.923+0000 7fe697400640 1 -- 172.21.15.47:0/2399504183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5bc9a1210 con 0x55a5bc9684d0 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.924+0000 7fe697400640 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9684d0 0x55a5bcd32580 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe68802aa00 tx=0x7fe688004190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a94e8d4623067d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.924+0000 7fe695600640 1 -- 172.21.15.47:0/2399504183 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688035030 con 0x55a5bc9684d0 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.924+0000 7fe695600640 1 -- 172.21.15.47:0/2399504183 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6880054f0 con 0x55a5bc9684d0 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.924+0000 7fe695600640 1 -- 172.21.15.47:0/2399504183 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688003850 con 0x55a5bc9684d0 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe69d600640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6840b2920 0x7fe6840b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 -- 172.21.15.47:0/2399504183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9684d0 msgr2=0x55a5bcd32580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9684d0 0x55a5bcd32580 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe68802aa00 tx=0x7fe688004190 comp rx=0 tx=0).stop 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe69d600640 1 -- 172.21.15.47:0/1694036166 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe6900e2530 con 0x7fe6a006c150 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 -- 172.21.15.47:0/2399504183 shutdown_connections 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9684d0 0x55a5bcd32580 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd2b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 --2- 172.21.15.47:0/2399504183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9891b0 0x55a5bcd2b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 -- 172.21.15.47:0/2399504183 >> 172.21.15.47:0/2399504183 conn(0x55a5bc97d300 msgr2=0x55a5bcd26a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6a5000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6840b2920 0x7fe6840b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 -- 172.21.15.47:0/2399504183 shutdown_connections 2024-05-14T12:37:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.925+0000 7fe6ae172740 1 -- 172.21.15.47:0/2399504183 wait complete. 2024-05-14T12:37:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.926+0000 7fe6a5000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6840b2920 0x7fe6840b4e30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55a5bcd2c2d0 tx=0x7fe698009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.926+0000 7fe6ae172740 1 -- start start 2024-05-14T12:37:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.926+0000 7fe6ae172740 1 Processor -- start 2024-05-14T12:37:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd34c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd35180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6ae172740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a5bcd32f70 con 0x55a5bc9602f0 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6ae172740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5bcc48660 con 0x55a5bc9684d0 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6ae172740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a5bcd330f0 con 0x55a5bc9891b0 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6ae172740 10 client.0 _ll_register_callbacks cb 0x55a5bcc12400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51956/0 (socket says 172.21.15.47:51956) 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 -- 172.21.15.47:0/31799335 learned_addr learned my addr 172.21.15.47:0/31799335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe697400640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd35180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe69fe00640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd34c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 -- 172.21.15.47:0/31799335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 msgr2=0x55a5bcd35180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd35180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 -- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 msgr2=0x55a5bcd34c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd34c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe6a5000640 1 -- 172.21.15.47:0/31799335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5bca6d620 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.927+0000 7fe69fe00640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd34c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.928+0000 7fe6a5000640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6980049d0 tx=0x7fe698004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af678cef310fcb32 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.928+0000 7fe68e000640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.928+0000 7fe68e000640 1 -- 172.21.15.47:0/31799335 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69802d060 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.928+0000 7fe68e000640 1 -- 172.21.15.47:0/31799335 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe698017030 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.928+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6880054f0 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.928+0000 7fe68e000640 1 -- 172.21.15.47:0/31799335 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fe69801d6a0 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.928+0000 7fe6ae172740 10 client.26104 fetch_fsmap learned FSMap version 48 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.929+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a5bcd3f070 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.929+0000 7fe68e000640 1 -- 172.21.15.47:0/31799335 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6880054f0 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.929+0000 7fe68e000640 1 -- 172.21.15.47:0/31799335 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7fe698032070 con 0x55a5bc9891b0 2024-05-14T12:37:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.929+0000 7fe6ae172740 10 client.26104 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T12:37:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.929+0000 7fe6ae172740 10 client.26104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:37:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.930+0000 7fe6ae172740 20 client.26104 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.930+0000 7fe6ae172740 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc947d80 0x55a5bcd427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.930+0000 7fe6ae172740 4 client.26104 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:37:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.930+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5bcc9d160 con 0x55a5bc947d80 2024-05-14T12:37:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.930+0000 7fe69fe00640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc947d80 0x55a5bcd427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.931+0000 7fe69fe00640 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc947d80 0x55a5bcd427d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eb5fd5cc1439e1a server_cookie=df43f439cfa1bc45 in_seq=0 out_seq=0 2024-05-14T12:37:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.931+0000 7fe68e000640 10 client.26104 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.931+0000 7fe68e000640 1 -- 172.21.15.47:0/31799335 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a5bcc9d160 con 0x55a5bc947d80 2024-05-14T12:37:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.931+0000 7fe68e000640 10 client.26104 handle_command_reply: tid=0 2024-05-14T12:37:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.931+0000 7fe6ae172740 1 client.26104 shutdown 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 msgr2=0x55a5bcd3c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6980049d0 tx=0x7fe698004ab0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 shutdown_connections 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc947d80 0x55a5bcd427d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c070 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd35180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 --2- 172.21.15.47:0/31799335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9602f0 0x55a5bcd34c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 >> 172.21.15.47:0/31799335 conn(0x55a5bc97d300 msgr2=0x55a5bcd25a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe68e000640 0 client.26104 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 shutdown_connections 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 1 -- 172.21.15.47:0/31799335 wait complete. 2024-05-14T12:37:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.932+0000 7fe6ae172740 20 client.26104 trim_cache size 0 max 16384 2024-05-14T12:37:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 Processor -- start 2024-05-14T12:37:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 -- start start 2024-05-14T12:37:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9602f0 0x55a5bcd26b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01b5d70 con 0x55a5bc9891b0 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01b79d0 con 0x55a5bc9684d0 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.949+0000 7fe6ae172740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01b6470 con 0x55a5bc9602f0 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe6a5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe69fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9602f0 0x55a5bcd26b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe6a5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41936/0 (socket says 172.21.15.47:41936) 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe69fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9602f0 0x55a5bcd26b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51972/0 (socket says 172.21.15.47:51972) 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe6a5000640 1 -- 172.21.15.47:0/4225850315 learned_addr learned my addr 172.21.15.47:0/4225850315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe697400640 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe69fe00640 1 -- 172.21.15.47:0/4225850315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 msgr2=0x55a5bcd3bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe69fe00640 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe69fe00640 1 -- 172.21.15.47:0/4225850315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9891b0 msgr2=0x55a5bcd3c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe69fe00640 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe69fe00640 1 -- 172.21.15.47:0/4225850315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5bcd32940 con 0x55a5bc9602f0 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.950+0000 7fe6a5000640 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.951+0000 7fe69fe00640 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9602f0 0x55a5bcd26b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55a5bcd2c4e0 tx=0x7fe690009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75ecde214c251b64 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.951+0000 7fe694c00640 1 -- 172.21.15.47:0/4225850315 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900a9620 con 0x55a5bc9602f0 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.951+0000 7fe694c00640 1 -- 172.21.15.47:0/4225850315 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6900aa210 con 0x55a5bc9602f0 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.951+0000 7fe694c00640 1 -- 172.21.15.47:0/4225850315 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690010a90 con 0x55a5bc9602f0 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 -- 172.21.15.47:0/4225850315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9602f0 msgr2=0x55a5bcd26b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9602f0 0x55a5bcd26b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55a5bcd2c4e0 tx=0x7fe690009740 comp rx=0 tx=0).stop 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 -- 172.21.15.47:0/4225850315 shutdown_connections 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 --2- 172.21.15.47:0/4225850315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9602f0 0x55a5bcd26b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 -- 172.21.15.47:0/4225850315 >> 172.21.15.47:0/4225850315 conn(0x55a5bc97d300 msgr2=0x55a5bcd26450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 -- 172.21.15.47:0/4225850315 shutdown_connections 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 -- 172.21.15.47:0/4225850315 wait complete. 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.952+0000 7fe6ae172740 1 -- start start 2024-05-14T12:37:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 1 Processor -- start 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9602f0 0x55a5bcd39ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01b7300 con 0x55a5bc9684d0 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01b6b70 con 0x55a5bc9602f0 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a01b3d30 con 0x55a5bc9891b0 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe6ae172740 10 client.0 _ll_register_callbacks cb 0x7fe698009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe697400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe697400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41946/0 (socket says 172.21.15.47:41946) 2024-05-14T12:37:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.953+0000 7fe697400640 1 -- 172.21.15.47:0/3321602491 learned_addr learned my addr 172.21.15.47:0/3321602491 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6a5000640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe69fe00640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9602f0 0x55a5bcd39ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6a5000640 1 -- 172.21.15.47:0/3321602491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9602f0 msgr2=0x55a5bcd39ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6a5000640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9602f0 0x55a5bcd39ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6a5000640 1 -- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9684d0 msgr2=0x55a5bcd3a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6a5000640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6a5000640 1 -- 172.21.15.47:0/3321602491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5bcd3b4c0 con 0x55a5bc9891b0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe697400640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6a5000640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3af00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe69800ffd0 tx=0x7fe69801d2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4529324812a7c23 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe68e000640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe68e000640 1 -- 172.21.15.47:0/3321602491 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698038070 con 0x55a5bc9891b0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6900aa210 con 0x55a5bc9891b0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.954+0000 7fe68e000640 1 -- 172.21.15.47:0/3321602491 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe6980335f0 con 0x55a5bc9891b0 2024-05-14T12:37:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe68e000640 1 -- 172.21.15.47:0/3321602491 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fe69800f8d0 con 0x55a5bc9891b0 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 10 client.26110 fetch_fsmap learned FSMap version 48 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a5bcd3c7c0 con 0x55a5bc9891b0 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe68e000640 1 -- 172.21.15.47:0/3321602491 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6900aa210 con 0x55a5bc9891b0 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe68e000640 1 -- 172.21.15.47:0/3321602491 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 48) ==== 8382+0+0 (secure 0 0 0) 0x7fe698032040 con 0x55a5bc9891b0 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 10 client.26110 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 10 client.26110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 20 client.26110 populate_metadata read hostname 'smithi047' 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc91d1c0 0x55a5bcdb5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 4 client.26110 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.955+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5bcc96fd0 con 0x55a5bc91d1c0 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.956+0000 7fe69fe00640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc91d1c0 0x55a5bcdb5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.956+0000 7fe69fe00640 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc91d1c0 0x55a5bcdb5810 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14e255615b1de9c2 server_cookie=4a70b53a315263b8 in_seq=0 out_seq=0 2024-05-14T12:37:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:37:36.956+0000 7fe68e000640 10 client.26110 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:37:38.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:37 smithi047 ceph-mon[31254]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 KiB/s wr, 24 op/s 2024-05-14T12:37:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:37 smithi073 ceph-mon[35809]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 KiB/s wr, 24 op/s 2024-05-14T12:37:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:37 smithi066 ceph-mon[35981]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 KiB/s wr, 24 op/s 2024-05-14T12:37:39.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:38 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:39.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:38 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:39.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:38 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:40.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:39 smithi073 ceph-mon[35809]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-05-14T12:37:40.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:39 smithi066 ceph-mon[35981]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-05-14T12:37:40.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:39 smithi047 ceph-mon[31254]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-05-14T12:37:41.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:41 smithi047 ceph-mon[31254]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 36 KiB/s wr, 21 op/s 2024-05-14T12:37:41.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:41 smithi066 ceph-mon[35981]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 36 KiB/s wr, 21 op/s 2024-05-14T12:37:41.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:41 smithi073 ceph-mon[35809]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 36 KiB/s wr, 21 op/s 2024-05-14T12:37:44.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:43 smithi066 ceph-mon[35981]: pgmap v826: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-05-14T12:37:44.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:43 smithi047 ceph-mon[31254]: pgmap v826: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-05-14T12:37:44.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:43 smithi073 ceph-mon[35809]: pgmap v826: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-05-14T12:37:46.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:45 smithi066 ceph-mon[35981]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-05-14T12:37:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:45 smithi047 ceph-mon[31254]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-05-14T12:37:46.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:45 smithi073 ceph-mon[35809]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-05-14T12:37:48.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:47 smithi066 ceph-mon[35981]: pgmap v828: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-05-14T12:37:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:47 smithi047 ceph-mon[31254]: pgmap v828: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-05-14T12:37:48.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:47 smithi073 ceph-mon[35809]: pgmap v828: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-05-14T12:37:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:49 smithi066 ceph-mon[35981]: pgmap v829: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T12:37:50.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:49 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:37:50.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:49 smithi047 ceph-mon[31254]: pgmap v829: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T12:37:50.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:49 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:37:50.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:49 smithi073 ceph-mon[35809]: pgmap v829: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T12:37:50.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:49 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:37:51.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:37:51.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:37:51.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:37:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:37:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:37:51.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:37:51.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:37:51.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:37:51.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:37:52.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:51 smithi066 ceph-mon[35981]: pgmap v830: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-05-14T12:37:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:51 smithi047 ceph-mon[31254]: pgmap v830: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-05-14T12:37:52.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:51 smithi073 ceph-mon[35809]: pgmap v830: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-05-14T12:37:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:53 smithi066 ceph-mon[35981]: pgmap v831: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-05-14T12:37:54.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:53 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:54.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:53 smithi047 ceph-mon[31254]: pgmap v831: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-05-14T12:37:54.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:53 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:53 smithi073 ceph-mon[35809]: pgmap v831: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-05-14T12:37:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:53 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:37:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:55 smithi066 ceph-mon[35981]: pgmap v832: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2024-05-14T12:37:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:55 smithi047 ceph-mon[31254]: pgmap v832: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2024-05-14T12:37:56.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:55 smithi073 ceph-mon[35809]: pgmap v832: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2024-05-14T12:37:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:57 smithi066 ceph-mon[35981]: pgmap v833: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-05-14T12:37:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:57 smithi047 ceph-mon[31254]: pgmap v833: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-05-14T12:37:58.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:57 smithi073 ceph-mon[35809]: pgmap v833: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-05-14T12:38:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:37:59 smithi047 ceph-mon[31254]: pgmap v834: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.8 KiB/s wr, 17 op/s 2024-05-14T12:38:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:37:59 smithi073 ceph-mon[35809]: pgmap v834: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.8 KiB/s wr, 17 op/s 2024-05-14T12:38:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:37:59 smithi066 ceph-mon[35981]: pgmap v834: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.8 KiB/s wr, 17 op/s 2024-05-14T12:38:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:01 smithi047 ceph-mon[31254]: pgmap v835: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.2 KiB/s wr, 18 op/s 2024-05-14T12:38:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:01 smithi073 ceph-mon[35809]: pgmap v835: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.2 KiB/s wr, 18 op/s 2024-05-14T12:38:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:01 smithi066 ceph-mon[35981]: pgmap v835: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.2 KiB/s wr, 18 op/s 2024-05-14T12:38:03.818 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-14T12:38:03.818 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.95 2024-05-14T12:38:03.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:38:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:03 smithi047 ceph-mon[31254]: pgmap v836: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 18 op/s 2024-05-14T12:38:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:03 smithi073 ceph-mon[35809]: pgmap v836: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 18 op/s 2024-05-14T12:38:04.283 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:38:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:03 smithi066 ceph-mon[35981]: pgmap v836: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 18 op/s 2024-05-14T12:38:05.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:05 smithi047 ceph-mon[31254]: pgmap v837: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-14T12:38:06.126 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:05 smithi066 ceph-mon[35981]: pgmap v837: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-14T12:38:06.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:05 smithi073 ceph-mon[35809]: pgmap v837: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-05-14T12:38:06.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.659+0000 7f06e4a00700 1 -- 172.21.15.47:0/1379925510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0108f20 msgr2=0x7f06e0109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:06.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.659+0000 7f06e4a00700 1 --2- 172.21.15.47:0/1379925510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0108f20 0x7f06e0109330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009990 tx=0x7f06cc009ca0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.659+0000 7f06e4a00700 1 -- 172.21.15.47:0/1379925510 shutdown_connections 2024-05-14T12:38:06.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.659+0000 7f06e4a00700 1 --2- 172.21.15.47:0/1379925510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0109870 0x7f06e01111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.659+0000 7f06e4a00700 1 --2- 172.21.15.47:0/1379925510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e01045f0 0x7f06e0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.659+0000 7f06e4a00700 1 --2- 172.21.15.47:0/1379925510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0108f20 0x7f06e0109330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.659+0000 7f06e4a00700 1 -- 172.21.15.47:0/1379925510 >> 172.21.15.47:0/1379925510 conn(0x7f06e0100040 msgr2=0x7f06e0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:06.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.663+0000 7f06e4a00700 1 -- 172.21.15.47:0/1379925510 shutdown_connections 2024-05-14T12:38:06.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.663+0000 7f06e4a00700 1 -- 172.21.15.47:0/1379925510 wait complete. 2024-05-14T12:38:06.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.665+0000 7f06e4a00700 1 Processor -- start 2024-05-14T12:38:06.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.665+0000 7f06e4a00700 1 -- start start 2024-05-14T12:38:06.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.666+0000 7f06e4a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e01045f0 0x7f06e019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:06.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.666+0000 7f06e4a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0108f20 0x7f06e019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:06.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.666+0000 7f06e4a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0109870 0x7f06e01a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:06.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.666+0000 7f06e4a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01144d0 con 0x7f06e0108f20 2024-05-14T12:38:06.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.666+0000 7f06e4a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0114350 con 0x7f06e0109870 2024-05-14T12:38:06.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.666+0000 7f06e4a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0114650 con 0x7f06e01045f0 2024-05-14T12:38:06.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.666+0000 7f06dd400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0108f20 0x7f06e019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:06.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dd400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0108f20 0x7f06e019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38292/0 (socket says 172.21.15.47:38292) 2024-05-14T12:38:06.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dd400700 1 -- 172.21.15.47:0/2169433158 learned_addr learned my addr 172.21.15.47:0/2169433158 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dde00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e01045f0 0x7f06e019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06de800700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0109870 0x7f06e01a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dd400700 1 -- 172.21.15.47:0/2169433158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e01045f0 msgr2=0x7f06e019d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dd400700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e01045f0 0x7f06e019d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dd400700 1 -- 172.21.15.47:0/2169433158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0109870 msgr2=0x7f06e01a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dd400700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0109870 0x7f06e01a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.667+0000 7f06dd400700 1 -- 172.21.15.47:0/2169433158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e01a1fb0 con 0x7f06e0108f20 2024-05-14T12:38:06.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.668+0000 7f06de800700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0109870 0x7f06e01a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.668+0000 7f06dd400700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0108f20 0x7f06e019d680 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.669+0000 7f06d6a00700 1 -- 172.21.15.47:0/2169433158 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc026070 con 0x7f06e0108f20 2024-05-14T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.669+0000 7f06d6a00700 1 -- 172.21.15.47:0/2169433158 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06cc00b610 con 0x7f06e0108f20 2024-05-14T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.669+0000 7f06d6a00700 1 -- 172.21.15.47:0/2169433158 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0173f0 con 0x7f06e0108f20 2024-05-14T12:38:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.669+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e01a2240 con 0x7f06e0108f20 2024-05-14T12:38:06.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.669+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e01a26d0 con 0x7f06e0108f20 2024-05-14T12:38:06.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.671+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e00512c0 con 0x7f06e0108f20 2024-05-14T12:38:06.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.676+0000 7f06d6a00700 1 -- 172.21.15.47:0/2169433158 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f06cc029070 con 0x7f06e0108f20 2024-05-14T12:38:06.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.679+0000 7f06d6a00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f06c40b2900 0x7f06c40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:06.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.679+0000 7f06d6a00700 1 -- 172.21.15.47:0/2169433158 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f06cc0e36c0 con 0x7f06e0108f20 2024-05-14T12:38:06.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.680+0000 7f06dde00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f06c40b2900 0x7f06c40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:06.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.681+0000 7f06dde00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f06c40b2900 0x7f06c40b4e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009cb0 tx=0x7f06d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:06.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.684+0000 7f06d6a00700 1 -- 172.21.15.47:0/2169433158 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f06cc013070 con 0x7f06e0108f20 2024-05-14T12:38:06.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.987+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06e01a9c80 con 0x7f06e0108f20 2024-05-14T12:38:06.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.989+0000 7f06d6a00700 1 -- 172.21.15.47:0/2169433158 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11936 (secure 0 0 0) 0x7f06cc021410 con 0x7f06e0108f20 2024-05-14T12:38:06.989 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:38:06.992 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:37:52.056424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:38:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.992+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f06c40b2900 msgr2=0x7f06c40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.992+0000 7f06e4a00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f06c40b2900 0x7f06c40b4e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009cb0 tx=0x7f06d0009260 comp rx=0 tx=0).stop 2024-05-14T12:38:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.992+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0108f20 msgr2=0x7f06e019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.992+0000 7f06e4a00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0108f20 0x7f06e019d680 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc009580 comp rx=0 tx=0).stop 2024-05-14T12:38:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 shutdown_connections 2024-05-14T12:38:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f06c40b2900 0x7f06c40b4e10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06e0109870 0x7f06e01a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e01045f0 0x7f06e019d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 --2- 172.21.15.47:0/2169433158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e0108f20 0x7f06e019d680 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 >> 172.21.15.47:0/2169433158 conn(0x7f06e0100040 msgr2=0x7f06e01086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 shutdown_connections 2024-05-14T12:38:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:06.993+0000 7f06e4a00700 1 -- 172.21.15.47:0/2169433158 wait complete. 2024-05-14T12:38:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 50 2024-05-14T12:38:08.060 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 78.95 --await-for 42.0' 2024-05-14T12:38:08.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 78.95 --await-for 42.0 2024-05-14T12:38:08.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:07 smithi047 ceph-mon[31254]: pgmap v838: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.1 KiB/s wr, 19 op/s 2024-05-14T12:38:08.138 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:07 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2169433158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:38:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:07 smithi073 ceph-mon[35809]: pgmap v838: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.1 KiB/s wr, 19 op/s 2024-05-14T12:38:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:07 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2169433158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:38:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:07 smithi066 ceph-mon[35981]: pgmap v838: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.1 KiB/s wr, 19 op/s 2024-05-14T12:38:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:07 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2169433158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:38:08.527 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:38:09.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:09 smithi047 ceph-mon[31254]: pgmap v839: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.1 KiB/s wr, 17 op/s 2024-05-14T12:38:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:09 smithi073 ceph-mon[35809]: pgmap v839: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.1 KiB/s wr, 17 op/s 2024-05-14T12:38:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:09 smithi066 ceph-mon[35981]: pgmap v839: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.1 KiB/s wr, 17 op/s 2024-05-14T12:38:11.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.106+0000 7f7026600700 1 -- 172.21.15.47:0/142530024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 msgr2=0x7f702010e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:11.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.106+0000 7f7026600700 1 --2- 172.21.15.47:0/142530024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702010e3a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f700c009990 tx=0x7f700c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.106+0000 7f7026600700 1 -- 172.21.15.47:0/142530024 shutdown_connections 2024-05-14T12:38:11.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.106+0000 7f7026600700 1 --2- 172.21.15.47:0/142530024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702010e8e0 0x7f7020110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.106+0000 7f7026600700 1 --2- 172.21.15.47:0/142530024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7020105500 0x7f7020105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.106+0000 7f7026600700 1 --2- 172.21.15.47:0/142530024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702010e3a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.106+0000 7f7026600700 1 -- 172.21.15.47:0/142530024 >> 172.21.15.47:0/142530024 conn(0x7f70200fedc0 msgr2=0x7f70201011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:11.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.107+0000 7f7026600700 1 -- 172.21.15.47:0/142530024 shutdown_connections 2024-05-14T12:38:11.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.107+0000 7f7026600700 1 -- 172.21.15.47:0/142530024 wait complete. 2024-05-14T12:38:11.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.108+0000 7f7026600700 1 Processor -- start 2024-05-14T12:38:11.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.108+0000 7f7026600700 1 -- start start 2024-05-14T12:38:11.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f7026600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7020105500 0x7f702019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f7026600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f7026600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702010e8e0 0x7f702019f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f7026600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7020114490 con 0x7f7020105500 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f7026600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7020114310 con 0x7f7020105e50 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f7026600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7020114610 con 0x7f702010e8e0 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702019b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:37910/0 (socket says 172.21.15.47:37910) 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f701ea00700 1 -- 172.21.15.47:0/1946775362 learned_addr learned my addr 172.21.15.47:0/1946775362 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.109+0000 7f701f400700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7020105500 0x7f702019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f701fe00700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702010e8e0 0x7f702019f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f701ea00700 1 -- 172.21.15.47:0/1946775362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702010e8e0 msgr2=0x7f702019f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f701ea00700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702010e8e0 0x7f702019f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f701ea00700 1 -- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7020105500 msgr2=0x7f702019ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:11.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f701ea00700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7020105500 0x7f702019ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f701ea00700 1 -- 172.21.15.47:0/1946775362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702019fd30 con 0x7f7020105e50 2024-05-14T12:38:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f701ea00700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702019b400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f700c005910 tx=0x7f700c00b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f7017e00700 1 -- 172.21.15.47:0/1946775362 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c027070 con 0x7f7020105e50 2024-05-14T12:38:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f7017e00700 1 -- 172.21.15.47:0/1946775362 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f700c022470 con 0x7f7020105e50 2024-05-14T12:38:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.110+0000 7f7017e00700 1 -- 172.21.15.47:0/1946775362 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c017650 con 0x7f7020105e50 2024-05-14T12:38:11.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.111+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702019ffc0 con 0x7f7020105e50 2024-05-14T12:38:11.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.111+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70201a0450 con 0x7f7020105e50 2024-05-14T12:38:11.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.114+0000 7f7017e00700 1 -- 172.21.15.47:0/1946775362 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f700c02a070 con 0x7f7020105e50 2024-05-14T12:38:11.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 Processor -- start 2024-05-14T12:38:11.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 -- start start 2024-05-14T12:38:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f7017e00700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70040b2900 0x7f70040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231d5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f7017e00700 1 -- 172.21.15.47:0/1946775362 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f700c0e3100 con 0x7f7020105e50 2024-05-14T12:38:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b2230f2bb0 con 0x55b223052fd0 2024-05-14T12:38:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b2230908f0 con 0x55b2231d11d0 2024-05-14T12:38:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.116+0000 7f70351ecb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b2230eeb70 con 0x55b2231d59b0 2024-05-14T12:38:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701fe00700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70040b2900 0x7f70040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231d5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:37918/0 (socket says 172.21.15.47:37918) 2024-05-14T12:38:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 -- 172.21.15.47:0/3362534625 learned_addr learned my addr 172.21.15.47:0/3362534625 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701f400700 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 -- 172.21.15.47:0/3362534625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 msgr2=0x55b2231d5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 -- 172.21.15.47:0/3362534625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 msgr2=0x55b2231d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.117+0000 7f701ea00700 1 -- 172.21.15.47:0/3362534625 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b22303fa60 con 0x55b2231d11d0 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.118+0000 7f701ea00700 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231d5470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f700c0aa470 tx=0x7f700c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aace1c68d82237b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.118+0000 7f701fe00700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70040b2900 0x7f70040b4e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7018009550 tx=0x7f7018009bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.118+0000 7f7014c00700 1 -- 172.21.15.47:0/3362534625 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c0aa770 con 0x55b2231d11d0 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.118+0000 7f7014c00700 1 -- 172.21.15.47:0/3362534625 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f700c0aeb20 con 0x55b2231d11d0 2024-05-14T12:38:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.118+0000 7f7014c00700 1 -- 172.21.15.47:0/3362534625 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c0b30b0 con 0x55b2231d11d0 2024-05-14T12:38:11.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 -- 172.21.15.47:0/3362534625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 msgr2=0x55b2231d5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:11.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231d5470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f700c0aa470 tx=0x7f700c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 -- 172.21.15.47:0/3362534625 shutdown_connections 2024-05-14T12:38:11.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3362534625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231d5470 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 -- 172.21.15.47:0/3362534625 >> 172.21.15.47:0/3362534625 conn(0x55b223098100 msgr2=0x55b2231cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 -- 172.21.15.47:0/3362534625 shutdown_connections 2024-05-14T12:38:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.119+0000 7f70351ecb80 1 -- 172.21.15.47:0/3362534625 wait complete. 2024-05-14T12:38:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.120+0000 7f70351ecb80 1 -- start start 2024-05-14T12:38:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.120+0000 7f70351ecb80 1 Processor -- start 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b223052fd0 0x55b2231da730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231dac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231db1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f70351ecb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b2231dd720 con 0x55b2231d59b0 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f70351ecb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b223058cb0 con 0x55b2231d11d0 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f70351ecb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b2231dd8a0 con 0x55b223052fd0 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f70351ecb80 10 client.0 _ll_register_callbacks cb 0x55b223099e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:38:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231dac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f701f400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b223052fd0 0x55b2231da730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231dac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:37924/0 (socket says 172.21.15.47:37924) 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f701ea00700 1 -- 172.21.15.47:0/3110123828 learned_addr learned my addr 172.21.15.47:0/3110123828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f701fe00700 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231db1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.121+0000 7f701f400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b223052fd0 0x55b2231da730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52988/0 (socket says 172.21.15.47:52988) 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f701ea00700 1 -- 172.21.15.47:0/3110123828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b223052fd0 msgr2=0x55b2231da730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f701ea00700 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b223052fd0 0x55b2231da730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f701ea00700 1 -- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 msgr2=0x55b2231db1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f701ea00700 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231db1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f701ea00700 1 -- 172.21.15.47:0/3110123828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2230b85b0 con 0x55b2231d11d0 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f701ea00700 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231dac70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f700c009350 tx=0x7f700c0a6630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0543d3073abf185 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f7009600700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f7009600700 1 -- 172.21.15.47:0/3110123828 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c0aa770 con 0x55b2231d11d0 2024-05-14T12:38:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f7009600700 1 -- 172.21.15.47:0/3110123828 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f700c0aabe0 con 0x55b2231d11d0 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f700c0aeb20 con 0x55b2231d11d0 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.122+0000 7f7009600700 1 -- 172.21.15.47:0/3110123828 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f700c0b30b0 con 0x55b2231d11d0 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 10 client.26096 fetch_fsmap learned FSMap version 50 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55b2231dd720 con 0x55b2231d11d0 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f7009600700 1 -- 172.21.15.47:0/3110123828 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f700c0aeb20 con 0x55b2231d11d0 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f7009600700 1 -- 172.21.15.47:0/3110123828 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f700c090ce0 con 0x55b2231d11d0 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 10 client.26096 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 10 client.26096 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 20 client.26096 populate_metadata read hostname 'smithi047' 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2231ea570 0x55b2231ec990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 4 client.26096 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:38:11.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.123+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b22319d350 con 0x55b2231ea570 2024-05-14T12:38:11.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.124+0000 7f701f400700 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2231ea570 0x55b2231ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:11.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.124+0000 7f701f400700 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2231ea570 0x55b2231ec990 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f52b620e11cf0ea server_cookie=5bcbaa66c1135b88 in_seq=0 out_seq=0 2024-05-14T12:38:11.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:11.124+0000 7f7009600700 10 client.26096 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:11 smithi047 ceph-mon[31254]: pgmap v840: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.7 KiB/s wr, 18 op/s 2024-05-14T12:38:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:11 smithi073 ceph-mon[35809]: pgmap v840: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.7 KiB/s wr, 18 op/s 2024-05-14T12:38:12.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:11 smithi066 ceph-mon[35981]: pgmap v840: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.7 KiB/s wr, 18 op/s 2024-05-14T12:38:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:13 smithi047 ceph-mon[31254]: pgmap v841: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-05-14T12:38:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:13 smithi073 ceph-mon[35809]: pgmap v841: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-05-14T12:38:14.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:13 smithi066 ceph-mon[35981]: pgmap v841: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-05-14T12:38:16.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:15 smithi047 ceph-mon[31254]: pgmap v842: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-05-14T12:38:16.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:15 smithi073 ceph-mon[35809]: pgmap v842: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-05-14T12:38:16.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:15 smithi066 ceph-mon[35981]: pgmap v842: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-05-14T12:38:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:17 smithi047 ceph-mon[31254]: pgmap v843: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 23 op/s 2024-05-14T12:38:18.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:17 smithi073 ceph-mon[35809]: pgmap v843: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 23 op/s 2024-05-14T12:38:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:17 smithi066 ceph-mon[35981]: pgmap v843: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 23 op/s 2024-05-14T12:38:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:19 smithi047 ceph-mon[31254]: pgmap v844: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 21 op/s 2024-05-14T12:38:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:19 smithi073 ceph-mon[35809]: pgmap v844: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 21 op/s 2024-05-14T12:38:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:19 smithi066 ceph-mon[35981]: pgmap v844: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 21 op/s 2024-05-14T12:38:22.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:21 smithi047 ceph-mon[31254]: pgmap v845: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-05-14T12:38:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:21 smithi073 ceph-mon[35809]: pgmap v845: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-05-14T12:38:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:21 smithi066 ceph-mon[35981]: pgmap v845: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-05-14T12:38:24.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:23 smithi047 ceph-mon[31254]: pgmap v846: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 20 op/s 2024-05-14T12:38:24.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:23 smithi073 ceph-mon[35809]: pgmap v846: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 20 op/s 2024-05-14T12:38:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:23 smithi066 ceph-mon[35981]: pgmap v846: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 20 op/s 2024-05-14T12:38:26.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:25 smithi047 ceph-mon[31254]: pgmap v847: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 14 op/s 2024-05-14T12:38:26.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:25 smithi073 ceph-mon[35809]: pgmap v847: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 14 op/s 2024-05-14T12:38:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:25 smithi066 ceph-mon[35981]: pgmap v847: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 14 op/s 2024-05-14T12:38:28.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:27 smithi047 ceph-mon[31254]: pgmap v848: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-05-14T12:38:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:27 smithi073 ceph-mon[35809]: pgmap v848: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-05-14T12:38:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:27 smithi066 ceph-mon[35981]: pgmap v848: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-05-14T12:38:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:29 smithi047 ceph-mon[31254]: pgmap v849: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:29 smithi073 ceph-mon[35809]: pgmap v849: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:29 smithi066 ceph-mon[35981]: pgmap v849: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.552+0000 7fe68e000640 1 -- 172.21.15.47:0/3321602491 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5bcc96fd0 con 0x55a5bc91d1c0 2024-05-14T12:38:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.552+0000 7fe68e000640 10 client.26110 handle_command_reply: tid=0 2024-05-14T12:38:31.553 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.552+0000 7fe6ae172740 1 client.26110 shutdown 2024-05-14T12:38:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 msgr2=0x55a5bcd3af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3af00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe69800ffd0 tx=0x7fe69801d2f0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 shutdown_connections 2024-05-14T12:38:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55a5bc91d1c0 0x55a5bcdb5810 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5bc9891b0 0x55a5bcd3af00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5bc9684d0 0x55a5bcd3a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 --2- 172.21.15.47:0/3321602491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5bc9602f0 0x55a5bcd39ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe68e000640 0 client.26110 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.553+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 >> 172.21.15.47:0/3321602491 conn(0x55a5bc97d300 msgr2=0x55a5bcd25000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.554+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 shutdown_connections 2024-05-14T12:38:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.554+0000 7fe6ae172740 1 -- 172.21.15.47:0/3321602491 wait complete. 2024-05-14T12:38:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.554+0000 7fe6ae172740 20 client.26110 trim_cache size 0 max 16384 2024-05-14T12:38:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.554+0000 7f7009600700 1 -- 172.21.15.47:0/3110123828 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b22319d350 con 0x55b2231ea570 2024-05-14T12:38:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.554+0000 7f7009600700 10 client.26096 handle_command_reply: tid=0 2024-05-14T12:38:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:38:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:38:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:38:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:38:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.555+0000 7f70351ecb80 1 client.26096 shutdown 2024-05-14T12:38:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 msgr2=0x55b2231dac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231dac70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f700c009350 tx=0x7f700c0a6630 comp rx=0 tx=0).stop 2024-05-14T12:38:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 shutdown_connections 2024-05-14T12:38:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2231ea570 0x55b2231ec990 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231db1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b223052fd0 0x55b2231da730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 --2- 172.21.15.47:0/3110123828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231dac70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 >> 172.21.15.47:0/3110123828 conn(0x55b223098100 msgr2=0x55b2231c56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:31.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f7009600700 0 client.26096 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:31.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 shutdown_connections 2024-05-14T12:38:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6840b2920 msgr2=0x7fe6840b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6840b2920 0x7fe6840b4e30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55a5bcd2c2d0 tx=0x7fe698009500 comp rx=0 tx=0).stop 2024-05-14T12:38:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a006c150 msgr2=0x7fe6a010c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a006c150 0x7fe6a010c760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe69000e9f0 tx=0x7fe69000eeb0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.556+0000 7f70351ecb80 1 -- 172.21.15.47:0/3110123828 wait complete. 2024-05-14T12:38:31.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.557+0000 7f70351ecb80 20 client.26096 trim_cache size 0 max 16384 2024-05-14T12:38:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 shutdown_connections 2024-05-14T12:38:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe6840b2920 0x7fe6840b4e30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6a0112370 0x7fe6a010b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6a010d670 0x7fe6a010ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 --2- 172.21.15.47:0/1694036166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6a006c150 0x7fe6a010c760 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.557+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 >> 172.21.15.47:0/1694036166 conn(0x7fe6a0071750 msgr2=0x7fe6a010e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.558+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 shutdown_connections 2024-05-14T12:38:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:31.558+0000 7fe6a7000640 1 -- 172.21.15.47:0/1694036166 wait complete. 2024-05-14T12:38:31.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.589+0000 7f70351ecb80 1 Processor -- start 2024-05-14T12:38:31.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f70351ecb80 1 -- start start 2024-05-14T12:38:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f70351ecb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70201aca40 con 0x55b223052fd0 2024-05-14T12:38:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f70351ecb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70201ae760 con 0x55b2231d11d0 2024-05-14T12:38:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f70351ecb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f70201ad140 con 0x55b2231d59b0 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.590+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:52968/0 (socket says 172.21.15.47:52968) 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701fe00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38006/0 (socket says 172.21.15.47:38006) 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701ea00700 1 -- 172.21.15.47:0/1789182126 learned_addr learned my addr 172.21.15.47:0/1789182126 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701f400700 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701fe00700 1 -- 172.21.15.47:0/1789182126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 msgr2=0x55b2231cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701fe00700 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701fe00700 1 -- 172.21.15.47:0/1789182126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 msgr2=0x55b2231d9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701fe00700 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.591+0000 7f701fe00700 1 -- 172.21.15.47:0/1789182126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2231d8cc0 con 0x55b2231d59b0 2024-05-14T12:38:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.592+0000 7f701fe00700 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d64d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7018009eb0 tx=0x7f701801e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3a9985857fe6aa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.592+0000 7f700be00700 1 -- 172.21.15.47:0/1789182126 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701802d070 con 0x55b2231d59b0 2024-05-14T12:38:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.592+0000 7f700be00700 1 -- 172.21.15.47:0/1789182126 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f701801b930 con 0x55b2231d59b0 2024-05-14T12:38:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.592+0000 7f700be00700 1 -- 172.21.15.47:0/1789182126 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018012040 con 0x55b2231d59b0 2024-05-14T12:38:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 -- 172.21.15.47:0/1789182126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 msgr2=0x55b2231d64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d64d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7018009eb0 tx=0x7f701801e000 comp rx=0 tx=0).stop 2024-05-14T12:38:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 -- 172.21.15.47:0/1789182126 shutdown_connections 2024-05-14T12:38:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d59b0 0x55b2231d64d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b223052fd0 0x55b2231d9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 --2- 172.21.15.47:0/1789182126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2231d11d0 0x55b2231cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 -- 172.21.15.47:0/1789182126 >> 172.21.15.47:0/1789182126 conn(0x55b223098100 msgr2=0x55b2231d5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.593+0000 7f70351ecb80 1 -- 172.21.15.47:0/1789182126 shutdown_connections 2024-05-14T12:38:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.594+0000 7f70351ecb80 1 -- 172.21.15.47:0/1789182126 wait complete. 2024-05-14T12:38:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.594+0000 7f70351ecb80 1 -- start start 2024-05-14T12:38:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 1 Processor -- start 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b223052fd0 0x55b2231e2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d11d0 0x55b2231e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231df960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70201adfd0 con 0x55b2231d59b0 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70201ad840 con 0x55b223052fd0 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f70201aa9c0 con 0x55b2231d11d0 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.595+0000 7f70351ecb80 10 client.0 _ll_register_callbacks cb 0x55b223099e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d11d0 0x55b2231e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d11d0 0x55b2231e2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38012/0 (socket says 172.21.15.47:38012) 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701f400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b223052fd0 0x55b2231e2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 -- 172.21.15.47:0/2632323854 learned_addr learned my addr 172.21.15.47:0/2632323854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701fe00700 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231df960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 -- 172.21.15.47:0/2632323854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b223052fd0 msgr2=0x55b2231e2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b223052fd0 0x55b2231e2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 -- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 msgr2=0x55b2231df960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231df960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 -- 172.21.15.47:0/2632323854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2231dfed0 con 0x55b2231d11d0 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f701ea00700 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d11d0 0x55b2231e2ed0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f700c022d00 tx=0x7f700c085000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4fc3ea0c500e57 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.596+0000 7f7009600700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:38:31.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f7009600700 1 -- 172.21.15.47:0/2632323854 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c08c060 con 0x55b2231d11d0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f7009600700 1 -- 172.21.15.47:0/2632323854 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f700c0a6340 con 0x55b2231d11d0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701801b930 con 0x55b2231d11d0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f7009600700 1 -- 172.21.15.47:0/2632323854 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f700c0a99d0 con 0x55b2231d11d0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f70351ecb80 10 client.26134 fetch_fsmap learned FSMap version 50 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55b2231dfed0 con 0x55b2231d11d0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f7009600700 1 -- 172.21.15.47:0/2632323854 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f701801b930 con 0x55b2231d11d0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f7009600700 1 -- 172.21.15.47:0/2632323854 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f700c090ce0 con 0x55b2231d11d0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f70351ecb80 10 client.26134 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.597+0000 7f70351ecb80 10 client.26134 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.598+0000 7f70351ecb80 20 client.26134 populate_metadata read hostname 'smithi047' 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.598+0000 7f70351ecb80 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2232556b0 0x55b223257ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.598+0000 7f70351ecb80 4 client.26134 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.95, "await_for": 42.0}] 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.598+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.95, "await_for": 42.0}) -- 0x55b223100590 con 0x55b2232556b0 2024-05-14T12:38:31.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.598+0000 7f701f400700 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2232556b0 0x55b223257ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:31.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.599+0000 7f701f400700 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2232556b0 0x55b223257ad0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7427f253848e8607 server_cookie=d971496b5354ab1b in_seq=0 out_seq=0 2024-05-14T12:38:31.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:31.599+0000 7f7009600700 10 client.26134 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:31 smithi047 ceph-mon[31254]: pgmap v850: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:32.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:31 smithi073 ceph-mon[35809]: pgmap v850: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:31 smithi066 ceph-mon[35981]: pgmap v850: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:34.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:33 smithi047 ceph-mon[31254]: pgmap v851: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:34.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:33 smithi073 ceph-mon[35809]: pgmap v851: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:34.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:33 smithi066 ceph-mon[35981]: pgmap v851: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 20 op/s 2024-05-14T12:38:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:35 smithi047 ceph-mon[31254]: pgmap v852: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 18 op/s 2024-05-14T12:38:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:35 smithi073 ceph-mon[35809]: pgmap v852: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 18 op/s 2024-05-14T12:38:36.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:35 smithi066 ceph-mon[35981]: pgmap v852: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 18 op/s 2024-05-14T12:38:38.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:37 smithi047 ceph-mon[31254]: pgmap v853: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-05-14T12:38:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:37 smithi073 ceph-mon[35809]: pgmap v853: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-05-14T12:38:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:37 smithi066 ceph-mon[35981]: pgmap v853: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-05-14T12:38:40.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:39 smithi047 ceph-mon[31254]: pgmap v854: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2024-05-14T12:38:40.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:39 smithi073 ceph-mon[35809]: pgmap v854: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2024-05-14T12:38:40.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:39 smithi066 ceph-mon[35981]: pgmap v854: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2024-05-14T12:38:42.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:41 smithi073 ceph-mon[35809]: pgmap v855: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:38:42.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:41 smithi066 ceph-mon[35981]: pgmap v855: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:38:42.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:41 smithi047 ceph-mon[31254]: pgmap v855: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:38:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:43 smithi073 ceph-mon[35809]: pgmap v856: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2024-05-14T12:38:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:43 smithi066 ceph-mon[35981]: pgmap v856: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2024-05-14T12:38:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:43 smithi047 ceph-mon[31254]: pgmap v856: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2024-05-14T12:38:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 -- 172.21.15.47:0/1294648733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 msgr2=0x7fde501069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 --2- 172.21.15.47:0/1294648733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 0x7fde501069f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fde44009900 tx=0x7fde4402a3f0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 -- 172.21.15.47:0/1294648733 shutdown_connections 2024-05-14T12:38:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 --2- 172.21.15.47:0/1294648733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde5010bc30 0x7fde5010e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 --2- 172.21.15.47:0/1294648733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde50106f30 0x7fde50107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 --2- 172.21.15.47:0/1294648733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 0x7fde501069f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 -- 172.21.15.47:0/1294648733 >> 172.21.15.47:0/1294648733 conn(0x7fde50100f00 msgr2=0x7fde50103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 -- 172.21.15.47:0/1294648733 shutdown_connections 2024-05-14T12:38:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.806+0000 7fde56a00640 1 -- 172.21.15.47:0/1294648733 wait complete. 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.807+0000 7fde56a00640 1 Processor -- start 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56a00640 1 -- start start 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 0x7fde5019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde50106f30 0x7fde5019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde5010bc30 0x7fde501a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde50111890 con 0x7fde50105cf0 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56a00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde50111710 con 0x7fde50106f30 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fde50111a10 con 0x7fde5010bc30 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde5010bc30 0x7fde501a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde54c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde50106f30 0x7fde5019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde55600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 0x7fde5019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde5010bc30 0x7fde501a38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38720/0 (socket says 172.21.15.47:38720) 2024-05-14T12:38:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.808+0000 7fde56000640 1 -- 172.21.15.47:0/3637357801 learned_addr learned my addr 172.21.15.47:0/3637357801 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56000640 1 -- 172.21.15.47:0/3637357801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde50106f30 msgr2=0x7fde5019c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56000640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde50106f30 0x7fde5019c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56000640 1 -- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 msgr2=0x7fde5019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56000640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 0x7fde5019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56000640 1 -- 172.21.15.47:0/3637357801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde501a3f60 con 0x7fde5010bc30 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde54c00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde50106f30 0x7fde5019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56000640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde5010bc30 0x7fde501a38f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fde4800efd0 tx=0x7fde4800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde4e000640 1 -- 172.21.15.47:0/3637357801 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48003b70 con 0x7fde5010bc30 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde4e000640 1 -- 172.21.15.47:0/3637357801 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde48003d10 con 0x7fde5010bc30 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde501a4250 con 0x7fde5010bc30 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde4e000640 1 -- 172.21.15.47:0/3637357801 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde480108a0 con 0x7fde5010bc30 2024-05-14T12:38:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.809+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde501a47a0 con 0x7fde5010bc30 2024-05-14T12:38:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 Processor -- start 2024-05-14T12:38:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde4e000640 1 -- 172.21.15.47:0/3637357801 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fde48004020 con 0x7fde5010bc30 2024-05-14T12:38:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 -- start start 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b4e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647832f0 0x563464b4e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b55780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563464ab2550 con 0x5634647ac1b0 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563464a57bc0 con 0x56346478b4d0 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.813+0000 7fde5f037740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563464aae510 con 0x5634647832f0 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde54c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b4e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde54c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b4e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54112/0 (socket says 172.21.15.47:54112) 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde54c00640 1 -- 172.21.15.47:0/144929155 learned_addr learned my addr 172.21.15.47:0/144929155 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde55600640 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647832f0 0x563464b4e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde54c00640 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b55780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde55600640 1 -- 172.21.15.47:0/144929155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 msgr2=0x563464b55780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde55600640 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b55780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde55600640 1 -- 172.21.15.47:0/144929155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 msgr2=0x563464b4e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde55600640 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b4e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.814+0000 7fde55600640 1 -- 172.21.15.47:0/144929155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634647c4210 con 0x5634647832f0 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.815+0000 7fde4e000640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fde380b2920 0x7fde380b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.815+0000 7fde4e000640 1 -- 172.21.15.47:0/3637357801 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fde480e2620 con 0x7fde5010bc30 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.815+0000 7fde55600640 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647832f0 0x563464b4e880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fde4402a910 tx=0x7fde44000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=908cf6a86af9e606 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.815+0000 7fde54c00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fde380b2920 0x7fde380b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.815+0000 7fde42600640 1 -- 172.21.15.47:0/144929155 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44040070 con 0x5634647832f0 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.815+0000 7fde42600640 1 -- 172.21.15.47:0/144929155 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde44032e20 con 0x5634647832f0 2024-05-14T12:38:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.815+0000 7fde42600640 1 -- 172.21.15.47:0/144929155 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44035040 con 0x5634647832f0 2024-05-14T12:38:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 -- 172.21.15.47:0/144929155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647832f0 msgr2=0x563464b4e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647832f0 0x563464b4e880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fde4402a910 tx=0x7fde44000bc0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde54c00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fde380b2920 0x7fde380b4e30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x563464b4f4d0 tx=0x7fde3c009b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 -- 172.21.15.47:0/144929155 shutdown_connections 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b55780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647832f0 0x563464b4e880 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 --2- 172.21.15.47:0/144929155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b4e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 -- 172.21.15.47:0/144929155 >> 172.21.15.47:0/144929155 conn(0x5634647a0300 msgr2=0x563464b49c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 -- 172.21.15.47:0/144929155 shutdown_connections 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.816+0000 7fde5f037740 1 -- 172.21.15.47:0/144929155 wait complete. 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.817+0000 7fde5f037740 1 -- start start 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.817+0000 7fde5f037740 1 Processor -- start 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde5f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647832f0 0x563464b605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde5f037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b60b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde5f037740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647ac1b0 0x563464b67a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde5f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563464b56170 con 0x5634647832f0 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde5f037740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563464a6b660 con 0x56346478b4d0 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde5f037740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563464b562f0 con 0x5634647ac1b0 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde5f037740 10 client.0 _ll_register_callbacks cb 0x563464a35400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde54c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b60b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde55600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647832f0 0x563464b605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde56000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647ac1b0 0x563464b67a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde55600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647832f0 0x563464b605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54118/0 (socket says 172.21.15.47:54118) 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde55600640 1 -- 172.21.15.47:0/2225565567 learned_addr learned my addr 172.21.15.47:0/2225565567 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde56000640 1 -- 172.21.15.47:0/2225565567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 msgr2=0x563464b60b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde56000640 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b60b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde56000640 1 -- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647832f0 msgr2=0x563464b605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde56000640 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647832f0 0x563464b605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.818+0000 7fde56000640 1 -- 172.21.15.47:0/2225565567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563464890620 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde55600640 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647832f0 0x563464b605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde56000640 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647ac1b0 0x563464b67a70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fde480a6e70 tx=0x7fde480a5390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58986f119ce77108 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde36a00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde36a00640 1 -- 172.21.15.47:0/2225565567 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48091040 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde36a00640 1 -- 172.21.15.47:0/2225565567 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fde480c4280 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde44032e20 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde36a00640 1 -- 172.21.15.47:0/2225565567 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fde480aa300 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde5f037740 10 client.26146 fetch_fsmap learned FSMap version 50 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563464b6aa10 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.819+0000 7fde36a00640 1 -- 172.21.15.47:0/2225565567 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde44032e20 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde36a00640 1 -- 172.21.15.47:0/2225565567 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7fde4801f020 con 0x5634647ac1b0 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde5f037740 10 client.26146 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:38:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde5f037740 10 client.26146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:38:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde5f037740 20 client.26146 populate_metadata read hostname 'smithi047' 2024-05-14T12:38:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde5f037740 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56346476ad80 0x563464b6e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde5f037740 4 client.26146 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:38:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563464ac0160 con 0x56346476ad80 2024-05-14T12:38:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.820+0000 7fde55600640 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56346476ad80 0x563464b6e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.821+0000 7fde55600640 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56346476ad80 0x563464b6e1a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afddc1fdd061cf02 server_cookie=9c8d77ee25462292 in_seq=0 out_seq=0 2024-05-14T12:38:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.821+0000 7fde36a00640 10 client.26146 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde36a00640 1 -- 172.21.15.47:0/2225565567 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563464ac0160 con 0x56346476ad80 2024-05-14T12:38:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde36a00640 10 client.26146 handle_command_reply: tid=0 2024-05-14T12:38:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 client.26146 shutdown 2024-05-14T12:38:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647ac1b0 msgr2=0x563464b67a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647ac1b0 0x563464b67a70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fde480a6e70 tx=0x7fde480a5390 comp rx=0 tx=0).stop 2024-05-14T12:38:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 shutdown_connections 2024-05-14T12:38:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56346476ad80 0x563464b6e1a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634647ac1b0 0x563464b67a70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56346478b4d0 0x563464b60b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde36a00640 0 client.26146 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 --2- 172.21.15.47:0/2225565567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647832f0 0x563464b605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 >> 172.21.15.47:0/2225565567 conn(0x5634647a0300 msgr2=0x563464b4cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 shutdown_connections 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.822+0000 7fde5f037740 1 -- 172.21.15.47:0/2225565567 wait complete. 2024-05-14T12:38:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.823+0000 7fde5f037740 20 client.26146 trim_cache size 0 max 16384 2024-05-14T12:38:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.840+0000 7fde5f037740 1 Processor -- start 2024-05-14T12:38:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.840+0000 7fde5f037740 1 -- start start 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde5f037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b52280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde5f037740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b67990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde5f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde5f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde501a8f60 con 0x5634647ac1b0 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde5f037740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde501aac80 con 0x5634647832f0 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde5f037740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fde501a9660 con 0x56346478b4d0 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b52280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde56000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b52280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35642/0 (socket says 172.21.15.47:35642) 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde54c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b67990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 -- 172.21.15.47:0/2163693436 learned_addr learned my addr 172.21.15.47:0/2163693436 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 -- 172.21.15.47:0/2163693436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 msgr2=0x563464b67990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.843 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 --2- 172.21.15.47:0/2163693436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b67990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 -- 172.21.15.47:0/2163693436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 msgr2=0x563464b527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 --2- 172.21.15.47:0/2163693436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.841+0000 7fde55600640 1 -- 172.21.15.47:0/2163693436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563464b454a0 con 0x5634647832f0 2024-05-14T12:38:44.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.842+0000 7fde55600640 1 --2- 172.21.15.47:0/2163693436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b52280 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde44005f70 tx=0x7fde44005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a70332f8ea04df7b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:44.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.842+0000 7fde41c00640 1 -- 172.21.15.47:0/2163693436 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44040040 con 0x5634647832f0 2024-05-14T12:38:44.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.842+0000 7fde41c00640 1 -- 172.21.15.47:0/2163693436 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde44005040 con 0x5634647832f0 2024-05-14T12:38:44.844 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.842+0000 7fde41c00640 1 -- 172.21.15.47:0/2163693436 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44035040 con 0x5634647832f0 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 -- 172.21.15.47:0/2163693436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 msgr2=0x563464b52280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 --2- 172.21.15.47:0/2163693436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b52280 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde44005f70 tx=0x7fde44005e50 comp rx=0 tx=0).stop 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 -- 172.21.15.47:0/2163693436 shutdown_connections 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 --2- 172.21.15.47:0/2163693436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464b527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 --2- 172.21.15.47:0/2163693436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b67990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 --2- 172.21.15.47:0/2163693436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b52280 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 -- 172.21.15.47:0/2163693436 >> 172.21.15.47:0/2163693436 conn(0x5634647a0300 msgr2=0x563464b4e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:44.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 -- 172.21.15.47:0/2163693436 shutdown_connections 2024-05-14T12:38:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.843+0000 7fde5f037740 1 -- 172.21.15.47:0/2163693436 wait complete. 2024-05-14T12:38:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.844+0000 7fde5f037740 1 -- start start 2024-05-14T12:38:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.844+0000 7fde5f037740 1 Processor -- start 2024-05-14T12:38:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde5f037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b64a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde5f037740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b64f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde5f037740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464bd4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde5f037740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde501aa4f0 con 0x5634647ac1b0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde5f037740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde501a9d60 con 0x5634647832f0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde5f037740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fde501a6f40 con 0x56346478b4d0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde5f037740 10 client.0 _ll_register_callbacks cb 0x7fde48004830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde55600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b64a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde56000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464bd4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde54c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b64f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde55600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b64a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:35654/0 (socket says 172.21.15.47:35654) 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.845+0000 7fde55600640 1 -- 172.21.15.47:0/2709231012 learned_addr learned my addr 172.21.15.47:0/2709231012 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde55600640 1 -- 172.21.15.47:0/2709231012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 msgr2=0x563464b64f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde55600640 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b64f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde55600640 1 -- 172.21.15.47:0/2709231012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 msgr2=0x563464bd4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde55600640 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464bd4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde55600640 1 -- 172.21.15.47:0/2709231012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563464bd4ab0 con 0x5634647832f0 2024-05-14T12:38:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde55600640 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b64a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde44005ab0 tx=0x7fde4402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b74efa1866d19dcd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde36a00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde36a00640 1 -- 172.21.15.47:0/2709231012 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4405c060 con 0x5634647832f0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde36a00640 1 -- 172.21.15.47:0/2709231012 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fde440053f0 con 0x5634647832f0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.846+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde44005040 con 0x5634647832f0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde36a00640 1 -- 172.21.15.47:0/2709231012 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fde44040050 con 0x5634647832f0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 10 client.26120 fetch_fsmap learned FSMap version 50 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563464bd5d00 con 0x5634647832f0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde36a00640 1 -- 172.21.15.47:0/2709231012 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde44005040 con 0x5634647832f0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde36a00640 1 -- 172.21.15.47:0/2709231012 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7fde44061070 con 0x5634647832f0 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 10 client.26120 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 10 client.26120 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 20 client.26120 populate_metadata read hostname 'smithi047' 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5634647401c0 0x563464bd8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:38:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 4 client.26120 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:38:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.847+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563464b56e60 con 0x5634647401c0 2024-05-14T12:38:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.848+0000 7fde54c00640 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5634647401c0 0x563464bd8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:38:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.848+0000 7fde54c00640 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5634647401c0 0x563464bd8310 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ce76cd8a79c67c server_cookie=f4ca03ba22510efe in_seq=0 out_seq=0 2024-05-14T12:38:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:44.848+0000 7fde36a00640 10 client.26120 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:46.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:45 smithi073 ceph-mon[35809]: pgmap v857: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2024-05-14T12:38:46.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:45 smithi066 ceph-mon[35981]: pgmap v857: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2024-05-14T12:38:46.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:45 smithi047 ceph-mon[31254]: pgmap v857: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2024-05-14T12:38:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:48 smithi066 ceph-mon[35981]: pgmap v858: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 KiB/s wr, 18 op/s 2024-05-14T12:38:48.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:48 smithi047 ceph-mon[31254]: pgmap v858: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 KiB/s wr, 18 op/s 2024-05-14T12:38:48.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:48 smithi073 ceph-mon[35809]: pgmap v858: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 KiB/s wr, 18 op/s 2024-05-14T12:38:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:50 smithi066 ceph-mon[35981]: pgmap v859: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-05-14T12:38:50.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:50 smithi047 ceph-mon[31254]: pgmap v859: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-05-14T12:38:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:50 smithi073 ceph-mon[35809]: pgmap v859: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-05-14T12:38:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:51 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:38:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:51 smithi066 ceph-mon[35981]: pgmap v860: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-05-14T12:38:51.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:51 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:38:51.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:51 smithi047 ceph-mon[31254]: pgmap v860: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-05-14T12:38:51.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:51 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:38:51.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:51 smithi073 ceph-mon[35809]: pgmap v860: 97 pgs: 97 active+clean; 9.9 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-05-14T12:38:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:38:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:38:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:38:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:38:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:38:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:38:52.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:38:52.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:38:52.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:38:53.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:53 smithi066 ceph-mon[35981]: pgmap v861: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2024-05-14T12:38:53.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:53 smithi047 ceph-mon[31254]: pgmap v861: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2024-05-14T12:38:53.505 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:53 smithi073 ceph-mon[35809]: pgmap v861: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2024-05-14T12:38:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.898+0000 7f7009600700 1 -- 172.21.15.47:0/2632323854 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55b223100590 con 0x55b2232556b0 2024-05-14T12:38:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.898+0000 7f7009600700 10 client.26134 handle_command_reply: tid=0 2024-05-14T12:38:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.898+0000 7f70351ecb80 1 client.26134 shutdown 2024-05-14T12:38:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.898+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d11d0 msgr2=0x55b2231e2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.898+0000 7f70351ecb80 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d11d0 0x55b2231e2ed0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f700c022d00 tx=0x7f700c085000 comp rx=0 tx=0).stop 2024-05-14T12:38:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.898+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 shutdown_connections 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.898+0000 7f70351ecb80 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55b2232556b0 0x55b223257ad0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.899+0000 7f70351ecb80 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2231d59b0 0x55b2231df960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.899+0000 7f70351ecb80 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b223052fd0 0x55b2231e2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.899+0000 7f70351ecb80 1 --2- 172.21.15.47:0/2632323854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b2231d11d0 0x55b2231e2ed0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.899+0000 7f7009600700 0 client.26134 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.899+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 >> 172.21.15.47:0/2632323854 conn(0x55b223098100 msgr2=0x55b2231cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.899+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 shutdown_connections 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.899+0000 7f70351ecb80 1 -- 172.21.15.47:0/2632323854 wait complete. 2024-05-14T12:38:54.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.900+0000 7f70351ecb80 20 client.26134 trim_cache size 0 max 16384 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 50, 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 26, 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "ad501fb9": { 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 26, 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:38:54.901 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 79.0, 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:38:54.902 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:38:54.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:38:54.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:38:54.903 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:38:54.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70040b2900 msgr2=0x7f70040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:54.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70040b2900 0x7f70040b4e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7018009550 tx=0x7f7018009bd0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 msgr2=0x7f702019b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702019b400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f700c005910 tx=0x7f700c00b670 comp rx=0 tx=0).stop 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 shutdown_connections 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f70040b2900 0x7f70040b4e10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f702010e8e0 0x7f702019f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7020105500 0x7f702019ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 --2- 172.21.15.47:0/1946775362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7020105e50 0x7f702019b400 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.901+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 >> 172.21.15.47:0/1946775362 conn(0x7f70200fedc0 msgr2=0x7f70200ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.902+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 shutdown_connections 2024-05-14T12:38:54.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:38:54.902+0000 7f7026600700 1 -- 172.21.15.47:0/1946775362 wait complete. 2024-05-14T12:38:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.737+0000 7fde36a00640 1 -- 172.21.15.47:0/2709231012 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563464b56e60 con 0x5634647401c0 2024-05-14T12:38:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.737+0000 7fde36a00640 10 client.26120 handle_command_reply: tid=0 2024-05-14T12:38:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.737+0000 7fde5f037740 1 client.26120 shutdown 2024-05-14T12:38:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.739+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 msgr2=0x563464b64a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.739+0000 7fde5f037740 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b64a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde44005ab0 tx=0x7fde4402a3f0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.742+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 shutdown_connections 2024-05-14T12:38:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.742+0000 7fde5f037740 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5634647401c0 0x563464bd8310 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.742+0000 7fde5f037740 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5634647ac1b0 0x563464bd4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.742+0000 7fde5f037740 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56346478b4d0 0x563464b64f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.742+0000 7fde5f037740 1 --2- 172.21.15.47:0/2709231012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5634647832f0 0x563464b64a20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.742+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 >> 172.21.15.47:0/2709231012 conn(0x5634647a0300 msgr2=0x563464b4e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.743+0000 7fde36a00640 0 client.26120 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:38:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.743+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 shutdown_connections 2024-05-14T12:38:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.743+0000 7fde5f037740 1 -- 172.21.15.47:0/2709231012 wait complete. 2024-05-14T12:38:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.744+0000 7fde5f037740 20 client.26120 trim_cache size 0 max 16384 2024-05-14T12:38:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:38:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:38:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:38:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:38:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.745+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fde380b2920 msgr2=0x7fde380b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fde380b2920 0x7fde380b4e30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x563464b4f4d0 tx=0x7fde3c009b70 comp rx=0 tx=0).stop 2024-05-14T12:38:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde5010bc30 msgr2=0x7fde501a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:38:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde5010bc30 0x7fde501a38f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fde4800efd0 tx=0x7fde4800c6a0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 shutdown_connections 2024-05-14T12:38:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fde380b2920 0x7fde380b4e30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde5010bc30 0x7fde501a38f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde50106f30 0x7fde5019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 --2- 172.21.15.47:0/3637357801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde50105cf0 0x7fde5019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:38:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.746+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 >> 172.21.15.47:0/3637357801 conn(0x7fde50100f00 msgr2=0x7fde50107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:38:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.747+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 shutdown_connections 2024-05-14T12:38:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:38:55.749+0000 7fde56a00640 1 -- 172.21.15.47:0/3637357801 wait complete. 2024-05-14T12:38:55.809 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ad501fb9', quiesce took 52.0 seconds. Will release after: 18.95 2024-05-14T12:38:56.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:55 smithi066 ceph-mon[35981]: pgmap v862: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2024-05-14T12:38:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:55 smithi047 ceph-mon[31254]: pgmap v862: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2024-05-14T12:38:56.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:55 smithi073 ceph-mon[35809]: pgmap v862: 97 pgs: 97 active+clean; 9.8 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2024-05-14T12:38:58.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:57 smithi066 ceph-mon[35981]: pgmap v863: 97 pgs: 97 active+clean; 9.7 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 21 op/s 2024-05-14T12:38:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:57 smithi047 ceph-mon[31254]: pgmap v863: 97 pgs: 97 active+clean; 9.7 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 21 op/s 2024-05-14T12:38:58.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:57 smithi073 ceph-mon[35809]: pgmap v863: 97 pgs: 97 active+clean; 9.7 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 21 op/s 2024-05-14T12:39:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:38:59 smithi047 ceph-mon[31254]: pgmap v864: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 20 op/s 2024-05-14T12:39:00.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:38:59 smithi073 ceph-mon[35809]: pgmap v864: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 20 op/s 2024-05-14T12:39:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:38:59 smithi066 ceph-mon[35981]: pgmap v864: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 20 op/s 2024-05-14T12:39:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:01 smithi047 ceph-mon[31254]: pgmap v865: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 21 op/s 2024-05-14T12:39:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:01 smithi073 ceph-mon[35809]: pgmap v865: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 21 op/s 2024-05-14T12:39:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:01 smithi066 ceph-mon[35981]: pgmap v865: 97 pgs: 97 active+clean; 9.6 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 21 op/s 2024-05-14T12:39:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:03 smithi047 ceph-mon[31254]: pgmap v866: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2024-05-14T12:39:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:03 smithi073 ceph-mon[35809]: pgmap v866: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2024-05-14T12:39:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:03 smithi066 ceph-mon[35981]: pgmap v866: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2024-05-14T12:39:06.126 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:05 smithi066 ceph-mon[35981]: pgmap v867: 97 pgs: 97 active+clean; 9.4 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 19 op/s 2024-05-14T12:39:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:05 smithi047 ceph-mon[31254]: pgmap v867: 97 pgs: 97 active+clean; 9.4 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 19 op/s 2024-05-14T12:39:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:05 smithi073 ceph-mon[35809]: pgmap v867: 97 pgs: 97 active+clean; 9.4 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 19 op/s 2024-05-14T12:39:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:07 smithi047 ceph-mon[31254]: pgmap v868: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.6 KiB/s wr, 23 op/s 2024-05-14T12:39:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:07 smithi073 ceph-mon[35809]: pgmap v868: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.6 KiB/s wr, 23 op/s 2024-05-14T12:39:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:07 smithi066 ceph-mon[35981]: pgmap v868: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.6 KiB/s wr, 23 op/s 2024-05-14T12:39:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 -- 172.21.15.47:0/2379064964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f8410a0d0 msgr2=0x7f5f8410add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2379064964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f8410a0d0 0x7f5f8410add0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009900 tx=0x7f5f7402a410 comp rx=0 tx=0).stop 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 -- 172.21.15.47:0/2379064964 shutdown_connections 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2379064964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f84110010 0x7f5f84112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2379064964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 0x7f5f8410b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2379064964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f8410a0d0 0x7f5f8410add0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 -- 172.21.15.47:0/2379064964 >> 172.21.15.47:0/2379064964 conn(0x7f5f84078ce0 msgr2=0x7f5f84107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 -- 172.21.15.47:0/2379064964 shutdown_connections 2024-05-14T12:39:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.990+0000 7f5f88c00640 1 -- 172.21.15.47:0/2379064964 wait complete. 2024-05-14T12:39:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 Processor -- start 2024-05-14T12:39:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 -- start start 2024-05-14T12:39:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f8410a0d0 0x7f5f841a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 0x7f5f841a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f84110010 0x7f5f841a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84115ce0 con 0x7f5f8410a0d0 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84115b60 con 0x7f5f8410b310 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.992+0000 7f5f88c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84115e60 con 0x7f5f84110010 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 0x7f5f841a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f8410a0d0 0x7f5f841a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f84110010 0x7f5f841a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 0x7f5f841a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50196/0 (socket says 172.21.15.47:50196) 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f82a00640 1 -- 172.21.15.47:0/2865766647 learned_addr learned my addr 172.21.15.47:0/2865766647 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83e00640 1 -- 172.21.15.47:0/2865766647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 msgr2=0x7f5f841a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83e00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 0x7f5f841a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83e00640 1 -- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f8410a0d0 msgr2=0x7f5f841a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83e00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f8410a0d0 0x7f5f841a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83e00640 1 -- 172.21.15.47:0/2865766647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f841a82d0 con 0x7f5f84110010 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f82a00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 0x7f5f841a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.993+0000 7f5f83e00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f84110010 0x7f5f841a7c60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009fd0 tx=0x7f5f7c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.994+0000 7f5f7be00640 1 -- 172.21.15.47:0/2865766647 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00ce20 con 0x7f5f84110010 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.994+0000 7f5f7be00640 1 -- 172.21.15.47:0/2865766647 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f7c005020 con 0x7f5f84110010 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.994+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f841a85c0 con 0x7f5f84110010 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.994+0000 7f5f7be00640 1 -- 172.21.15.47:0/2865766647 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c010690 con 0x7f5f84110010 2024-05-14T12:39:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.994+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f841a8b10 con 0x7f5f84110010 2024-05-14T12:39:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.998+0000 7f5f91272740 1 Processor -- start 2024-05-14T12:39:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f7be00640 1 -- 172.21.15.47:0/2865766647 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5f7c0054d0 con 0x7f5f84110010 2024-05-14T12:39:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f91272740 1 -- start start 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f91272740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77ba81b0 0x563c77f4a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f91272740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f4a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f91272740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77b874d0 0x563c77f51780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f91272740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c77eae550 con 0x563c77b7f2f0 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f91272740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c77e53bc0 con 0x563c77ba81b0 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f91272740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563c77eaa510 con 0x563c77b874d0 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:08.999+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77ba81b0 0x563c77f4a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77ba81b0 0x563c77f4a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50206/0 (socket says 172.21.15.47:50206) 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 -- 172.21.15.47:0/1526597144 learned_addr learned my addr 172.21.15.47:0/1526597144 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77b874d0 0x563c77f51780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f83400640 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f4a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 -- 172.21.15.47:0/1526597144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77b874d0 msgr2=0x563c77f51780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77b874d0 0x563c77f51780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 -- 172.21.15.47:0/1526597144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 msgr2=0x563c77f4a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f4a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 -- 172.21.15.47:0/1526597144 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c77bc0210 con 0x563c77ba81b0 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f82a00640 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77ba81b0 0x563c77f4a300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c011d00 tx=0x7f5f6c009c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827930ea3b123304 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.000+0000 7f5f73e00640 1 -- 172.21.15.47:0/1526597144 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00fc50 con 0x563c77ba81b0 2024-05-14T12:39:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.001+0000 7f5f7be00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5f680b2920 0x7f5f680b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.001+0000 7f5f73e00640 1 -- 172.21.15.47:0/1526597144 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f6c00fdf0 con 0x563c77ba81b0 2024-05-14T12:39:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.001+0000 7f5f73e00640 1 -- 172.21.15.47:0/1526597144 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00e610 con 0x563c77ba81b0 2024-05-14T12:39:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.001+0000 7f5f7be00640 1 -- 172.21.15.47:0/2865766647 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5f7c0e28c0 con 0x7f5f84110010 2024-05-14T12:39:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.001+0000 7f5f83400640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5f680b2920 0x7f5f680b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 -- 172.21.15.47:0/1526597144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77ba81b0 msgr2=0x563c77f4a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77ba81b0 0x563c77f4a300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c011d00 tx=0x7f5f6c009c80 comp rx=0 tx=0).stop 2024-05-14T12:39:09.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f83400640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5f680b2920 0x7f5f680b4e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f7402aa00 tx=0x7f5f740314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 -- 172.21.15.47:0/1526597144 shutdown_connections 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77b874d0 0x563c77f51780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f4a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 --2- 172.21.15.47:0/1526597144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77ba81b0 0x563c77f4a300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 -- 172.21.15.47:0/1526597144 >> 172.21.15.47:0/1526597144 conn(0x563c77b9c300 msgr2=0x563c77f45c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 -- 172.21.15.47:0/1526597144 shutdown_connections 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.002+0000 7f5f91272740 1 -- 172.21.15.47:0/1526597144 wait complete. 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 -- start start 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 Processor -- start 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f53eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b874d0 0x563c77f543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.009 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77ba81b0 0x563c77f5b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c77f521d0 con 0x563c77b7f2f0 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c77e67660 con 0x563c77b874d0 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.003+0000 7f5f91272740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563c77f52350 con 0x563c77ba81b0 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b874d0 0x563c77f543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f83400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f53eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f91272740 10 client.0 _ll_register_callbacks cb 0x563c77e31400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b874d0 0x563c77f543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50220/0 (socket says 172.21.15.47:50220) 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 -- 172.21.15.47:0/591981851 learned_addr learned my addr 172.21.15.47:0/591981851 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f83e00640 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77ba81b0 0x563c77f5b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 -- 172.21.15.47:0/591981851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77ba81b0 msgr2=0x563c77f5b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77ba81b0 0x563c77f5b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 -- 172.21.15.47:0/591981851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 msgr2=0x563c77f53eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f53eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 -- 172.21.15.47:0/591981851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c77c8c620 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f82a00640 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b874d0 0x563c77f543f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005510 tx=0x7f5f6c005540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e7af7ebbc6bdc53 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.004+0000 7f5f70c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.005+0000 7f5f70c00640 1 -- 172.21.15.47:0/591981851 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c025050 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.005+0000 7f5f70c00640 1 -- 172.21.15.47:0/591981851 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5f6c01f440 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.005+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f6c00fdf0 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.005+0000 7f5f70c00640 1 -- 172.21.15.47:0/591981851 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5f6c00fc50 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.005+0000 7f5f91272740 10 client.26132 fetch_fsmap learned FSMap version 50 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.005+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563c77f5e280 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.005+0000 7f5f70c00640 1 -- 172.21.15.47:0/591981851 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f6c00fdf0 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f70c00640 1 -- 172.21.15.47:0/591981851 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f5f6c028070 con 0x563c77b874d0 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f91272740 10 client.26132 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:39:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f91272740 10 client.26132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f91272740 20 client.26132 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f91272740 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b66d80 0x563c77f617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f91272740 4 client.26132 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c77ebc160 con 0x563c77b66d80 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.006+0000 7f5f83400640 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b66d80 0x563c77f617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.007+0000 7f5f83400640 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b66d80 0x563c77f617f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66c6932d52b843ac server_cookie=c21753038a3c2117 in_seq=0 out_seq=0 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.007+0000 7f5f70c00640 10 client.26132 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f70c00640 1 -- 172.21.15.47:0/591981851 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563c77ebc160 con 0x563c77b66d80 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f70c00640 10 client.26132 handle_command_reply: tid=0 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 client.26132 shutdown 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b874d0 msgr2=0x563c77f543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b874d0 0x563c77f543f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005510 tx=0x7f5f6c005540 comp rx=0 tx=0).stop 2024-05-14T12:39:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 shutdown_connections 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b66d80 0x563c77f617f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77ba81b0 0x563c77f5b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b874d0 0x563c77f543f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f70c00640 0 client.26132 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 --2- 172.21.15.47:0/591981851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f53eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 >> 172.21.15.47:0/591981851 conn(0x563c77b9c300 msgr2=0x563c77f44c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 shutdown_connections 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 1 -- 172.21.15.47:0/591981851 wait complete. 2024-05-14T12:39:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.008+0000 7f5f91272740 20 client.26132 trim_cache size 0 max 16384 2024-05-14T12:39:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.025+0000 7f5f91272740 1 Processor -- start 2024-05-14T12:39:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f91272740 1 -- start start 2024-05-14T12:39:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f91272740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77f66fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f91272740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f91272740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f52e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f91272740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841b1710 con 0x563c77b7f2f0 2024-05-14T12:39:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f91272740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841b3430 con 0x563c77b9c300 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f91272740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841b1e10 con 0x563c77f4aa90 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f83e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f52e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50230/0 (socket says 172.21.15.47:50230) 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f82a00640 1 -- 172.21.15.47:0/922211726 learned_addr learned my addr 172.21.15.47:0/922211726 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.026+0000 7f5f83400640 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77f66fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f82a00640 1 -- 172.21.15.47:0/922211726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 msgr2=0x563c77f66fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f82a00640 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77f66fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f82a00640 1 -- 172.21.15.47:0/922211726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 msgr2=0x563c77f52e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f82a00640 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f52e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f82a00640 1 -- 172.21.15.47:0/922211726 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c77f414a0 con 0x563c77b9c300 2024-05-14T12:39:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f82a00640 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f674f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c004bd0 tx=0x7f5f6c011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8408fc24c43cc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f73400640 1 -- 172.21.15.47:0/922211726 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0055b0 con 0x563c77b9c300 2024-05-14T12:39:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f73400640 1 -- 172.21.15.47:0/922211726 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f6c00fdf0 con 0x563c77b9c300 2024-05-14T12:39:09.029 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.027+0000 7f5f73400640 1 -- 172.21.15.47:0/922211726 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c01f440 con 0x563c77b9c300 2024-05-14T12:39:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.028+0000 7f5f91272740 1 -- 172.21.15.47:0/922211726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 msgr2=0x563c77f674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.028+0000 7f5f91272740 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f674f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c004bd0 tx=0x7f5f6c011900 comp rx=0 tx=0).stop 2024-05-14T12:39:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.028+0000 7f5f91272740 1 -- 172.21.15.47:0/922211726 shutdown_connections 2024-05-14T12:39:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.028+0000 7f5f91272740 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f52e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.028+0000 7f5f91272740 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f674f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.028+0000 7f5f91272740 1 --2- 172.21.15.47:0/922211726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77f66fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.028+0000 7f5f91272740 1 -- 172.21.15.47:0/922211726 >> 172.21.15.47:0/922211726 conn(0x563c77f4eb20 msgr2=0x563c77f526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.029+0000 7f5f91272740 1 -- 172.21.15.47:0/922211726 shutdown_connections 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.029+0000 7f5f91272740 1 -- 172.21.15.47:0/922211726 wait complete. 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.029+0000 7f5f91272740 1 -- start start 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.029+0000 7f5f91272740 1 Processor -- start 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f91272740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f5ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f91272740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f5b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f91272740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77fc7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f91272740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841b2ca0 con 0x563c77b7f2f0 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f91272740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841b2510 con 0x563c77b9c300 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f91272740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f841af6d0 con 0x563c77f4aa90 2024-05-14T12:39:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f91272740 10 client.0 _ll_register_callbacks cb 0x7f5f6c0117d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f5b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f5b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50242/0 (socket says 172.21.15.47:50242) 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 -- 172.21.15.47:0/3962229865 learned_addr learned my addr 172.21.15.47:0/3962229865 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f83400640 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f5ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f83e00640 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77fc7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 -- 172.21.15.47:0/3962229865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 msgr2=0x563c77fc7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77fc7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 -- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 msgr2=0x563c77f5ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f5ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.030+0000 7f5f82a00640 1 -- 172.21.15.47:0/3962229865 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c77fc81a0 con 0x563c77b9c300 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f82a00640 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f5b1c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0059f0 tx=0x7f5f6c005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=772d63aa2d20d147 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f70c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f70c00640 1 -- 172.21.15.47:0/3962229865 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c005610 con 0x563c77b9c300 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f6c00fdf0 con 0x563c77b9c300 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f70c00640 1 -- 172.21.15.47:0/3962229865 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5f6c011130 con 0x563c77b9c300 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f70c00640 1 -- 172.21.15.47:0/3962229865 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5f6c04d050 con 0x563c77b9c300 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f91272740 10 client.26138 fetch_fsmap learned FSMap version 50 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.031+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563c77fc9430 con 0x563c77b9c300 2024-05-14T12:39:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f70c00640 1 -- 172.21.15.47:0/3962229865 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f6c00fdf0 con 0x563c77b9c300 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f70c00640 1 -- 172.21.15.47:0/3962229865 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f5f6c028040 con 0x563c77b9c300 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f91272740 10 client.26138 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f91272740 10 client.26138 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f91272740 20 client.26138 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f91272740 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b874d0 0x563c77fcbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f91272740 4 client.26138 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c77eb5fd0 con 0x563c77b874d0 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.032+0000 7f5f83400640 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b874d0 0x563c77fcbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.033+0000 7f5f83400640 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b874d0 0x563c77fcbeb0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4be56bbe5674f504 server_cookie=f4a99ec9854d533 in_seq=0 out_seq=0 2024-05-14T12:39:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:09.033+0000 7f5f70c00640 10 client.26138 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:09 smithi047 ceph-mon[31254]: pgmap v869: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 18 op/s 2024-05-14T12:39:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:09 smithi073 ceph-mon[35809]: pgmap v869: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 18 op/s 2024-05-14T12:39:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:09 smithi066 ceph-mon[35981]: pgmap v869: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 18 op/s 2024-05-14T12:39:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:11 smithi047 ceph-mon[31254]: pgmap v870: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 18 op/s 2024-05-14T12:39:12.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:11 smithi073 ceph-mon[35809]: pgmap v870: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 18 op/s 2024-05-14T12:39:12.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:11 smithi066 ceph-mon[35981]: pgmap v870: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 18 op/s 2024-05-14T12:39:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:13 smithi047 ceph-mon[31254]: pgmap v871: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-05-14T12:39:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:13 smithi073 ceph-mon[35809]: pgmap v871: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-05-14T12:39:14.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:13 smithi066 ceph-mon[35981]: pgmap v871: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-05-14T12:39:14.760 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:39:15.250 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:39:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.982+0000 7f5f70c00640 1 -- 172.21.15.47:0/3962229865 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c77eb5fd0 con 0x563c77b874d0 2024-05-14T12:39:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.982+0000 7f5f70c00640 10 client.26138 handle_command_reply: tid=0 2024-05-14T12:39:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.982+0000 7f5f91272740 1 client.26138 shutdown 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.983+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 msgr2=0x563c77f5b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.983+0000 7f5f91272740 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f5b1c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0059f0 tx=0x7f5f6c005c50 comp rx=0 tx=0).stop 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 shutdown_connections 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563c77b874d0 0x563c77fcbeb0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563c77f4aa90 0x563c77fc7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c77b9c300 0x563c77f5b1c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 --2- 172.21.15.47:0/3962229865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c77b7f2f0 0x563c77f5ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 >> 172.21.15.47:0/3962229865 conn(0x563c77f4eb20 msgr2=0x563c77f53120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f70c00640 0 client.26138 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 shutdown_connections 2024-05-14T12:39:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.984+0000 7f5f91272740 1 -- 172.21.15.47:0/3962229865 wait complete. 2024-05-14T12:39:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.985+0000 7f5f91272740 20 client.26138 trim_cache size 0 max 16384 2024-05-14T12:39:15.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:15 smithi047 ceph-mon[31254]: pgmap v872: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 15 op/s 2024-05-14T12:39:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:39:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:39:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:39:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5f680b2920 msgr2=0x7f5f680b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5f680b2920 0x7f5f680b4e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f7402aa00 tx=0x7f5f740314a0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f84110010 msgr2=0x7f5f841a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f84110010 0x7f5f841a7c60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009fd0 tx=0x7f5f7c00ef10 comp rx=0 tx=0).stop 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 shutdown_connections 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f5f680b2920 0x7f5f680b4e30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f84110010 0x7f5f841a7c60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f8410b310 0x7f5f841a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 --2- 172.21.15.47:0/2865766647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f8410a0d0 0x7f5f841a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.986+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 >> 172.21.15.47:0/2865766647 conn(0x7f5f84078ce0 msgr2=0x7f5f8410bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.987+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 shutdown_connections 2024-05-14T12:39:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:15.987+0000 7f5f88c00640 1 -- 172.21.15.47:0/2865766647 wait complete. 2024-05-14T12:39:16.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:15 smithi073 ceph-mon[35809]: pgmap v872: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 15 op/s 2024-05-14T12:39:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:15 smithi066 ceph-mon[35981]: pgmap v872: 97 pgs: 97 active+clean; 9.2 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 15 op/s 2024-05-14T12:39:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 -- 172.21.15.47:0/1515753733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff840108f00 msgr2=0x7ff840109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 --2- 172.21.15.47:0/1515753733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff840108f00 0x7ff840109310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0098f0 tx=0x7ff82c009c00 comp rx=0 tx=0).stop 2024-05-14T12:39:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 -- 172.21.15.47:0/1515753733 shutdown_connections 2024-05-14T12:39:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 --2- 172.21.15.47:0/1515753733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff840109850 0x7ff8401111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 --2- 172.21.15.47:0/1515753733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8401045d0 0x7ff8401049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 --2- 172.21.15.47:0/1515753733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff840108f00 0x7ff840109310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 -- 172.21.15.47:0/1515753733 >> 172.21.15.47:0/1515753733 conn(0x7ff8400ffea0 msgr2=0x7ff8401022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 -- 172.21.15.47:0/1515753733 shutdown_connections 2024-05-14T12:39:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.754+0000 7ff848600700 1 -- 172.21.15.47:0/1515753733 wait complete. 2024-05-14T12:39:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 Processor -- start 2024-05-14T12:39:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 -- start start 2024-05-14T12:39:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8401045d0 0x7ff84019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff840108f00 0x7ff84019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff840109850 0x7ff8401a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401144b0 con 0x7ff840108f00 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff840114330 con 0x7ff8401045d0 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.756+0000 7ff848600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff840114630 con 0x7ff840109850 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8401045d0 0x7ff84019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff840108f00 0x7ff84019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8401045d0 0x7ff84019d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50264/0 (socket says 172.21.15.47:50264) 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 -- 172.21.15.47:0/3998739712 learned_addr learned my addr 172.21.15.47:0/3998739712 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff846600700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff840109850 0x7ff8401a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 -- 172.21.15.47:0/3998739712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff840109850 msgr2=0x7ff8401a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff840109850 0x7ff8401a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 -- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff840108f00 msgr2=0x7ff84019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff840108f00 0x7ff84019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845c00700 1 -- 172.21.15.47:0/3998739712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8401a1f50 con 0x7ff8401045d0 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.757+0000 7ff845200700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff840108f00 0x7ff84019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.758+0000 7ff845c00700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8401045d0 0x7ff84019d080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e9c0 tx=0x7ff83400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.758+0000 7ff83e000700 1 -- 172.21.15.47:0/3998739712 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83400cbd0 con 0x7ff8401045d0 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.758+0000 7ff83e000700 1 -- 172.21.15.47:0/3998739712 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff83400cd70 con 0x7ff8401045d0 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.758+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8401a2240 con 0x7ff8401045d0 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.758+0000 7ff83e000700 1 -- 172.21.15.47:0/3998739712 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834005580 con 0x7ff8401045d0 2024-05-14T12:39:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.758+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8401a9b60 con 0x7ff8401045d0 2024-05-14T12:39:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.759+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8400512c0 con 0x7ff8401045d0 2024-05-14T12:39:17.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.762+0000 7ff83e000700 1 -- 172.21.15.47:0/3998739712 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff834004750 con 0x7ff8401045d0 2024-05-14T12:39:17.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.763+0000 7ff83e000700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8280b2900 0x7ff8280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:17.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.763+0000 7ff83e000700 1 -- 172.21.15.47:0/3998739712 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff8340e2410 con 0x7ff8401045d0 2024-05-14T12:39:17.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.764+0000 7ff845200700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8280b2900 0x7ff8280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.764+0000 7ff845200700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8280b2900 0x7ff8280b4e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009810 tx=0x7ff82c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:17.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:17.767+0000 7ff83e000700 1 -- 172.21.15.47:0/3998739712 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff8340aa0f0 con 0x7ff8401045d0 2024-05-14T12:39:18.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.057+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff84019e3e0 con 0x7ff8401045d0 2024-05-14T12:39:18.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:17 smithi047 ceph-mon[31254]: pgmap v873: 97 pgs: 97 active+clean; 9.1 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-14T12:39:18.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.058+0000 7ff83e000700 1 -- 172.21.15.47:0/3998739712 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11936 (secure 0 0 0) 0x7ff8340a99f0 con 0x7ff8401045d0 2024-05-14T12:39:18.059 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:39:18.060 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:37:52.056424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.061+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8280b2900 msgr2=0x7ff8280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.061+0000 7ff848600700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8280b2900 0x7ff8280b4e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009810 tx=0x7ff82c019040 comp rx=0 tx=0).stop 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.061+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8401045d0 msgr2=0x7ff84019d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.061+0000 7ff848600700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8401045d0 0x7ff84019d080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e9c0 tx=0x7ff83400ecd0 comp rx=0 tx=0).stop 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.061+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 shutdown_connections 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.062+0000 7ff848600700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff8280b2900 0x7ff8280b4e10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.062+0000 7ff848600700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff840109850 0x7ff8401a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.062+0000 7ff848600700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8401045d0 0x7ff84019d080 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.062+0000 7ff848600700 1 --2- 172.21.15.47:0/3998739712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff840108f00 0x7ff84019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.062+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 >> 172.21.15.47:0/3998739712 conn(0x7ff8400ffea0 msgr2=0x7ff84010a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.062+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 shutdown_connections 2024-05-14T12:39:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:18.062+0000 7ff848600700 1 -- 172.21.15.47:0/3998739712 wait complete. 2024-05-14T12:39:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 50 2024-05-14T12:39:18.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:17 smithi073 ceph-mon[35809]: pgmap v873: 97 pgs: 97 active+clean; 9.1 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-14T12:39:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:17 smithi066 ceph-mon[35981]: pgmap v873: 97 pgs: 97 active+clean; 9.1 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-14T12:39:18.877 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id ad501fb9 --release --await' 2024-05-14T12:39:18.877 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id ad501fb9 --release --await 2024-05-14T12:39:19.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:18 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3998739712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:39:19.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:18 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3998739712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:39:19.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:18 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3998739712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:39:19.371 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:39:20.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:19 smithi047 ceph-mon[31254]: pgmap v874: 97 pgs: 97 active+clean; 9.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.8 KiB/s wr, 18 op/s 2024-05-14T12:39:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:19 smithi073 ceph-mon[35809]: pgmap v874: 97 pgs: 97 active+clean; 9.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.8 KiB/s wr, 18 op/s 2024-05-14T12:39:20.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:19 smithi066 ceph-mon[35981]: pgmap v874: 97 pgs: 97 active+clean; 9.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.8 KiB/s wr, 18 op/s 2024-05-14T12:39:21.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 -- 172.21.15.47:0/3613007169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410af20 msgr2=0x7f78f410b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:21.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 --2- 172.21.15.47:0/3613007169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410af20 0x7f78f410b330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009990 tx=0x7f78e0009ca0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 -- 172.21.15.47:0/3613007169 shutdown_connections 2024-05-14T12:39:21.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 --2- 172.21.15.47:0/3613007169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78f410b870 0x7f78f41131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 --2- 172.21.15.47:0/3613007169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 0x7f78f4106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 --2- 172.21.15.47:0/3613007169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410af20 0x7f78f410b330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 -- 172.21.15.47:0/3613007169 >> 172.21.15.47:0/3613007169 conn(0x7f78f4102030 msgr2=0x7f78f4104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:21.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 -- 172.21.15.47:0/3613007169 shutdown_connections 2024-05-14T12:39:21.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.972+0000 7f78fa600700 1 -- 172.21.15.47:0/3613007169 wait complete. 2024-05-14T12:39:21.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.974+0000 7f78fa600700 1 Processor -- start 2024-05-14T12:39:21.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.974+0000 7f78fa600700 1 -- start start 2024-05-14T12:39:21.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.974+0000 7f78fa600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 0x7f78f419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.974+0000 7f78fa600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78f410af20 0x7f78f419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.974+0000 7f78fa600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410b870 0x7f78f41a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78fa600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41164d0 con 0x7f78f410af20 2024-05-14T12:39:21.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78fa600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4116350 con 0x7f78f410b870 2024-05-14T12:39:21.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78fa600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4116650 con 0x7f78f4106640 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 0x7f78f419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 0x7f78f419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:34990/0 (socket says 172.21.15.47:34990) 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 -- 172.21.15.47:0/1628638504 learned_addr learned my addr 172.21.15.47:0/1628638504 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f3e00700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78f410af20 0x7f78f419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9c00700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410b870 0x7f78f41a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 -- 172.21.15.47:0/1628638504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410b870 msgr2=0x7f78f41a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410b870 0x7f78f41a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 -- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78f410af20 msgr2=0x7f78f419d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78f410af20 0x7f78f419d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.975+0000 7f78f9200700 1 -- 172.21.15.47:0/1628638504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f41a1d10 con 0x7f78f4106640 2024-05-14T12:39:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.976+0000 7f78f9200700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 0x7f78f419ce40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f78e800e9a0 tx=0x7f78e800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.976+0000 7f78f1600700 1 -- 172.21.15.47:0/1628638504 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e800ca10 con 0x7f78f4106640 2024-05-14T12:39:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.976+0000 7f78f1600700 1 -- 172.21.15.47:0/1628638504 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e800cbb0 con 0x7f78f4106640 2024-05-14T12:39:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.976+0000 7f78f1600700 1 -- 172.21.15.47:0/1628638504 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8018680 con 0x7f78f4106640 2024-05-14T12:39:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.976+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f41a2000 con 0x7f78f4106640 2024-05-14T12:39:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.976+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f41a9920 con 0x7f78f4106640 2024-05-14T12:39:21.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.980+0000 7f78f1600700 1 -- 172.21.15.47:0/1628638504 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f78e8010430 con 0x7f78f4106640 2024-05-14T12:39:21.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.981+0000 7f78f1600700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f78dc0b2900 0x7f78dc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.981+0000 7f78f1600700 1 -- 172.21.15.47:0/1628638504 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f78e80e2380 con 0x7f78f4106640 2024-05-14T12:39:21.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.981+0000 7f78f3e00700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f78dc0b2900 0x7f78dc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.982+0000 7f78f3e00700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f78dc0b2900 0x7f78dc0b4e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f78f4105a60 tx=0x7f78e0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:21.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.983+0000 7f790a6c4b80 1 Processor -- start 2024-05-14T12:39:21.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.983+0000 7f790a6c4b80 1 -- start start 2024-05-14T12:39:21.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e2c5d1b20 con 0x564e2c531f40 2024-05-14T12:39:21.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e2c56f860 con 0x564e2c6af900 2024-05-14T12:39:21.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564e2c5cdae0 con 0x564e2c6af4f0 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f78f9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f78f9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43732/0 (socket says 172.21.15.47:43732) 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f78f9200700 1 -- 172.21.15.47:0/2880980000 learned_addr learned my addr 172.21.15.47:0/2880980000 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f78f3e00700 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.984+0000 7f78f9c00700 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78f9200700 1 -- 172.21.15.47:0/2880980000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 msgr2=0x564e2c6b9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78f9200700 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78f9200700 1 -- 172.21.15.47:0/2880980000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 msgr2=0x564e2c6bc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78f9200700 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78f9200700 1 -- 172.21.15.47:0/2880980000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e2c51e9d0 con 0x564e2c531f40 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78f9200700 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6aefb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f78e80a98f0 tx=0x7f78e8010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa314ba66c02cdb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78e6000700 1 -- 172.21.15.47:0/2880980000 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80aa060 con 0x564e2c531f40 2024-05-14T12:39:21.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78e6000700 1 -- 172.21.15.47:0/2880980000 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e80a9960 con 0x564e2c531f40 2024-05-14T12:39:21.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.985+0000 7f78e6000700 1 -- 172.21.15.47:0/2880980000 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80b2330 con 0x564e2c531f40 2024-05-14T12:39:21.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.986+0000 7f790a6c4b80 1 -- 172.21.15.47:0/2880980000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 msgr2=0x564e2c6aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.986+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6aefb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f78e80a98f0 tx=0x7f78e8010c10 comp rx=0 tx=0).stop 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.986+0000 7f790a6c4b80 1 -- 172.21.15.47:0/2880980000 shutdown_connections 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.986+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.986+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6aefb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.986+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/2880980000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.986+0000 7f790a6c4b80 1 -- 172.21.15.47:0/2880980000 >> 172.21.15.47:0/2880980000 conn(0x564e2c577070 msgr2=0x564e2c6aae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.987+0000 7f790a6c4b80 1 -- 172.21.15.47:0/2880980000 shutdown_connections 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.987+0000 7f790a6c4b80 1 -- 172.21.15.47:0/2880980000 wait complete. 2024-05-14T12:39:21.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.987+0000 7f790a6c4b80 1 -- start start 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 1 Processor -- start 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6b9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af900 0x564e2c6ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e2c6bca70 con 0x564e2c531f40 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e2c537c20 con 0x564e2c6af4f0 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564e2c6bcbf0 con 0x564e2c6af900 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.988+0000 7f790a6c4b80 10 client.0 _ll_register_callbacks cb 0x564e2c578d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af900 0x564e2c6ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af900 0x564e2c6ba1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:35002/0 (socket says 172.21.15.47:35002) 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59506/0 (socket says 172.21.15.47:59506) 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 -- 172.21.15.47:0/1821516198 learned_addr learned my addr 172.21.15.47:0/1821516198 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 -- 172.21.15.47:0/1821516198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af4f0 msgr2=0x564e2c6b9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 -- 172.21.15.47:0/1821516198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 msgr2=0x564e2c6b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 -- 172.21.15.47:0/1821516198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e2c597520 con 0x564e2c6af900 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78f9c00700 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af900 0x564e2c6ba1c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78ec011ef0 tx=0x7f78ec014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2ee6da47b0a47e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.989+0000 7f78daa00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.990+0000 7f78daa00700 1 -- 172.21.15.47:0/1821516198 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec014ce0 con 0x564e2c6af900 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.990+0000 7f78daa00700 1 -- 172.21.15.47:0/1821516198 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f78ec003a00 con 0x564e2c6af900 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.990+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78e80a9960 con 0x564e2c6af900 2024-05-14T12:39:21.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.990+0000 7f78daa00700 1 -- 172.21.15.47:0/1821516198 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f78ec0093a0 con 0x564e2c6af900 2024-05-14T12:39:21.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.990+0000 7f790a6c4b80 10 client.26188 fetch_fsmap learned FSMap version 50 2024-05-14T12:39:21.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.990+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x564e2c6c7800 con 0x564e2c6af900 2024-05-14T12:39:21.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.990+0000 7f78daa00700 1 -- 172.21.15.47:0/1821516198 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e80a9960 con 0x564e2c6af900 2024-05-14T12:39:21.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f78daa00700 1 -- 172.21.15.47:0/1821516198 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f78ec007500 con 0x564e2c6af900 2024-05-14T12:39:21.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f790a6c4b80 10 client.26188 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:39:21.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f790a6c4b80 10 client.26188 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f790a6c4b80 20 client.26188 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c6c9e90 0x564e2c6cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f790a6c4b80 4 client.26188 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e2c67c2c0 con 0x564e2c6c9e90 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.991+0000 7f78f9200700 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c6c9e90 0x564e2c6cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.992+0000 7f78f9200700 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c6c9e90 0x564e2c6cc320 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96ccea9273472c13 server_cookie=9a09aa4778f2c94 in_seq=0 out_seq=0 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.992+0000 7f78daa00700 10 client.26188 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f78daa00700 1 -- 172.21.15.47:0/1821516198 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564e2c67c2c0 con 0x564e2c6c9e90 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f78daa00700 10 client.26188 handle_command_reply: tid=0 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 client.26188 shutdown 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af900 msgr2=0x564e2c6ba1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af900 0x564e2c6ba1c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78ec011ef0 tx=0x7f78ec014600 comp rx=0 tx=0).stop 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 shutdown_connections 2024-05-14T12:39:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c6c9e90 0x564e2c6cc320 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af900 0x564e2c6ba1c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f78daa00700 0 client.26188 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1821516198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af4f0 0x564e2c6b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 >> 172.21.15.47:0/1821516198 conn(0x564e2c577070 msgr2=0x564e2c6b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 shutdown_connections 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.993+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1821516198 wait complete. 2024-05-14T12:39:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:21.994+0000 7f790a6c4b80 20 client.26188 trim_cache size 0 max 16384 2024-05-14T12:39:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.016+0000 7f790a6c4b80 1 Processor -- start 2024-05-14T12:39:22.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.016+0000 7f790a6c4b80 1 -- start start 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6ba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41b0d60 con 0x564e2c531f40 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41b2a80 con 0x564e2c6af900 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41b1460 con 0x564e2c6af4f0 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59514/0 (socket says 172.21.15.47:59514) 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 -- 172.21.15.47:0/203554461 learned_addr learned my addr 172.21.15.47:0/203554461 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9200700 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:22.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f3e00700 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 -- 172.21.15.47:0/203554461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 msgr2=0x564e2c6d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 -- 172.21.15.47:0/203554461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 msgr2=0x564e2c6ba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6ba130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.017+0000 7f78f9c00700 1 -- 172.21.15.47:0/203554461 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e2c6ac3f0 con 0x564e2c6af900 2024-05-14T12:39:22.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.018+0000 7f78f9c00700 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6d2020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78ec011450 tx=0x7f78ec007da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833ce45f1878f29f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:22.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.018+0000 7f78e5600700 1 -- 172.21.15.47:0/203554461 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0075c0 con 0x564e2c6af900 2024-05-14T12:39:22.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.018+0000 7f78e5600700 1 -- 172.21.15.47:0/203554461 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78ec02d070 con 0x564e2c6af900 2024-05-14T12:39:22.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.018+0000 7f78e5600700 1 -- 172.21.15.47:0/203554461 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec01e6f0 con 0x564e2c6af900 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 -- 172.21.15.47:0/203554461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 msgr2=0x564e2c6d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6d2020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78ec011450 tx=0x7f78ec007da0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 -- 172.21.15.47:0/203554461 shutdown_connections 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6d2020 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c531f40 0x564e2c6ba130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/203554461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c6af4f0 0x564e2c6d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 -- 172.21.15.47:0/203554461 >> 172.21.15.47:0/203554461 conn(0x564e2c577070 msgr2=0x564e2c6b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 -- 172.21.15.47:0/203554461 shutdown_connections 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.019+0000 7f790a6c4b80 1 -- 172.21.15.47:0/203554461 wait complete. 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.020+0000 7f790a6c4b80 1 -- start start 2024-05-14T12:39:22.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.020+0000 7f790a6c4b80 1 Processor -- start 2024-05-14T12:39:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c531f40 0x564e2c6bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c6af4f0 0x564e2c6bf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f790a6c4b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41b22f0 con 0x564e2c6af4f0 2024-05-14T12:39:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41b1b60 con 0x564e2c6af900 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f790a6c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41aece0 con 0x564e2c531f40 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f790a6c4b80 10 client.0 _ll_register_callbacks cb 0x564e2c578d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c531f40 0x564e2c6bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c531f40 0x564e2c6bec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:35022/0 (socket says 172.21.15.47:35022) 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 -- 172.21.15.47:0/1142650511 learned_addr learned my addr 172.21.15.47:0/1142650511 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9c00700 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f3e00700 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c6af4f0 0x564e2c6bf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 -- 172.21.15.47:0/1142650511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 msgr2=0x564e2c6bf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 -- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c6af4f0 msgr2=0x564e2c6bf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c6af4f0 0x564e2c6bf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.021+0000 7f78f9200700 1 -- 172.21.15.47:0/1142650511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e2c734810 con 0x564e2c531f40 2024-05-14T12:39:22.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f78f9200700 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c531f40 0x564e2c6bec10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f78e80a9660 tx=0x7f78e80a93e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9863e7d7ac86f44c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f78daa00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f78daa00700 1 -- 172.21.15.47:0/1142650511 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80aa060 con 0x564e2c531f40 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f78daa00700 1 -- 172.21.15.47:0/1142650511 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f78e80cc0d0 con 0x564e2c531f40 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78ec02d070 con 0x564e2c531f40 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f78daa00700 1 -- 172.21.15.47:0/1142650511 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f78e80a9960 con 0x564e2c531f40 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f790a6c4b80 10 client.26194 fetch_fsmap learned FSMap version 50 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x564e2c735a90 con 0x564e2c531f40 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.022+0000 7f78daa00700 1 -- 172.21.15.47:0/1142650511 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78ec02d070 con 0x564e2c531f40 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f78daa00700 1 -- 172.21.15.47:0/1142650511 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f78e80c6060 con 0x564e2c531f40 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f790a6c4b80 10 client.26194 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f790a6c4b80 10 client.26194 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f790a6c4b80 20 client.26194 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c735d20 0x564e2c738140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:22.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f790a6c4b80 4 client.26194 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ad501fb9", "release": true, "await": true}] 2024-05-14T12:39:22.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ad501fb9", "release": true, "await": true}) -- 0x564e2c5df500 con 0x564e2c735d20 2024-05-14T12:39:22.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.023+0000 7f78f3e00700 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c735d20 0x564e2c738140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:22.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.024+0000 7f78f3e00700 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c735d20 0x564e2c738140 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16227dbe8c512cec server_cookie=4433675a04c247d in_seq=0 out_seq=0 2024-05-14T12:39:22.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.024+0000 7f78daa00700 10 client.26194 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:22.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f78daa00700 1 -- 172.21.15.47:0/1142650511 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564e2c5df500 con 0x564e2c735d20 2024-05-14T12:39:22.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f78daa00700 10 client.26194 handle_command_reply: tid=0 2024-05-14T12:39:22.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 client.26194 shutdown 2024-05-14T12:39:22.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c531f40 msgr2=0x564e2c6bec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:22.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c531f40 0x564e2c6bec10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f78e80a9660 tx=0x7f78e80a93e0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 shutdown_connections 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x564e2c735d20 0x564e2c738140 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e2c6af900 0x564e2c6bf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564e2c531f40 0x564e2c6bec10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f78daa00700 0 client.26194 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.043+0000 7f790a6c4b80 1 --2- 172.21.15.47:0/1142650511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e2c6af4f0 0x564e2c6bf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.044+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 >> 172.21.15.47:0/1142650511 conn(0x564e2c577070 msgr2=0x564e2c6bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.044+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 shutdown_connections 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.044+0000 7f790a6c4b80 1 -- 172.21.15.47:0/1142650511 wait complete. 2024-05-14T12:39:22.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.044+0000 7f790a6c4b80 20 client.26194 trim_cache size 0 max 16384 2024-05-14T12:39:22.046 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:39:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 50, 2024-05-14T12:39:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:39:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 28, 2024-05-14T12:39:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:39:22.046 INFO:teuthology.orchestra.run.smithi047.stdout: "ad501fb9": { 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 28, 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 79.0, 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:39:22.047 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:22.048 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:22.048 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:39:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f78dc0b2900 msgr2=0x7f78dc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:22.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f78dc0b2900 0x7f78dc0b4e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f78f4105a60 tx=0x7f78e0005fd0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 msgr2=0x7f78f419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 0x7f78f419ce40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f78e800e9a0 tx=0x7f78e800ecb0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 shutdown_connections 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f78dc0b2900 0x7f78dc0b4e10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f410b870 0x7f78f41a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78f4106640 0x7f78f419ce40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 --2- 172.21.15.47:0/1628638504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78f410af20 0x7f78f419d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.045+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 >> 172.21.15.47:0/1628638504 conn(0x7f78f4102030 msgr2=0x7f78f410a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.046+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 shutdown_connections 2024-05-14T12:39:22.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:22.046+0000 7f78fa600700 1 -- 172.21.15.47:0/1628638504 wait complete. 2024-05-14T12:39:22.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:21 smithi047 ceph-mon[31254]: pgmap v875: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 19 op/s 2024-05-14T12:39:22.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:21 smithi073 ceph-mon[35809]: pgmap v875: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 19 op/s 2024-05-14T12:39:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:21 smithi066 ceph-mon[35981]: pgmap v875: 97 pgs: 97 active+clean; 8.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 19 op/s 2024-05-14T12:39:23.080 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ad501fb9', seconds elapsed: 79.3 2024-05-14T12:39:23.080 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.95 2024-05-14T12:39:23.080 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:39:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:39:24.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:23 smithi047 ceph-mon[31254]: pgmap v876: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 21 op/s 2024-05-14T12:39:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:23 smithi073 ceph-mon[35809]: pgmap v876: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 21 op/s 2024-05-14T12:39:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:23 smithi066 ceph-mon[35981]: pgmap v876: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 21 op/s 2024-05-14T12:39:25.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.804+0000 7fbc03800700 1 -- 172.21.15.47:0/2051259582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 msgr2=0x7fbbfc117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:25.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 --2- 172.21.15.47:0/2051259582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 0x7fbbfc117810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009990 tx=0x7fbbf4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:39:25.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 -- 172.21.15.47:0/2051259582 shutdown_connections 2024-05-14T12:39:25.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 --2- 172.21.15.47:0/2051259582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 0x7fbbfc117810 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:25.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 --2- 172.21.15.47:0/2051259582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbfc110970 0x7fbbfc110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:25.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 --2- 172.21.15.47:0/2051259582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 0x7fbbfc10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:25.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 -- 172.21.15.47:0/2051259582 >> 172.21.15.47:0/2051259582 conn(0x7fbbfc077c80 msgr2=0x7fbbfc0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:25.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 -- 172.21.15.47:0/2051259582 shutdown_connections 2024-05-14T12:39:25.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.805+0000 7fbc03800700 1 -- 172.21.15.47:0/2051259582 wait complete. 2024-05-14T12:39:25.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.806+0000 7fbc03800700 1 Processor -- start 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.806+0000 7fbc03800700 1 -- start start 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.806+0000 7fbc03800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 0x7fbbfc1a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc03800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 0x7fbbfc1a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc03800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbfc110970 0x7fbbfc1a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc03800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc11aae0 con 0x7fbbfc10a990 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc03800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc11a960 con 0x7fbbfc110970 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc03800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc11ac60 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc00e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 0x7fbbfc1a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbbf3e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 0x7fbbfc1a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc00e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 0x7fbbfc1a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43798/0 (socket says 172.21.15.47:43798) 2024-05-14T12:39:25.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc00e00700 1 -- 172.21.15.47:0/3879871507 learned_addr learned my addr 172.21.15.47:0/3879871507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:25.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.807+0000 7fbc01800700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbfc110970 0x7fbbfc1a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:25.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbf3e00700 1 -- 172.21.15.47:0/3879871507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbfc110970 msgr2=0x7fbbfc1a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:25.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbf3e00700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbfc110970 0x7fbbfc1a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:25.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbf3e00700 1 -- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 msgr2=0x7fbbfc1a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:25.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbf3e00700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 0x7fbbfc1a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbf3e00700 1 -- 172.21.15.47:0/3879871507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc1a62c0 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbc00e00700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 0x7fbbfc1a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbf3e00700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 0x7fbbfc1a1990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc06d120 tx=0x7fbbe400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbfa000700 1 -- 172.21.15.47:0/3879871507 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4016070 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbbfa000700 1 -- 172.21.15.47:0/3879871507 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe400fd40 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.808+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc1a65b0 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.809+0000 7fbbfa000700 1 -- 172.21.15.47:0/3879871507 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe400e3b0 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.809+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc1aded0 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.810+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbfc0512c0 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.813+0000 7fbbfa000700 1 -- 172.21.15.47:0/3879871507 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbbe4019070 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.815+0000 7fbbfa000700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbbe00b2900 0x7fbbe00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:25.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.815+0000 7fbbfa000700 1 -- 172.21.15.47:0/3879871507 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbbe40e1b70 con 0x7fbbfc10b2e0 2024-05-14T12:39:25.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.815+0000 7fbc00e00700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbbe00b2900 0x7fbbe00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:25.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.816+0000 7fbc00e00700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbbe00b2900 0x7fbbe00b4e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009520 tx=0x7fbbec00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:25.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:25.820+0000 7fbbfa000700 1 -- 172.21.15.47:0/3879871507 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbbe40a9850 con 0x7fbbfc10b2e0 2024-05-14T12:39:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.130+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbfc1a2750 con 0x7fbbfc10b2e0 2024-05-14T12:39:26.131 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:25 smithi047 ceph-mon[31254]: pgmap v877: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 19 op/s 2024-05-14T12:39:26.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.131+0000 7fbbfa000700 1 -- 172.21.15.47:0/3879871507 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11936 (secure 0 0 0) 0x7fbbe40a9150 con 0x7fbbfc10b2e0 2024-05-14T12:39:26.132 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:39:26.132 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:37:52.056424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:39:26.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbbe00b2900 msgr2=0x7fbbe00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:26.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbbe00b2900 0x7fbbe00b4e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009520 tx=0x7fbbec00b040 comp rx=0 tx=0).stop 2024-05-14T12:39:26.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 msgr2=0x7fbbfc1a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 0x7fbbfc1a1990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc06d120 tx=0x7fbbe400dc30 comp rx=0 tx=0).stop 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 shutdown_connections 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbbe00b2900 0x7fbbe00b4e10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbfc110970 0x7fbbfc1a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbfc10a990 0x7fbbfc1a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 --2- 172.21.15.47:0/3879871507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbfc10b2e0 0x7fbbfc1a1990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.135+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 >> 172.21.15.47:0/3879871507 conn(0x7fbbfc077c80 msgr2=0x7fbbfc07b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.136+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 shutdown_connections 2024-05-14T12:39:26.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:26.136+0000 7fbc03800700 1 -- 172.21.15.47:0/3879871507 wait complete. 2024-05-14T12:39:26.138 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 50 2024-05-14T12:39:26.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:25 smithi073 ceph-mon[35809]: pgmap v877: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 19 op/s 2024-05-14T12:39:26.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:25 smithi066 ceph-mon[35981]: pgmap v877: 97 pgs: 97 active+clean; 8.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 19 op/s 2024-05-14T12:39:26.931 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 78.95 --await-for 42.0' 2024-05-14T12:39:26.932 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 78.95 --await-for 42.0 2024-05-14T12:39:27.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:26 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3879871507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:39:27.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:26 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3879871507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:39:27.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:26 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3879871507' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:39:27.416 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:39:28.115 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:27 smithi047 ceph-mon[31254]: pgmap v878: 97 pgs: 97 active+clean; 8.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 23 op/s 2024-05-14T12:39:28.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:27 smithi073 ceph-mon[35809]: pgmap v878: 97 pgs: 97 active+clean; 8.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 23 op/s 2024-05-14T12:39:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:27 smithi066 ceph-mon[35981]: pgmap v878: 97 pgs: 97 active+clean; 8.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 23 op/s 2024-05-14T12:39:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 -- 172.21.15.47:0/3755940018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904104560 msgr2=0x7f1904106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 --2- 172.21.15.47:0/3755940018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904104560 0x7f1904106980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009ca0 tx=0x7f18f402a8c0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 -- 172.21.15.47:0/3755940018 shutdown_connections 2024-05-14T12:39:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 --2- 172.21.15.47:0/3755940018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1904109820 0x7f190410bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 --2- 172.21.15.47:0/3755940018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904106ec0 0x7f19041092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 --2- 172.21.15.47:0/3755940018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904104560 0x7f1904106980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 -- 172.21.15.47:0/3755940018 >> 172.21.15.47:0/3755940018 conn(0x7f19040fdb60 msgr2=0x7f1904100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:29.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 -- 172.21.15.47:0/3755940018 shutdown_connections 2024-05-14T12:39:29.269 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.267+0000 7f1909200640 1 -- 172.21.15.47:0/3755940018 wait complete. 2024-05-14T12:39:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 Processor -- start 2024-05-14T12:39:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 -- start start 2024-05-14T12:39:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904104560 0x7f190419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904106ec0 0x7f190419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1904109820 0x7f19041a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f190410f5f0 con 0x7f1904109820 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f190410f470 con 0x7f1904104560 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.269+0000 7f1909200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f190410f770 con 0x7f1904106ec0 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904104560 0x7f190419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904104560 0x7f190419c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56518/0 (socket says 172.21.15.47:56518) 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 -- 172.21.15.47:0/765414163 learned_addr learned my addr 172.21.15.47:0/765414163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1902a00640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904106ec0 0x7f190419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903e00640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1904109820 0x7f19041a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 -- 172.21.15.47:0/765414163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904106ec0 msgr2=0x7f190419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904106ec0 0x7f190419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 -- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1904109820 msgr2=0x7f19041a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1904109820 0x7f19041a38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1903400640 1 -- 172.21.15.47:0/765414163 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19041a3f40 con 0x7f1904104560 2024-05-14T12:39:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.270+0000 7f1902a00640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904106ec0 0x7f190419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:39:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.271+0000 7f1903400640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904104560 0x7f190419c400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f18f402ade0 tx=0x7f18f40317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.271+0000 7f18fbe00640 1 -- 172.21.15.47:0/765414163 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f4003c30 con 0x7f1904104560 2024-05-14T12:39:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.271+0000 7f18fbe00640 1 -- 172.21.15.47:0/765414163 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18f4003dd0 con 0x7f1904104560 2024-05-14T12:39:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.271+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19041a41d0 con 0x7f1904104560 2024-05-14T12:39:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.271+0000 7f18fbe00640 1 -- 172.21.15.47:0/765414163 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f402fb60 con 0x7f1904104560 2024-05-14T12:39:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.271+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19041a4720 con 0x7f1904104560 2024-05-14T12:39:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 Processor -- start 2024-05-14T12:39:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 -- start start 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c30300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c30880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c37780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d038b94550 con 0x55d03888e1b0 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d038b39bc0 con 0x55d03886d4d0 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.275+0000 7f19117bf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d038b90510 con 0x55d0388652f0 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c37780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c37780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56528/0 (socket says 172.21.15.47:56528) 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 -- 172.21.15.47:0/2776958626 learned_addr learned my addr 172.21.15.47:0/2776958626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1903e00640 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c30300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 -- 172.21.15.47:0/2776958626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 msgr2=0x55d038c30880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:39:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c30880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 -- 172.21.15.47:0/2776958626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 msgr2=0x55d038c30300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c30300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 -- 172.21.15.47:0/2776958626 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0388a6210 con 0x55d03886d4d0 2024-05-14T12:39:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.276+0000 7f1902a00640 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c37780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0114f0 tx=0x7f18ec0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4e3ca263a4d9de7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.277+0000 7f18fbe00640 1 -- 172.21.15.47:0/765414163 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f18f402fd00 con 0x7f1904104560 2024-05-14T12:39:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.277+0000 7f18f8c00640 1 -- 172.21.15.47:0/2776958626 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec01e070 con 0x55d03886d4d0 2024-05-14T12:39:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.277+0000 7f18f8c00640 1 -- 172.21.15.47:0/2776958626 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ec0035f0 con 0x55d03886d4d0 2024-05-14T12:39:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.277+0000 7f18f8c00640 1 -- 172.21.15.47:0/2776958626 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00f820 con 0x55d03886d4d0 2024-05-14T12:39:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 -- 172.21.15.47:0/2776958626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 msgr2=0x55d038c37780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c37780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0114f0 tx=0x7f18ec0119b0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 -- 172.21.15.47:0/2776958626 shutdown_connections 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c37780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c30880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 --2- 172.21.15.47:0/2776958626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c30300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 -- 172.21.15.47:0/2776958626 >> 172.21.15.47:0/2776958626 conn(0x55d038882300 msgr2=0x55d038c2bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 -- 172.21.15.47:0/2776958626 shutdown_connections 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.278+0000 7f19117bf740 1 -- 172.21.15.47:0/2776958626 wait complete. 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.279+0000 7f19117bf740 1 -- start start 2024-05-14T12:39:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.279+0000 7f18fbe00640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18e80b27b0 0x7f18e80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.279+0000 7f18fbe00640 1 -- 172.21.15.47:0/765414163 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f18f4103710 con 0x7f1904104560 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.279+0000 7f19117bf740 1 Processor -- start 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.279+0000 7f1903e00640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18e80b27b0 0x7f18e80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f19117bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0388652f0 0x55d038c42630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f19117bf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d03886d4d0 0x55d038c42b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f19117bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c49ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f19117bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d038c381d0 con 0x55d03888e1b0 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f19117bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d038b4d660 con 0x55d0388652f0 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f19117bf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d038c38350 con 0x55d03886d4d0 2024-05-14T12:39:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f19117bf740 10 client.0 _ll_register_callbacks cb 0x55d038b17400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f1903e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c49ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f1903400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0388652f0 0x55d038c42630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f1903400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0388652f0 0x55d038c42630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56534/0 (socket says 172.21.15.47:56534) 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f1903e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c49ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35638/0 (socket says 172.21.15.47:35638) 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f1902a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d03886d4d0 0x55d038c42b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.280+0000 7f1903400640 1 -- 172.21.15.47:0/3886507597 learned_addr learned my addr 172.21.15.47:0/3886507597 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1903e00640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18e80b27b0 0x7f18e80b4cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55d038c314d0 tx=0x7f18fc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1903400640 1 -- 172.21.15.47:0/3886507597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d03886d4d0 msgr2=0x55d038c42b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1903400640 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d03886d4d0 0x55d038c42b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1903400640 1 -- 172.21.15.47:0/3886507597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 msgr2=0x55d038c49ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1903400640 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c49ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1903400640 1 -- 172.21.15.47:0/3886507597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d038972620 con 0x55d0388652f0 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1902a00640 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d03886d4d0 0x55d038c42b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f1903400640 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0388652f0 0x55d038c42630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f18f4031b50 tx=0x7f18f40ca560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c2c1c2697449bc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.281+0000 7f18f1600640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.282+0000 7f18f1600640 1 -- 172.21.15.47:0/3886507597 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40cad30 con 0x55d0388652f0 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.282+0000 7f18f1600640 1 -- 172.21.15.47:0/3886507597 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f18f40e5350 con 0x55d0388652f0 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.282+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18ec0035f0 con 0x55d0388652f0 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.282+0000 7f18f1600640 1 -- 172.21.15.47:0/3886507597 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f18f40ea050 con 0x55d0388652f0 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.282+0000 7f19117bf740 10 client.26180 fetch_fsmap learned FSMap version 50 2024-05-14T12:39:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.282+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55d038c381d0 con 0x55d0388652f0 2024-05-14T12:39:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f18f1600640 1 -- 172.21.15.47:0/3886507597 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ec0035f0 con 0x55d0388652f0 2024-05-14T12:39:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f18f1600640 1 -- 172.21.15.47:0/3886507597 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f18f40cb090 con 0x55d0388652f0 2024-05-14T12:39:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f19117bf740 10 client.26180 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f19117bf740 10 client.26180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f19117bf740 20 client.26180 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f19117bf740 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d03884cd80 0x55d038c501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f19117bf740 4 client.26180 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.283+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d038ba2160 con 0x55d03884cd80 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.284+0000 7f1902a00640 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d03884cd80 0x55d038c501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.285+0000 7f18f1600640 10 client.26180 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.285+0000 7f1902a00640 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d03884cd80 0x55d038c501b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d42131b84e15a95 server_cookie=b722f8b255620424 in_seq=0 out_seq=0 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.285+0000 7f18f1600640 1 -- 172.21.15.47:0/3886507597 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d038ba2160 con 0x55d03884cd80 2024-05-14T12:39:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.285+0000 7f18f1600640 10 client.26180 handle_command_reply: tid=0 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 client.26180 shutdown 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0388652f0 msgr2=0x55d038c42630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0388652f0 0x55d038c42630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f18f4031b50 tx=0x7f18f40ca560 comp rx=0 tx=0).stop 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 shutdown_connections 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d03884cd80 0x55d038c501b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038c49ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d03886d4d0 0x55d038c42b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 --2- 172.21.15.47:0/3886507597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0388652f0 0x55d038c42630 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 >> 172.21.15.47:0/3886507597 conn(0x55d038882300 msgr2=0x55d038c2ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f18f1600640 0 client.26180 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.286+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 shutdown_connections 2024-05-14T12:39:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.287+0000 7f19117bf740 1 -- 172.21.15.47:0/3886507597 wait complete. 2024-05-14T12:39:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.287+0000 7f19117bf740 20 client.26180 trim_cache size 0 max 16384 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 Processor -- start 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 -- start start 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c38720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03886d4d0 0x55d038c38c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03888e1b0 0x55d038c391a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19041a8f10 con 0x55d03886d4d0 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f19041aac30 con 0x55d03888e1b0 2024-05-14T12:39:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.304+0000 7f19117bf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f19041a9610 con 0x55d0388652f0 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c38720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c38720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:44704/0 (socket says 172.21.15.47:44704) 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 -- 172.21.15.47:0/3817825183 learned_addr learned my addr 172.21.15.47:0/3817825183 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903e00640 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03888e1b0 0x55d038c391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1902a00640 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03886d4d0 0x55d038c38c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 -- 172.21.15.47:0/3817825183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03888e1b0 msgr2=0x55d038c391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03888e1b0 0x55d038c391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 -- 172.21.15.47:0/3817825183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03886d4d0 msgr2=0x55d038c38c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03886d4d0 0x55d038c38c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 -- 172.21.15.47:0/3817825183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d038c37620 con 0x55d0388652f0 2024-05-14T12:39:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903e00640 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03888e1b0 0x55d038c391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f1903400640 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c38720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f18f402f550 tx=0x7f18f402f660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c157fef86aebf27f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f18f3e00640 1 -- 172.21.15.47:0/3817825183 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40a9070 con 0x55d0388652f0 2024-05-14T12:39:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f18f3e00640 1 -- 172.21.15.47:0/3817825183 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18f40e1030 con 0x55d0388652f0 2024-05-14T12:39:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.305+0000 7f18f3e00640 1 -- 172.21.15.47:0/3817825183 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40d3940 con 0x55d0388652f0 2024-05-14T12:39:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.306+0000 7f19117bf740 1 -- 172.21.15.47:0/3817825183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 msgr2=0x55d038c38720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.306+0000 7f19117bf740 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c38720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f18f402f550 tx=0x7f18f402f660 comp rx=0 tx=0).stop 2024-05-14T12:39:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.306+0000 7f19117bf740 1 -- 172.21.15.47:0/3817825183 shutdown_connections 2024-05-14T12:39:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.306+0000 7f19117bf740 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03888e1b0 0x55d038c391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.306+0000 7f19117bf740 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03886d4d0 0x55d038c38c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.306+0000 7f19117bf740 1 --2- 172.21.15.47:0/3817825183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c38720 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.306+0000 7f19117bf740 1 -- 172.21.15.47:0/3817825183 >> 172.21.15.47:0/3817825183 conn(0x55d038882300 msgr2=0x55d038c34240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.307+0000 7f19117bf740 1 -- 172.21.15.47:0/3817825183 shutdown_connections 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.307+0000 7f19117bf740 1 -- 172.21.15.47:0/3817825183 wait complete. 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.307+0000 7f19117bf740 1 -- start start 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.307+0000 7f19117bf740 1 Processor -- start 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f19117bf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f19117bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c48830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f19117bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038cb65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f19117bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19041aa4a0 con 0x55d03888e1b0 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f19117bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f19041a9d10 con 0x55d03886d4d0 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f19117bf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f19041a6f10 con 0x55d0388652f0 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f19117bf740 10 client.0 _ll_register_callbacks cb 0x7f18f40093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1902a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c48830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:44716/0 (socket says 172.21.15.47:44716) 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 -- 172.21.15.47:0/3022328768 learned_addr learned my addr 172.21.15.47:0/3022328768 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903e00640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038cb65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 -- 172.21.15.47:0/3022328768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 msgr2=0x55d038c48830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c48830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 -- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 msgr2=0x55d038cb65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038cb65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903400640 1 -- 172.21.15.47:0/3022328768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d038cb6ba0 con 0x55d0388652f0 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1902a00640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c48830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.308+0000 7f1903e00640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038cb65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f1903400640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c482f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18f40d3750 tx=0x7f18f40095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86d7f9da7f4b5e85 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f18f1600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f18f1600640 1 -- 172.21.15.47:0/3022328768 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40a9070 con 0x55d0388652f0 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f18f1600640 1 -- 172.21.15.47:0/3022328768 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f18f40caf90 con 0x55d0388652f0 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f40e1030 con 0x55d0388652f0 2024-05-14T12:39:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f18f1600640 1 -- 172.21.15.47:0/3022328768 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f18f40c66a0 con 0x55d0388652f0 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f19117bf740 10 client.26215 fetch_fsmap learned FSMap version 50 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55d038cb6ba0 con 0x55d0388652f0 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f18f1600640 1 -- 172.21.15.47:0/3022328768 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18f40e1030 con 0x55d0388652f0 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f18f1600640 1 -- 172.21.15.47:0/3022328768 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f18f40c9b20 con 0x55d0388652f0 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f19117bf740 10 client.26215 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.309+0000 7f19117bf740 10 client.26215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.310+0000 7f19117bf740 20 client.26215 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.310+0000 7f19117bf740 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d0388221c0 0x55d038cba490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.310+0000 7f19117bf740 4 client.26215 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.310+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d038b9bfd0 con 0x55d0388221c0 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.310+0000 7f1902a00640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d0388221c0 0x55d038cba490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.311+0000 7f1902a00640 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d0388221c0 0x55d038cba490 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdf9ef37cfaca4d7 server_cookie=56a52c5f91751194 in_seq=0 out_seq=0 2024-05-14T12:39:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:29.311+0000 7f18f1600640 10 client.26215 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 -- 172.21.15.47:0/2215010023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a4410b2e0 msgr2=0x7f4a44117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 --2- 172.21.15.47:0/2215010023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a4410b2e0 0x7f4a44117810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00b0a0 tx=0x7f4a3c00b3b0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 -- 172.21.15.47:0/2215010023 shutdown_connections 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 --2- 172.21.15.47:0/2215010023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a4410b2e0 0x7f4a44117810 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 --2- 172.21.15.47:0/2215010023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a44110970 0x7f4a44110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 --2- 172.21.15.47:0/2215010023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 0x7f4a4410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 -- 172.21.15.47:0/2215010023 >> 172.21.15.47:0/2215010023 conn(0x7f4a44077c80 msgr2=0x7f4a440780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:29.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 -- 172.21.15.47:0/2215010023 shutdown_connections 2024-05-14T12:39:29.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.841+0000 7f4a49800700 1 -- 172.21.15.47:0/2215010023 wait complete. 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 Processor -- start 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 -- start start 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 0x7f4a441a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a4410b2e0 0x7f4a441a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a44110970 0x7f4a441a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4411aae0 con 0x7f4a4410b2e0 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4411a960 con 0x7f4a44110970 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a49800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4411ac60 con 0x7f4a4410a990 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.843+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 0x7f4a441a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 0x7f4a441a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:44730/0 (socket says 172.21.15.47:44730) 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 -- 172.21.15.47:0/1155538925 learned_addr learned my addr 172.21.15.47:0/1155538925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42000700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a4410b2e0 0x7f4a441a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a43400700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a44110970 0x7f4a441a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 -- 172.21.15.47:0/1155538925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a44110970 msgr2=0x7f4a441a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a44110970 0x7f4a441a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 -- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a4410b2e0 msgr2=0x7f4a441a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a4410b2e0 0x7f4a441a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 -- 172.21.15.47:0/1155538925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a441a62c0 con 0x7f4a4410a990 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a43400700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a44110970 0x7f4a441a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:29.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.844+0000 7f4a42a00700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 0x7f4a441a13f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400e970 tx=0x7f4a3400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.845+0000 7f4a3b400700 1 -- 172.21.15.47:0/1155538925 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400cbd0 con 0x7f4a4410a990 2024-05-14T12:39:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.845+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a441a65b0 con 0x7f4a4410a990 2024-05-14T12:39:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.845+0000 7f4a3b400700 1 -- 172.21.15.47:0/1155538925 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a3400cd70 con 0x7f4a4410a990 2024-05-14T12:39:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.845+0000 7f4a3b400700 1 -- 172.21.15.47:0/1155538925 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34005680 con 0x7f4a4410a990 2024-05-14T12:39:29.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.845+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a441aded0 con 0x7f4a4410a990 2024-05-14T12:39:29.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.849+0000 7f4a3b400700 1 -- 172.21.15.47:0/1155538925 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4a34004830 con 0x7f4a4410a990 2024-05-14T12:39:29.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.850+0000 7f4a58341b80 1 Processor -- start 2024-05-14T12:39:29.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.850+0000 7f4a3b400700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4a280b2880 0x7f4a280b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.850+0000 7f4a58341b80 1 -- start start 2024-05-14T12:39:29.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.850+0000 7f4a3b400700 1 -- 172.21.15.47:0/1155538925 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4a340e2420 con 0x7f4a4410a990 2024-05-14T12:39:29.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.850+0000 7f4a43400700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4a280b2880 0x7f4a280b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.850+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce46fd0 0x56479cfc4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfd12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a58341b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56479cee6bb0 con 0x56479cfc4690 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a58341b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56479ce848f0 con 0x56479ce46fd0 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a58341b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56479cee2b70 con 0x56479cfc4aa0 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce46fd0 0x56479cfc4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce46fd0 0x56479cfc4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56578/0 (socket says 172.21.15.47:56578) 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 -- 172.21.15.47:0/308436706 learned_addr learned my addr 172.21.15.47:0/308436706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42000700 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 -- 172.21.15.47:0/308436706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 msgr2=0x56479cfd12a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfd12a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 -- 172.21.15.47:0/308436706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 msgr2=0x56479cfced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a42a00700 1 -- 172.21.15.47:0/308436706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479ce33a60 con 0x56479ce46fd0 2024-05-14T12:39:29.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.851+0000 7f4a43400700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4a280b2880 0x7f4a280b4d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009900 tx=0x7f4a3c009ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.852+0000 7f4a42a00700 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce46fd0 0x56479cfc4150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009230 tx=0x7f4a340a98a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e332b8d121401a99 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.852+0000 7f4a2fe00700 1 -- 172.21.15.47:0/308436706 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b21b0 con 0x56479ce46fd0 2024-05-14T12:39:29.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.852+0000 7f4a2fe00700 1 -- 172.21.15.47:0/308436706 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a340bee50 con 0x56479ce46fd0 2024-05-14T12:39:29.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.852+0000 7f4a2fe00700 1 -- 172.21.15.47:0/308436706 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b2860 con 0x56479ce46fd0 2024-05-14T12:39:29.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 -- 172.21.15.47:0/308436706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce46fd0 msgr2=0x56479cfc4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:29.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce46fd0 0x56479cfc4150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009230 tx=0x7f4a340a98a0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 -- 172.21.15.47:0/308436706 shutdown_connections 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfd12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce46fd0 0x56479cfc4150 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 --2- 172.21.15.47:0/308436706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 -- 172.21.15.47:0/308436706 >> 172.21.15.47:0/308436706 conn(0x56479ce85c10 msgr2=0x56479cfbffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 -- 172.21.15.47:0/308436706 shutdown_connections 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 -- 172.21.15.47:0/308436706 wait complete. 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.853+0000 7f4a58341b80 1 -- start start 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 1 Processor -- start 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce46fd0 0x56479cfce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479cfcee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfcf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56479cfd1bb0 con 0x56479ce46fd0 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56479ce4ccb0 con 0x56479cfc4690 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56479cfd1d30 con 0x56479cfc4aa0 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.854+0000 7f4a58341b80 10 client.0 _ll_register_callbacks cb 0x56479ce7a510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479cfcee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479cfcee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:56584/0 (socket says 172.21.15.47:56584) 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 -- 172.21.15.47:0/2661510066 learned_addr learned my addr 172.21.15.47:0/2661510066 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a43400700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfcf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce46fd0 0x56479cfce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 -- 172.21.15.47:0/2661510066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 msgr2=0x56479cfcf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfcf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 -- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce46fd0 msgr2=0x56479cfce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce46fd0 0x56479cfce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 -- 172.21.15.47:0/2661510066 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479ceac5b0 con 0x56479cfc4690 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a43400700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfcf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce46fd0 0x56479cfce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a42000700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479cfcee60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a30012700 tx=0x7f4a30012ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe178e7980d1403 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.855+0000 7f4a2cc00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2661510066 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30004050 con 0x56479cfc4690 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2661510066 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4a300041f0 con 0x56479cfc4690 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a340bee50 con 0x56479cfc4690 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2661510066 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4a300043f0 con 0x56479cfc4690 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a58341b80 10 client.26198 fetch_fsmap learned FSMap version 50 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56479cfdc990 con 0x56479cfc4690 2024-05-14T12:39:29.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2661510066 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a340bee50 con 0x56479cfc4690 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2661510066 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 50) ==== 8398+0+0 (secure 0 0 0) 0x7f4a3000f740 con 0x56479cfc4690 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.856+0000 7f4a58341b80 10 client.26198 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a58341b80 10 client.26198 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a58341b80 20 client.26198 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfdefd0 0x56479cfe13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a58341b80 4 client.26198 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56479cf91200 con 0x56479cfdefd0 2024-05-14T12:39:29.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfdefd0 0x56479cfe13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:29.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfdefd0 0x56479cfe13f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7305bbf12f1017d server_cookie=f09d1d7cf3854614 in_seq=0 out_seq=0 2024-05-14T12:39:29.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:29.857+0000 7f4a2cc00700 10 client.26198 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:29 smithi047 ceph-mon[31254]: pgmap v879: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:39:30.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:29 smithi073 ceph-mon[35809]: pgmap v879: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:39:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:29 smithi066 ceph-mon[35981]: pgmap v879: 97 pgs: 97 active+clean; 8.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:39:31.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:31 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:31.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:31 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:31.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:31 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:32 smithi066 ceph-mon[35981]: pgmap v880: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 19 op/s 2024-05-14T12:39:32.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:32 smithi047 ceph-mon[31254]: pgmap v880: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 19 op/s 2024-05-14T12:39:32.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:32 smithi073 ceph-mon[35809]: pgmap v880: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 19 op/s 2024-05-14T12:39:34.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:34 smithi066 ceph-mon[35981]: pgmap v881: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-14T12:39:34.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:34 smithi047 ceph-mon[31254]: pgmap v881: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-14T12:39:34.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:34 smithi073 ceph-mon[35809]: pgmap v881: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-14T12:39:35.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:35 smithi066 ceph-mon[35981]: pgmap v882: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.1 KiB/s wr, 17 op/s 2024-05-14T12:39:35.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:35 smithi047 ceph-mon[31254]: pgmap v882: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.1 KiB/s wr, 17 op/s 2024-05-14T12:39:35.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:35 smithi073 ceph-mon[35809]: pgmap v882: 97 pgs: 97 active+clean; 8.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.1 KiB/s wr, 17 op/s 2024-05-14T12:39:38.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:37 smithi047 ceph-mon[31254]: pgmap v883: 97 pgs: 97 active+clean; 8.4 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-05-14T12:39:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:37 smithi073 ceph-mon[35809]: pgmap v883: 97 pgs: 97 active+clean; 8.4 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-05-14T12:39:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:37 smithi066 ceph-mon[35981]: pgmap v883: 97 pgs: 97 active+clean; 8.4 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-05-14T12:39:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.074+0000 7f18f1600640 1 -- 172.21.15.47:0/3022328768 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d038b9bfd0 con 0x55d0388221c0 2024-05-14T12:39:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.074+0000 7f18f1600640 10 client.26215 handle_command_reply: tid=0 2024-05-14T12:39:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.074+0000 7f19117bf740 1 client.26215 shutdown 2024-05-14T12:39:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 msgr2=0x55d038c482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c482f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18f40d3750 tx=0x7f18f40095c0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 shutdown_connections 2024-05-14T12:39:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55d0388221c0 0x55d038cba490 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d03888e1b0 0x55d038cb65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d03886d4d0 0x55d038c48830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 --2- 172.21.15.47:0/3022328768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d0388652f0 0x55d038c482f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 >> 172.21.15.47:0/3022328768 conn(0x55d038882300 msgr2=0x55d038c34240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.075+0000 7f18f1600640 0 client.26215 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.076+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 shutdown_connections 2024-05-14T12:39:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.076+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2661510066 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56479cf91200 con 0x56479cfdefd0 2024-05-14T12:39:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.076+0000 7f4a2cc00700 10 client.26198 handle_command_reply: tid=0 2024-05-14T12:39:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.076+0000 7f19117bf740 1 -- 172.21.15.47:0/3022328768 wait complete. 2024-05-14T12:39:40.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.076+0000 7f4a58341b80 1 client.26198 shutdown 2024-05-14T12:39:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f19117bf740 20 client.26215 trim_cache size 0 max 16384 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 msgr2=0x56479cfcee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479cfcee60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a30012700 tx=0x7f4a30012ac0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 shutdown_connections 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfdefd0 0x56479cfe13f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479cfc4aa0 0x56479cfcf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce46fd0 0x56479cfce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2661510066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479cfcee60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a2cc00700 0 client.26198 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:40.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 >> 172.21.15.47:0/2661510066 conn(0x56479ce85c10 msgr2=0x56479cfbf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:40.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 shutdown_connections 2024-05-14T12:39:40.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.077+0000 7f4a58341b80 1 -- 172.21.15.47:0/2661510066 wait complete. 2024-05-14T12:39:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:39:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:39:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:39:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:39:40.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.078+0000 7f4a58341b80 20 client.26198 trim_cache size 0 max 16384 2024-05-14T12:39:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18e80b27b0 msgr2=0x7f18e80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18e80b27b0 0x7f18e80b4cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55d038c314d0 tx=0x7f18fc005f90 comp rx=0 tx=0).stop 2024-05-14T12:39:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904104560 msgr2=0x7f190419c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904104560 0x7f190419c400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f18f402ade0 tx=0x7f18f40317c0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 shutdown_connections 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f18e80b27b0 0x7f18e80b4cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1904109820 0x7f19041a38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1904106ec0 0x7f190419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 --2- 172.21.15.47:0/765414163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1904104560 0x7f190419c400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 >> 172.21.15.47:0/765414163 conn(0x7f19040fdb60 msgr2=0x7f1904101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 shutdown_connections 2024-05-14T12:39:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:40.079+0000 7f1909200640 1 -- 172.21.15.47:0/765414163 wait complete. 2024-05-14T12:39:40.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.102+0000 7f4a58341b80 1 Processor -- start 2024-05-14T12:39:40.151 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:39 smithi047 ceph-mon[31254]: pgmap v884: 97 pgs: 97 active+clean; 8.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.9 KiB/s wr, 19 op/s 2024-05-14T12:39:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.102+0000 7f4a58341b80 1 -- start start 2024-05-14T12:39:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce85c10 0x56479cfca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfcef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfe6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a58341b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441b5380 con 0x56479cfc4690 2024-05-14T12:39:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a58341b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441b70a0 con 0x56479ce85c10 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a58341b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441b5a80 con 0x56479ce46fd0 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce85c10 0x56479cfca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a42000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfcef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce85c10 0x56479cfca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:39852/0 (socket says 172.21.15.47:39852) 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a42a00700 1 -- 172.21.15.47:0/2170884235 learned_addr learned my addr 172.21.15.47:0/2170884235 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.103+0000 7f4a42000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfcef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45394/0 (socket says 172.21.15.47:45394) 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.104+0000 7f4a43400700 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfe6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.104+0000 7f4a42a00700 1 -- 172.21.15.47:0/2170884235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 msgr2=0x56479cfcef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.104+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfcef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.104+0000 7f4a42a00700 1 -- 172.21.15.47:0/2170884235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 msgr2=0x56479cfe6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.104+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfe6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.104+0000 7f4a42a00700 1 -- 172.21.15.47:0/2170884235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479cfcce90 con 0x56479ce85c10 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.105+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce85c10 0x56479cfca1b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a340a5a80 tx=0x7f4a340a98a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4beda1ae0c6e1ac7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.105+0000 7f4a2f400700 1 -- 172.21.15.47:0/2170884235 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b2860 con 0x56479ce85c10 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.105+0000 7f4a2f400700 1 -- 172.21.15.47:0/2170884235 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a340bee50 con 0x56479ce85c10 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.105+0000 7f4a2f400700 1 -- 172.21.15.47:0/2170884235 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34016330 con 0x56479ce85c10 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.106+0000 7f4a58341b80 1 -- 172.21.15.47:0/2170884235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce85c10 msgr2=0x56479cfca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.106+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce85c10 0x56479cfca1b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a340a5a80 tx=0x7f4a340a98a0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.107+0000 7f4a58341b80 1 -- 172.21.15.47:0/2170884235 shutdown_connections 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.107+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479cfc4690 0x56479cfe6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.107+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479ce85c10 0x56479cfca1b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.107+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2170884235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfcef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.107+0000 7f4a58341b80 1 -- 172.21.15.47:0/2170884235 >> 172.21.15.47:0/2170884235 conn(0x56479cfb91e0 msgr2=0x56479cfc6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.107+0000 7f4a58341b80 1 -- 172.21.15.47:0/2170884235 shutdown_connections 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.107+0000 7f4a58341b80 1 -- 172.21.15.47:0/2170884235 wait complete. 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.108+0000 7f4a58341b80 1 -- start start 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.109+0000 7f4a58341b80 1 Processor -- start 2024-05-14T12:39:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.109+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfd3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.109+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce85c10 0x56479cfd3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.109+0000 7f4a58341b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479d041710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.109+0000 7f4a58341b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441b6910 con 0x56479ce85c10 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.109+0000 7f4a58341b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441b6180 con 0x56479cfc4690 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.109+0000 7f4a58341b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441b3300 con 0x56479ce46fd0 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a58341b80 10 client.0 _ll_register_callbacks cb 0x56479ce7a510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfd3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfd3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:45410/0 (socket says 172.21.15.47:45410) 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 -- 172.21.15.47:0/2843445702 learned_addr learned my addr 172.21.15.47:0/2843445702 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a43400700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479d041710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42000700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce85c10 0x56479cfd3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 -- 172.21.15.47:0/2843445702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 msgr2=0x56479d041710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479d041710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 -- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce85c10 msgr2=0x56479cfd3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce85c10 0x56479cfd3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a42a00700 1 -- 172.21.15.47:0/2843445702 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479d041db0 con 0x56479ce46fd0 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.110+0000 7f4a43400700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479d041710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a42a00700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfd3710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a340a94c0 tx=0x7f4a340dff60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8163dc9380c010c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a2cc00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2843445702 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340aa100 con 0x56479ce46fd0 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a340bee50 con 0x56479ce46fd0 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2843445702 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4a340a5ff0 con 0x56479ce46fd0 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2843445702 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4a340b2860 con 0x56479ce46fd0 2024-05-14T12:39:40.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a58341b80 10 client.26230 fetch_fsmap learned FSMap version 51 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.111+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56479d04a150 con 0x56479ce46fd0 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2843445702 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a340bee50 con 0x56479ce46fd0 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2843445702 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 51) ==== 8386+0+0 (secure 0 0 0) 0x7f4a340c5070 con 0x56479ce46fd0 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a58341b80 10 client.26230 fetch_fsmap finished waiting for FSMap version 51 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a58341b80 10 client.26230 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a58341b80 20 client.26230 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfc4aa0 0x56479d04c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a58341b80 4 client.26230 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.95, "await_for": 42.0}] 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.112+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.95, "await_for": 42.0}) -- 0x56479cef4590 con 0x56479cfc4aa0 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.113+0000 7f4a42000700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfc4aa0 0x56479d04c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.113+0000 7f4a42000700 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfc4aa0 0x56479d04c280 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab982fb17a685b03 server_cookie=656d23072a7a654e in_seq=0 out_seq=0 2024-05-14T12:39:40.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:40.113+0000 7f4a2cc00700 10 client.26230 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:40.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:39 smithi073 ceph-mon[35809]: pgmap v884: 97 pgs: 97 active+clean; 8.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.9 KiB/s wr, 19 op/s 2024-05-14T12:39:40.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:39 smithi066 ceph-mon[35981]: pgmap v884: 97 pgs: 97 active+clean; 8.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.9 KiB/s wr, 19 op/s 2024-05-14T12:39:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:41 smithi047 ceph-mon[31254]: pgmap v885: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 20 op/s 2024-05-14T12:39:42.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:41 smithi073 ceph-mon[35809]: pgmap v885: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 20 op/s 2024-05-14T12:39:42.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:41 smithi066 ceph-mon[35981]: pgmap v885: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 20 op/s 2024-05-14T12:39:42.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.853+0000 7f4a2cc00700 1 -- 172.21.15.47:0/2843445702 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56479cef4590 con 0x56479cfc4aa0 2024-05-14T12:39:42.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.853+0000 7f4a2cc00700 10 client.26230 handle_command_reply: tid=0 2024-05-14T12:39:42.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.853+0000 7f4a58341b80 1 client.26230 shutdown 2024-05-14T12:39:42.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 msgr2=0x56479cfd3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:42.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfd3710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a340a94c0 tx=0x7f4a340dff60 comp rx=0 tx=0).stop 2024-05-14T12:39:42.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 shutdown_connections 2024-05-14T12:39:42.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56479cfc4aa0 0x56479d04c280 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56479cfc4690 0x56479d041710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56479ce46fd0 0x56479cfd3710 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 --2- 172.21.15.47:0/2843445702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56479ce85c10 0x56479cfd3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.854+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 >> 172.21.15.47:0/2843445702 conn(0x56479cfb91e0 msgr2=0x56479cfc6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.855+0000 7f4a2cc00700 0 client.26230 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.855+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 shutdown_connections 2024-05-14T12:39:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.855+0000 7f4a58341b80 1 -- 172.21.15.47:0/2843445702 wait complete. 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.855+0000 7f4a58341b80 20 client.26230 trim_cache size 0 max 16384 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 51, 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 30, 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "19159e7f": { 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 30, 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:39:42.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 79.0, 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCED", 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:39:42.857 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:39:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4a280b2880 msgr2=0x7f4a280b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4a280b2880 0x7f4a280b4d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009900 tx=0x7f4a3c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 msgr2=0x7f4a441a13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 0x7f4a441a13f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400e970 tx=0x7f4a3400ec80 comp rx=0 tx=0).stop 2024-05-14T12:39:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 shutdown_connections 2024-05-14T12:39:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f4a280b2880 0x7f4a280b4d90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a44110970 0x7f4a441a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a4410a990 0x7f4a441a13f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 --2- 172.21.15.47:0/1155538925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a4410b2e0 0x7f4a441a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 >> 172.21.15.47:0/1155538925 conn(0x7f4a44077c80 msgr2=0x7f4a4407b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 shutdown_connections 2024-05-14T12:39:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:39:42.857+0000 7f4a49800700 1 -- 172.21.15.47:0/1155538925 wait complete. 2024-05-14T12:39:43.682 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '19159e7f', quiesce took 20.6 seconds. Will release after: 18.95 2024-05-14T12:39:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:43 smithi047 ceph-mon[31254]: pgmap v886: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-05-14T12:39:43.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:43 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:44.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:43 smithi073 ceph-mon[35809]: pgmap v886: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-05-14T12:39:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:43 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:43 smithi066 ceph-mon[35981]: pgmap v886: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-05-14T12:39:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:43 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:45 smithi047 ceph-mon[31254]: pgmap v887: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.1 KiB/s wr, 18 op/s 2024-05-14T12:39:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:45 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:46.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:45 smithi073 ceph-mon[35809]: pgmap v887: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.1 KiB/s wr, 18 op/s 2024-05-14T12:39:46.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:45 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:45 smithi066 ceph-mon[35981]: pgmap v887: 97 pgs: 97 active+clean; 8.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.1 KiB/s wr, 18 op/s 2024-05-14T12:39:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:45 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:47 smithi047 ceph-mon[31254]: pgmap v888: 97 pgs: 97 active+clean; 8.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.1 KiB/s wr, 22 op/s 2024-05-14T12:39:48.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:47 smithi073 ceph-mon[35809]: pgmap v888: 97 pgs: 97 active+clean; 8.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.1 KiB/s wr, 22 op/s 2024-05-14T12:39:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:47 smithi066 ceph-mon[35981]: pgmap v888: 97 pgs: 97 active+clean; 8.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.1 KiB/s wr, 22 op/s 2024-05-14T12:39:50.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:49 smithi047 ceph-mon[31254]: pgmap v889: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:39:50.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:49 smithi073 ceph-mon[35809]: pgmap v889: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:39:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:49 smithi066 ceph-mon[35981]: pgmap v889: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 17 op/s 2024-05-14T12:39:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:51 smithi047 ceph-mon[31254]: pgmap v890: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 18 op/s 2024-05-14T12:39:52.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:51 smithi073 ceph-mon[35809]: pgmap v890: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 18 op/s 2024-05-14T12:39:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:51 smithi066 ceph-mon[35981]: pgmap v890: 97 pgs: 97 active+clean; 7.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 18 op/s 2024-05-14T12:39:53.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:52 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:39:53.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:52 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:39:53.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:52 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:39:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.336+0000 7f0c65800640 1 -- 172.21.15.47:0/1959890036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60103a80 msgr2=0x7f0c60104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.336+0000 7f0c65800640 1 --2- 172.21.15.47:0/1959890036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60103a80 0x7f0c60104780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009ca0 tx=0x7f0c5002a8c0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.336+0000 7f0c65800640 1 -- 172.21.15.47:0/1959890036 shutdown_connections 2024-05-14T12:39:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.336+0000 7f0c65800640 1 --2- 172.21.15.47:0/1959890036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c601099c0 0x7f0c6010bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.336+0000 7f0c65800640 1 --2- 172.21.15.47:0/1959890036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c60104cc0 0x7f0c601050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.336+0000 7f0c65800640 1 --2- 172.21.15.47:0/1959890036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60103a80 0x7f0c60104780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.336+0000 7f0c65800640 1 -- 172.21.15.47:0/1959890036 >> 172.21.15.47:0/1959890036 conn(0x7f0c600fec70 msgr2=0x7f0c60101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.337+0000 7f0c65800640 1 -- 172.21.15.47:0/1959890036 shutdown_connections 2024-05-14T12:39:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.337+0000 7f0c65800640 1 -- 172.21.15.47:0/1959890036 wait complete. 2024-05-14T12:39:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 Processor -- start 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 -- start start 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c60103a80 0x7f0c6019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60104cc0 0x7f0c6019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c601099c0 0x7f0c601a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6010f650 con 0x7f0c60103a80 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6010f4d0 con 0x7f0c60104cc0 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.338+0000 7f0c65800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6010f7d0 con 0x7f0c601099c0 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c60103a80 0x7f0c6019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60104cc0 0x7f0c6019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60104cc0 0x7f0c6019c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:47252/0 (socket says 172.21.15.47:47252) 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c60103a80 0x7f0c6019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48534/0 (socket says 172.21.15.47:48534) 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 -- 172.21.15.47:0/2878892238 learned_addr learned my addr 172.21.15.47:0/2878892238 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c64e00640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c601099c0 0x7f0c601a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 -- 172.21.15.47:0/2878892238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c601099c0 msgr2=0x7f0c601a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c601099c0 0x7f0c601a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 -- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c60103a80 msgr2=0x7f0c6019c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c60103a80 0x7f0c6019c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.339+0000 7f0c5f400640 1 -- 172.21.15.47:0/2878892238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c601a3f00 con 0x7f0c60104cc0 2024-05-14T12:39:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.340+0000 7f0c5f400640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60104cc0 0x7f0c6019c900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e9f0 tx=0x7f0c4800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.340+0000 7f0c5cc00640 1 -- 172.21.15.47:0/2878892238 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800cd80 con 0x7f0c60104cc0 2024-05-14T12:39:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.340+0000 7f0c5cc00640 1 -- 172.21.15.47:0/2878892238 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c480108e0 con 0x7f0c60104cc0 2024-05-14T12:39:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.340+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c601a41f0 con 0x7f0c60104cc0 2024-05-14T12:39:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.340+0000 7f0c5cc00640 1 -- 172.21.15.47:0/2878892238 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48018980 con 0x7f0c60104cc0 2024-05-14T12:39:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.340+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c601a4790 con 0x7f0c60104cc0 2024-05-14T12:39:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 Processor -- start 2024-05-14T12:39:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 -- start start 2024-05-14T12:39:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c5cc00640 1 -- 172.21.15.47:0/2878892238 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0c48010430 con 0x7f0c60104cc0 2024-05-14T12:39:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a8d1b0 0x563027e2f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a642f0 0x563027e2f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a6c4d0 0x563027e36780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563027d93550 con 0x563027a642f0 2024-05-14T12:39:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563027d38bc0 con 0x563027a6c4d0 2024-05-14T12:39:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563027d8f510 con 0x563027a8d1b0 2024-05-14T12:39:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c64e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a8d1b0 0x563027e2f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a6c4d0 0x563027e36780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a642f0 0x563027e2f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a6c4d0 0x563027e36780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:47262/0 (socket says 172.21.15.47:47262) 2024-05-14T12:39:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c5f400640 1 -- 172.21.15.47:0/609661210 learned_addr learned my addr 172.21.15.47:0/609661210 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.344+0000 7f0c64e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a8d1b0 0x563027e2f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52388/0 (socket says 172.21.15.47:52388) 2024-05-14T12:39:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c64e00640 1 -- 172.21.15.47:0/609661210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a6c4d0 msgr2=0x563027e36780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c64e00640 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a6c4d0 0x563027e36780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c64e00640 1 -- 172.21.15.47:0/609661210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a642f0 msgr2=0x563027e2f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c64e00640 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a642f0 0x563027e2f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c64e00640 1 -- 172.21.15.47:0/609661210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563027aa5210 con 0x563027a8d1b0 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c5f400640 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a6c4d0 0x563027e36780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.345+0000 7f0c64e00640 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a8d1b0 0x563027e2f300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009b80 tx=0x7f0c58011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf93ca0a211eea4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.346+0000 7f0c55600640 1 -- 172.21.15.47:0/609661210 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004030 con 0x563027a8d1b0 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.346+0000 7f0c55600640 1 -- 172.21.15.47:0/609661210 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c58005020 con 0x563027a8d1b0 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.346+0000 7f0c55600640 1 -- 172.21.15.47:0/609661210 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004c60 con 0x563027a8d1b0 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.346+0000 7f0c5cc00640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0c440b2920 0x7f0c440b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.346+0000 7f0c5cc00640 1 -- 172.21.15.47:0/2878892238 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0c480e2510 con 0x7f0c60104cc0 2024-05-14T12:39:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.346+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0c440b2920 0x7f0c440b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/609661210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a8d1b0 msgr2=0x563027e2f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a8d1b0 0x563027e2f300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009b80 tx=0x7f0c58011810 comp rx=0 tx=0).stop 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/609661210 shutdown_connections 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a6c4d0 0x563027e36780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a642f0 0x563027e2f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/609661210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a8d1b0 0x563027e2f300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/609661210 >> 172.21.15.47:0/609661210 conn(0x563027a81300 msgr2=0x563027e2ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/609661210 shutdown_connections 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/609661210 wait complete. 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.347+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0c440b2920 0x7f0c440b4e30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000f80 tx=0x7f0c50005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.348+0000 7f0c6ddf1740 1 -- start start 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.348+0000 7f0c6ddf1740 1 Processor -- start 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e38df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e39330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027e40290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563027e371d0 con 0x563027a8d1b0 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563027d4c660 con 0x563027a642f0 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563027e37350 con 0x563027a6c4d0 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c6ddf1740 10 client.0 _ll_register_callbacks cb 0x563027d16400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e39330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e39330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52398/0 (socket says 172.21.15.47:52398) 2024-05-14T12:39:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 -- 172.21.15.47:0/978845804 learned_addr learned my addr 172.21.15.47:0/978845804 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e38df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c64e00640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027e40290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 -- 172.21.15.47:0/978845804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 msgr2=0x563027e38df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e38df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 -- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 msgr2=0x563027e40290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027e40290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5f400640 1 -- 172.21.15.47:0/978845804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563027b71620 con 0x563027a6c4d0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.349+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e38df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c5f400640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e39330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0c480a6e10 tx=0x7f0c4800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae773f74f3f3f6f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c4e000640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c4e000640 1 -- 172.21.15.47:0/978845804 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480a5330 con 0x563027a6c4d0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c58005020 con 0x563027a6c4d0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c4e000640 1 -- 172.21.15.47:0/978845804 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0c480e20d0 con 0x563027a6c4d0 2024-05-14T12:39:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c4e000640 1 -- 172.21.15.47:0/978845804 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0c48010720 con 0x563027a6c4d0 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c6ddf1740 10 client.26242 fetch_fsmap learned FSMap version 53 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563027e43280 con 0x563027a6c4d0 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.350+0000 7f0c4e000640 1 -- 172.21.15.47:0/978845804 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c58005020 con 0x563027a6c4d0 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c4e000640 1 -- 172.21.15.47:0/978845804 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) ==== 8386+0+0 (secure 0 0 0) 0x7f0c48018b20 con 0x563027a6c4d0 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c6ddf1740 10 client.26242 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c6ddf1740 10 client.26242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c6ddf1740 20 client.26242 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a4bd80 0x563027e469f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c6ddf1740 4 client.26242 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563027da1160 con 0x563027a4bd80 2024-05-14T12:39:53.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.351+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a4bd80 0x563027e469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.352+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a4bd80 0x563027e469f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2a0b6a9dff19627 server_cookie=b57afa4e63a54d89 in_seq=0 out_seq=0 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.352+0000 7f0c4e000640 10 client.26242 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c4e000640 1 -- 172.21.15.47:0/978845804 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563027da1160 con 0x563027a4bd80 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c4e000640 10 client.26242 handle_command_reply: tid=0 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 client.26242 shutdown 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 msgr2=0x563027e39330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e39330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0c480a6e10 tx=0x7f0c4800cf20 comp rx=0 tx=0).stop 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 shutdown_connections 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a4bd80 0x563027e469f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027e40290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e39330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/978845804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e38df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 >> 172.21.15.47:0/978845804 conn(0x563027a81300 msgr2=0x563027e29c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.353+0000 7f0c4e000640 0 client.26242 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.354+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 shutdown_connections 2024-05-14T12:39:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.354+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/978845804 wait complete. 2024-05-14T12:39:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.354+0000 7f0c6ddf1740 20 client.26242 trim_cache size 0 max 16384 2024-05-14T12:39:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.385+0000 7f0c6ddf1740 1 Processor -- start 2024-05-14T12:39:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.385+0000 7f0c6ddf1740 1 -- start start 2024-05-14T12:39:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a642f0 0x563027e2e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a6c4d0 0x563027e2e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a8d1b0 0x563027e401b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ad3a0 con 0x563027a6c4d0 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601af060 con 0x563027a8d1b0 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601adad0 con 0x563027a642f0 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a642f0 0x563027e2e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a642f0 0x563027e2e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52402/0 (socket says 172.21.15.47:52402) 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 -- 172.21.15.47:0/2765544814 learned_addr learned my addr 172.21.15.47:0/2765544814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c64e00640 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a8d1b0 0x563027e401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5f400640 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a6c4d0 0x563027e2e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 -- 172.21.15.47:0/2765544814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a8d1b0 msgr2=0x563027e401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a8d1b0 0x563027e401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 -- 172.21.15.47:0/2765544814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a6c4d0 msgr2=0x563027e2e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a6c4d0 0x563027e2e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5fe00640 1 -- 172.21.15.47:0/2765544814 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563027e264a0 con 0x563027a642f0 2024-05-14T12:39:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.386+0000 7f0c5f400640 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a6c4d0 0x563027e2e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:39:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.387+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a642f0 0x563027e2e1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005e30 tx=0x7f0c50041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85d52494c18d42c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.387+0000 7f0c54c00640 1 -- 172.21.15.47:0/2765544814 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50055470 con 0x563027a642f0 2024-05-14T12:39:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.387+0000 7f0c54c00640 1 -- 172.21.15.47:0/2765544814 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c5005b070 con 0x563027a642f0 2024-05-14T12:39:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.387+0000 7f0c54c00640 1 -- 172.21.15.47:0/2765544814 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c500305c0 con 0x563027a642f0 2024-05-14T12:39:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.388+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/2765544814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a642f0 msgr2=0x563027e2e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:39:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.388+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a642f0 0x563027e2e1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005e30 tx=0x7f0c50041000 comp rx=0 tx=0).stop 2024-05-14T12:39:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.388+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/2765544814 shutdown_connections 2024-05-14T12:39:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.388+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a8d1b0 0x563027e401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.388+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a6c4d0 0x563027e2e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.388+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/2765544814 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a642f0 0x563027e2e1a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.388+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/2765544814 >> 172.21.15.47:0/2765544814 conn(0x563027a81300 msgr2=0x563027e2da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:39:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.389+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/2765544814 shutdown_connections 2024-05-14T12:39:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.389+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/2765544814 wait complete. 2024-05-14T12:39:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.389+0000 7f0c6ddf1740 1 -- start start 2024-05-14T12:39:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.389+0000 7f0c6ddf1740 1 Processor -- start 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e3d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e3dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c6ddf1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027eacd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ae8d0 con 0x563027a8d1b0 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ae1d0 con 0x563027a642f0 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c6ddf1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ab360 con 0x563027a6c4d0 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c6ddf1740 10 client.0 _ll_register_callbacks cb 0x7f0c480e5c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.390+0000 7f0c64e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027eacd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e3d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c64e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027eacd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48564/0 (socket says 172.21.15.47:48564) 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e3dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c64e00640 1 -- 172.21.15.47:0/4161900582 learned_addr learned my addr 172.21.15.47:0/4161900582 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5f400640 1 -- 172.21.15.47:0/4161900582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 msgr2=0x563027e3d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5f400640 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e3d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5f400640 1 -- 172.21.15.47:0/4161900582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 msgr2=0x563027eacd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5f400640 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027eacd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5f400640 1 -- 172.21.15.47:0/4161900582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563027e3e420 con 0x563027a6c4d0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e3d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c5f400640 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e3dde0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c480a6140 tx=0x7f0c48009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e27267077fce5915 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c4e000640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c4e000640 1 -- 172.21.15.47:0/4161900582 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480a5330 con 0x563027a6c4d0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.391+0000 7f0c4e000640 1 -- 172.21.15.47:0/4161900582 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0c480a6190 con 0x563027a6c4d0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c5005b070 con 0x563027a6c4d0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c4e000640 1 -- 172.21.15.47:0/4161900582 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0c480a96b0 con 0x563027a6c4d0 2024-05-14T12:39:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c6ddf1740 10 client.26248 fetch_fsmap learned FSMap version 53 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563027eae3d0 con 0x563027a6c4d0 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c4e000640 1 -- 172.21.15.47:0/4161900582 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c5005b070 con 0x563027a6c4d0 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c4e000640 1 -- 172.21.15.47:0/4161900582 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) ==== 8386+0+0 (secure 0 0 0) 0x7f0c480a8870 con 0x563027a6c4d0 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c6ddf1740 10 client.26248 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c6ddf1740 10 client.26248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.392+0000 7f0c6ddf1740 20 client.26248 populate_metadata read hostname 'smithi047' 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.393+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a211c0 0x563027eb0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.393+0000 7f0c6ddf1740 4 client.26248 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:39:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.393+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563027d9afd0 con 0x563027a211c0 2024-05-14T12:39:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.393+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a211c0 0x563027eb0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:39:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.393+0000 7f0c4e000640 10 client.26248 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:39:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:39:53.393+0000 7f0c5fe00640 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a211c0 0x563027eb0e80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4362680cd5dea55 server_cookie=5de69a3025939ca in_seq=0 out_seq=0 2024-05-14T12:39:54.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: pgmap v891: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 19 op/s 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:39:54.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:39:54.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: pgmap v891: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 19 op/s 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:39:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:39:54.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: pgmap v891: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 19 op/s 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:39:54.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:39:54.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:39:54.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:39:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:54 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi066 to 176.2M 2024-05-14T12:39:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:54 smithi047 ceph-mon[31254]: Unable to set osd_memory_target on smithi066 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-05-14T12:39:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:54 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi047 to 177.5M 2024-05-14T12:39:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:54 smithi047 ceph-mon[31254]: Unable to set osd_memory_target on smithi047 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-14T12:39:55.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:54 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi066 to 176.2M 2024-05-14T12:39:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:54 smithi073 ceph-mon[35809]: Unable to set osd_memory_target on smithi066 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-05-14T12:39:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:54 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi047 to 177.5M 2024-05-14T12:39:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:54 smithi073 ceph-mon[35809]: Unable to set osd_memory_target on smithi047 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-14T12:39:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:54 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi066 to 176.2M 2024-05-14T12:39:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:54 smithi066 ceph-mon[35981]: Unable to set osd_memory_target on smithi066 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-05-14T12:39:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:54 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi047 to 177.5M 2024-05-14T12:39:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:54 smithi066 ceph-mon[35981]: Unable to set osd_memory_target on smithi047 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-14T12:39:56.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:55 smithi047 ceph-mon[31254]: pgmap v892: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 15 op/s 2024-05-14T12:39:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:55 smithi073 ceph-mon[35809]: pgmap v892: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 15 op/s 2024-05-14T12:39:56.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:55 smithi066 ceph-mon[35981]: pgmap v892: 97 pgs: 97 active+clean; 7.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 852 B/s wr, 15 op/s 2024-05-14T12:39:58.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:57 smithi047 ceph-mon[31254]: pgmap v893: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.6 KiB/s wr, 19 op/s 2024-05-14T12:39:58.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:57 smithi073 ceph-mon[35809]: pgmap v893: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.6 KiB/s wr, 19 op/s 2024-05-14T12:39:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:57 smithi066 ceph-mon[35981]: pgmap v893: 97 pgs: 97 active+clean; 7.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.6 KiB/s wr, 19 op/s 2024-05-14T12:39:59.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:58 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:59.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:58 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:39:59.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:58 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:39:59 smithi047 ceph-mon[31254]: pgmap v894: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.4 KiB/s wr, 15 op/s 2024-05-14T12:40:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:39:59 smithi073 ceph-mon[35809]: pgmap v894: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.4 KiB/s wr, 15 op/s 2024-05-14T12:40:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:39:59 smithi066 ceph-mon[35981]: pgmap v894: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.4 KiB/s wr, 15 op/s 2024-05-14T12:40:01.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:00 smithi047 ceph-mon[31254]: overall HEALTH_OK 2024-05-14T12:40:01.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:00 smithi073 ceph-mon[35809]: overall HEALTH_OK 2024-05-14T12:40:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:00 smithi066 ceph-mon[35981]: overall HEALTH_OK 2024-05-14T12:40:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:01 smithi047 ceph-mon[31254]: pgmap v895: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.4 KiB/s wr, 17 op/s 2024-05-14T12:40:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:01 smithi073 ceph-mon[35809]: pgmap v895: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.4 KiB/s wr, 17 op/s 2024-05-14T12:40:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:01 smithi066 ceph-mon[35981]: pgmap v895: 97 pgs: 97 active+clean; 7.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.4 KiB/s wr, 17 op/s 2024-05-14T12:40:02.634 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:40:03.122 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:40:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:03 smithi047 ceph-mon[31254]: pgmap v896: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 17 op/s 2024-05-14T12:40:04.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:03 smithi073 ceph-mon[35809]: pgmap v896: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 17 op/s 2024-05-14T12:40:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:03 smithi066 ceph-mon[35981]: pgmap v896: 97 pgs: 97 active+clean; 7.5 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 17 op/s 2024-05-14T12:40:05.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.630+0000 7f2b57e00700 1 -- 172.21.15.47:0/1297121234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 msgr2=0x7f2b5010ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:05.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.630+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1297121234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 0x7f2b5010ada0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009990 tx=0x7f2b44009ca0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.630+0000 7f2b57e00700 1 -- 172.21.15.47:0/1297121234 shutdown_connections 2024-05-14T12:40:05.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.630+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1297121234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b5010b2e0 0x7f2b50117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.631+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1297121234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b50110970 0x7f2b50110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.631+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1297121234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 0x7f2b5010ada0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.631+0000 7f2b57e00700 1 -- 172.21.15.47:0/1297121234 >> 172.21.15.47:0/1297121234 conn(0x7f2b50077c80 msgr2=0x7f2b500780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:05.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.631+0000 7f2b57e00700 1 -- 172.21.15.47:0/1297121234 shutdown_connections 2024-05-14T12:40:05.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.631+0000 7f2b57e00700 1 -- 172.21.15.47:0/1297121234 wait complete. 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.632+0000 7f2b57e00700 1 Processor -- start 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.632+0000 7f2b57e00700 1 -- start start 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b57e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 0x7f2b501a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b57e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b5010b2e0 0x7f2b501a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b57e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b50110970 0x7f2b501a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b57e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5011aa90 con 0x7f2b50110970 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b57e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5011a910 con 0x7f2b5010b2e0 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b57e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5011ac10 con 0x7f2b5010a990 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b5010b2e0 0x7f2b501a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b55400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 0x7f2b501a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:05.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b5010b2e0 0x7f2b501a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:55214/0 (socket says 172.21.15.47:55214) 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 -- 172.21.15.47:0/1306763689 learned_addr learned my addr 172.21.15.47:0/1306763689 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b55e00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b50110970 0x7f2b501a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 -- 172.21.15.47:0/1306763689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 msgr2=0x7f2b501a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 0x7f2b501a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 -- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b50110970 msgr2=0x7f2b501a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b50110970 0x7f2b501a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b54a00700 1 -- 172.21.15.47:0/1306763689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b501a6350 con 0x7f2b5010b2e0 2024-05-14T12:40:05.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.633+0000 7f2b55400700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 0x7f2b501a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:40:05.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.634+0000 7f2b54a00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b5010b2e0 0x7f2b501a1a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b44009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:05.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.634+0000 7f2b4e000700 1 -- 172.21.15.47:0/1306763689 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44026070 con 0x7f2b5010b2e0 2024-05-14T12:40:05.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.634+0000 7f2b4e000700 1 -- 172.21.15.47:0/1306763689 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b44021410 con 0x7f2b5010b2e0 2024-05-14T12:40:05.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.634+0000 7f2b4e000700 1 -- 172.21.15.47:0/1306763689 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44017650 con 0x7f2b5010b2e0 2024-05-14T12:40:05.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.634+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b501a65e0 con 0x7f2b5010b2e0 2024-05-14T12:40:05.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.635+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b501a6a70 con 0x7f2b5010b2e0 2024-05-14T12:40:05.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.636+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b500512c0 con 0x7f2b5010b2e0 2024-05-14T12:40:05.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.638+0000 7f2b4e000700 1 -- 172.21.15.47:0/1306763689 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2b44029070 con 0x7f2b5010b2e0 2024-05-14T12:40:05.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.640+0000 7f2b4e000700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2b380b2900 0x7f2b380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:05.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.640+0000 7f2b4e000700 1 -- 172.21.15.47:0/1306763689 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2b440e3190 con 0x7f2b5010b2e0 2024-05-14T12:40:05.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.640+0000 7f2b55400700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2b380b2900 0x7f2b380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:05.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.641+0000 7f2b55400700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2b380b2900 0x7f2b380b4e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009680 tx=0x7f2b3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:05.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.642+0000 7f2b4e000700 1 -- 172.21.15.47:0/1306763689 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2b44013070 con 0x7f2b5010b2e0 2024-05-14T12:40:05.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.936+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b5002e5f0 con 0x7f2b5010b2e0 2024-05-14T12:40:05.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.937+0000 7f2b4e000700 1 -- 172.21.15.47:0/1306763689 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11929 (secure 0 0 0) 0x7f2b440aaf00 con 0x7f2b5010b2e0 2024-05-14T12:40:05.938 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:40:05.939 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:39:57.059681+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:40:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.940+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2b380b2900 msgr2=0x7f2b380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.940+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2b380b2900 0x7f2b380b4e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009680 tx=0x7f2b3c009260 comp rx=0 tx=0).stop 2024-05-14T12:40:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.940+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b5010b2e0 msgr2=0x7f2b501a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.940+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b5010b2e0 0x7f2b501a1a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b44009510 comp rx=0 tx=0).stop 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 shutdown_connections 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2b380b2900 0x7f2b380b4e10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b50110970 0x7f2b501a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b5010a990 0x7f2b501a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 --2- 172.21.15.47:0/1306763689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b5010b2e0 0x7f2b501a1a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 >> 172.21.15.47:0/1306763689 conn(0x7f2b50077c80 msgr2=0x7f2b5007b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 shutdown_connections 2024-05-14T12:40:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:05.941+0000 7f2b57e00700 1 -- 172.21.15.47:0/1306763689 wait complete. 2024-05-14T12:40:05.942 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 54 2024-05-14T12:40:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:05 smithi047 ceph-mon[31254]: pgmap v897: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2024-05-14T12:40:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:05 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1306763689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:40:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:05 smithi073 ceph-mon[35809]: pgmap v897: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2024-05-14T12:40:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:05 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1306763689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:40:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:05 smithi066 ceph-mon[35981]: pgmap v897: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.5 KiB/s wr, 16 op/s 2024-05-14T12:40:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:05 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1306763689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:40:06.779 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id 19159e7f --release --await' 2024-05-14T12:40:06.780 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id 19159e7f --release --await 2024-05-14T12:40:07.257 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:40:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:07 smithi047 ceph-mon[31254]: pgmap v898: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 21 op/s 2024-05-14T12:40:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:07 smithi073 ceph-mon[35809]: pgmap v898: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 21 op/s 2024-05-14T12:40:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:07 smithi066 ceph-mon[35981]: pgmap v898: 97 pgs: 97 active+clean; 7.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 21 op/s 2024-05-14T12:40:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 -- 172.21.15.47:0/1995931201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678076680 msgr2=0x7fb678110480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 --2- 172.21.15.47:0/1995931201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678076680 0x7fb678110480 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb6640098f0 tx=0x7fb664009c00 comp rx=0 tx=0).stop 2024-05-14T12:40:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 -- 172.21.15.47:0/1995931201 shutdown_connections 2024-05-14T12:40:09.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 --2- 172.21.15.47:0/1995931201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6781109c0 0x7fb678112e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 --2- 172.21.15.47:0/1995931201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb678075d30 0x7fb678076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 --2- 172.21.15.47:0/1995931201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678076680 0x7fb678110480 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 -- 172.21.15.47:0/1995931201 >> 172.21.15.47:0/1995931201 conn(0x7fb678079d50 msgr2=0x7fb67807a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 -- 172.21.15.47:0/1995931201 shutdown_connections 2024-05-14T12:40:09.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.580+0000 7fb67ea00700 1 -- 172.21.15.47:0/1995931201 wait complete. 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 Processor -- start 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 -- start start 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678075d30 0x7fb67819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678076680 0x7fb67819d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6781109c0 0x7fb6781a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb678116510 con 0x7fb6781109c0 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb678116390 con 0x7fb678075d30 2024-05-14T12:40:09.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.582+0000 7fb67ea00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb678116690 con 0x7fb678076680 2024-05-14T12:40:09.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67d600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678075d30 0x7fb67819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678076680 0x7fb67819d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67d600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678075d30 0x7fb67819cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33304/0 (socket says 172.21.15.47:33304) 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678076680 0x7fb67819d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55498/0 (socket says 172.21.15.47:55498) 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67d600700 1 -- 172.21.15.47:0/4078213365 learned_addr learned my addr 172.21.15.47:0/4078213365 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67e000700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6781109c0 0x7fb6781a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 -- 172.21.15.47:0/4078213365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678075d30 msgr2=0x7fb67819cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678075d30 0x7fb67819cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 -- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6781109c0 msgr2=0x7fb6781a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6781109c0 0x7fb6781a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 -- 172.21.15.47:0/4078213365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6781a1dd0 con 0x7fb678076680 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67e000700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6781109c0 0x7fb6781a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.583+0000 7fb67cc00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678076680 0x7fb67819d4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c010 tx=0x7fb66400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:09.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.584+0000 7fb676000700 1 -- 172.21.15.47:0/4078213365 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640051c0 con 0x7fb678076680 2024-05-14T12:40:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.584+0000 7fb676000700 1 -- 172.21.15.47:0/4078213365 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66400b560 con 0x7fb678076680 2024-05-14T12:40:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.584+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6781a2060 con 0x7fb678076680 2024-05-14T12:40:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.584+0000 7fb676000700 1 -- 172.21.15.47:0/4078213365 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640039e0 con 0x7fb678076680 2024-05-14T12:40:09.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.584+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6781a2540 con 0x7fb678076680 2024-05-14T12:40:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.587+0000 7fb676000700 1 -- 172.21.15.47:0/4078213365 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb66400b930 con 0x7fb678076680 2024-05-14T12:40:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.589+0000 7fb68eb1cb80 1 Processor -- start 2024-05-14T12:40:09.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb68eb1cb80 1 -- start start 2024-05-14T12:40:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f4ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f504f0 0x558277f5abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f50900 0x558277f5d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558277e72b20 con 0x558277f50900 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558277e10860 con 0x558277dd2f40 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558277e6eae0 con 0x558277f504f0 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.590+0000 7fb676000700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb6600b2880 0x7fb6600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f504f0 0x558277f5abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb676000700 1 -- 172.21.15.47:0/4078213365 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb6640e30f0 con 0x7fb678076680 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f504f0 0x558277f5abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55510/0 (socket says 172.21.15.47:55510) 2024-05-14T12:40:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 -- 172.21.15.47:0/3025317049 learned_addr learned my addr 172.21.15.47:0/3025317049 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67cc00700 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f50900 0x558277f5d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67e000700 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f4ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67e000700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb6600b2880 0x7fb6600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 -- 172.21.15.47:0/3025317049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 msgr2=0x558277f4ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f4ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 -- 172.21.15.47:0/3025317049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f50900 msgr2=0x558277f5d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f50900 0x558277f5d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67d600700 1 -- 172.21.15.47:0/3025317049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558277dbf9d0 con 0x558277f504f0 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.591+0000 7fb67cc00700 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f50900 0x558277f5d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:40:09.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.592+0000 7fb67d600700 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f504f0 0x558277f5abe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009e30 tx=0x7fb66c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d221492fc61dd16 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.592+0000 7fb66aa00700 1 -- 172.21.15.47:0/3025317049 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c01e070 con 0x558277f504f0 2024-05-14T12:40:09.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.592+0000 7fb67e000700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb6600b2880 0x7fb6600b4d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x558277f4c790 tx=0x7fb67000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.592+0000 7fb66aa00700 1 -- 172.21.15.47:0/3025317049 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c019ae0 con 0x558277f504f0 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.592+0000 7fb66aa00700 1 -- 172.21.15.47:0/3025317049 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c00ec10 con 0x558277f504f0 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/3025317049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f504f0 msgr2=0x558277f5abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f504f0 0x558277f5abe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009e30 tx=0x7fb66c011720 comp rx=0 tx=0).stop 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/3025317049 shutdown_connections 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f50900 0x558277f5d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f4ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/3025317049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f504f0 0x558277f5abe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/3025317049 >> 172.21.15.47:0/3025317049 conn(0x558277e18070 msgr2=0x558277f4be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/3025317049 shutdown_connections 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.593+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/3025317049 wait complete. 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.594+0000 7fb68eb1cb80 1 -- start start 2024-05-14T12:40:09.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.594+0000 7fb68eb1cb80 1 Processor -- start 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277dd2f40 0x558277f5a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f50900 0x558277f5b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558277f5da70 con 0x558277f504f0 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558277dd8c20 con 0x558277f50900 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558277f5dbf0 con 0x558277dd2f40 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb68eb1cb80 10 client.0 _ll_register_callbacks cb 0x558277e19d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:40:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb67cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb67cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60108/0 (socket says 172.21.15.47:60108) 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb67d600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277dd2f40 0x558277f5a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb67cc00700 1 -- 172.21.15.47:0/2663123642 learned_addr learned my addr 172.21.15.47:0/2663123642 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.595+0000 7fb67e000700 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f50900 0x558277f5b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb67d600700 1 -- 172.21.15.47:0/2663123642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f50900 msgr2=0x558277f5b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb67d600700 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f50900 0x558277f5b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb67d600700 1 -- 172.21.15.47:0/2663123642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 msgr2=0x558277f5abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb67d600700 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb67d600700 1 -- 172.21.15.47:0/2663123642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558277e38520 con 0x558277dd2f40 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb67d600700 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277dd2f40 0x558277f5a670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c00e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd7ffad8445e1ba7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb65f400700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb65f400700 1 -- 172.21.15.47:0/2663123642 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c027070 con 0x558277dd2f40 2024-05-14T12:40:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb66c019ae0 con 0x558277dd2f40 2024-05-14T12:40:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.596+0000 7fb65f400700 1 -- 172.21.15.47:0/2663123642 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb66c004020 con 0x558277dd2f40 2024-05-14T12:40:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb65f400700 1 -- 172.21.15.47:0/2663123642 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb66c032050 con 0x558277dd2f40 2024-05-14T12:40:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 10 client.26266 fetch_fsmap learned FSMap version 54 2024-05-14T12:40:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x558277f68640 con 0x558277dd2f40 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb65f400700 1 -- 172.21.15.47:0/2663123642 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb66c019ae0 con 0x558277dd2f40 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb65f400700 1 -- 172.21.15.47:0/2663123642 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 54) ==== 8382+0+0 (secure 0 0 0) 0x7fb66c005040 con 0x558277dd2f40 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 10 client.26266 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 10 client.26266 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 20 client.26266 populate_metadata read hostname 'smithi047' 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277f6ab10 0x558277f6cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 4 client.26266 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.597+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558277f1d2c0 con 0x558277f6ab10 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.598+0000 7fb67cc00700 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277f6ab10 0x558277f6cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.598+0000 7fb67cc00700 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277f6ab10 0x558277f6cf30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25706536d648cef4 server_cookie=431a4d4adb28c276 in_seq=0 out_seq=0 2024-05-14T12:40:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:09.598+0000 7fb65f400700 10 client.26266 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:09 smithi047 ceph-mon[31254]: pgmap v899: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.6 KiB/s wr, 19 op/s 2024-05-14T12:40:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:09 smithi073 ceph-mon[35809]: pgmap v899: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.6 KiB/s wr, 19 op/s 2024-05-14T12:40:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:09 smithi066 ceph-mon[35981]: pgmap v899: 97 pgs: 97 active+clean; 7.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.6 KiB/s wr, 19 op/s 2024-05-14T12:40:12.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:11 smithi073 ceph-mon[35809]: pgmap v900: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.6 KiB/s wr, 21 op/s 2024-05-14T12:40:12.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:11 smithi066 ceph-mon[35981]: pgmap v900: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.6 KiB/s wr, 21 op/s 2024-05-14T12:40:12.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:11 smithi047 ceph-mon[31254]: pgmap v900: 97 pgs: 97 active+clean; 7.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.6 KiB/s wr, 21 op/s 2024-05-14T12:40:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.181+0000 7f0c4e000640 1 -- 172.21.15.47:0/4161900582 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563027d9afd0 con 0x563027a211c0 2024-05-14T12:40:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.181+0000 7f0c4e000640 10 client.26248 handle_command_reply: tid=0 2024-05-14T12:40:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.181+0000 7f0c6ddf1740 1 client.26248 shutdown 2024-05-14T12:40:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.182+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 msgr2=0x563027e3dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.182+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e3dde0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c480a6140 tx=0x7f0c48009700 comp rx=0 tx=0).stop 2024-05-14T12:40:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.183+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 shutdown_connections 2024-05-14T12:40:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.183+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563027a211c0 0x563027eb0e80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.183+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563027a8d1b0 0x563027eacd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.183+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563027a6c4d0 0x563027e3dde0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.183+0000 7f0c4e000640 0 client.26248 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.183+0000 7f0c6ddf1740 1 --2- 172.21.15.47:0/4161900582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563027a642f0 0x563027e3d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.183+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 >> 172.21.15.47:0/4161900582 conn(0x563027a81300 msgr2=0x563027e2e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.184+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 shutdown_connections 2024-05-14T12:40:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.184+0000 7f0c6ddf1740 1 -- 172.21.15.47:0/4161900582 wait complete. 2024-05-14T12:40:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.184+0000 7f0c6ddf1740 20 client.26248 trim_cache size 0 max 16384 2024-05-14T12:40:13.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.183+0000 7fb65f400700 1 -- 172.21.15.47:0/2663123642 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558277f1d2c0 con 0x558277f6ab10 2024-05-14T12:40:13.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.183+0000 7fb65f400700 10 client.26266 handle_command_reply: tid=0 2024-05-14T12:40:13.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.183+0000 7fb68eb1cb80 1 client.26266 shutdown 2024-05-14T12:40:13.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277dd2f40 msgr2=0x558277f5a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277dd2f40 0x558277f5a670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c00e530 comp rx=0 tx=0).stop 2024-05-14T12:40:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:40:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:40:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:40:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 shutdown_connections 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277f6ab10 0x558277f6cf30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f50900 0x558277f5b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277dd2f40 0x558277f5a670 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2663123642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb65f400700 0 client.26266 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.184+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 >> 172.21.15.47:0/2663123642 conn(0x558277e18070 msgr2=0x558277f51ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.185+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 shutdown_connections 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.185+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2663123642 wait complete. 2024-05-14T12:40:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.185+0000 7fb68eb1cb80 20 client.26266 trim_cache size 0 max 16384 2024-05-14T12:40:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.185+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0c440b2920 msgr2=0x7f0c440b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.185+0000 7f0c65800640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0c440b2920 0x7f0c440b4e30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000f80 tx=0x7f0c50005fd0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60104cc0 msgr2=0x7f0c6019c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60104cc0 0x7f0c6019c900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e9f0 tx=0x7f0c4800eeb0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 shutdown_connections 2024-05-14T12:40:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f0c440b2920 0x7f0c440b4e30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c601099c0 0x7f0c601a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c60104cc0 0x7f0c6019c900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 --2- 172.21.15.47:0/2878892238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c60103a80 0x7f0c6019c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 >> 172.21.15.47:0/2878892238 conn(0x7f0c600fec70 msgr2=0x7f0c600ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 shutdown_connections 2024-05-14T12:40:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:13.186+0000 7f0c65800640 1 -- 172.21.15.47:0/2878892238 wait complete. 2024-05-14T12:40:13.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.226+0000 7fb68eb1cb80 1 Processor -- start 2024-05-14T12:40:13.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.226+0000 7fb68eb1cb80 1 -- start start 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277dd2f40 0x558277f55b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f504f0 0x558277f725c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f72b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781b0c20 con 0x558277dd2f40 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781b28b0 con 0x558277f504f0 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781b1350 con 0x558277f50900 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb67cc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f504f0 0x558277f725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb67cc00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f504f0 0x558277f725c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33310/0 (socket says 172.21.15.47:33310) 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb67cc00700 1 -- 172.21.15.47:0/2201145818 learned_addr learned my addr 172.21.15.47:0/2201145818 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb67d600700 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277dd2f40 0x558277f55b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:13.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.227+0000 7fb67e000700 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f72b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.228+0000 7fb67cc00700 1 -- 172.21.15.47:0/2201145818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 msgr2=0x558277f72b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.228+0000 7fb67cc00700 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f72b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.228+0000 7fb67cc00700 1 -- 172.21.15.47:0/2201145818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277dd2f40 msgr2=0x558277f55b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.228+0000 7fb67cc00700 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277dd2f40 0x558277f55b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.228+0000 7fb67cc00700 1 -- 172.21.15.47:0/2201145818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558277f5d600 con 0x558277f504f0 2024-05-14T12:40:13.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.228+0000 7fb67e000700 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f72b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:40:13.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.228+0000 7fb67cc00700 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f504f0 0x558277f725c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb6640aa460 tx=0x7fb6640b1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f7fedbfb1a57278 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:13.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.229+0000 7fb66a000700 1 -- 172.21.15.47:0/2201145818 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640c4070 con 0x558277f504f0 2024-05-14T12:40:13.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.229+0000 7fb66a000700 1 -- 172.21.15.47:0/2201145818 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6640aa270 con 0x558277f504f0 2024-05-14T12:40:13.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.229+0000 7fb66a000700 1 -- 172.21.15.47:0/2201145818 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640b3550 con 0x558277f504f0 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2201145818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f504f0 msgr2=0x558277f725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f504f0 0x558277f725c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb6640aa460 tx=0x7fb6640b1040 comp rx=0 tx=0).stop 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2201145818 shutdown_connections 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f72b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277dd2f40 0x558277f55b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/2201145818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277f504f0 0x558277f725c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2201145818 >> 172.21.15.47:0/2201145818 conn(0x558277e18070 msgr2=0x558277f65af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2201145818 shutdown_connections 2024-05-14T12:40:13.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.230+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/2201145818 wait complete. 2024-05-14T12:40:13.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.231+0000 7fb68eb1cb80 1 -- start start 2024-05-14T12:40:13.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.231+0000 7fb68eb1cb80 1 Processor -- start 2024-05-14T12:40:13.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:13.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:13.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb68eb1cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f5fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:13.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781b2150 con 0x558277f504f0 2024-05-14T12:40:13.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781b1a50 con 0x558277dd2f40 2024-05-14T12:40:13.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb68eb1cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6781aeba0 con 0x558277f50900 2024-05-14T12:40:13.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb68eb1cb80 10 client.0 _ll_register_callbacks cb 0x558277e19d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb67d600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb67e000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f5fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb67d600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:33320/0 (socket says 172.21.15.47:33320) 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb67d600700 1 -- 172.21.15.47:0/922699559 learned_addr learned my addr 172.21.15.47:0/922699559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb67cc00700 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb67d600700 1 -- 172.21.15.47:0/922699559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 msgr2=0x558277f5fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.232+0000 7fb67d600700 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f5fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb67d600700 1 -- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 msgr2=0x558277f5f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb67d600700 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb67d600700 1 -- 172.21.15.47:0/922699559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558277f603b0 con 0x558277dd2f40 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb67d600700 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f633c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009350 tx=0x7fb66c005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee32f7bfef86a3f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb65f400700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb65f400700 1 -- 172.21.15.47:0/922699559 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c03b060 con 0x558277dd2f40 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb65f400700 1 -- 172.21.15.47:0/922699559 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb66c004450 con 0x558277dd2f40 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.233+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6640aa270 con 0x558277dd2f40 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb65f400700 1 -- 172.21.15.47:0/922699559 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb66c027040 con 0x558277dd2f40 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 10 client.26246 fetch_fsmap learned FSMap version 54 2024-05-14T12:40:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x558277fd6090 con 0x558277dd2f40 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb65f400700 1 -- 172.21.15.47:0/922699559 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6640aa270 con 0x558277dd2f40 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb65f400700 1 -- 172.21.15.47:0/922699559 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8382+0+0 (secure 0 0 0) 0x7fb66c040070 con 0x558277dd2f40 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 10 client.26246 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 10 client.26246 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 20 client.26246 populate_metadata read hostname 'smithi047' 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277fd6710 0x558277fd8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 4 client.26246 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "19159e7f", "release": true, "await": true}] 2024-05-14T12:40:13.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.234+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "19159e7f", "release": true, "await": true}) -- 0x558277e80500 con 0x558277fd6710 2024-05-14T12:40:13.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.235+0000 7fb67cc00700 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277fd6710 0x558277fd8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:13.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.235+0000 7fb67cc00700 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277fd6710 0x558277fd8b30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f5ee822c23a7bf4 server_cookie=c0d120b3c032a4a8 in_seq=0 out_seq=0 2024-05-14T12:40:13.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.235+0000 7fb65f400700 10 client.26246 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.250+0000 7fb65f400700 1 -- 172.21.15.47:0/922699559 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x558277e80500 con 0x558277fd6710 2024-05-14T12:40:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.250+0000 7fb65f400700 10 client.26246 handle_command_reply: tid=0 2024-05-14T12:40:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.250+0000 7fb68eb1cb80 1 client.26246 shutdown 2024-05-14T12:40:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 msgr2=0x558277f633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f633c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009350 tx=0x7fb66c005f00 comp rx=0 tx=0).stop 2024-05-14T12:40:13.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 shutdown_connections 2024-05-14T12:40:13.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558277fd6710 0x558277fd8b30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558277f50900 0x558277f5fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558277dd2f40 0x558277f633c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 --2- 172.21.15.47:0/922699559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558277f504f0 0x558277f5f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb65f400700 0 client.26246 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 >> 172.21.15.47:0/922699559 conn(0x558277e18070 msgr2=0x558277f66520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.251+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 shutdown_connections 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.252+0000 7fb68eb1cb80 1 -- 172.21.15.47:0/922699559 wait complete. 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.252+0000 7fb68eb1cb80 20 client.26246 trim_cache size 0 max 16384 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:40:13.253 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 54, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 32, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "19159e7f": { 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 32, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 79.0, 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:40:13.254 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RELEASED", 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:40:13.255 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb6600b2880 msgr2=0x7fb6600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb6600b2880 0x7fb6600b4d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x558277f4c790 tx=0x7fb67000b040 comp rx=0 tx=0).stop 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678076680 msgr2=0x7fb67819d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678076680 0x7fb67819d4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c010 tx=0x7fb66400fa00 comp rx=0 tx=0).stop 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 shutdown_connections 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fb6600b2880 0x7fb6600b4d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6781109c0 0x7fb6781a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb678075d30 0x7fb67819cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 --2- 172.21.15.47:0/4078213365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678076680 0x7fb67819d4a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 >> 172.21.15.47:0/4078213365 conn(0x7fb678079d50 msgr2=0x7fb678100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 shutdown_connections 2024-05-14T12:40:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:40:13.253+0000 7fb67ea00700 1 -- 172.21.15.47:0/4078213365 wait complete. 2024-05-14T12:40:14.131 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '19159e7f', seconds elapsed: 51.1 2024-05-14T12:40:14.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:14 smithi073 ceph-mon[35809]: pgmap v901: 97 pgs: 97 active+clean; 7.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.6 KiB/s wr, 21 op/s 2024-05-14T12:40:14.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:13 smithi066 ceph-mon[35981]: pgmap v901: 97 pgs: 97 active+clean; 7.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.6 KiB/s wr, 21 op/s 2024-05-14T12:40:14.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:13 smithi047 ceph-mon[31254]: pgmap v901: 97 pgs: 97 active+clean; 7.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.6 KiB/s wr, 21 op/s 2024-05-14T12:40:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:16 smithi066 ceph-mon[35981]: pgmap v902: 97 pgs: 97 active+clean; 7.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.3 KiB/s wr, 18 op/s 2024-05-14T12:40:16.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:16 smithi047 ceph-mon[31254]: pgmap v902: 97 pgs: 97 active+clean; 7.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.3 KiB/s wr, 18 op/s 2024-05-14T12:40:16.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:16 smithi073 ceph-mon[35809]: pgmap v902: 97 pgs: 97 active+clean; 7.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.3 KiB/s wr, 18 op/s 2024-05-14T12:40:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:18 smithi066 ceph-mon[35981]: pgmap v903: 97 pgs: 97 active+clean; 7.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 21 op/s 2024-05-14T12:40:18.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:18 smithi047 ceph-mon[31254]: pgmap v903: 97 pgs: 97 active+clean; 7.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 21 op/s 2024-05-14T12:40:18.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:18 smithi073 ceph-mon[35809]: pgmap v903: 97 pgs: 97 active+clean; 7.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 21 op/s 2024-05-14T12:40:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:20 smithi066 ceph-mon[35981]: pgmap v904: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 852 B/s wr, 17 op/s 2024-05-14T12:40:20.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:20 smithi047 ceph-mon[31254]: pgmap v904: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 852 B/s wr, 17 op/s 2024-05-14T12:40:20.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:20 smithi073 ceph-mon[35809]: pgmap v904: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 852 B/s wr, 17 op/s 2024-05-14T12:40:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:22 smithi066 ceph-mon[35981]: pgmap v905: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 17 op/s 2024-05-14T12:40:22.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:22 smithi047 ceph-mon[31254]: pgmap v905: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 17 op/s 2024-05-14T12:40:22.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:22 smithi073 ceph-mon[35809]: pgmap v905: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 17 op/s 2024-05-14T12:40:24.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:24 smithi066 ceph-mon[35981]: pgmap v906: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 18 op/s 2024-05-14T12:40:24.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:24 smithi047 ceph-mon[31254]: pgmap v906: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 18 op/s 2024-05-14T12:40:24.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:24 smithi073 ceph-mon[35809]: pgmap v906: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 18 op/s 2024-05-14T12:40:25.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:25 smithi047 ceph-mon[31254]: pgmap v907: 97 pgs: 97 active+clean; 6.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 15 op/s 2024-05-14T12:40:25.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:25 smithi073 ceph-mon[35809]: pgmap v907: 97 pgs: 97 active+clean; 6.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 15 op/s 2024-05-14T12:40:25.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:25 smithi066 ceph-mon[35981]: pgmap v907: 97 pgs: 97 active+clean; 6.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 15 op/s 2024-05-14T12:40:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 -- 172.21.15.47:0/3875927154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc10ba60 msgr2=0x7f69fc10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 --2- 172.21.15.47:0/3875927154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc10ba60 0x7f69fc10de80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009be0 tx=0x7f69f402a6c0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 -- 172.21.15.47:0/3875927154 shutdown_connections 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 --2- 172.21.15.47:0/3875927154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc10ba60 0x7f69fc10de80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 --2- 172.21.15.47:0/3875927154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69fc0759b0 0x7f69fc10b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 --2- 172.21.15.47:0/3875927154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc075060 0x7f69fc075470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 -- 172.21.15.47:0/3875927154 >> 172.21.15.47:0/3875927154 conn(0x7f69fc0fec80 msgr2=0x7f69fc101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 -- 172.21.15.47:0/3875927154 shutdown_connections 2024-05-14T12:40:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.426+0000 7f69fbe00640 1 -- 172.21.15.47:0/3875927154 wait complete. 2024-05-14T12:40:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.427+0000 7f69fbe00640 1 Processor -- start 2024-05-14T12:40:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fbe00640 1 -- start start 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc075060 0x7f69fc19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc0759b0 0x7f69fc19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fbe00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69fc10ba60 0x7f69fc1a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc111850 con 0x7f69fc075060 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fbe00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1116d0 con 0x7f69fc10ba60 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fbe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1119d0 con 0x7f69fc0759b0 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc075060 0x7f69fc19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc0759b0 0x7f69fc19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fb400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69fc10ba60 0x7f69fc1a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc0759b0 0x7f69fc19c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52278/0 (socket says 172.21.15.47:52278) 2024-05-14T12:40:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fb400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69fc10ba60 0x7f69fc1a3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:46532/0 (socket says 172.21.15.47:46532) 2024-05-14T12:40:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69fa000640 1 -- 172.21.15.47:0/4204355507 learned_addr learned my addr 172.21.15.47:0/4204355507 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.428+0000 7f69faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc075060 0x7f69fc19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54278/0 (socket says 172.21.15.47:54278) 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f69fa000640 1 -- 172.21.15.47:0/4204355507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69fc10ba60 msgr2=0x7f69fc1a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f69fa000640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69fc10ba60 0x7f69fc1a3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f69fa000640 1 -- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc075060 msgr2=0x7f69fc19c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f69fa000640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc075060 0x7f69fc19c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f69fa000640 1 -- 172.21.15.47:0/4204355507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc1a3ea0 con 0x7f69fc0759b0 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f69fa000640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc0759b0 0x7f69fc19c8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9f0 tx=0x7f69e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f6a00a00640 1 -- 172.21.15.47:0/4204355507 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e400ccc0 con 0x7f69fc0759b0 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f6a00a00640 1 -- 172.21.15.47:0/4204355507 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e40054d0 con 0x7f69fc0759b0 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f6a00a00640 1 -- 172.21.15.47:0/4204355507 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4010430 con 0x7f69fc0759b0 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.429+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc1a4190 con 0x7f69fc0759b0 2024-05-14T12:40:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.430+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc1a46e0 con 0x7f69fc0759b0 2024-05-14T12:40:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 Processor -- start 2024-05-14T12:40:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 -- start start 2024-05-14T12:40:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a00a00640 1 -- 172.21.15.47:0/4204355507 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f69e40046c0 con 0x7f69fc0759b0 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x563644209300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e3e2f0 0x563644209880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x563644210780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56364416d550 con 0x563643e671b0 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563644112bc0 con 0x563643e464d0 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.433+0000 7f6a08d92740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563644169510 con 0x563643e3e2f0 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e3e2f0 0x563644209880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69fa000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x563644210780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69fb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x563644209300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e3e2f0 0x563644209880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52282/0 (socket says 172.21.15.47:52282) 2024-05-14T12:40:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 -- 172.21.15.47:0/731309772 learned_addr learned my addr 172.21.15.47:0/731309772 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 -- 172.21.15.47:0/731309772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 msgr2=0x563644210780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 --2- 172.21.15.47:0/731309772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x563644210780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 -- 172.21.15.47:0/731309772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 msgr2=0x563644209300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 --2- 172.21.15.47:0/731309772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x563644209300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 -- 172.21.15.47:0/731309772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563643e7f210 con 0x563643e3e2f0 2024-05-14T12:40:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.434+0000 7f69faa00640 1 --2- 172.21.15.47:0/731309772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e3e2f0 0x563644209880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009c90 tx=0x7f69ec011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42299bf2ead5760f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.435+0000 7f69ebe00640 1 -- 172.21.15.47:0/731309772 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec01e070 con 0x563643e3e2f0 2024-05-14T12:40:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.435+0000 7f69ebe00640 1 -- 172.21.15.47:0/731309772 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ec019ae0 con 0x563643e3e2f0 2024-05-14T12:40:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.435+0000 7f69ebe00640 1 -- 172.21.15.47:0/731309772 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00ea40 con 0x563643e3e2f0 2024-05-14T12:40:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.435+0000 7f6a00a00640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f69e00b2920 0x7f69e00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.435+0000 7f6a00a00640 1 -- 172.21.15.47:0/4204355507 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f69e40e2490 con 0x7f69fc0759b0 2024-05-14T12:40:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.435+0000 7f69fb400640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f69e00b2920 0x7f69e00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 -- 172.21.15.47:0/731309772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e3e2f0 msgr2=0x563644209880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 --2- 172.21.15.47:0/731309772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e3e2f0 0x563644209880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009c90 tx=0x7f69ec011810 comp rx=0 tx=0).stop 2024-05-14T12:40:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 -- 172.21.15.47:0/731309772 shutdown_connections 2024-05-14T12:40:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 --2- 172.21.15.47:0/731309772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x563644210780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 --2- 172.21.15.47:0/731309772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e3e2f0 0x563644209880 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 --2- 172.21.15.47:0/731309772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x563644209300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 -- 172.21.15.47:0/731309772 >> 172.21.15.47:0/731309772 conn(0x563643e5b300 msgr2=0x563644204c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 -- 172.21.15.47:0/731309772 shutdown_connections 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f69fb400640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f69e00b2920 0x7f69e00b4e30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f69f4004af0 tx=0x7f69f4030990 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.436+0000 7f6a08d92740 1 -- 172.21.15.47:0/731309772 wait complete. 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.437+0000 7f6a08d92740 1 -- start start 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.437+0000 7f6a08d92740 1 Processor -- start 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e3e2f0 0x563644212d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x5636442132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x56364421a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f6a08d92740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5636442111d0 con 0x563643e671b0 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f6a08d92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563644126660 con 0x563643e3e2f0 2024-05-14T12:40:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f6a08d92740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563644211350 con 0x563643e464d0 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f6a08d92740 10 client.0 _ll_register_callbacks cb 0x5636440f0400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x5636442132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69faa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e3e2f0 0x563644212d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x5636442132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52290/0 (socket says 172.21.15.47:52290) 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 -- 172.21.15.47:0/730967072 learned_addr learned my addr 172.21.15.47:0/730967072 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fb400640 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x56364421a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 -- 172.21.15.47:0/730967072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e3e2f0 msgr2=0x563644212d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e3e2f0 0x563644212d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 -- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 msgr2=0x56364421a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x56364421a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.438+0000 7f69fa000640 1 -- 172.21.15.47:0/730967072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563643f4b620 con 0x563643e464d0 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f69fa000640 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x5636442132d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c6a0 tx=0x7f69e40aa010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f6c7c08b90fe31 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f69e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f69e8c00640 1 -- 172.21.15.47:0/730967072 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e40a9840 con 0x563643e464d0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f69e8c00640 1 -- 172.21.15.47:0/730967072 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f69e40a8ee0 con 0x563643e464d0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69ec019ae0 con 0x563643e464d0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f69e8c00640 1 -- 172.21.15.47:0/730967072 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f69e40a5200 con 0x563643e464d0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f6a08d92740 10 client.26284 fetch_fsmap learned FSMap version 54 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x56364421d230 con 0x563643e464d0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.439+0000 7f69e8c00640 1 -- 172.21.15.47:0/730967072 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ec019ae0 con 0x563643e464d0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f69e8c00640 1 -- 172.21.15.47:0/730967072 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 54) ==== 8382+0+0 (secure 0 0 0) 0x7f69e40e20b0 con 0x563643e464d0 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f6a08d92740 10 client.26284 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f6a08d92740 10 client.26284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f6a08d92740 20 client.26284 populate_metadata read hostname 'smithi047' 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f6a08d92740 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643e25d80 0x563644220990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f6a08d92740 4 client.26284 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:40:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56364417b160 con 0x563643e25d80 2024-05-14T12:40:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.440+0000 7f69faa00640 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643e25d80 0x563644220990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.441+0000 7f69faa00640 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643e25d80 0x563644220990 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1387b12a94e24b78 server_cookie=98d5ba480c1d1920 in_seq=0 out_seq=0 2024-05-14T12:40:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.441+0000 7f69e8c00640 10 client.26284 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f69e8c00640 1 -- 172.21.15.47:0/730967072 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56364417b160 con 0x563643e25d80 2024-05-14T12:40:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f69e8c00640 10 client.26284 handle_command_reply: tid=0 2024-05-14T12:40:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 client.26284 shutdown 2024-05-14T12:40:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 msgr2=0x5636442132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x5636442132d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c6a0 tx=0x7f69e40aa010 comp rx=0 tx=0).stop 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 shutdown_connections 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643e25d80 0x563644220990 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e671b0 0x56364421a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x5636442132d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 --2- 172.21.15.47:0/730967072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e3e2f0 0x563644212d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 >> 172.21.15.47:0/730967072 conn(0x563643e5b300 msgr2=0x563644207ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f69e8c00640 0 client.26284 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 shutdown_connections 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 1 -- 172.21.15.47:0/730967072 wait complete. 2024-05-14T12:40:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.442+0000 7f6a08d92740 20 client.26284 trim_cache size 0 max 16384 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.459+0000 7f6a08d92740 1 Processor -- start 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.459+0000 7f6a08d92740 1 -- start start 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x56364420d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x56364421a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e671b0 0x56364420d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f6a08d92740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ad340 con 0x563643e3e2f0 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f6a08d92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1aefd0 con 0x563643e464d0 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f6a08d92740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ada70 con 0x563643e671b0 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x56364420d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x56364420d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54310/0 (socket says 172.21.15.47:54310) 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 -- 172.21.15.47:0/2734986686 learned_addr learned my addr 172.21.15.47:0/2734986686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69fa000640 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x56364421a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69fb400640 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e671b0 0x56364420d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 -- 172.21.15.47:0/2734986686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e671b0 msgr2=0x56364420d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e671b0 0x56364420d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 -- 172.21.15.47:0/2734986686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 msgr2=0x56364421a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x56364421a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69faa00640 1 -- 172.21.15.47:0/2734986686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563643e25fb0 con 0x563643e3e2f0 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.460+0000 7f69fb400640 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e671b0 0x56364420d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.461+0000 7f69faa00640 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x56364420d1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69ec011d10 tx=0x7f69ec009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e29c21636640f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.461+0000 7f69eb400640 1 -- 172.21.15.47:0/2734986686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec032070 con 0x563643e3e2f0 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.461+0000 7f69eb400640 1 -- 172.21.15.47:0/2734986686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ec005040 con 0x563643e3e2f0 2024-05-14T12:40:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.461+0000 7f69eb400640 1 -- 172.21.15.47:0/2734986686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec01e040 con 0x563643e3e2f0 2024-05-14T12:40:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 -- 172.21.15.47:0/2734986686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 msgr2=0x56364420d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x56364420d1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69ec011d10 tx=0x7f69ec009850 comp rx=0 tx=0).stop 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 -- 172.21.15.47:0/2734986686 shutdown_connections 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e671b0 0x56364420d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e464d0 0x56364421a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 --2- 172.21.15.47:0/2734986686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x56364420d1e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 -- 172.21.15.47:0/2734986686 >> 172.21.15.47:0/2734986686 conn(0x563643e5b300 msgr2=0x563644209280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 -- 172.21.15.47:0/2734986686 shutdown_connections 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.462+0000 7f6a08d92740 1 -- 172.21.15.47:0/2734986686 wait complete. 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 -- start start 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 Processor -- start 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x563644216e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x563644217390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e671b0 0x563644286d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ae870 con 0x563643e3e2f0 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ae170 con 0x563643e671b0 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.463+0000 7f6a08d92740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ab300 con 0x563643e464d0 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f6a08d92740 10 client.0 _ll_register_callbacks cb 0x7f69e400cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x563644216e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x563644217390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x563644217390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52308/0 (socket says 172.21.15.47:52308) 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 -- 172.21.15.47:0/1064468271 learned_addr learned my addr 172.21.15.47:0/1064468271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fb400640 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e671b0 0x563644286d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 -- 172.21.15.47:0/1064468271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e671b0 msgr2=0x563644286d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e671b0 0x563644286d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 -- 172.21.15.47:0/1064468271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 msgr2=0x563644216e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x563644216e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 -- 172.21.15.47:0/1064468271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56364421a350 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69fa000640 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x563644217390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f69e40a6ce0 tx=0x7f69e40a90f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31a3eccd3bc253a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.464+0000 7f69e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f69e8c00640 1 -- 172.21.15.47:0/1064468271 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e40a91e0 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f69e8c00640 1 -- 172.21.15.47:0/1064468271 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f69e40e2270 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69ec005040 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f69e8c00640 1 -- 172.21.15.47:0/1064468271 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f69e40a93c0 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 10 client.26290 fetch_fsmap learned FSMap version 54 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5636442881d0 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f69e8c00640 1 -- 172.21.15.47:0/1064468271 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ec005040 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f69e8c00640 1 -- 172.21.15.47:0/1064468271 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 54) ==== 8382+0+0 (secure 0 0 0) 0x7f69e40b2b20 con 0x563643e464d0 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 10 client.26290 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 10 client.26290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 20 client.26290 populate_metadata read hostname 'smithi047' 2024-05-14T12:40:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643dfb1c0 0x56364428a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 4 client.26290 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:40:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.465+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563644174fd0 con 0x563643dfb1c0 2024-05-14T12:40:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.466+0000 7f69faa00640 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643dfb1c0 0x56364428a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.466+0000 7f69faa00640 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643dfb1c0 0x56364428a8d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8cd343fcd3aa33 server_cookie=55c9bfa909664072 in_seq=0 out_seq=0 2024-05-14T12:40:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:26.466+0000 7f69e8c00640 10 client.26290 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:28.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:27 smithi047 ceph-mon[31254]: pgmap v908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 18 op/s 2024-05-14T12:40:28.205 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:27 smithi073 ceph-mon[35809]: pgmap v908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 18 op/s 2024-05-14T12:40:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:27 smithi066 ceph-mon[35981]: pgmap v908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 18 op/s 2024-05-14T12:40:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:29 smithi047 ceph-mon[31254]: pgmap v909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 16 op/s 2024-05-14T12:40:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:29 smithi073 ceph-mon[35809]: pgmap v909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 16 op/s 2024-05-14T12:40:30.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:29 smithi066 ceph-mon[35981]: pgmap v909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 16 op/s 2024-05-14T12:40:31.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:30 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:31.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:30 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:31.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:30 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:31 smithi047 ceph-mon[31254]: pgmap v910: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 852 B/s wr, 18 op/s 2024-05-14T12:40:32.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:31 smithi073 ceph-mon[35809]: pgmap v910: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 852 B/s wr, 18 op/s 2024-05-14T12:40:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:31 smithi066 ceph-mon[35981]: pgmap v910: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 852 B/s wr, 18 op/s 2024-05-14T12:40:34.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:33 smithi047 ceph-mon[31254]: pgmap v911: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-05-14T12:40:34.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:33 smithi073 ceph-mon[35809]: pgmap v911: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-05-14T12:40:34.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:33 smithi066 ceph-mon[35981]: pgmap v911: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-05-14T12:40:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:35 smithi047 ceph-mon[31254]: pgmap v912: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-05-14T12:40:36.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:35 smithi073 ceph-mon[35809]: pgmap v912: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-05-14T12:40:36.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:35 smithi066 ceph-mon[35981]: pgmap v912: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-05-14T12:40:38.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:37 smithi047 ceph-mon[31254]: pgmap v913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 20 op/s 2024-05-14T12:40:38.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:37 smithi073 ceph-mon[35809]: pgmap v913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 20 op/s 2024-05-14T12:40:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:37 smithi066 ceph-mon[35981]: pgmap v913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 20 op/s 2024-05-14T12:40:40.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:39 smithi047 ceph-mon[31254]: pgmap v914: 97 pgs: 97 active+clean; 6.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2024-05-14T12:40:40.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:39 smithi073 ceph-mon[35809]: pgmap v914: 97 pgs: 97 active+clean; 6.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2024-05-14T12:40:40.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:39 smithi066 ceph-mon[35981]: pgmap v914: 97 pgs: 97 active+clean; 6.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2024-05-14T12:40:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.091+0000 7f69e8c00640 1 -- 172.21.15.47:0/1064468271 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563644174fd0 con 0x563643dfb1c0 2024-05-14T12:40:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.091+0000 7f69e8c00640 10 client.26290 handle_command_reply: tid=0 2024-05-14T12:40:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.091+0000 7f6a08d92740 1 client.26290 shutdown 2024-05-14T12:40:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.091+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 msgr2=0x563644217390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.091+0000 7f6a08d92740 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x563644217390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f69e40a6ce0 tx=0x7f69e40a90f0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 shutdown_connections 2024-05-14T12:40:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f6a08d92740 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x563643dfb1c0 0x56364428a8d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f6a08d92740 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563643e671b0 0x563644286d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f69e8c00640 0 client.26290 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f6a08d92740 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563643e464d0 0x563644217390 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f6a08d92740 1 --2- 172.21.15.47:0/1064468271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563643e3e2f0 0x563644216e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.092 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 >> 172.21.15.47:0/1064468271 conn(0x563643e5b300 msgr2=0x563644212d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.092+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 shutdown_connections 2024-05-14T12:40:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.093+0000 7f6a08d92740 1 -- 172.21.15.47:0/1064468271 wait complete. 2024-05-14T12:40:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.093+0000 7f6a08d92740 20 client.26290 trim_cache size 0 max 16384 2024-05-14T12:40:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:40:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:40:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:40:42.093 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:40:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f69e00b2920 msgr2=0x7f69e00b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f69e00b2920 0x7f69e00b4e30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f69f4004af0 tx=0x7f69f4030990 comp rx=0 tx=0).stop 2024-05-14T12:40:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc0759b0 msgr2=0x7f69fc19c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:42.094 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc0759b0 0x7f69fc19c8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9f0 tx=0x7f69e400eeb0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 shutdown_connections 2024-05-14T12:40:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f69e00b2920 0x7f69e00b4e30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69fc10ba60 0x7f69fc1a3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69fc0759b0 0x7f69fc19c8a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 --2- 172.21.15.47:0/4204355507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69fc075060 0x7f69fc19c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.094+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 >> 172.21.15.47:0/4204355507 conn(0x7f69fc0fec80 msgr2=0x7f69fc107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.095+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 shutdown_connections 2024-05-14T12:40:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:42.095+0000 7f69fbe00640 1 -- 172.21.15.47:0/4204355507 wait complete. 2024-05-14T12:40:42.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:41 smithi047 ceph-mon[31254]: pgmap v915: 97 pgs: 97 active+clean; 6.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.5 KiB/s wr, 21 op/s 2024-05-14T12:40:42.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:41 smithi073 ceph-mon[35809]: pgmap v915: 97 pgs: 97 active+clean; 6.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.5 KiB/s wr, 21 op/s 2024-05-14T12:40:42.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:41 smithi066 ceph-mon[35981]: pgmap v915: 97 pgs: 97 active+clean; 6.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.5 KiB/s wr, 21 op/s 2024-05-14T12:40:44.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:43 smithi047 ceph-mon[31254]: pgmap v916: 97 pgs: 97 active+clean; 6.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 20 op/s 2024-05-14T12:40:44.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:43 smithi073 ceph-mon[35809]: pgmap v916: 97 pgs: 97 active+clean; 6.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 20 op/s 2024-05-14T12:40:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:43 smithi066 ceph-mon[35981]: pgmap v916: 97 pgs: 97 active+clean; 6.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 20 op/s 2024-05-14T12:40:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:45 smithi047 ceph-mon[31254]: pgmap v917: 97 pgs: 97 active+clean; 6.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-05-14T12:40:46.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:45 smithi073 ceph-mon[35809]: pgmap v917: 97 pgs: 97 active+clean; 6.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-05-14T12:40:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:45 smithi066 ceph-mon[35981]: pgmap v917: 97 pgs: 97 active+clean; 6.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-05-14T12:40:48.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:47 smithi047 ceph-mon[31254]: pgmap v918: 97 pgs: 97 active+clean; 6.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-05-14T12:40:48.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:47 smithi073 ceph-mon[35809]: pgmap v918: 97 pgs: 97 active+clean; 6.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-05-14T12:40:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:47 smithi066 ceph-mon[35981]: pgmap v918: 97 pgs: 97 active+clean; 6.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 KiB/s wr, 23 op/s 2024-05-14T12:40:50.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:49 smithi047 ceph-mon[31254]: pgmap v919: 97 pgs: 97 active+clean; 5.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 21 op/s 2024-05-14T12:40:50.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:49 smithi073 ceph-mon[35809]: pgmap v919: 97 pgs: 97 active+clean; 5.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 21 op/s 2024-05-14T12:40:50.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:49 smithi066 ceph-mon[35981]: pgmap v919: 97 pgs: 97 active+clean; 5.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 21 op/s 2024-05-14T12:40:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:51 smithi047 ceph-mon[31254]: pgmap v920: 97 pgs: 97 active+clean; 5.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 KiB/s wr, 22 op/s 2024-05-14T12:40:52.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:51 smithi073 ceph-mon[35809]: pgmap v920: 97 pgs: 97 active+clean; 5.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 KiB/s wr, 22 op/s 2024-05-14T12:40:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:51 smithi066 ceph-mon[35981]: pgmap v920: 97 pgs: 97 active+clean; 5.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 KiB/s wr, 22 op/s 2024-05-14T12:40:54.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:53 smithi047 ceph-mon[31254]: pgmap v921: 97 pgs: 97 active+clean; 5.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 KiB/s wr, 21 op/s 2024-05-14T12:40:54.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:53 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:54.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:53 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:40:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:53 smithi073 ceph-mon[35809]: pgmap v921: 97 pgs: 97 active+clean; 5.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 KiB/s wr, 21 op/s 2024-05-14T12:40:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:53 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:54.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:53 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:40:54.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:53 smithi066 ceph-mon[35981]: pgmap v921: 97 pgs: 97 active+clean; 5.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 KiB/s wr, 21 op/s 2024-05-14T12:40:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:53 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:53 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:40:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:54 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:54 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:54 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:54 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:54 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:54 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:54 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:54 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:54 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:54 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:54 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:54 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T12:40:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 -- 172.21.15.47:0/953480604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4810b9f0 msgr2=0x7f7d4810de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 --2- 172.21.15.47:0/953480604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4810b9f0 0x7f7d4810de30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009ca0 tx=0x7f7d4002a8c0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 -- 172.21.15.47:0/953480604 shutdown_connections 2024-05-14T12:40:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 --2- 172.21.15.47:0/953480604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4810b9f0 0x7f7d4810de30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 --2- 172.21.15.47:0/953480604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d48075a10 0x7f7d4810b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 --2- 172.21.15.47:0/953480604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d480750c0 0x7f7d480754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 -- 172.21.15.47:0/953480604 >> 172.21.15.47:0/953480604 conn(0x7f7d480fec70 msgr2=0x7f7d48101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 -- 172.21.15.47:0/953480604 shutdown_connections 2024-05-14T12:40:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.359+0000 7f7d47e00640 1 -- 172.21.15.47:0/953480604 wait complete. 2024-05-14T12:40:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.360+0000 7f7d47e00640 1 Processor -- start 2024-05-14T12:40:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47e00640 1 -- start start 2024-05-14T12:40:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d480750c0 0x7f7d4819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d48075a10 0x7f7d4819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4810b9f0 0x7f7d481a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48111880 con 0x7f7d480750c0 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48111700 con 0x7f7d48075a10 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48111a00 con 0x7f7d4810b9f0 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d46a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d480750c0 0x7f7d4819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4810b9f0 0x7f7d481a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4810b9f0 0x7f7d481a37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:47414/0 (socket says 172.21.15.47:47414) 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.361+0000 7f7d47400640 1 -- 172.21.15.47:0/888328900 learned_addr learned my addr 172.21.15.47:0/888328900 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.362+0000 7f7d46000640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d48075a10 0x7f7d4819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.362+0000 7f7d47400640 1 -- 172.21.15.47:0/888328900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d48075a10 msgr2=0x7f7d4819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.362+0000 7f7d47400640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d48075a10 0x7f7d4819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.362+0000 7f7d47400640 1 -- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d480750c0 msgr2=0x7f7d4819c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.362+0000 7f7d47400640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d480750c0 0x7f7d4819c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.362+0000 7f7d47400640 1 -- 172.21.15.47:0/888328900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d481a3e60 con 0x7f7d4810b9f0 2024-05-14T12:40:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.362+0000 7f7d47400640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4810b9f0 0x7f7d481a37f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7d40033040 tx=0x7f7d400316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.363+0000 7f7d3f400640 1 -- 172.21.15.47:0/888328900 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40003b70 con 0x7f7d4810b9f0 2024-05-14T12:40:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.363+0000 7f7d3f400640 1 -- 172.21.15.47:0/888328900 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d40003d10 con 0x7f7d4810b9f0 2024-05-14T12:40:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.363+0000 7f7d3f400640 1 -- 172.21.15.47:0/888328900 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4002fb40 con 0x7f7d4810b9f0 2024-05-14T12:40:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.363+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d481a40f0 con 0x7f7d4810b9f0 2024-05-14T12:40:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.363+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d481a45f0 con 0x7f7d4810b9f0 2024-05-14T12:40:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.366+0000 7f7d3f400640 1 -- 172.21.15.47:0/888328900 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7d40004610 con 0x7f7d4810b9f0 2024-05-14T12:40:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 Processor -- start 2024-05-14T12:40:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 -- start start 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dc8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dc8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dcf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fc22d2c550 con 0x55fc22a054d0 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fc22cd1bc0 con 0x55fc229fd2f0 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d549ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fc22d28510 con 0x55fc22a261b0 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d46000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dc8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d46a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dc8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d46000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dc8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:47424/0 (socket says 172.21.15.47:47424) 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d46000640 1 -- 172.21.15.47:0/3825618388 learned_addr learned my addr 172.21.15.47:0/3825618388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.367+0000 7f7d46a00640 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dc8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:36108/0 (socket says 172.21.15.47:36108) 2024-05-14T12:40:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46000640 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dcf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46000640 1 -- 172.21.15.47:0/3825618388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 msgr2=0x55fc22dc8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46000640 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dc8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46000640 1 -- 172.21.15.47:0/3825618388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 msgr2=0x55fc22dcf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46000640 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dcf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46000640 1 -- 172.21.15.47:0/3825618388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc22a3e210 con 0x55fc22a261b0 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46a00640 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dc8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d3f400640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7d2c0b2920 0x7f7d2c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.368+0000 7f7d46000640 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dc8300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7d340097e0 tx=0x7f7d34009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad50bd4d6a381fdf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.369+0000 7f7d33e00640 1 -- 172.21.15.47:0/3825618388 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34004030 con 0x55fc22a261b0 2024-05-14T12:40:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.369+0000 7f7d3f400640 1 -- 172.21.15.47:0/888328900 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7d401035f0 con 0x7f7d4810b9f0 2024-05-14T12:40:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.369+0000 7f7d33e00640 1 -- 172.21.15.47:0/3825618388 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d3400fc70 con 0x55fc22a261b0 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.369+0000 7f7d33e00640 1 -- 172.21.15.47:0/3825618388 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34003990 con 0x55fc22a261b0 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.369+0000 7f7d46a00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7d2c0b2920 0x7f7d2c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 -- 172.21.15.47:0/3825618388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 msgr2=0x55fc22dc8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d46a00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7d2c0b2920 0x7f7d2c0b4e30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fc22dc96e0 tx=0x7f7d38005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dc8300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7d340097e0 tx=0x7f7d34009770 comp rx=0 tx=0).stop 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 -- 172.21.15.47:0/3825618388 shutdown_connections 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dcf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dc8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3825618388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dc8300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 -- 172.21.15.47:0/3825618388 >> 172.21.15.47:0/3825618388 conn(0x55fc22a1a300 msgr2=0x55fc22dc3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 -- 172.21.15.47:0/3825618388 shutdown_connections 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 -- 172.21.15.47:0/3825618388 wait complete. 2024-05-14T12:40:55.373 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.370+0000 7f7d549ab740 1 -- start start 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 1 Processor -- start 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc229fd2f0 0x55fc22dd1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a054d0 0x55fc22dd2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a261b0 0x55fc22dd93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fc22dd01d0 con 0x55fc229fd2f0 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fc22ce5660 con 0x55fc22a261b0 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fc22dd0350 con 0x55fc22a054d0 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.371+0000 7f7d549ab740 10 client.0 _ll_register_callbacks cb 0x55fc22caf400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a261b0 0x55fc22dd93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d46a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc229fd2f0 0x55fc22dd1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a261b0 0x55fc22dd93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:36116/0 (socket says 172.21.15.47:36116) 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 -- 172.21.15.47:0/793826775 learned_addr learned my addr 172.21.15.47:0/793826775 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d46000640 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a054d0 0x55fc22dd2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 -- 172.21.15.47:0/793826775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a054d0 msgr2=0x55fc22dd2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a054d0 0x55fc22dd2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 -- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc229fd2f0 msgr2=0x55fc22dd1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc229fd2f0 0x55fc22dd1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 -- 172.21.15.47:0/793826775 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc22b0a620 con 0x55fc22a261b0 2024-05-14T12:40:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d46a00640 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc229fd2f0 0x55fc22dd1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:40:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d47400640 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a261b0 0x55fc22dd93b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7d400ca8d0 tx=0x7f7d400ca340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b24afd91e988576 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.372+0000 7f7d30c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:40:55.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d30c00640 1 -- 172.21.15.47:0/793826775 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400cabd0 con 0x55fc22a261b0 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d30c00640 1 -- 172.21.15.47:0/793826775 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7d4002fce0 con 0x55fc22a261b0 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d3400fc70 con 0x55fc22a261b0 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d30c00640 1 -- 172.21.15.47:0/793826775 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7d400cef80 con 0x55fc22a261b0 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d549ab740 10 client.26276 fetch_fsmap learned FSMap version 56 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55fc22dd01d0 con 0x55fc22a261b0 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d30c00640 1 -- 172.21.15.47:0/793826775 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d3400fc70 con 0x55fc22a261b0 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d30c00640 1 -- 172.21.15.47:0/793826775 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 56) ==== 8374+0+0 (secure 0 0 0) 0x7f7d400c6050 con 0x55fc22a261b0 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d549ab740 10 client.26276 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d549ab740 10 client.26276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.373+0000 7f7d549ab740 20 client.26276 populate_metadata read hostname 'smithi047' 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.374+0000 7f7d549ab740 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229e4d80 0x55fc22ddfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.374+0000 7f7d549ab740 4 client.26276 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:40:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.374+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc22d3a160 con 0x55fc229e4d80 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.374+0000 7f7d46a00640 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229e4d80 0x55fc22ddfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.375+0000 7f7d46a00640 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229e4d80 0x55fc22ddfa20 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=837afc1bf09144db server_cookie=e8d9c5f53f4358cd in_seq=0 out_seq=0 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.375+0000 7f7d30c00640 10 client.26276 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.375+0000 7f7d30c00640 1 -- 172.21.15.47:0/793826775 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fc22d3a160 con 0x55fc229e4d80 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.375+0000 7f7d30c00640 10 client.26276 handle_command_reply: tid=0 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 client.26276 shutdown 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a261b0 msgr2=0x55fc22dd93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a261b0 0x55fc22dd93b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7d400ca8d0 tx=0x7f7d400ca340 comp rx=0 tx=0).stop 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 shutdown_connections 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229e4d80 0x55fc22ddfa20 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a261b0 0x55fc22dd93b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a054d0 0x55fc22dd2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 --2- 172.21.15.47:0/793826775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc229fd2f0 0x55fc22dd1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 >> 172.21.15.47:0/793826775 conn(0x55fc22a1a300 msgr2=0x55fc22dc6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d30c00640 0 client.26276 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 shutdown_connections 2024-05-14T12:40:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 1 -- 172.21.15.47:0/793826775 wait complete. 2024-05-14T12:40:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.376+0000 7f7d549ab740 20 client.26276 trim_cache size 0 max 16384 2024-05-14T12:40:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.395+0000 7f7d549ab740 1 Processor -- start 2024-05-14T12:40:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.395+0000 7f7d549ab740 1 -- start start 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.395+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc229fd2f0 0x55fc22dd0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a054d0 0x55fc22dd92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a261b0 0x55fc22dc34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d549ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481ad270 con 0x55fc22a261b0 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d549ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481aeea0 con 0x55fc22a054d0 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d549ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481ad9a0 con 0x55fc229fd2f0 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc229fd2f0 0x55fc22dd0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a054d0 0x55fc22dd92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d47400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a261b0 0x55fc22dc34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a054d0 0x55fc22dd92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:36124/0 (socket says 172.21.15.47:36124) 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 -- 172.21.15.47:0/3820933054 learned_addr learned my addr 172.21.15.47:0/3820933054 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc229fd2f0 0x55fc22dd0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:47454/0 (socket says 172.21.15.47:47454) 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 -- 172.21.15.47:0/3820933054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc229fd2f0 msgr2=0x55fc22dd0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc229fd2f0 0x55fc22dd0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 -- 172.21.15.47:0/3820933054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a261b0 msgr2=0x55fc22dc34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a261b0 0x55fc22dc34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46000640 1 -- 172.21.15.47:0/3820933054 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc22dbf4a0 con 0x55fc22a054d0 2024-05-14T12:40:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.396+0000 7f7d46a00640 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc229fd2f0 0x55fc22dd0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:40:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.397+0000 7f7d46000640 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a054d0 0x55fc22dd92d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d3401d000 tx=0x7f7d34011620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9514d542c1669cd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.397+0000 7f7d33400640 1 -- 172.21.15.47:0/3820933054 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34004020 con 0x55fc22a054d0 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.397+0000 7f7d33400640 1 -- 172.21.15.47:0/3820933054 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d340054f0 con 0x55fc22a054d0 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.397+0000 7f7d33400640 1 -- 172.21.15.47:0/3820933054 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400faf0 con 0x55fc22a054d0 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 -- 172.21.15.47:0/3820933054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a054d0 msgr2=0x55fc22dd92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a054d0 0x55fc22dd92d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d3401d000 tx=0x7f7d34011620 comp rx=0 tx=0).stop 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 -- 172.21.15.47:0/3820933054 shutdown_connections 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a261b0 0x55fc22dc34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc22a054d0 0x55fc22dd92d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 --2- 172.21.15.47:0/3820933054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc229fd2f0 0x55fc22dd0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 -- 172.21.15.47:0/3820933054 >> 172.21.15.47:0/3820933054 conn(0x55fc22a1a300 msgr2=0x55fc22dd06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 -- 172.21.15.47:0/3820933054 shutdown_connections 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.398+0000 7f7d549ab740 1 -- 172.21.15.47:0/3820933054 wait complete. 2024-05-14T12:40:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.399+0000 7f7d549ab740 1 -- start start 2024-05-14T12:40:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.399+0000 7f7d549ab740 1 Processor -- start 2024-05-14T12:40:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.399+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dd63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dd68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d549ab740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dd7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d549ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481ae770 con 0x55fc22a054d0 2024-05-14T12:40:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d549ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481ae0a0 con 0x55fc229fd2f0 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d549ab740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481ab230 con 0x55fc22a261b0 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d549ab740 10 client.0 _ll_register_callbacks cb 0x7f7d40003ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dd63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dd63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:36128/0 (socket says 172.21.15.47:36128) 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 -- 172.21.15.47:0/710604500 learned_addr learned my addr 172.21.15.47:0/710604500 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d47400640 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dd7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46000640 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dd68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 -- 172.21.15.47:0/710604500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 msgr2=0x55fc22dd7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dd7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 -- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 msgr2=0x55fc22dd68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dd68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 -- 172.21.15.47:0/710604500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc22dd7de0 con 0x55fc229fd2f0 2024-05-14T12:40:55.404 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d46a00640 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dd63b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d38004150 tx=0x7f7d38004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52371a867681d94f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.400+0000 7f7d30c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d30c00640 1 -- 172.21.15.47:0/710604500 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38003b80 con 0x55fc229fd2f0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d30c00640 1 -- 172.21.15.47:0/710604500 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7d38018030 con 0x55fc229fd2f0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d340054f0 con 0x55fc229fd2f0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d30c00640 1 -- 172.21.15.47:0/710604500 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7d3803a050 con 0x55fc229fd2f0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 10 client.26282 fetch_fsmap learned FSMap version 56 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55fc22dd9170 con 0x55fc229fd2f0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d30c00640 1 -- 172.21.15.47:0/710604500 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d340054f0 con 0x55fc229fd2f0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d30c00640 1 -- 172.21.15.47:0/710604500 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 56) ==== 8374+0+0 (secure 0 0 0) 0x7f7d3801f430 con 0x55fc229fd2f0 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 10 client.26282 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 10 client.26282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 20 client.26282 populate_metadata read hostname 'smithi047' 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229ba1c0 0x55fc22e4a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:40:55.405 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 4 client.26282 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:40:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.401+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc22d33fd0 con 0x55fc229ba1c0 2024-05-14T12:40:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.402+0000 7f7d46000640 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229ba1c0 0x55fc22e4a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:40:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.402+0000 7f7d46000640 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229ba1c0 0x55fc22e4a1d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d9bc6360575b01a server_cookie=57a015993f552b5a in_seq=0 out_seq=0 2024-05-14T12:40:55.406 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:40:55.402+0000 7f7d30c00640 10 client.26282 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:40:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:55 smithi073 ceph-mon[35809]: Adjusting osd_memory_target on smithi073 to 176.2M 2024-05-14T12:40:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:55 smithi073 ceph-mon[35809]: Unable to set osd_memory_target on smithi073 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-05-14T12:40:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:55 smithi073 ceph-mon[35809]: pgmap v922: 97 pgs: 97 active+clean; 5.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 19 op/s 2024-05-14T12:40:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:40:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:40:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:55 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:40:56.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:55 smithi066 ceph-mon[35981]: Adjusting osd_memory_target on smithi073 to 176.2M 2024-05-14T12:40:56.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:55 smithi066 ceph-mon[35981]: Unable to set osd_memory_target on smithi073 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-05-14T12:40:56.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:55 smithi066 ceph-mon[35981]: pgmap v922: 97 pgs: 97 active+clean; 5.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 19 op/s 2024-05-14T12:40:56.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:40:56.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:40:56.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:55 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:40:56.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:55 smithi047 ceph-mon[31254]: Adjusting osd_memory_target on smithi073 to 176.2M 2024-05-14T12:40:56.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:55 smithi047 ceph-mon[31254]: Unable to set osd_memory_target on smithi073 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-05-14T12:40:56.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:55 smithi047 ceph-mon[31254]: pgmap v922: 97 pgs: 97 active+clean; 5.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 19 op/s 2024-05-14T12:40:56.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:40:56.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:40:56.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:55 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:40:58.287 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:58 smithi047 ceph-mon[31254]: pgmap v923: 97 pgs: 97 active+clean; 5.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 23 op/s 2024-05-14T12:40:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:58 smithi066 ceph-mon[35981]: pgmap v923: 97 pgs: 97 active+clean; 5.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 23 op/s 2024-05-14T12:40:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:58 smithi073 ceph-mon[35809]: pgmap v923: 97 pgs: 97 active+clean; 5.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 23 op/s 2024-05-14T12:40:59.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:40:59 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:59.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:40:59 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:40:59.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:40:59 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:41:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:00 smithi066 ceph-mon[35981]: pgmap v924: 97 pgs: 97 active+clean; 5.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 19 op/s 2024-05-14T12:41:00.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:00 smithi047 ceph-mon[31254]: pgmap v924: 97 pgs: 97 active+clean; 5.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 19 op/s 2024-05-14T12:41:00.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:00 smithi073 ceph-mon[35809]: pgmap v924: 97 pgs: 97 active+clean; 5.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 19 op/s 2024-05-14T12:41:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:02 smithi066 ceph-mon[35981]: pgmap v925: 97 pgs: 97 active+clean; 5.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 20 op/s 2024-05-14T12:41:02.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:02 smithi047 ceph-mon[31254]: pgmap v925: 97 pgs: 97 active+clean; 5.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 20 op/s 2024-05-14T12:41:02.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:02 smithi073 ceph-mon[35809]: pgmap v925: 97 pgs: 97 active+clean; 5.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 20 op/s 2024-05-14T12:41:04.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:04 smithi066 ceph-mon[35981]: pgmap v926: 97 pgs: 97 active+clean; 5.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 20 op/s 2024-05-14T12:41:04.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:04 smithi047 ceph-mon[31254]: pgmap v926: 97 pgs: 97 active+clean; 5.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 20 op/s 2024-05-14T12:41:04.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:04 smithi073 ceph-mon[35809]: pgmap v926: 97 pgs: 97 active+clean; 5.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 20 op/s 2024-05-14T12:41:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:06 smithi066 ceph-mon[35981]: pgmap v927: 97 pgs: 97 active+clean; 5.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.4 KiB/s wr, 17 op/s 2024-05-14T12:41:06.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:06 smithi047 ceph-mon[31254]: pgmap v927: 97 pgs: 97 active+clean; 5.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.4 KiB/s wr, 17 op/s 2024-05-14T12:41:06.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:06 smithi073 ceph-mon[35809]: pgmap v927: 97 pgs: 97 active+clean; 5.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.4 KiB/s wr, 17 op/s 2024-05-14T12:41:07.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:07 smithi047 ceph-mon[31254]: pgmap v928: 97 pgs: 97 active+clean; 5.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 22 op/s 2024-05-14T12:41:07.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:07 smithi073 ceph-mon[35809]: pgmap v928: 97 pgs: 97 active+clean; 5.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 22 op/s 2024-05-14T12:41:07.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:07 smithi066 ceph-mon[35981]: pgmap v928: 97 pgs: 97 active+clean; 5.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 22 op/s 2024-05-14T12:41:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:09 smithi047 ceph-mon[31254]: pgmap v929: 97 pgs: 97 active+clean; 5.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 KiB/s wr, 18 op/s 2024-05-14T12:41:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:09 smithi073 ceph-mon[35809]: pgmap v929: 97 pgs: 97 active+clean; 5.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 KiB/s wr, 18 op/s 2024-05-14T12:41:10.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:09 smithi066 ceph-mon[35981]: pgmap v929: 97 pgs: 97 active+clean; 5.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 KiB/s wr, 18 op/s 2024-05-14T12:41:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:11 smithi047 ceph-mon[31254]: pgmap v930: 97 pgs: 97 active+clean; 5.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 20 op/s 2024-05-14T12:41:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:11 smithi073 ceph-mon[35809]: pgmap v930: 97 pgs: 97 active+clean; 5.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 20 op/s 2024-05-14T12:41:12.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:11 smithi066 ceph-mon[35981]: pgmap v930: 97 pgs: 97 active+clean; 5.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 20 op/s 2024-05-14T12:41:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:13 smithi047 ceph-mon[31254]: pgmap v931: 97 pgs: 97 active+clean; 5.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 21 op/s 2024-05-14T12:41:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:13 smithi073 ceph-mon[35809]: pgmap v931: 97 pgs: 97 active+clean; 5.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 21 op/s 2024-05-14T12:41:14.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:13 smithi066 ceph-mon[35981]: pgmap v931: 97 pgs: 97 active+clean; 5.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 21 op/s 2024-05-14T12:41:15.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.340+0000 7f7d30c00640 1 -- 172.21.15.47:0/710604500 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc22d33fd0 con 0x55fc229ba1c0 2024-05-14T12:41:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.340+0000 7f7d30c00640 10 client.26282 handle_command_reply: tid=0 2024-05-14T12:41:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.340+0000 7f7d549ab740 1 client.26282 shutdown 2024-05-14T12:41:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.340+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 msgr2=0x55fc22dd63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.340+0000 7f7d549ab740 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dd63b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d38004150 tx=0x7f7d38004730 comp rx=0 tx=0).stop 2024-05-14T12:41:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 shutdown_connections 2024-05-14T12:41:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d549ab740 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fc229ba1c0 0x55fc22e4a1d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d549ab740 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fc22a261b0 0x55fc22dd7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d549ab740 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fc22a054d0 0x55fc22dd68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d549ab740 1 --2- 172.21.15.47:0/710604500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc229fd2f0 0x55fc22dd63b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 >> 172.21.15.47:0/710604500 conn(0x55fc22a1a300 msgr2=0x55fc22dc6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d30c00640 0 client.26282 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.341+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 shutdown_connections 2024-05-14T12:41:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.342+0000 7f7d549ab740 1 -- 172.21.15.47:0/710604500 wait complete. 2024-05-14T12:41:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.342+0000 7f7d549ab740 20 client.26282 trim_cache size 0 max 16384 2024-05-14T12:41:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:41:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:41:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:41:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:41:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7d2c0b2920 msgr2=0x7f7d2c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7d2c0b2920 0x7f7d2c0b4e30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fc22dc96e0 tx=0x7f7d38005f90 comp rx=0 tx=0).stop 2024-05-14T12:41:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4810b9f0 msgr2=0x7f7d481a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4810b9f0 0x7f7d481a37f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7d40033040 tx=0x7f7d400316f0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 shutdown_connections 2024-05-14T12:41:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7d2c0b2920 0x7f7d2c0b4e30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4810b9f0 0x7f7d481a37f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d48075a10 0x7f7d4819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.343+0000 7f7d47e00640 1 --2- 172.21.15.47:0/888328900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d480750c0 0x7f7d4819c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.344+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 >> 172.21.15.47:0/888328900 conn(0x7f7d480fec70 msgr2=0x7f7d480ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.344+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 shutdown_connections 2024-05-14T12:41:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:15.344+0000 7f7d47e00640 1 -- 172.21.15.47:0/888328900 wait complete. 2024-05-14T12:41:16.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:15 smithi047 ceph-mon[31254]: pgmap v932: 97 pgs: 97 active+clean; 5.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 18 op/s 2024-05-14T12:41:16.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:15 smithi073 ceph-mon[35809]: pgmap v932: 97 pgs: 97 active+clean; 5.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 18 op/s 2024-05-14T12:41:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:15 smithi066 ceph-mon[35981]: pgmap v932: 97 pgs: 97 active+clean; 5.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 18 op/s 2024-05-14T12:41:18.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:17 smithi047 ceph-mon[31254]: pgmap v933: 97 pgs: 97 active+clean; 5.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-14T12:41:18.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:17 smithi073 ceph-mon[35809]: pgmap v933: 97 pgs: 97 active+clean; 5.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-14T12:41:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:17 smithi066 ceph-mon[35981]: pgmap v933: 97 pgs: 97 active+clean; 5.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-14T12:41:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:19 smithi047 ceph-mon[31254]: pgmap v934: 97 pgs: 97 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-05-14T12:41:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:19 smithi073 ceph-mon[35809]: pgmap v934: 97 pgs: 97 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-05-14T12:41:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:19 smithi066 ceph-mon[35981]: pgmap v934: 97 pgs: 97 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-05-14T12:41:22.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:21 smithi047 ceph-mon[31254]: pgmap v935: 97 pgs: 97 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.8 KiB/s wr, 20 op/s 2024-05-14T12:41:22.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:21 smithi073 ceph-mon[35809]: pgmap v935: 97 pgs: 97 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.8 KiB/s wr, 20 op/s 2024-05-14T12:41:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:21 smithi066 ceph-mon[35981]: pgmap v935: 97 pgs: 97 active+clean; 4.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.8 KiB/s wr, 20 op/s 2024-05-14T12:41:24.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:23 smithi047 ceph-mon[31254]: pgmap v936: 97 pgs: 97 active+clean; 4.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-05-14T12:41:24.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:23 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:41:24.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:23 smithi073 ceph-mon[35809]: pgmap v936: 97 pgs: 97 active+clean; 4.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-05-14T12:41:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:23 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:41:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:23 smithi066 ceph-mon[35981]: pgmap v936: 97 pgs: 97 active+clean; 4.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.3 KiB/s wr, 21 op/s 2024-05-14T12:41:24.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:23 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:41:24.518 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.3 2024-05-14T12:41:24.519 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:41:24.996 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:41:26.191 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:25 smithi047 ceph-mon[31254]: pgmap v937: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.2 KiB/s wr, 18 op/s 2024-05-14T12:41:26.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:25 smithi073 ceph-mon[35809]: pgmap v937: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.2 KiB/s wr, 18 op/s 2024-05-14T12:41:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:25 smithi066 ceph-mon[35981]: pgmap v937: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.2 KiB/s wr, 18 op/s 2024-05-14T12:41:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.445+0000 7f2a25a00700 1 -- 172.21.15.47:0/1051357657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20115370 msgr2=0x7f2a20117790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.445+0000 7f2a25a00700 1 --2- 172.21.15.47:0/1051357657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20115370 0x7f2a20117790 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800b0a0 tx=0x7f2a1800b3b0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.445+0000 7f2a25a00700 1 -- 172.21.15.47:0/1051357657 shutdown_connections 2024-05-14T12:41:27.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.445+0000 7f2a25a00700 1 --2- 172.21.15.47:0/1051357657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20115370 0x7f2a20117790 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.445+0000 7f2a25a00700 1 --2- 172.21.15.47:0/1051357657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a20075b60 0x7f2a20075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.445+0000 7f2a25a00700 1 --2- 172.21.15.47:0/1051357657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a200764b0 0x7f2a20114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.445+0000 7f2a25a00700 1 -- 172.21.15.47:0/1051357657 >> 172.21.15.47:0/1051357657 conn(0x7f2a20100040 msgr2=0x7f2a20102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.446+0000 7f2a25a00700 1 -- 172.21.15.47:0/1051357657 shutdown_connections 2024-05-14T12:41:27.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.446+0000 7f2a25a00700 1 -- 172.21.15.47:0/1051357657 wait complete. 2024-05-14T12:41:27.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.448+0000 7f2a25a00700 1 Processor -- start 2024-05-14T12:41:27.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.448+0000 7f2a25a00700 1 -- start start 2024-05-14T12:41:27.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a25a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20075b60 0x7f2a201a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:27.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a25a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a200764b0 0x7f2a201a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:27.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a25a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a20115370 0x7f2a201a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:27.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a25a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2011aad0 con 0x7f2a20115370 2024-05-14T12:41:27.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a25a00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2011a950 con 0x7f2a200764b0 2024-05-14T12:41:27.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a25a00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2011ac50 con 0x7f2a20075b60 2024-05-14T12:41:27.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a1ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20075b60 0x7f2a201a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a1e000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a200764b0 0x7f2a201a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a1ea00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20075b60 0x7f2a201a13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:59646/0 (socket says 172.21.15.47:59646) 2024-05-14T12:41:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.449+0000 7f2a1ea00700 1 -- 172.21.15.47:0/4064938010 learned_addr learned my addr 172.21.15.47:0/4064938010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1f400700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a20115370 0x7f2a201a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1ea00700 1 -- 172.21.15.47:0/4064938010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a200764b0 msgr2=0x7f2a201a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1ea00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a200764b0 0x7f2a201a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1ea00700 1 -- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a20115370 msgr2=0x7f2a201a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1ea00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a20115370 0x7f2a201a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1ea00700 1 -- 172.21.15.47:0/4064938010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a201a6270 con 0x7f2a20075b60 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1e000700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a200764b0 0x7f2a201a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.450+0000 7f2a1ea00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20075b60 0x7f2a201a13a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000e9a0 tx=0x7f2a1000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.451+0000 7f2a17400700 1 -- 172.21.15.47:0/4064938010 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000cbd0 con 0x7f2a20075b60 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.451+0000 7f2a17400700 1 -- 172.21.15.47:0/4064938010 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a1000cd70 con 0x7f2a20075b60 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.451+0000 7f2a17400700 1 -- 172.21.15.47:0/4064938010 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10018680 con 0x7f2a20075b60 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.451+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a201a6560 con 0x7f2a20075b60 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.451+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201ade80 con 0x7f2a20075b60 2024-05-14T12:41:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.452+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a200772a0 con 0x7f2a20075b60 2024-05-14T12:41:27.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.454+0000 7f2a17400700 1 -- 172.21.15.47:0/4064938010 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2a10010430 con 0x7f2a20075b60 2024-05-14T12:41:27.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.456+0000 7f2a17400700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2a040b2900 0x7f2a040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:27.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.456+0000 7f2a17400700 1 -- 172.21.15.47:0/4064938010 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2a100e2470 con 0x7f2a20075b60 2024-05-14T12:41:27.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.457+0000 7f2a1e000700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2a040b2900 0x7f2a040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:27.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.457+0000 7f2a1e000700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2a040b2900 0x7f2a040b4e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a201034e0 tx=0x7f2a0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:27.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.460+0000 7f2a17400700 1 -- 172.21.15.47:0/4064938010 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2a100aa150 con 0x7f2a20075b60 2024-05-14T12:41:27.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.762+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a201a2700 con 0x7f2a20075b60 2024-05-14T12:41:27.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.763+0000 7f2a17400700 1 -- 172.21.15.47:0/4064938010 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+11927 (secure 0 0 0) 0x7f2a100a9a50 con 0x7f2a20075b60 2024-05-14T12:41:27.763 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:41:27.763 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":58,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:41:22.671992+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24502,24490,24517,24535,24521]},"id":1}]} 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2a040b2900 msgr2=0x7f2a040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2a040b2900 0x7f2a040b4e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a201034e0 tx=0x7f2a0c009260 comp rx=0 tx=0).stop 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20075b60 msgr2=0x7f2a201a13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20075b60 0x7f2a201a13a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000e9a0 tx=0x7f2a1000ecb0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 shutdown_connections 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f2a040b2900 0x7f2a040b4e10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a20115370 0x7f2a201a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a20075b60 0x7f2a201a13a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 --2- 172.21.15.47:0/4064938010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a200764b0 0x7f2a201a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 >> 172.21.15.47:0/4064938010 conn(0x7f2a20100040 msgr2=0x7f2a201005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 shutdown_connections 2024-05-14T12:41:27.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:27.766+0000 7f2a25a00700 1 -- 172.21.15.47:0/4064938010 wait complete. 2024-05-14T12:41:27.767 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 58 2024-05-14T12:41:28.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:27 smithi047 ceph-mon[31254]: pgmap v938: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 22 op/s 2024-05-14T12:41:28.210 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:27 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/4064938010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:41:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:27 smithi073 ceph-mon[35809]: pgmap v938: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 22 op/s 2024-05-14T12:41:28.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:27 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/4064938010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:41:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:27 smithi066 ceph-mon[35981]: pgmap v938: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 22 op/s 2024-05-14T12:41:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:27 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/4064938010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 -- 172.21.15.47:0/2017181831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88104560 msgr2=0x7fec88106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 --2- 172.21.15.47:0/2017181831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88104560 0x7fec88106980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fec7800dc90 tx=0x7fec7802e370 comp rx=0 tx=0).stop 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 -- 172.21.15.47:0/2017181831 shutdown_connections 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 --2- 172.21.15.47:0/2017181831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec88109820 0x7fec8810bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 --2- 172.21.15.47:0/2017181831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 0x7fec881092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 --2- 172.21.15.47:0/2017181831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88104560 0x7fec88106980 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 -- 172.21.15.47:0/2017181831 >> 172.21.15.47:0/2017181831 conn(0x7fec880fdb60 msgr2=0x7fec88100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 -- 172.21.15.47:0/2017181831 shutdown_connections 2024-05-14T12:41:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.589+0000 7fec87200640 1 -- 172.21.15.47:0/2017181831 wait complete. 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.590+0000 7fec87200640 1 Processor -- start 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.590+0000 7fec87200640 1 -- start start 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec87200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec88104560 0x7fec88198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec87200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 0x7fec88198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec87200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88109820 0x7fec8819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec87200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec8810d490 con 0x7fec88104560 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec87200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec8810d310 con 0x7fec88109820 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec87200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec8810d610 con 0x7fec88106ec0 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 0x7fec88198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 0x7fec88198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:46466/0 (socket says 172.21.15.47:46466) 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 -- 172.21.15.47:0/9969125 learned_addr learned my addr 172.21.15.47:0/9969125 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec88104560 0x7fec88198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec86800640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88109820 0x7fec8819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 -- 172.21.15.47:0/9969125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88109820 msgr2=0x7fec8819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88109820 0x7fec8819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 -- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec88104560 msgr2=0x7fec88198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec88104560 0x7fec88198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.591+0000 7fec85400640 1 -- 172.21.15.47:0/9969125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8819fb40 con 0x7fec88106ec0 2024-05-14T12:41:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.592+0000 7fec85400640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 0x7fec88198540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec7400ea60 tx=0x7fec7400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.592+0000 7fec7ea00640 1 -- 172.21.15.47:0/9969125 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7400cde0 con 0x7fec88106ec0 2024-05-14T12:41:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.592+0000 7fec7ea00640 1 -- 172.21.15.47:0/9969125 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec740035f0 con 0x7fec88106ec0 2024-05-14T12:41:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.592+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8819fe30 con 0x7fec88106ec0 2024-05-14T12:41:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.592+0000 7fec7ea00640 1 -- 172.21.15.47:0/9969125 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74010690 con 0x7fec88106ec0 2024-05-14T12:41:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.592+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec881a0290 con 0x7fec88106ec0 2024-05-14T12:41:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.595+0000 7fec93feb740 1 Processor -- start 2024-05-14T12:41:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec93feb740 1 -- start start 2024-05-14T12:41:28.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec7ea00640 1 -- 172.21.15.47:0/9969125 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fec74010830 con 0x7fec88106ec0 2024-05-14T12:41:28.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec93feb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097801b0 0x561609b22300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec93feb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097572f0 0x561609b22880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec93feb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56160975f4d0 0x561609b29780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec93feb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561609a86550 con 0x56160975f4d0 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec93feb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561609a2bbc0 con 0x5616097572f0 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec93feb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561609a82510 con 0x5616097801b0 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec86800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097801b0 0x561609b22300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec85e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097572f0 0x561609b22880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec86800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097801b0 0x561609b22300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:46480/0 (socket says 172.21.15.47:46480) 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.596+0000 7fec86800640 1 -- 172.21.15.47:0/1986438967 learned_addr learned my addr 172.21.15.47:0/1986438967 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85400640 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56160975f4d0 0x561609b29780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85e00640 1 -- 172.21.15.47:0/1986438967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097801b0 msgr2=0x561609b22300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85e00640 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097801b0 0x561609b22300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85e00640 1 -- 172.21.15.47:0/1986438967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56160975f4d0 msgr2=0x561609b29780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85e00640 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56160975f4d0 0x561609b29780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85e00640 1 -- 172.21.15.47:0/1986438967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561609798210 con 0x5616097572f0 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec86800640 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097801b0 0x561609b22300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85400640 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56160975f4d0 0x561609b29780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.597+0000 7fec85e00640 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097572f0 0x561609b22880 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec7802e960 tx=0x7fec78004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e9681f7fc042cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.598+0000 7fec7ea00640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fec6c0b28f0 0x7fec6c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.598+0000 7fec73400640 1 -- 172.21.15.47:0/1986438967 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec780046c0 con 0x5616097572f0 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.598+0000 7fec73400640 1 -- 172.21.15.47:0/1986438967 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec78004860 con 0x5616097572f0 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.598+0000 7fec73400640 1 -- 172.21.15.47:0/1986438967 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78003990 con 0x5616097572f0 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.598+0000 7fec7ea00640 1 -- 172.21.15.47:0/9969125 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fec740e2480 con 0x7fec88106ec0 2024-05-14T12:41:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.598+0000 7fec86800640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fec6c0b28f0 0x7fec6c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 -- 172.21.15.47:0/1986438967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097572f0 msgr2=0x561609b22880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097572f0 0x561609b22880 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec7802e960 tx=0x7fec78004ad0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec86800640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fec6c0b28f0 0x7fec6c0b4e00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x561609b234d0 tx=0x7fec800096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 -- 172.21.15.47:0/1986438967 shutdown_connections 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56160975f4d0 0x561609b29780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097572f0 0x561609b22880 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 --2- 172.21.15.47:0/1986438967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097801b0 0x561609b22300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 -- 172.21.15.47:0/1986438967 >> 172.21.15.47:0/1986438967 conn(0x561609774300 msgr2=0x561609b1dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 -- 172.21.15.47:0/1986438967 shutdown_connections 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.599+0000 7fec93feb740 1 -- 172.21.15.47:0/1986438967 wait complete. 2024-05-14T12:41:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.600+0000 7fec93feb740 1 -- start start 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.600+0000 7fec93feb740 1 Processor -- start 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.600+0000 7fec93feb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097572f0 0x561609b2bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.600+0000 7fec93feb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56160975f4d0 0x561609b2c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.600+0000 7fec93feb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097801b0 0x561609b33240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.600+0000 7fec93feb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561609b2a170 con 0x5616097572f0 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec93feb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561609a3f660 con 0x5616097801b0 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec93feb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x561609b2a2f0 con 0x56160975f4d0 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec93feb740 10 client.0 _ll_register_callbacks cb 0x561609a09400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097801b0 0x561609b33240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec85e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097572f0 0x561609b2bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec85400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56160975f4d0 0x561609b2c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097801b0 0x561609b33240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59684/0 (socket says 172.21.15.47:59684) 2024-05-14T12:41:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 -- 172.21.15.47:0/2367234508 learned_addr learned my addr 172.21.15.47:0/2367234508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 -- 172.21.15.47:0/2367234508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56160975f4d0 msgr2=0x561609b2c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56160975f4d0 0x561609b2c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 -- 172.21.15.47:0/2367234508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097572f0 msgr2=0x561609b2bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097572f0 0x561609b2bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec86800640 1 -- 172.21.15.47:0/2367234508 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561609864620 con 0x5616097801b0 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.601+0000 7fec85400640 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56160975f4d0 0x561609b2c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec86800640 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097801b0 0x561609b33240 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec80005f10 tx=0x7fec80004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=994587e6e2a6e689 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec67e00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec67e00640 1 -- 172.21.15.47:0/2367234508 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8002c060 con 0x5616097801b0 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec67e00640 1 -- 172.21.15.47:0/2367234508 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fec80017030 con 0x5616097801b0 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec78004860 con 0x5616097801b0 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec67e00640 1 -- 172.21.15.47:0/2367234508 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fec80011650 con 0x5616097801b0 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec93feb740 10 client.26300 fetch_fsmap learned FSMap version 58 2024-05-14T12:41:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.602+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x561609b36240 con 0x5616097801b0 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec67e00640 1 -- 172.21.15.47:0/2367234508 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec78004860 con 0x5616097801b0 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec67e00640 1 -- 172.21.15.47:0/2367234508 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fec8001c860 con 0x5616097801b0 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec93feb740 10 client.26300 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec93feb740 10 client.26300 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec93feb740 20 client.26300 populate_metadata read hostname 'smithi047' 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec93feb740 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56160973ed80 0x561609b39930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec93feb740 4 client.26300 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561609a94160 con 0x56160973ed80 2024-05-14T12:41:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.603+0000 7fec85e00640 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56160973ed80 0x561609b39930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.604+0000 7fec85e00640 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56160973ed80 0x561609b39930 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a24cffa0d113b990 server_cookie=59951834307d3f2a in_seq=0 out_seq=0 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.604+0000 7fec67e00640 10 client.26300 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.605+0000 7fec67e00640 1 -- 172.21.15.47:0/2367234508 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561609a94160 con 0x56160973ed80 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.605+0000 7fec67e00640 10 client.26300 handle_command_reply: tid=0 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.605+0000 7fec93feb740 1 client.26300 shutdown 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.605+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097801b0 msgr2=0x561609b33240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.605+0000 7fec93feb740 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097801b0 0x561609b33240 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec80005f10 tx=0x7fec80004ab0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 shutdown_connections 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x56160973ed80 0x561609b39930 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5616097801b0 0x561609b33240 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56160975f4d0 0x561609b2c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec67e00640 0 client.26300 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 --2- 172.21.15.47:0/2367234508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097572f0 0x561609b2bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 >> 172.21.15.47:0/2367234508 conn(0x561609774300 msgr2=0x561609b20ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 shutdown_connections 2024-05-14T12:41:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 1 -- 172.21.15.47:0/2367234508 wait complete. 2024-05-14T12:41:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.606+0000 7fec93feb740 20 client.26300 trim_cache size 0 max 16384 2024-05-14T12:41:28.626 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db / --timeout 60 --expiration 78.3 --await-for 42.0' 2024-05-14T12:41:28.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db / --timeout 60 --expiration 78.3 --await-for 42.0 2024-05-14T12:41:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 Processor -- start 2024-05-14T12:41:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 -- start start 2024-05-14T12:41:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b1c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b1c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b1ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec881a8fb0 con 0x5616097801b0 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec881aabe0 con 0x56160975f4d0 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.628+0000 7fec93feb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec881a96e0 con 0x5616097572f0 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b1c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b1c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b1c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59688/0 (socket says 172.21.15.47:59688) 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 -- 172.21.15.47:0/1802390991 learned_addr learned my addr 172.21.15.47:0/1802390991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b1c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:46502/0 (socket says 172.21.15.47:46502) 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec86800640 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b1ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 -- 172.21.15.47:0/1802390991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 msgr2=0x561609b1c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b1c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 -- 172.21.15.47:0/1802390991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 msgr2=0x561609b1ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b1ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 -- 172.21.15.47:0/1802390991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561609b2ce10 con 0x56160975f4d0 2024-05-14T12:41:28.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec86800640 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b1ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:41:28.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.629+0000 7fec85400640 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b1c790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fec7400c760 tx=0x7fec740a93f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55737592c88b93be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:28.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.630+0000 7fec72a00640 1 -- 172.21.15.47:0/1802390991 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740b2250 con 0x56160975f4d0 2024-05-14T12:41:28.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.630+0000 7fec72a00640 1 -- 172.21.15.47:0/1802390991 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec740a95b0 con 0x56160975f4d0 2024-05-14T12:41:28.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.630+0000 7fec72a00640 1 -- 172.21.15.47:0/1802390991 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74003ac0 con 0x56160975f4d0 2024-05-14T12:41:28.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.630+0000 7fec93feb740 1 -- 172.21.15.47:0/1802390991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 msgr2=0x561609b1c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:28.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.630+0000 7fec93feb740 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b1c790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fec7400c760 tx=0x7fec740a93f0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 -- 172.21.15.47:0/1802390991 shutdown_connections 2024-05-14T12:41:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b1ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b1c790 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 --2- 172.21.15.47:0/1802390991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b1c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 -- 172.21.15.47:0/1802390991 >> 172.21.15.47:0/1802390991 conn(0x561609774300 msgr2=0x561609b26260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:28.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 -- 172.21.15.47:0/1802390991 shutdown_connections 2024-05-14T12:41:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 -- 172.21.15.47:0/1802390991 wait complete. 2024-05-14T12:41:28.646 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 -- start start 2024-05-14T12:41:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.631+0000 7fec93feb740 1 Processor -- start 2024-05-14T12:41:28.647 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec93feb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b306e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec93feb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b30c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec93feb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b9fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec93feb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec881aa510 con 0x5616097801b0 2024-05-14T12:41:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec93feb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec881a9e40 con 0x56160975f4d0 2024-05-14T12:41:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec93feb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec881a6f70 con 0x5616097572f0 2024-05-14T12:41:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec93feb740 10 client.0 _ll_register_callbacks cb 0x7fec80003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:41:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec85400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b30c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec85400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b30c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59696/0 (socket says 172.21.15.47:59696) 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec85400640 1 -- 172.21.15.47:0/2548511142 learned_addr learned my addr 172.21.15.47:0/2548511142 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec85e00640 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.632+0000 7fec86800640 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b9fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec85e00640 1 -- 172.21.15.47:0/2548511142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 msgr2=0x561609b30c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec85e00640 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b30c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec85e00640 1 -- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 msgr2=0x561609b9fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec85e00640 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b9fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec85e00640 1 -- 172.21.15.47:0/2548511142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561609b33b70 con 0x5616097572f0 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec85e00640 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b306e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec7800dc60 tx=0x7fec78005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77bb165d58b42e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec67e00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:41:28.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec67e00640 1 -- 172.21.15.47:0/2548511142 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78054030 con 0x5616097572f0 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec67e00640 1 -- 172.21.15.47:0/2548511142 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fec7803b040 con 0x5616097572f0 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.633+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec740a95b0 con 0x5616097572f0 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec67e00640 1 -- 172.21.15.47:0/2548511142 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fec780048a0 con 0x5616097572f0 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 10 client.26332 fetch_fsmap learned FSMap version 58 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x561609ba1180 con 0x5616097572f0 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec67e00640 1 -- 172.21.15.47:0/2548511142 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec740a95b0 con 0x5616097572f0 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec67e00640 1 -- 172.21.15.47:0/2548511142 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7fec7800b870 con 0x5616097572f0 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 10 client.26332 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 10 client.26332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 20 client.26332 populate_metadata read hostname 'smithi047' 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5616097141c0 0x561609ba37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 4 client.26332 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:41:28.651 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.634+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561609a8dfd0 con 0x5616097141c0 2024-05-14T12:41:28.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.635+0000 7fec85400640 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5616097141c0 0x561609ba37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:28.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.635+0000 7fec85400640 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5616097141c0 0x561609ba37c0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48893911301a7e1 server_cookie=5e4c0279a73e8c97 in_seq=0 out_seq=0 2024-05-14T12:41:28.652 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:28.635+0000 7fec67e00640 10 client.26332 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:29.043 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:41:30.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:29 smithi047 ceph-mon[31254]: pgmap v939: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T12:41:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:29 smithi073 ceph-mon[35809]: pgmap v939: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T12:41:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:29 smithi066 ceph-mon[35981]: pgmap v939: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 -- 172.21.15.47:0/2886875829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e4110c70 msgr2=0x7f13e4113090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 --2- 172.21.15.47:0/2886875829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e4110c70 0x7f13e4113090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009f90 tx=0x7f13dc00b330 comp rx=0 tx=0).stop 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 -- 172.21.15.47:0/2886875829 shutdown_connections 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 --2- 172.21.15.47:0/2886875829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e4110c70 0x7f13e4113090 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 --2- 172.21.15.47:0/2886875829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e41030c0 0x7f13e41034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 --2- 172.21.15.47:0/2886875829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e4103a10 0x7f13e4110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 -- 172.21.15.47:0/2886875829 >> 172.21.15.47:0/2886875829 conn(0x7f13e40fedc0 msgr2=0x7f13e41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 -- 172.21.15.47:0/2886875829 shutdown_connections 2024-05-14T12:41:31.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.538+0000 7f13ea600700 1 -- 172.21.15.47:0/2886875829 wait complete. 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.539+0000 7f13ea600700 1 Processor -- start 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.539+0000 7f13ea600700 1 -- start start 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13ea600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e41030c0 0x7f13e419d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13ea600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e4103a10 0x7f13e419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13ea600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e4110c70 0x7f13e41a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13ea600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41166d0 con 0x7f13e4103a10 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13ea600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4116550 con 0x7f13e4110c70 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13ea600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4116850 con 0x7f13e41030c0 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13e3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e4110c70 0x7f13e41a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13e3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e41030c0 0x7f13e419d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13e3e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e4110c70 0x7f13e41a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59716/0 (socket says 172.21.15.47:59716) 2024-05-14T12:41:31.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13e2a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e4103a10 0x7f13e419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.540+0000 7f13e3e00700 1 -- 172.21.15.47:0/79944137 learned_addr learned my addr 172.21.15.47:0/79944137 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13e3e00700 1 -- 172.21.15.47:0/79944137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e41030c0 msgr2=0x7f13e419d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13e3e00700 1 --2- 172.21.15.47:0/79944137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e41030c0 0x7f13e419d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13e3e00700 1 -- 172.21.15.47:0/79944137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e4103a10 msgr2=0x7f13e419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13e3e00700 1 --2- 172.21.15.47:0/79944137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e4103a10 0x7f13e419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13e3e00700 1 -- 172.21.15.47:0/79944137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e41a1f30 con 0x7f13e4110c70 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13e3e00700 1 --2- 172.21.15.47:0/79944137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e4110c70 0x7f13e41a1890 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009c10 tx=0x7f13dc00cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13dbe00700 1 -- 172.21.15.47:0/79944137 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc021070 con 0x7f13e4110c70 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13dbe00700 1 -- 172.21.15.47:0/79944137 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13dc007ac0 con 0x7f13e4110c70 2024-05-14T12:41:31.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13dbe00700 1 -- 172.21.15.47:0/79944137 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc005040 con 0x7f13e4110c70 2024-05-14T12:41:31.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13ea600700 1 -- 172.21.15.47:0/79944137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41a21c0 con 0x7f13e4110c70 2024-05-14T12:41:31.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.541+0000 7f13ea600700 1 -- 172.21.15.47:0/79944137 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41a26b0 con 0x7f13e4110c70 2024-05-14T12:41:31.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.545+0000 7f13dbe00700 1 -- 172.21.15.47:0/79944137 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f13dc024070 con 0x7f13e4110c70 2024-05-14T12:41:31.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.546+0000 7f13f9106b80 1 Processor -- start 2024-05-14T12:41:31.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13f9106b80 1 -- start start 2024-05-14T12:41:31.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13dbe00700 1 --2- 172.21.15.47:0/79944137 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13c80b2900 0x7f13c80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7022a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13dbe00700 1 -- 172.21.15.47:0/79944137 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f13dc00f020 con 0x7f13e4110c70 2024-05-14T12:41:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13e2a00700 1 --2- 172.21.15.47:0/79944137 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13c80b2900 0x7f13c80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13e3400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13f9106b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fa8c617bb0 con 0x55fa8c6f5690 2024-05-14T12:41:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13f9106b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fa8c5b58f0 con 0x55fa8c577fd0 2024-05-14T12:41:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13f9106b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fa8c613b70 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13e3400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59728/0 (socket says 172.21.15.47:59728) 2024-05-14T12:41:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.547+0000 7f13e3400700 1 -- 172.21.15.47:0/2432441448 learned_addr learned my addr 172.21.15.47:0/2432441448 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e3e00700 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e2a00700 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e3e00700 1 -- 172.21.15.47:0/2432441448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 msgr2=0x55fa8c6f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:31.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e3e00700 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e3e00700 1 -- 172.21.15.47:0/2432441448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5690 msgr2=0x55fa8c6ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:31.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e3e00700 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e3e00700 1 -- 172.21.15.47:0/2432441448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8c564a60 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.548+0000 7f13e3e00700 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7022a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0aab90 tx=0x7f13dc0aa440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de1aba19e0f88dd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.549+0000 7f13e2a00700 1 --2- 172.21.15.47:0/79944137 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13c80b2900 0x7f13c80b4e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fa8c6f66b0 tx=0x7f13d0009890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.549+0000 7f13d8c00700 1 -- 172.21.15.47:0/2432441448 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc092070 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.549+0000 7f13d8c00700 1 -- 172.21.15.47:0/2432441448 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13dc0aa710 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.549+0000 7f13d8c00700 1 -- 172.21.15.47:0/2432441448 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0aae60 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 -- 172.21.15.47:0/2432441448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 msgr2=0x55fa8c7022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7022a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0aab90 tx=0x7f13dc0aa440 comp rx=0 tx=0).stop 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 -- 172.21.15.47:0/2432441448 shutdown_connections 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7022a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2432441448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 -- 172.21.15.47:0/2432441448 >> 172.21.15.47:0/2432441448 conn(0x55fa8c5b6c10 msgr2=0x55fa8c6f0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:31.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 -- 172.21.15.47:0/2432441448 shutdown_connections 2024-05-14T12:41:31.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 -- 172.21.15.47:0/2432441448 wait complete. 2024-05-14T12:41:31.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.550+0000 7f13f9106b80 1 -- start start 2024-05-14T12:41:31.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 1 Processor -- start 2024-05-14T12:41:31.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c577fd0 0x55fa8c6ff870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fa8c7029d0 con 0x55fa8c577fd0 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fa8c57dcb0 con 0x55fa8c6f5690 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fa8c702b50 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.551+0000 7f13f9106b80 10 client.0 _ll_register_callbacks cb 0x55fa8c5ab510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e2a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c577fd0 0x55fa8c6ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:46524/0 (socket says 172.21.15.47:46524) 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 -- 172.21.15.47:0/3227584663 learned_addr learned my addr 172.21.15.47:0/3227584663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e2a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:59732/0 (socket says 172.21.15.47:59732) 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c577fd0 0x55fa8c6ff870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37864/0 (socket says 172.21.15.47:37864) 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 -- 172.21.15.47:0/3227584663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 msgr2=0x55fa8c6ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 -- 172.21.15.47:0/3227584663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c577fd0 msgr2=0x55fa8c6ff870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c577fd0 0x55fa8c6ff870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 -- 172.21.15.47:0/3227584663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8c5dd5b0 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13e3e00700 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7002f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f13dc004fd0 tx=0x7f13dc0ab0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d9223f334a61a00 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.552+0000 7f13cd600700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13cd600700 1 -- 172.21.15.47:0/3227584663 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0ca060 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13cd600700 1 -- 172.21.15.47:0/3227584663 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f13dc0b3750 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13dc0aa710 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13cd600700 1 -- 172.21.15.47:0/3227584663 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f13dc0c5070 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13f9106b80 10 client.26344 fetch_fsmap learned FSMap version 58 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55fa8c7029d0 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13cd600700 1 -- 172.21.15.47:0/3227584663 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13dc0aa710 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13cd600700 1 -- 172.21.15.47:0/3227584663 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7f13dc011070 con 0x55fa8c6f5aa0 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13f9106b80 10 client.26344 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T12:41:31.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13f9106b80 10 client.26344 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:41:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13f9106b80 20 client.26344 populate_metadata read hostname 'smithi047' 2024-05-14T12:41:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.553+0000 7f13f9106b80 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c70f9c0 0x55fa8c711de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.554+0000 7f13f9106b80 4 client.26344 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:41:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.554+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa8c6c2200 con 0x55fa8c70f9c0 2024-05-14T12:41:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.554+0000 7f13e3400700 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c70f9c0 0x55fa8c711de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.554+0000 7f13e3400700 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c70f9c0 0x55fa8c711de0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba31f9e4e5553760 server_cookie=719e70066b21722b in_seq=0 out_seq=0 2024-05-14T12:41:31.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:31.554+0000 7f13cd600700 10 client.26344 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:32.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:31 smithi047 ceph-mon[31254]: pgmap v940: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T12:41:32.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:31 smithi073 ceph-mon[35809]: pgmap v940: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T12:41:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:31 smithi066 ceph-mon[35981]: pgmap v940: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-14T12:41:34.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:33 smithi047 ceph-mon[31254]: pgmap v941: 97 pgs: 97 active+clean; 4.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-05-14T12:41:34.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:33 smithi073 ceph-mon[35809]: pgmap v941: 97 pgs: 97 active+clean; 4.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-05-14T12:41:34.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:33 smithi066 ceph-mon[35981]: pgmap v941: 97 pgs: 97 active+clean; 4.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-05-14T12:41:36.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:35 smithi047 ceph-mon[31254]: pgmap v942: 97 pgs: 97 active+clean; 4.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 KiB/s wr, 18 op/s 2024-05-14T12:41:36.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:35 smithi073 ceph-mon[35809]: pgmap v942: 97 pgs: 97 active+clean; 4.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 KiB/s wr, 18 op/s 2024-05-14T12:41:36.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:35 smithi066 ceph-mon[35981]: pgmap v942: 97 pgs: 97 active+clean; 4.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 KiB/s wr, 18 op/s 2024-05-14T12:41:38.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:37 smithi047 ceph-mon[31254]: pgmap v943: 97 pgs: 97 active+clean; 4.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.3 KiB/s wr, 22 op/s 2024-05-14T12:41:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:37 smithi073 ceph-mon[35809]: pgmap v943: 97 pgs: 97 active+clean; 4.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.3 KiB/s wr, 22 op/s 2024-05-14T12:41:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:37 smithi066 ceph-mon[35981]: pgmap v943: 97 pgs: 97 active+clean; 4.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.3 KiB/s wr, 22 op/s 2024-05-14T12:41:40.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:39 smithi047 ceph-mon[31254]: pgmap v944: 97 pgs: 97 active+clean; 4.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.7 KiB/s wr, 18 op/s 2024-05-14T12:41:40.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:39 smithi073 ceph-mon[35809]: pgmap v944: 97 pgs: 97 active+clean; 4.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.7 KiB/s wr, 18 op/s 2024-05-14T12:41:40.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:39 smithi066 ceph-mon[35981]: pgmap v944: 97 pgs: 97 active+clean; 4.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.7 KiB/s wr, 18 op/s 2024-05-14T12:41:42.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:41 smithi073 ceph-mon[35809]: pgmap v945: 97 pgs: 97 active+clean; 4.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.7 KiB/s wr, 19 op/s 2024-05-14T12:41:42.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:41 smithi066 ceph-mon[35981]: pgmap v945: 97 pgs: 97 active+clean; 4.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.7 KiB/s wr, 19 op/s 2024-05-14T12:41:42.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:41 smithi047 ceph-mon[31254]: pgmap v945: 97 pgs: 97 active+clean; 4.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.7 KiB/s wr, 19 op/s 2024-05-14T12:41:44.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:43 smithi073 ceph-mon[35809]: pgmap v946: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 21 op/s 2024-05-14T12:41:44.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:43 smithi066 ceph-mon[35981]: pgmap v946: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 21 op/s 2024-05-14T12:41:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:43 smithi047 ceph-mon[31254]: pgmap v946: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 21 op/s 2024-05-14T12:41:45.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.253+0000 7fec67e00640 1 -- 172.21.15.47:0/2548511142 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561609a8dfd0 con 0x5616097141c0 2024-05-14T12:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.254+0000 7fec67e00640 10 client.26332 handle_command_reply: tid=0 2024-05-14T12:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.254+0000 7fec93feb740 1 client.26332 shutdown 2024-05-14T12:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.254+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 msgr2=0x561609b306e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:45.255 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.254+0000 7fec93feb740 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b306e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec7800dc60 tx=0x7fec78005d50 comp rx=0 tx=0).stop 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 shutdown_connections 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5616097141c0 0x561609ba37c0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616097801b0 0x561609b9fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56160975f4d0 0x561609b30c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 --2- 172.21.15.47:0/2548511142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5616097572f0 0x561609b306e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 >> 172.21.15.47:0/2548511142 conn(0x561609774300 msgr2=0x561609b1c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec67e00640 0 client.26332 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 shutdown_connections 2024-05-14T12:41:45.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.255+0000 7fec93feb740 1 -- 172.21.15.47:0/2548511142 wait complete. 2024-05-14T12:41:45.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.256+0000 7fec93feb740 20 client.26332 trim_cache size 0 max 16384 2024-05-14T12:41:45.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.255+0000 7f13cd600700 1 -- 172.21.15.47:0/3227584663 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fa8c6c2200 con 0x55fa8c70f9c0 2024-05-14T12:41:45.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.255+0000 7f13cd600700 10 client.26344 handle_command_reply: tid=0 2024-05-14T12:41:45.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.256+0000 7f13f9106b80 1 client.26344 shutdown 2024-05-14T12:41:45.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.261+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 msgr2=0x55fa8c7002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:45.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.261+0000 7f13f9106b80 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7002f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f13dc004fd0 tx=0x7f13dc0ab0f0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:41:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:41:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:41:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:41:45.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.262+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 shutdown_connections 2024-05-14T12:41:45.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.262+0000 7f13f9106b80 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c70f9c0 0x55fa8c711de0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.262+0000 7f13f9106b80 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c7002f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.262+0000 7f13f9106b80 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c577fd0 0x55fa8c6ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.262+0000 7f13f9106b80 1 --2- 172.21.15.47:0/3227584663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c6ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.262+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 >> 172.21.15.47:0/3227584663 conn(0x55fa8c5b6c10 msgr2=0x55fa8c6f0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:45.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.262+0000 7f13cd600700 0 client.26344 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:45.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.263+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 shutdown_connections 2024-05-14T12:41:45.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.263+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fec6c0b28f0 msgr2=0x7fec6c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:45.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.263+0000 7fec87200640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fec6c0b28f0 0x7fec6c0b4e00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x561609b234d0 tx=0x7fec800096c0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.263+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 msgr2=0x7fec88198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:45.265 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.263+0000 7fec87200640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 0x7fec88198540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec7400ea60 tx=0x7fec7400ef20 comp rx=0 tx=0).stop 2024-05-14T12:41:45.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.263+0000 7f13f9106b80 1 -- 172.21.15.47:0/3227584663 wait complete. 2024-05-14T12:41:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.264+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 shutdown_connections 2024-05-14T12:41:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.264+0000 7fec87200640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fec6c0b28f0 0x7fec6c0b4e00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.264+0000 7fec87200640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec88109820 0x7fec8819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.264+0000 7fec87200640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec88106ec0 0x7fec88198540 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.264+0000 7fec87200640 1 --2- 172.21.15.47:0/9969125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec88104560 0x7fec88198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.266 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.264+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 >> 172.21.15.47:0/9969125 conn(0x7fec880fdb60 msgr2=0x7fec88105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:45.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.264+0000 7f13f9106b80 20 client.26344 trim_cache size 0 max 16384 2024-05-14T12:41:45.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.264+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 shutdown_connections 2024-05-14T12:41:45.267 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:45.266+0000 7fec87200640 1 -- 172.21.15.47:0/9969125 wait complete. 2024-05-14T12:41:45.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 Processor -- start 2024-05-14T12:41:45.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 -- start start 2024-05-14T12:41:45.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:45.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5690 0x55fa8c6fb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:45.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c70b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:45.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41b0db0 con 0x55fa8c6f5aa0 2024-05-14T12:41:45.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41b29e0 con 0x55fa8c577fd0 2024-05-14T12:41:45.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.302+0000 7f13f9106b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41b14e0 con 0x55fa8c6f5690 2024-05-14T12:41:45.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:45.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:55816/0 (socket says 172.21.15.47:55816) 2024-05-14T12:41:45.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 -- 172.21.15.47:0/4146891381 learned_addr learned my addr 172.21.15.47:0/4146891381 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:45.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e2a00700 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5690 0x55fa8c6fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:45.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3e00700 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c70b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 -- 172.21.15.47:0/4146891381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5690 msgr2=0x55fa8c6fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5690 0x55fa8c6fb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 -- 172.21.15.47:0/4146891381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 msgr2=0x55fa8c70b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c70b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3400700 1 -- 172.21.15.47:0/4146891381 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8c6e8a20 con 0x55fa8c577fd0 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.303+0000 7f13e3e00700 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c70b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.304+0000 7f13e3400700 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f9a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13d4000c00 tx=0x7f13d4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86168f46cdd8d2f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:45.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.304+0000 7f13cfe00700 1 -- 172.21.15.47:0/4146891381 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004250 con 0x55fa8c577fd0 2024-05-14T12:41:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.304+0000 7f13cfe00700 1 -- 172.21.15.47:0/4146891381 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13d4025070 con 0x55fa8c577fd0 2024-05-14T12:41:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.304+0000 7f13cfe00700 1 -- 172.21.15.47:0/4146891381 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4020370 con 0x55fa8c577fd0 2024-05-14T12:41:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 -- 172.21.15.47:0/4146891381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 msgr2=0x55fa8c6f9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f9a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13d4000c00 tx=0x7f13d4009260 comp rx=0 tx=0).stop 2024-05-14T12:41:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 -- 172.21.15.47:0/4146891381 shutdown_connections 2024-05-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c70b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c577fd0 0x55fa8c6f9a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 --2- 172.21.15.47:0/4146891381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c6f5690 0x55fa8c6fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 -- 172.21.15.47:0/4146891381 >> 172.21.15.47:0/4146891381 conn(0x55fa8c5b6c10 msgr2=0x55fa8c6ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 -- 172.21.15.47:0/4146891381 shutdown_connections 2024-05-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.306+0000 7f13f9106b80 1 -- 172.21.15.47:0/4146891381 wait complete. 2024-05-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.307+0000 7f13f9106b80 1 -- start start 2024-05-14T12:41:45.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.307+0000 7f13f9106b80 1 Processor -- start 2024-05-14T12:41:45.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c577fd0 0x55fa8c7080e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c704450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13f9106b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c704990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13f9106b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41b2310 con 0x55fa8c6f5aa0 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13f9106b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41b1c40 con 0x55fa8c6f5690 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13f9106b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41aed30 con 0x55fa8c577fd0 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13f9106b80 10 client.0 _ll_register_callbacks cb 0x55fa8c5ab510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13e3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c577fd0 0x55fa8c7080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13e3400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c577fd0 0x55fa8c7080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:52864/0 (socket says 172.21.15.47:52864) 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13e3400700 1 -- 172.21.15.47:0/2962302271 learned_addr learned my addr 172.21.15.47:0/2962302271 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:45.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.308+0000 7f13e2a00700 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c704450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13e3400700 1 -- 172.21.15.47:0/2962302271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 msgr2=0x55fa8c704450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13e3400700 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c704450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13e3400700 1 -- 172.21.15.47:0/2962302271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 msgr2=0x55fa8c704990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13e3400700 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c704990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13e3400700 1 -- 172.21.15.47:0/2962302271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8c704ed0 con 0x55fa8c577fd0 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13e2a00700 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c704450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13e3400700 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c577fd0 0x55fa8c7080e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f13d4005c20 tx=0x7f13d4004100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48bd1364c79559c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:45.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.309+0000 7f13cd600700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:41:45.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.310+0000 7f13cd600700 1 -- 172.21.15.47:0/2962302271 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004550 con 0x55fa8c577fd0 2024-05-14T12:41:45.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.310+0000 7f13cd600700 1 -- 172.21.15.47:0/2962302271 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f13d4003680 con 0x55fa8c577fd0 2024-05-14T12:41:45.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.310+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13d4025070 con 0x55fa8c577fd0 2024-05-14T12:41:45.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.310+0000 7f13cd600700 1 -- 172.21.15.47:0/2962302271 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f13d4003880 con 0x55fa8c577fd0 2024-05-14T12:41:45.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.310+0000 7f13f9106b80 10 client.26350 fetch_fsmap learned FSMap version 58 2024-05-14T12:41:45.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.310+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55fa8c77ae00 con 0x55fa8c577fd0 2024-05-14T12:41:45.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.310+0000 7f13cd600700 1 -- 172.21.15.47:0/2962302271 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13d4025070 con 0x55fa8c577fd0 2024-05-14T12:41:45.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13cd600700 1 -- 172.21.15.47:0/2962302271 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 58) ==== 8374+0+0 (secure 0 0 0) 0x7f13d4004a20 con 0x55fa8c577fd0 2024-05-14T12:41:45.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13f9106b80 10 client.26350 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T12:41:45.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13f9106b80 10 client.26350 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:41:45.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13f9106b80 20 client.26350 populate_metadata read hostname 'smithi047' 2024-05-14T12:41:45.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c77b460 0x55fa8c77d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:45.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13f9106b80 4 client.26350 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.3, "await_for": 42.0}] 2024-05-14T12:41:45.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.3, "await_for": 42.0}) -- 0x55fa8c625590 con 0x55fa8c77b460 2024-05-14T12:41:45.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.311+0000 7f13e2a00700 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c77b460 0x55fa8c77d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:45.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.312+0000 7f13e2a00700 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c77b460 0x55fa8c77d8e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53f21fe52a50c3e6 server_cookie=8dfdbcf6630d1ff2 in_seq=0 out_seq=0 2024-05-14T12:41:45.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:41:45.312+0000 7f13cd600700 10 client.26350 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:46 smithi066 ceph-mon[35981]: pgmap v947: 97 pgs: 97 active+clean; 4.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 18 op/s 2024-05-14T12:41:46.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:46 smithi047 ceph-mon[31254]: pgmap v947: 97 pgs: 97 active+clean; 4.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 18 op/s 2024-05-14T12:41:46.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:46 smithi073 ceph-mon[35809]: pgmap v947: 97 pgs: 97 active+clean; 4.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 18 op/s 2024-05-14T12:41:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:48 smithi066 ceph-mon[35981]: pgmap v948: 97 pgs: 97 active+clean; 4.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-14T12:41:48.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:48 smithi047 ceph-mon[31254]: pgmap v948: 97 pgs: 97 active+clean; 4.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-14T12:41:48.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:48 smithi073 ceph-mon[35809]: pgmap v948: 97 pgs: 97 active+clean; 4.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-05-14T12:41:50.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:50 smithi066 ceph-mon[35981]: pgmap v949: 97 pgs: 97 active+clean; 3.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 KiB/s wr, 21 op/s 2024-05-14T12:41:50.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:50 smithi047 ceph-mon[31254]: pgmap v949: 97 pgs: 97 active+clean; 3.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 KiB/s wr, 21 op/s 2024-05-14T12:41:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:50 smithi073 ceph-mon[35809]: pgmap v949: 97 pgs: 97 active+clean; 3.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 KiB/s wr, 21 op/s 2024-05-14T12:41:51.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:51 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:41:51.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:51 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:41:51.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:51 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:41:52.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:52 smithi066 ceph-mon[35981]: pgmap v950: 97 pgs: 97 active+clean; 3.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-05-14T12:41:52.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:52 smithi047 ceph-mon[31254]: pgmap v950: 97 pgs: 97 active+clean; 3.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-05-14T12:41:52.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:52 smithi073 ceph-mon[35809]: pgmap v950: 97 pgs: 97 active+clean; 3.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 KiB/s wr, 22 op/s 2024-05-14T12:41:54.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:54 smithi066 ceph-mon[35981]: pgmap v951: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.6 KiB/s wr, 24 op/s 2024-05-14T12:41:54.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:54 smithi047 ceph-mon[31254]: pgmap v951: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.6 KiB/s wr, 24 op/s 2024-05-14T12:41:54.543 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:54 smithi073 ceph-mon[35809]: pgmap v951: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.6 KiB/s wr, 24 op/s 2024-05-14T12:41:55.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:55 smithi066 ceph-mon[35981]: pgmap v952: 97 pgs: 97 active+clean; 3.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-05-14T12:41:55.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:55 smithi047 ceph-mon[31254]: pgmap v952: 97 pgs: 97 active+clean; 3.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-05-14T12:41:55.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:55 smithi073 ceph-mon[35809]: pgmap v952: 97 pgs: 97 active+clean; 3.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 20 op/s 2024-05-14T12:41:56.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:56 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:41:56.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:56 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:41:56.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:56 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:41:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:57 smithi066 ceph-mon[35981]: pgmap v953: 97 pgs: 97 active+clean; 3.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 24 op/s 2024-05-14T12:41:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:41:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:41:57.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:41:57.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:57 smithi047 ceph-mon[31254]: pgmap v953: 97 pgs: 97 active+clean; 3.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 24 op/s 2024-05-14T12:41:57.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:41:57.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:41:57.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:41:57.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:57 smithi073 ceph-mon[35809]: pgmap v953: 97 pgs: 97 active+clean; 3.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 24 op/s 2024-05-14T12:41:57.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:41:57.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:41:57.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:41:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 -- 172.21.15.47:0/96645315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 msgr2=0x7f215c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 --2- 172.21.15.47:0/96645315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c1047a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f214c009900 tx=0x7f214c02a3f0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 -- 172.21.15.47:0/96645315 shutdown_connections 2024-05-14T12:41:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 --2- 172.21.15.47:0/96645315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f215c1099e0 0x7f215c10be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 --2- 172.21.15.47:0/96645315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f215c104ce0 0x7f215c1050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 --2- 172.21.15.47:0/96645315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c1047a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 -- 172.21.15.47:0/96645315 >> 172.21.15.47:0/96645315 conn(0x7f215c0fecd0 msgr2=0x7f215c101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 -- 172.21.15.47:0/96645315 shutdown_connections 2024-05-14T12:41:58.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.508+0000 7f2161800640 1 -- 172.21.15.47:0/96645315 wait complete. 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.509+0000 7f2161800640 1 Processor -- start 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2161800640 1 -- start start 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2161800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2161800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f215c104ce0 0x7f215c076130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2161800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f215c1099e0 0x7f215c076670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2161800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10f670 con 0x7f215c1099e0 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2161800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10f4f0 con 0x7f215c103aa0 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2161800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10f7f0 con 0x7f215c104ce0 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f215be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2160e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f215c1099e0 0x7f215c076670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f2153e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f215c104ce0 0x7f215c076130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f215be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c077a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:34246/0 (socket says 172.21.15.47:34246) 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.510+0000 7f215be00640 1 -- 172.21.15.47:0/3342228221 learned_addr learned my addr 172.21.15.47:0/3342228221 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2153e00640 1 -- 172.21.15.47:0/3342228221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 msgr2=0x7f215c077a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2153e00640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c077a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2153e00640 1 -- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f215c1099e0 msgr2=0x7f215c076670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2153e00640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f215c1099e0 0x7f215c076670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2153e00640 1 -- 172.21.15.47:0/3342228221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c076da0 con 0x7f215c104ce0 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f215be00640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c077a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2153e00640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f215c104ce0 0x7f215c076130 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2144005fd0 tx=0x7f214400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2159600640 1 -- 172.21.15.47:0/3342228221 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144009c30 con 0x7f215c104ce0 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2159600640 1 -- 172.21.15.47:0/3342228221 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2144009dd0 con 0x7f215c104ce0 2024-05-14T12:41:58.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c1a42d0 con 0x7f215c104ce0 2024-05-14T12:41:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2159600640 1 -- 172.21.15.47:0/3342228221 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144010460 con 0x7f215c104ce0 2024-05-14T12:41:58.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.511+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c1a4790 con 0x7f215c104ce0 2024-05-14T12:41:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 Processor -- start 2024-05-14T12:41:58.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 -- start start 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8de0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2159600640 1 -- 172.21.15.47:0/3342228221 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2144003e80 con 0x7f215c104ce0 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a152f0 0x5606d8de0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8de7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606d8d44550 con 0x5606d8a3e1b0 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5606d8ce9bc0 con 0x5606d8a152f0 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2169e39740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5606d8d40510 con 0x5606d8a1d4d0 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.515+0000 7f2160e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8de0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2153e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8de7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8de0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40726/0 (socket says 172.21.15.47:40726) 2024-05-14T12:41:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 -- 172.21.15.47:0/1120394413 learned_addr learned my addr 172.21.15.47:0/1120394413 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f215be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a152f0 0x5606d8de0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 -- 172.21.15.47:0/1120394413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 msgr2=0x5606d8de7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8de7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 -- 172.21.15.47:0/1120394413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a152f0 msgr2=0x5606d8de0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a152f0 0x5606d8de0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 -- 172.21.15.47:0/1120394413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d8a56210 con 0x5606d8a3e1b0 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f215be00640 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a152f0 0x5606d8de0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.516+0000 7f2160e00640 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8de0300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2154009f50 tx=0x7f21540118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaeec7a5994c096 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.517+0000 7f2151600640 1 -- 172.21.15.47:0/1120394413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154004d20 con 0x5606d8a3e1b0 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.517+0000 7f2151600640 1 -- 172.21.15.47:0/1120394413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2154004050 con 0x5606d8a3e1b0 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.517+0000 7f2151600640 1 -- 172.21.15.47:0/1120394413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154005280 con 0x5606d8a3e1b0 2024-05-14T12:41:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.517+0000 7f2159600640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f21400b28a0 0x7f21400b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.517+0000 7f2159600640 1 -- 172.21.15.47:0/3342228221 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f21440e20c0 con 0x7f215c104ce0 2024-05-14T12:41:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.517+0000 7f215be00640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f21400b28a0 0x7f21400b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 -- 172.21.15.47:0/1120394413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 msgr2=0x5606d8de0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8de0300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2154009f50 tx=0x7f21540118d0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 -- 172.21.15.47:0/1120394413 shutdown_connections 2024-05-14T12:41:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8de7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a152f0 0x5606d8de0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 --2- 172.21.15.47:0/1120394413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8de0300 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 -- 172.21.15.47:0/1120394413 >> 172.21.15.47:0/1120394413 conn(0x5606d8a32300 msgr2=0x5606d8ddbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 -- 172.21.15.47:0/1120394413 shutdown_connections 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f2169e39740 1 -- 172.21.15.47:0/1120394413 wait complete. 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.518+0000 7f215be00640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f21400b28a0 0x7f21400b4db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f214c000c00 tx=0x7f214c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 -- start start 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 Processor -- start 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8de9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a1d4d0 0x5606d8dea330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8df1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5606d8de81d0 con 0x5606d8a3e1b0 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5606d8cfd660 con 0x5606d8a1d4d0 2024-05-14T12:41:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.519+0000 7f2169e39740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5606d8de8350 con 0x5606d8a152f0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2169e39740 10 client.0 _ll_register_callbacks cb 0x5606d8cc7400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a1d4d0 0x5606d8dea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a1d4d0 0x5606d8dea330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:34270/0 (socket says 172.21.15.47:34270) 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 -- 172.21.15.47:0/233477829 learned_addr learned my addr 172.21.15.47:0/233477829 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f215be00640 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8de9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2160e00640 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8df1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 -- 172.21.15.47:0/233477829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 msgr2=0x5606d8de9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8de9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 -- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 msgr2=0x5606d8df1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8df1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 -- 172.21.15.47:0/233477829 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d8b22620 con 0x5606d8a1d4d0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f2153e00640 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a1d4d0 0x5606d8dea330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f21440a6a00 tx=0x7f21440a5650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6343b559d760e66f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.520+0000 7f214a000640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:41:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f214a000640 1 -- 172.21.15.47:0/233477829 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144020070 con 0x5606d8a1d4d0 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f214a000640 1 -- 172.21.15.47:0/233477829 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f21440b20b0 con 0x5606d8a1d4d0 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2154004050 con 0x5606d8a1d4d0 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f214a000640 1 -- 172.21.15.47:0/233477829 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f21440a8f00 con 0x5606d8a1d4d0 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f2169e39740 10 client.26336 fetch_fsmap learned FSMap version 59 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5606d8df42e0 con 0x5606d8a1d4d0 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f214a000640 1 -- 172.21.15.47:0/233477829 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2154004050 con 0x5606d8a1d4d0 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f214a000640 1 -- 172.21.15.47:0/233477829 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7f21440910d0 con 0x5606d8a1d4d0 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.521+0000 7f2169e39740 10 client.26336 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.522+0000 7f2169e39740 10 client.26336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.522+0000 7f2169e39740 20 client.26336 populate_metadata read hostname 'smithi047' 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.522+0000 7f2169e39740 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d89fcd80 0x5606d8df7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.522+0000 7f2169e39740 4 client.26336 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.522+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606d8d52160 con 0x5606d89fcd80 2024-05-14T12:41:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.522+0000 7f215be00640 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d89fcd80 0x5606d8df7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.523+0000 7f215be00640 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d89fcd80 0x5606d8df7950 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1178ea99eea854 server_cookie=8edbe195500113cc in_seq=0 out_seq=0 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.523+0000 7f214a000640 10 client.26336 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.523+0000 7f214a000640 1 -- 172.21.15.47:0/233477829 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5606d8d52160 con 0x5606d89fcd80 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.523+0000 7f214a000640 10 client.26336 handle_command_reply: tid=0 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 client.26336 shutdown 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a1d4d0 msgr2=0x5606d8dea330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a1d4d0 0x5606d8dea330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f21440a6a00 tx=0x7f21440a5650 comp rx=0 tx=0).stop 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 shutdown_connections 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d89fcd80 0x5606d8df7950 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a3e1b0 0x5606d8df1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d8a1d4d0 0x5606d8dea330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f214a000640 0 client.26336 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 --2- 172.21.15.47:0/233477829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8de9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 >> 172.21.15.47:0/233477829 conn(0x5606d8a32300 msgr2=0x5606d8ddac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 shutdown_connections 2024-05-14T12:41:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 1 -- 172.21.15.47:0/233477829 wait complete. 2024-05-14T12:41:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.524+0000 7f2169e39740 20 client.26336 trim_cache size 0 max 16384 2024-05-14T12:41:58.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 Processor -- start 2024-05-14T12:41:58.541 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 -- start start 2024-05-14T12:41:58.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dfc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.542 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a152f0 0x5606d8df11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8dfc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1ad3b0 con 0x5606d8a152f0 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1aefb0 con 0x5606d89fcd80 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.541+0000 7f2169e39740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1adab0 con 0x5606d8a1d4d0 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dfc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f2160e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8dfc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dfc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:34272/0 (socket says 172.21.15.47:34272) 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 -- 172.21.15.47:0/3497107040 learned_addr learned my addr 172.21.15.47:0/3497107040 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f2153e00640 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a152f0 0x5606d8df11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 -- 172.21.15.47:0/3497107040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 msgr2=0x5606d8dfc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8dfc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 -- 172.21.15.47:0/3497107040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a152f0 msgr2=0x5606d8df11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a152f0 0x5606d8df11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.542+0000 7f215be00640 1 -- 172.21.15.47:0/3497107040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d8dd74a0 con 0x5606d89fcd80 2024-05-14T12:41:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.543+0000 7f215be00640 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dfc140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f214c009230 tx=0x7f214c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d767cbb26140a68a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.543+0000 7f2150c00640 1 -- 172.21.15.47:0/3497107040 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c05c070 con 0x5606d89fcd80 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.543+0000 7f2150c00640 1 -- 172.21.15.47:0/3497107040 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f214c003e50 con 0x5606d89fcd80 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.543+0000 7f2150c00640 1 -- 172.21.15.47:0/3497107040 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c035050 con 0x5606d89fcd80 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 -- 172.21.15.47:0/3497107040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 msgr2=0x5606d8dfc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dfc140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f214c009230 tx=0x7f214c009260 comp rx=0 tx=0).stop 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 -- 172.21.15.47:0/3497107040 shutdown_connections 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a1d4d0 0x5606d8dfc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a152f0 0x5606d8df11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 --2- 172.21.15.47:0/3497107040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dfc140 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 -- 172.21.15.47:0/3497107040 >> 172.21.15.47:0/3497107040 conn(0x5606d8a32300 msgr2=0x5606d8de4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 -- 172.21.15.47:0/3497107040 shutdown_connections 2024-05-14T12:41:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.544+0000 7f2169e39740 1 -- 172.21.15.47:0/3497107040 wait complete. 2024-05-14T12:41:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 -- start start 2024-05-14T12:41:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 Processor -- start 2024-05-14T12:41:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dee650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8deeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a1d4d0 0x5606d8defac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1ae8e0 con 0x5606d8a1d4d0 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1ae210 con 0x5606d89fcd80 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1ab370 con 0x5606d8a152f0 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.545+0000 7f2169e39740 10 client.0 _ll_register_callbacks cb 0x7f214400df10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f2153e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8deeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f2160e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a1d4d0 0x5606d8defac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dee650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:34288/0 (socket says 172.21.15.47:34288) 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 -- 172.21.15.47:0/1664318622 learned_addr learned my addr 172.21.15.47:0/1664318622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 -- 172.21.15.47:0/1664318622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 msgr2=0x5606d8deeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8deeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 -- 172.21.15.47:0/1664318622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a1d4d0 msgr2=0x5606d8defac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a1d4d0 0x5606d8defac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 -- 172.21.15.47:0/1664318622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d8de83b0 con 0x5606d89fcd80 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f2153e00640 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8deeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f215be00640 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dee650 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f214c031440 tx=0x7f214c0039b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3408a7f5f87427c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f214a000640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.546+0000 7f214a000640 1 -- 172.21.15.47:0/1664318622 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c05c070 con 0x5606d89fcd80 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.547+0000 7f214a000640 1 -- 172.21.15.47:0/1664318622 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f214c056950 con 0x5606d89fcd80 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.547+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f214c003e50 con 0x5606d89fcd80 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.547+0000 7f214a000640 1 -- 172.21.15.47:0/1664318622 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f214c068050 con 0x5606d89fcd80 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.547+0000 7f2169e39740 10 client.26342 fetch_fsmap learned FSMap version 59 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.547+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5606d8df1140 con 0x5606d89fcd80 2024-05-14T12:41:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.547+0000 7f214a000640 1 -- 172.21.15.47:0/1664318622 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f214c003e50 con 0x5606d89fcd80 2024-05-14T12:41:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.547+0000 7f214a000640 1 -- 172.21.15.47:0/1664318622 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7f214c053070 con 0x5606d89fcd80 2024-05-14T12:41:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.548+0000 7f2169e39740 10 client.26342 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:41:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.548+0000 7f2169e39740 10 client.26342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:41:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.548+0000 7f2169e39740 20 client.26342 populate_metadata read hostname 'smithi047' 2024-05-14T12:41:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.548+0000 7f2169e39740 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d8a3e1b0 0x5606d8e620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:41:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.548+0000 7f2169e39740 4 client.26342 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:41:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.548+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606d8d4bfd0 con 0x5606d8a3e1b0 2024-05-14T12:41:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.548+0000 7f2153e00640 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d8a3e1b0 0x5606d8e620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:41:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.549+0000 7f214a000640 10 client.26342 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:41:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:41:58.549+0000 7f2153e00640 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d8a3e1b0 0x5606d8e620d0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3a285c217a719a server_cookie=2445ef29c59a0700 in_seq=0 out_seq=0 2024-05-14T12:42:00.188 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:41:59 smithi047 ceph-mon[31254]: pgmap v954: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-05-14T12:42:00.204 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:41:59 smithi073 ceph-mon[35809]: pgmap v954: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-05-14T12:42:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:41:59 smithi066 ceph-mon[35981]: pgmap v954: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-05-14T12:42:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:01 smithi047 ceph-mon[31254]: pgmap v955: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 20 op/s 2024-05-14T12:42:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:01 smithi073 ceph-mon[35809]: pgmap v955: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 20 op/s 2024-05-14T12:42:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:01 smithi066 ceph-mon[35981]: pgmap v955: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.8 KiB/s wr, 20 op/s 2024-05-14T12:42:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:03 smithi047 ceph-mon[31254]: pgmap v956: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 20 op/s 2024-05-14T12:42:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:03 smithi073 ceph-mon[35809]: pgmap v956: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 20 op/s 2024-05-14T12:42:04.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:03 smithi066 ceph-mon[35981]: pgmap v956: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 20 op/s 2024-05-14T12:42:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:05 smithi047 ceph-mon[31254]: pgmap v957: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2024-05-14T12:42:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:05 smithi073 ceph-mon[35809]: pgmap v957: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2024-05-14T12:42:06.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:05 smithi066 ceph-mon[35981]: pgmap v957: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2024-05-14T12:42:08.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:07 smithi047 ceph-mon[31254]: pgmap v958: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 23 op/s 2024-05-14T12:42:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:07 smithi073 ceph-mon[35809]: pgmap v958: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 23 op/s 2024-05-14T12:42:08.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:07 smithi066 ceph-mon[35981]: pgmap v958: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 23 op/s 2024-05-14T12:42:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.315+0000 7f214a000640 1 -- 172.21.15.47:0/1664318622 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606d8d4bfd0 con 0x5606d8a3e1b0 2024-05-14T12:42:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.315+0000 7f214a000640 10 client.26342 handle_command_reply: tid=0 2024-05-14T12:42:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.315+0000 7f2169e39740 1 client.26342 shutdown 2024-05-14T12:42:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 msgr2=0x5606d8dee650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dee650 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f214c031440 tx=0x7f214c0039b0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 shutdown_connections 2024-05-14T12:42:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5606d8a3e1b0 0x5606d8e620d0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5606d8a1d4d0 0x5606d8defac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5606d8a152f0 0x5606d8deeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 --2- 172.21.15.47:0/1664318622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606d89fcd80 0x5606d8dee650 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f214a000640 0 client.26342 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.316+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 >> 172.21.15.47:0/1664318622 conn(0x5606d8a32300 msgr2=0x5606d8ddea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.317+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 shutdown_connections 2024-05-14T12:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.317+0000 7f2169e39740 1 -- 172.21.15.47:0/1664318622 wait complete. 2024-05-14T12:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.317+0000 7f2169e39740 20 client.26342 trim_cache size 0 max 16384 2024-05-14T12:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f21400b28a0 msgr2=0x7f21400b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f21400b28a0 0x7f21400b4db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f214c000c00 tx=0x7f214c0314a0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f215c104ce0 msgr2=0x7f215c076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f215c104ce0 0x7f215c076130 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2144005fd0 tx=0x7f214400dde0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 shutdown_connections 2024-05-14T12:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f21400b28a0 0x7f21400b4db0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f215c1099e0 0x7f215c076670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f215c104ce0 0x7f215c076130 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 --2- 172.21.15.47:0/3342228221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f215c103aa0 0x7f215c077a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 >> 172.21.15.47:0/3342228221 conn(0x7f215c0fecd0 msgr2=0x7f215c1059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.319+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 shutdown_connections 2024-05-14T12:42:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:09.320+0000 7f2161800640 1 -- 172.21.15.47:0/3342228221 wait complete. 2024-05-14T12:42:10.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:09 smithi047 ceph-mon[31254]: pgmap v959: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 KiB/s wr, 21 op/s 2024-05-14T12:42:10.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:09 smithi073 ceph-mon[35809]: pgmap v959: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 KiB/s wr, 21 op/s 2024-05-14T12:42:10.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:09 smithi066 ceph-mon[35981]: pgmap v959: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 KiB/s wr, 21 op/s 2024-05-14T12:42:12.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:11 smithi047 ceph-mon[31254]: pgmap v960: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 22 op/s 2024-05-14T12:42:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:11 smithi073 ceph-mon[35809]: pgmap v960: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 22 op/s 2024-05-14T12:42:12.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:11 smithi066 ceph-mon[35981]: pgmap v960: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 22 op/s 2024-05-14T12:42:14.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:13 smithi047 ceph-mon[31254]: pgmap v961: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.3 KiB/s wr, 23 op/s 2024-05-14T12:42:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:13 smithi073 ceph-mon[35809]: pgmap v961: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.3 KiB/s wr, 23 op/s 2024-05-14T12:42:14.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:13 smithi066 ceph-mon[35981]: pgmap v961: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.3 KiB/s wr, 23 op/s 2024-05-14T12:42:16.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:15 smithi047 ceph-mon[31254]: pgmap v962: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 20 op/s 2024-05-14T12:42:16.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:15 smithi073 ceph-mon[35809]: pgmap v962: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 20 op/s 2024-05-14T12:42:16.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:15 smithi066 ceph-mon[35981]: pgmap v962: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 20 op/s 2024-05-14T12:42:18.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:17 smithi047 ceph-mon[31254]: pgmap v963: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 23 op/s 2024-05-14T12:42:18.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:17 smithi073 ceph-mon[35809]: pgmap v963: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 23 op/s 2024-05-14T12:42:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:17 smithi066 ceph-mon[35981]: pgmap v963: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 23 op/s 2024-05-14T12:42:20.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:19 smithi047 ceph-mon[31254]: pgmap v964: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 17 op/s 2024-05-14T12:42:20.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:19 smithi073 ceph-mon[35809]: pgmap v964: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 17 op/s 2024-05-14T12:42:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:19 smithi066 ceph-mon[35981]: pgmap v964: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 17 op/s 2024-05-14T12:42:22.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:21 smithi047 ceph-mon[31254]: pgmap v965: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 18 op/s 2024-05-14T12:42:22.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:21 smithi073 ceph-mon[35809]: pgmap v965: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 18 op/s 2024-05-14T12:42:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:21 smithi066 ceph-mon[35981]: pgmap v965: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 18 op/s 2024-05-14T12:42:22.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 -- 172.21.15.47:0/1119659350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 msgr2=0x7ff7841090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 --2- 172.21.15.47:0/1119659350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff7841090c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009ca0 tx=0x7ff76c02a8b0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 -- 172.21.15.47:0/1119659350 shutdown_connections 2024-05-14T12:42:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 --2- 172.21.15.47:0/1119659350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff784109750 0x7ff78410bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 --2- 172.21.15.47:0/1119659350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff7841090c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 --2- 172.21.15.47:0/1119659350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7841041f0 0x7ff784106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 -- 172.21.15.47:0/1119659350 >> 172.21.15.47:0/1119659350 conn(0x7ff7840fdbb0 msgr2=0x7ff784100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 -- 172.21.15.47:0/1119659350 shutdown_connections 2024-05-14T12:42:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.586+0000 7ff783200640 1 -- 172.21.15.47:0/1119659350 wait complete. 2024-05-14T12:42:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 Processor -- start 2024-05-14T12:42:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 -- start start 2024-05-14T12:42:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7841041f0 0x7ff78419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff78419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff784109750 0x7ff7841a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410f660 con 0x7ff7841041f0 2024-05-14T12:42:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410f4e0 con 0x7ff784106be0 2024-05-14T12:42:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff783200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410f7e0 con 0x7ff784109750 2024-05-14T12:42:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff781400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff78419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.588+0000 7ff781e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7841041f0 0x7ff78419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff78419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:55020/0 (socket says 172.21.15.47:55020) 2024-05-14T12:42:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 -- 172.21.15.47:0/4269862038 learned_addr learned my addr 172.21.15.47:0/4269862038 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff782800640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff784109750 0x7ff7841a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 -- 172.21.15.47:0/4269862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff784109750 msgr2=0x7ff7841a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff784109750 0x7ff7841a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 -- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7841041f0 msgr2=0x7ff78419c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7841041f0 0x7ff78419c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 -- 172.21.15.47:0/4269862038 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7841a3f20 con 0x7ff784106be0 2024-05-14T12:42:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781e00640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7841041f0 0x7ff78419c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.589+0000 7ff781400640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff78419c920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff76c02add0 tx=0x7ff76c003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.590+0000 7ff77aa00640 1 -- 172.21.15.47:0/4269862038 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c004240 con 0x7ff784106be0 2024-05-14T12:42:22.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.590+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7841a41b0 con 0x7ff784106be0 2024-05-14T12:42:22.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.590+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7841a4750 con 0x7ff784106be0 2024-05-14T12:42:22.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.590+0000 7ff77aa00640 1 -- 172.21.15.47:0/4269862038 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76c040070 con 0x7ff784106be0 2024-05-14T12:42:22.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.590+0000 7ff77aa00640 1 -- 172.21.15.47:0/4269862038 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c045a50 con 0x7ff784106be0 2024-05-14T12:42:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.593+0000 7ff790084740 1 Processor -- start 2024-05-14T12:42:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff790084740 1 -- start start 2024-05-14T12:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff790084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7d8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff77aa00640 1 -- 172.21.15.47:0/4269862038 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff76c0043e0 con 0x7ff784106be0 2024-05-14T12:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff790084740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff790084740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7df780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff790084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557adf73c550 con 0x557adf4361b0 2024-05-14T12:42:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff790084740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557adf6e1bc0 con 0x557adf40d2f0 2024-05-14T12:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff790084740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557adf738510 con 0x557adf4154d0 2024-05-14T12:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff782800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7d8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff781e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff782800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7d8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54288/0 (socket says 172.21.15.47:54288) 2024-05-14T12:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff782800640 1 -- 172.21.15.47:0/3460364961 learned_addr learned my addr 172.21.15.47:0/3460364961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.594+0000 7ff781400640 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff781e00640 1 -- 172.21.15.47:0/3460364961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 msgr2=0x557adf7df780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff781e00640 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7df780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff781e00640 1 -- 172.21.15.47:0/3460364961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 msgr2=0x557adf7d8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff781e00640 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7d8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff781e00640 1 -- 172.21.15.47:0/3460364961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557adf44e210 con 0x557adf40d2f0 2024-05-14T12:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff781e00640 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d8880 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff774009fa0 tx=0x7ff7740118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8152a7a0add7f47 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff773400640 1 -- 172.21.15.47:0/3460364961 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774004030 con 0x557adf40d2f0 2024-05-14T12:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff773400640 1 -- 172.21.15.47:0/3460364961 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7740035f0 con 0x557adf40d2f0 2024-05-14T12:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.595+0000 7ff773400640 1 -- 172.21.15.47:0/3460364961 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77400f7e0 con 0x557adf40d2f0 2024-05-14T12:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.596+0000 7ff77aa00640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7640b2920 0x7ff7640b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 -- 172.21.15.47:0/3460364961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 msgr2=0x557adf7d8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d8880 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff774009fa0 tx=0x7ff7740118d0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff77aa00640 1 -- 172.21.15.47:0/4269862038 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff76c103310 con 0x7ff784106be0 2024-05-14T12:42:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff782800640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7640b2920 0x7ff7640b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 -- 172.21.15.47:0/3460364961 shutdown_connections 2024-05-14T12:42:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7df780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d8880 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 --2- 172.21.15.47:0/3460364961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7d8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 -- 172.21.15.47:0/3460364961 >> 172.21.15.47:0/3460364961 conn(0x557adf42a300 msgr2=0x557adf7d3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 -- 172.21.15.47:0/3460364961 shutdown_connections 2024-05-14T12:42:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.597+0000 7ff790084740 1 -- 172.21.15.47:0/3460364961 wait complete. 2024-05-14T12:42:22.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.598+0000 7ff790084740 1 -- start start 2024-05-14T12:42:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.598+0000 7ff782800640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7640b2920 0x7ff7640b4e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x557adf7d94d0 tx=0x7ff77c005cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.598+0000 7ff790084740 1 Processor -- start 2024-05-14T12:42:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff790084740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf40d2f0 0x557adf7ea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff790084740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4154d0 0x557adf7eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff790084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff790084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557adf7e01d0 con 0x557adf4361b0 2024-05-14T12:42:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff790084740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557adf6f5660 con 0x557adf4154d0 2024-05-14T12:42:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff790084740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557adf7e0350 con 0x557adf40d2f0 2024-05-14T12:42:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff790084740 10 client.0 _ll_register_callbacks cb 0x557adf6bf400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf40d2f0 0x557adf7ea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4154d0 0x557adf7eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf40d2f0 0x557adf7ea5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43110/0 (socket says 172.21.15.47:43110) 2024-05-14T12:42:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781e00640 1 -- 172.21.15.47:0/1482481146 learned_addr learned my addr 172.21.15.47:0/1482481146 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff782800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781400640 1 -- 172.21.15.47:0/1482481146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf40d2f0 msgr2=0x557adf7ea5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781400640 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf40d2f0 0x557adf7ea5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781400640 1 -- 172.21.15.47:0/1482481146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 msgr2=0x557adf7f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781400640 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.599+0000 7ff781400640 1 -- 172.21.15.47:0/1482481146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557adf51a620 con 0x557adf4154d0 2024-05-14T12:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff781400640 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4154d0 0x557adf7eab20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff76c004af0 tx=0x7ff76c009420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3bc44b6cb994e0c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff76be00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff76be00640 1 -- 172.21.15.47:0/1482481146 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0ca280 con 0x557adf4154d0 2024-05-14T12:42:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7740035f0 con 0x557adf4154d0 2024-05-14T12:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff76be00640 1 -- 172.21.15.47:0/1482481146 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff76c0ed0d0 con 0x557adf4154d0 2024-05-14T12:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff76be00640 1 -- 172.21.15.47:0/1482481146 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7ff76c0ca0a0 con 0x557adf4154d0 2024-05-14T12:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff790084740 10 client.26354 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x557adf7f49b0 con 0x557adf4154d0 2024-05-14T12:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.600+0000 7ff76be00640 1 -- 172.21.15.47:0/1482481146 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7740035f0 con 0x557adf4154d0 2024-05-14T12:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff76be00640 1 -- 172.21.15.47:0/1482481146 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7ff76c04d030 con 0x557adf4154d0 2024-05-14T12:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff790084740 10 client.26354 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff790084740 10 client.26354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff790084740 20 client.26354 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff790084740 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3f4d80 0x557adf7f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff790084740 4 client.26354 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557adf74a160 con 0x557adf3f4d80 2024-05-14T12:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.601+0000 7ff781e00640 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3f4d80 0x557adf7f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.602+0000 7ff781e00640 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3f4d80 0x557adf7f8200 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45fafb5b292d87af server_cookie=7ec2495a0fb44dee in_seq=0 out_seq=0 2024-05-14T12:42:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.602+0000 7ff76be00640 10 client.26354 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff76be00640 1 -- 172.21.15.47:0/1482481146 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557adf74a160 con 0x557adf3f4d80 2024-05-14T12:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff76be00640 10 client.26354 handle_command_reply: tid=0 2024-05-14T12:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 client.26354 shutdown 2024-05-14T12:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4154d0 msgr2=0x557adf7eab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4154d0 0x557adf7eab20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff76c004af0 tx=0x7ff76c009420 comp rx=0 tx=0).stop 2024-05-14T12:42:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 shutdown_connections 2024-05-14T12:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3f4d80 0x557adf7f8200 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4361b0 0x557adf7f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4154d0 0x557adf7eab20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff76be00640 0 client.26354 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 --2- 172.21.15.47:0/1482481146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf40d2f0 0x557adf7ea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 >> 172.21.15.47:0/1482481146 conn(0x557adf42a300 msgr2=0x557adf7d6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 shutdown_connections 2024-05-14T12:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 1 -- 172.21.15.47:0/1482481146 wait complete. 2024-05-14T12:42:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.603+0000 7ff790084740 20 client.26354 trim_cache size 0 max 16384 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.620+0000 7ff790084740 1 Processor -- start 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.620+0000 7ff790084740 1 -- start start 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff790084740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff790084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4154d0 0x557adf7f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff790084740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4361b0 0x557adf7d6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff790084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000e400 con 0x557adf4154d0 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff790084740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff760010000 con 0x557adf40d2f0 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff790084740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000eb00 con 0x557adf4361b0 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff782800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4361b0 0x557adf7d6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff782800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4361b0 0x557adf7d6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:43122/0 (socket says 172.21.15.47:43122) 2024-05-14T12:42:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff782800640 1 -- 172.21.15.47:0/13336981 learned_addr learned my addr 172.21.15.47:0/13336981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.621+0000 7ff781e00640 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff781400640 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4154d0 0x557adf7f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff782800640 1 -- 172.21.15.47:0/13336981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 msgr2=0x557adf7d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff782800640 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff782800640 1 -- 172.21.15.47:0/13336981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4154d0 msgr2=0x557adf7f19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff782800640 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4154d0 0x557adf7f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff782800640 1 -- 172.21.15.47:0/13336981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557adf7cf4a0 con 0x557adf4361b0 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff782800640 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4361b0 0x557adf7d6a90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff77c003ee0 tx=0x7ff77c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=292d325607d3bfc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff772a00640 1 -- 172.21.15.47:0/13336981 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c029480 con 0x557adf4361b0 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.622+0000 7ff772a00640 1 -- 172.21.15.47:0/13336981 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff77c029ad0 con 0x557adf4361b0 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff772a00640 1 -- 172.21.15.47:0/13336981 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c011990 con 0x557adf4361b0 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff790084740 1 -- 172.21.15.47:0/13336981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4361b0 msgr2=0x557adf7d6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff790084740 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4361b0 0x557adf7d6a90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff77c003ee0 tx=0x7ff77c019000 comp rx=0 tx=0).stop 2024-05-14T12:42:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff790084740 1 -- 172.21.15.47:0/13336981 shutdown_connections 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff790084740 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4361b0 0x557adf7d6a90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff790084740 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf4154d0 0x557adf7f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff790084740 1 --2- 172.21.15.47:0/13336981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf40d2f0 0x557adf7d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.623+0000 7ff790084740 1 -- 172.21.15.47:0/13336981 >> 172.21.15.47:0/13336981 conn(0x557adf42a300 msgr2=0x557adf7d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.624+0000 7ff790084740 1 -- 172.21.15.47:0/13336981 shutdown_connections 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.624+0000 7ff790084740 1 -- 172.21.15.47:0/13336981 wait complete. 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.624+0000 7ff790084740 1 -- start start 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.624+0000 7ff790084740 1 Processor -- start 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff790084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf40d2f0 0x557adf7ef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff790084740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7ef650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff790084740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4361b0 0x557adf7f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff790084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000f930 con 0x557adf40d2f0 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff790084740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000f260 con 0x557adf4361b0 2024-05-14T12:42:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff790084740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000c3c0 con 0x557adf4154d0 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff790084740 10 client.0 _ll_register_callbacks cb 0x7ff76c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff781e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf40d2f0 0x557adf7ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff782800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4361b0 0x557adf7f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff781400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff782800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4361b0 0x557adf7f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:55060/0 (socket says 172.21.15.47:55060) 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff781e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf40d2f0 0x557adf7ef110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54320/0 (socket says 172.21.15.47:54320) 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.625+0000 7ff781e00640 1 -- 172.21.15.47:0/3992069898 learned_addr learned my addr 172.21.15.47:0/3992069898 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff782800640 1 -- 172.21.15.47:0/3992069898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 msgr2=0x557adf7ef650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff782800640 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7ef650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff782800640 1 -- 172.21.15.47:0/3992069898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf40d2f0 msgr2=0x557adf7ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff782800640 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf40d2f0 0x557adf7ef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff782800640 1 -- 172.21.15.47:0/3992069898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557adf7f0b40 con 0x557adf4361b0 2024-05-14T12:42:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff781400640 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7ef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff782800640 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4361b0 0x557adf7f0580 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff77c018040 tx=0x7ff77c029d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f425bf5be64f44 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff76be00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff76be00640 1 -- 172.21.15.47:0/3992069898 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c029890 con 0x557adf4361b0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff76be00640 1 -- 172.21.15.47:0/3992069898 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff77c005040 con 0x557adf4361b0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.626+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff77c029ad0 con 0x557adf4361b0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff76be00640 1 -- 172.21.15.47:0/3992069898 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7ff77c005240 con 0x557adf4361b0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 10 client.26360 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x557adf8605b0 con 0x557adf4361b0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff76be00640 1 -- 172.21.15.47:0/3992069898 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff77c029ad0 con 0x557adf4361b0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff76be00640 1 -- 172.21.15.47:0/3992069898 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7ff77c030070 con 0x557adf4361b0 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 10 client.26360 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 10 client.26360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 20 client.26360 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3ca1c0 0x557adf862e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 4 client.26360 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.627+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557adf743fd0 con 0x557adf3ca1c0 2024-05-14T12:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.628+0000 7ff781e00640 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3ca1c0 0x557adf862e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.628+0000 7ff781e00640 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3ca1c0 0x557adf862e10 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=898e84a0b112d089 server_cookie=6d3d47c8ef745366 in_seq=0 out_seq=0 2024-05-14T12:42:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:22.628+0000 7ff76be00640 10 client.26360 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:24.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:23 smithi073 ceph-mon[35809]: pgmap v966: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 19 op/s 2024-05-14T12:42:24.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:23 smithi066 ceph-mon[35981]: pgmap v966: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 19 op/s 2024-05-14T12:42:24.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:23 smithi047 ceph-mon[31254]: pgmap v966: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 19 op/s 2024-05-14T12:42:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.339+0000 7ff76be00640 1 -- 172.21.15.47:0/3992069898 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557adf743fd0 con 0x557adf3ca1c0 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.339+0000 7ff76be00640 10 client.26360 handle_command_reply: tid=0 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.339+0000 7ff790084740 1 client.26360 shutdown 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4361b0 msgr2=0x557adf7f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4361b0 0x557adf7f0580 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff77c018040 tx=0x7ff77c029d10 comp rx=0 tx=0).stop 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 shutdown_connections 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x557adf3ca1c0 0x557adf862e10 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557adf4361b0 0x557adf7f0580 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557adf4154d0 0x557adf7ef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 --2- 172.21.15.47:0/3992069898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557adf40d2f0 0x557adf7ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff76be00640 0 client.26360 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.340+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 >> 172.21.15.47:0/3992069898 conn(0x557adf42a300 msgr2=0x557adf7fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.341+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 shutdown_connections 2024-05-14T12:42:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.341+0000 7ff790084740 1 -- 172.21.15.47:0/3992069898 wait complete. 2024-05-14T12:42:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.341+0000 7ff790084740 20 client.26360 trim_cache size 0 max 16384 2024-05-14T12:42:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:42:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:42:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:42:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7640b2920 msgr2=0x7ff7640b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7640b2920 0x7ff7640b4e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x557adf7d94d0 tx=0x7ff77c005cc0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 msgr2=0x7ff78419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff78419c920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff76c02add0 tx=0x7ff76c003c00 comp rx=0 tx=0).stop 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 shutdown_connections 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7640b2920 0x7ff7640b4e30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff784109750 0x7ff7841a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff784106be0 0x7ff78419c920 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 --2- 172.21.15.47:0/4269862038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7841041f0 0x7ff78419c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.342+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 >> 172.21.15.47:0/4269862038 conn(0x7ff7840fdbb0 msgr2=0x7ff7841082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.343+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 shutdown_connections 2024-05-14T12:42:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:25.343+0000 7ff783200640 1 -- 172.21.15.47:0/4269862038 wait complete. 2024-05-14T12:42:26.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:25 smithi073 ceph-mon[35809]: pgmap v967: 97 pgs: 97 active+clean; 2.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 17 op/s 2024-05-14T12:42:26.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:25 smithi066 ceph-mon[35981]: pgmap v967: 97 pgs: 97 active+clean; 2.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 17 op/s 2024-05-14T12:42:26.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:25 smithi047 ceph-mon[31254]: pgmap v967: 97 pgs: 97 active+clean; 2.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 17 op/s 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.314+0000 7f13cd600700 1 -- 172.21.15.47:0/2962302271 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: -115 ) ==== 8+0+594 (crc 0 0 0) 0x55fa8c625590 con 0x55fa8c77b460 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.314+0000 7f13cd600700 10 client.26350 handle_command_reply: tid=0 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.314+0000 7f13f9106b80 1 client.26350 shutdown 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c577fd0 msgr2=0x55fa8c7080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c577fd0 0x55fa8c7080e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f13d4005c20 tx=0x7f13d4004100 comp rx=0 tx=0).stop 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 shutdown_connections 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55fa8c77b460 0x55fa8c77d8e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fa8c6f5aa0 0x55fa8c704990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fa8c577fd0 0x55fa8c7080e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 --2- 172.21.15.47:0/2962302271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fa8c6f5690 0x55fa8c704450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13cd600700 0 client.26350 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:27.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.315+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 >> 172.21.15.47:0/2962302271 conn(0x55fa8c5b6c10 msgr2=0x55fa8c70b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.316+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 shutdown_connections 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.316+0000 7f13f9106b80 1 -- 172.21.15.47:0/2962302271 wait complete. 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:27.316+0000 7f13f9106b80 20 client.26350 trim_cache size 0 max 16384 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 59, 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 33, 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:42:27.317 INFO:teuthology.orchestra.run.smithi047.stdout: "3f3d2c55": { 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 33, 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 0.0, 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCING", 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.0 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 78.3, 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:42:27.318 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCING", 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.0 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:42:27.319 INFO:teuthology.orchestra.run.smithi047.stderr:Error EINPROGRESS: 2024-05-14T12:42:28.284 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:28 smithi047 ceph-mon[31254]: pgmap v968: 97 pgs: 97 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-05-14T12:42:28.288 DEBUG:teuthology.orchestra.run:got remote process result: 115 2024-05-14T12:42:28.289 WARNING:tasks.quiescer.fs.[cephfs]:Set '3f3d2c55' hasn't quiesced after 63.8 seconds (timeout: 60). Dumping ops with locks from all ranks. 2024-05-14T12:42:28.289 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:42:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:28 smithi066 ceph-mon[35981]: pgmap v968: 97 pgs: 97 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-05-14T12:42:28.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:28 smithi073 ceph-mon[35809]: pgmap v968: 97 pgs: 97 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-05-14T12:42:28.768 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:30 smithi047 ceph-mon[31254]: pgmap v969: 97 pgs: 97 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-05-14T12:42:30.303 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:30 smithi073 ceph-mon[35809]: pgmap v969: 97 pgs: 97 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-05-14T12:42:30.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:30 smithi066 ceph-mon[35981]: pgmap v969: 97 pgs: 97 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 -- 172.21.15.47:0/1818423350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c1034c0 msgr2=0x7fe22c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 --2- 172.21.15.47:0/1818423350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c1034c0 0x7fe22c1038d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b0a0 tx=0x7fe21c00b3b0 comp rx=0 tx=0).stop 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 -- 172.21.15.47:0/1818423350 shutdown_connections 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 --2- 172.21.15.47:0/1818423350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c108740 0x7fe22c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 --2- 172.21.15.47:0/1818423350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c1034c0 0x7fe22c1038d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 --2- 172.21.15.47:0/1818423350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe22c107df0 0x7fe22c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 -- 172.21.15.47:0/1818423350 >> 172.21.15.47:0/1818423350 conn(0x7fe22c0fedc0 msgr2=0x7fe22c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 -- 172.21.15.47:0/1818423350 shutdown_connections 2024-05-14T12:42:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.955+0000 7fe232600700 1 -- 172.21.15.47:0/1818423350 wait complete. 2024-05-14T12:42:30.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.957+0000 7fe232600700 1 Processor -- start 2024-05-14T12:42:30.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.957+0000 7fe232600700 1 -- start start 2024-05-14T12:42:30.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe232600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c1034c0 0x7fe22c0ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:30.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe232600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c107df0 0x7fe22c0ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe232600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe22c108740 0x7fe22c0ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe232600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c113370 con 0x7fe22c1034c0 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe232600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1131f0 con 0x7fe22c107df0 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe232600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1134f0 con 0x7fe22c108740 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe222a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c107df0 0x7fe22c0ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe22b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c1034c0 0x7fe22c0ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe222a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c107df0 0x7fe22c0ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41222/0 (socket says 172.21.15.47:41222) 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe222a00700 1 -- 172.21.15.47:0/2044540014 learned_addr learned my addr 172.21.15.47:0/2044540014 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.958+0000 7fe22be00700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe22c108740 0x7fe22c0ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:30.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe222a00700 1 -- 172.21.15.47:0/2044540014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe22c108740 msgr2=0x7fe22c0ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:30.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe222a00700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe22c108740 0x7fe22c0ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe222a00700 1 -- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c1034c0 msgr2=0x7fe22c0ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe222a00700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c1034c0 0x7fe22c0ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe222a00700 1 -- 172.21.15.47:0/2044540014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c1a91b0 con 0x7fe22c107df0 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe222a00700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c107df0 0x7fe22c0ff7e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe21400ea30 tx=0x7fe21400ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe228c00700 1 -- 172.21.15.47:0/2044540014 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21400cbd0 con 0x7fe22c107df0 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe228c00700 1 -- 172.21.15.47:0/2044540014 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2140044d0 con 0x7fe22c107df0 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe228c00700 1 -- 172.21.15.47:0/2044540014 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214003dc0 con 0x7fe22c107df0 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.959+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c1a94a0 con 0x7fe22c107df0 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.960+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c1a9990 con 0x7fe22c107df0 2024-05-14T12:42:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.961+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22c0512c0 con 0x7fe22c107df0 2024-05-14T12:42:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.963+0000 7fe228c00700 1 -- 172.21.15.47:0/2044540014 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe214003f80 con 0x7fe22c107df0 2024-05-14T12:42:30.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.964+0000 7fe228c00700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2100b2880 0x7fe2100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:30.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.965+0000 7fe228c00700 1 -- 172.21.15.47:0/2044540014 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe2140e2300 con 0x7fe22c107df0 2024-05-14T12:42:30.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.965+0000 7fe22b400700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2100b2880 0x7fe2100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.965+0000 7fe22b400700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2100b2880 0x7fe2100b4d90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009900 tx=0x7fe21c00b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:30.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:30.969+0000 7fe228c00700 1 -- 172.21.15.47:0/2044540014 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2140a9fe0 con 0x7fe22c107df0 2024-05-14T12:42:31.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.254+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe22c02e5f0 con 0x7fe22c107df0 2024-05-14T12:42:31.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.255+0000 7fe228c00700 1 -- 172.21.15.47:0/2044540014 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+11925 (secure 0 0 0) 0x7fe2140b2060 con 0x7fe22c107df0 2024-05-14T12:42:31.255 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:42:31.255 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":59,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:41:49.054978+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24521,24535,24517,24502,24490]},"id":1}]} 2024-05-14T12:42:31.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.257+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2100b2880 msgr2=0x7fe2100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:31.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.257+0000 7fe232600700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2100b2880 0x7fe2100b4d90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009900 tx=0x7fe21c00b700 comp rx=0 tx=0).stop 2024-05-14T12:42:31.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.257+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c107df0 msgr2=0x7fe22c0ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:31.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.257+0000 7fe232600700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c107df0 0x7fe22c0ff7e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe21400ea30 tx=0x7fe21400ed40 comp rx=0 tx=0).stop 2024-05-14T12:42:31.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 shutdown_connections 2024-05-14T12:42:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fe2100b2880 0x7fe2100b4d90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe22c108740 0x7fe22c0ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c1034c0 0x7fe22c0ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 --2- 172.21.15.47:0/2044540014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe22c107df0 0x7fe22c0ff7e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 >> 172.21.15.47:0/2044540014 conn(0x7fe22c0fedc0 msgr2=0x7fe22c1063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 shutdown_connections 2024-05-14T12:42:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:31.258+0000 7fe232600700 1 -- 172.21.15.47:0/2044540014 wait complete. 2024-05-14T12:42:31.259 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 59 2024-05-14T12:42:32.137 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 4 (f) to a remote file /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.f.json 2024-05-14T12:42:32.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 ops --flags=locks --path=/var/run/ceph/ops-3f3d2c55-1-mds.f.json 2024-05-14T12:42:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:32 smithi066 ceph-mon[35981]: pgmap v970: 97 pgs: 97 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-05-14T12:42:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:32 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2044540014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:42:32.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:32 smithi047 ceph-mon[31254]: pgmap v970: 97 pgs: 97 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-05-14T12:42:32.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:32 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2044540014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:42:32.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:32 smithi073 ceph-mon[35809]: pgmap v970: 97 pgs: 97 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-05-14T12:42:32.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:32 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2044540014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:42:32.663 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:34.228 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:34 smithi047 ceph-mon[31254]: pgmap v971: 97 pgs: 97 active+clean; 2.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.4 KiB/s wr, 19 op/s 2024-05-14T12:42:34.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:34 smithi066 ceph-mon[35981]: pgmap v971: 97 pgs: 97 active+clean; 2.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.4 KiB/s wr, 19 op/s 2024-05-14T12:42:34.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:34 smithi073 ceph-mon[35809]: pgmap v971: 97 pgs: 97 active+clean; 2.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.4 KiB/s wr, 19 op/s 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.215+0000 7fc17be00700 1 -- 172.21.15.47:0/2025845491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c075ae0 msgr2=0x7fc17c075ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.215+0000 7fc17be00700 1 --2- 172.21.15.47:0/2025845491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c075ae0 0x7fc17c075ef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009990 tx=0x7fc16c009ca0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.215+0000 7fc17be00700 1 -- 172.21.15.47:0/2025845491 shutdown_connections 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.215+0000 7fc17be00700 1 --2- 172.21.15.47:0/2025845491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c110a30 0x7fc17c112e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.215+0000 7fc17be00700 1 --2- 172.21.15.47:0/2025845491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c075ae0 0x7fc17c075ef0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.215+0000 7fc17be00700 1 --2- 172.21.15.47:0/2025845491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c076430 0x7fc17c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.215+0000 7fc17be00700 1 -- 172.21.15.47:0/2025845491 >> 172.21.15.47:0/2025845491 conn(0x7fc17c079d10 msgr2=0x7fc17c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.216+0000 7fc17be00700 1 -- 172.21.15.47:0/2025845491 shutdown_connections 2024-05-14T12:42:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.216+0000 7fc17be00700 1 -- 172.21.15.47:0/2025845491 wait complete. 2024-05-14T12:42:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.217+0000 7fc17be00700 1 Processor -- start 2024-05-14T12:42:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.217+0000 7fc17be00700 1 -- start start 2024-05-14T12:42:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c075ae0 0x7fc17c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17be00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c076430 0x7fc17c19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c110a30 0x7fc17c1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c116500 con 0x7fc17c075ae0 2024-05-14T12:42:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17be00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c116380 con 0x7fc17c076430 2024-05-14T12:42:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17be00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c116680 con 0x7fc17c110a30 2024-05-14T12:42:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17a000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c076430 0x7fc17c19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c110a30 0x7fc17c1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c075ae0 0x7fc17c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c110a30 0x7fc17c1a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51768/0 (socket says 172.21.15.47:51768) 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17a000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c076430 0x7fc17c19d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41238/0 (socket says 172.21.15.47:41238) 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.218+0000 7fc17b400700 1 -- 172.21.15.47:0/3151144710 learned_addr learned my addr 172.21.15.47:0/3151144710 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17b400700 1 -- 172.21.15.47:0/3151144710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c076430 msgr2=0x7fc17c19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17b400700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c076430 0x7fc17c19d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17b400700 1 -- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c075ae0 msgr2=0x7fc17c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17b400700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c075ae0 0x7fc17c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17b400700 1 -- 172.21.15.47:0/3151144710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c1a1d20 con 0x7fc17c110a30 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17a000700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c076430 0x7fc17c19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:35.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17b400700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c110a30 0x7fc17c1a1680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc17400ef30 tx=0x7fc17400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc173400700 1 -- 172.21.15.47:0/3151144710 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740092e0 con 0x7fc17c110a30 2024-05-14T12:42:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c1a1fb0 con 0x7fc17c110a30 2024-05-14T12:42:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.219+0000 7fc173400700 1 -- 172.21.15.47:0/3151144710 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc174004bb0 con 0x7fc17c110a30 2024-05-14T12:42:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.220+0000 7fc173400700 1 -- 172.21.15.47:0/3151144710 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174004020 con 0x7fc17c110a30 2024-05-14T12:42:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.220+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1a9930 con 0x7fc17c110a30 2024-05-14T12:42:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.223+0000 7fc173400700 1 -- 172.21.15.47:0/3151144710 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc17401b030 con 0x7fc17c110a30 2024-05-14T12:42:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.225+0000 7fc19081cb80 1 Processor -- start 2024-05-14T12:42:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.225+0000 7fc19081cb80 1 -- start start 2024-05-14T12:42:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.225+0000 7fc173400700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1600b2900 0x7fc1600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.225+0000 7fc173400700 1 -- 172.21.15.47:0/3151144710 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc1740e1c30 con 0x7fc17c110a30 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x5601278880b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17a000700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1600b2900 0x7fc1600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x56012788c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56012788cdf0 0x56012788d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc19081cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5601277a9b00 con 0x560127709f20 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc19081cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560127747840 con 0x56012788cdf0 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc19081cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5601277a5ac0 con 0x5601278885f0 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x5601278880b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56012788cdf0 0x56012788d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56012788cdf0 0x56012788d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41246/0 (socket says 172.21.15.47:41246) 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 -- 172.21.15.47:0/2979375409 learned_addr learned my addr 172.21.15.47:0/2979375409 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17a000700 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x56012788c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 -- 172.21.15.47:0/2979375409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 msgr2=0x56012788c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x56012788c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 -- 172.21.15.47:0/2979375409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 msgr2=0x5601278880b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x5601278880b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.226+0000 7fc17b400700 1 -- 172.21.15.47:0/2979375409 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601276f69b0 con 0x56012788cdf0 2024-05-14T12:42:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.227+0000 7fc17b400700 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56012788cdf0 0x56012788d200 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc174009c10 tx=0x7fc17400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b1b8a904de017db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.227+0000 7fc17a000700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1600b2900 0x7fc1600b4e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5601278844f0 tx=0x7fc168009cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.227+0000 7fc167e00700 1 -- 172.21.15.47:0/2979375409 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740a92a0 con 0x56012788cdf0 2024-05-14T12:42:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.227+0000 7fc167e00700 1 -- 172.21.15.47:0/2979375409 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1740ad650 con 0x56012788cdf0 2024-05-14T12:42:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.227+0000 7fc167e00700 1 -- 172.21.15.47:0/2979375409 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740dfe10 con 0x56012788cdf0 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 -- 172.21.15.47:0/2979375409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56012788cdf0 msgr2=0x56012788d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56012788cdf0 0x56012788d200 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc174009c10 tx=0x7fc17400ca10 comp rx=0 tx=0).stop 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 -- 172.21.15.47:0/2979375409 shutdown_connections 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56012788cdf0 0x56012788d200 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x5601278880b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 --2- 172.21.15.47:0/2979375409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x56012788c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 -- 172.21.15.47:0/2979375409 >> 172.21.15.47:0/2979375409 conn(0x560127748b60 msgr2=0x560127882dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 -- 172.21.15.47:0/2979375409 shutdown_connections 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.228+0000 7fc19081cb80 1 -- 172.21.15.47:0/2979375409 wait complete. 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.229+0000 7fc19081cb80 1 -- start start 2024-05-14T12:42:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.229+0000 7fc19081cb80 1 Processor -- start 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x560127891bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x560127892130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56012788cdf0 0x560127892670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc19081cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560127894d40 con 0x560127709f20 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc19081cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56012770fc00 con 0x5601278885f0 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc19081cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560127894ec0 con 0x56012788cdf0 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc19081cb80 10 client.0 _ll_register_callbacks cb 0x56012773d460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc17a000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x560127892130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x560127891bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc17b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56012788cdf0 0x560127892670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc17a000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x560127892130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41262/0 (socket says 172.21.15.47:41262) 2024-05-14T12:42:35.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.230+0000 7fc17a000700 1 -- 172.21.15.47:0/743444362 learned_addr learned my addr 172.21.15.47:0/743444362 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17b400700 1 -- 172.21.15.47:0/743444362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 msgr2=0x560127892130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17b400700 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x560127892130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17b400700 1 -- 172.21.15.47:0/743444362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 msgr2=0x560127891bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17b400700 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x560127891bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17b400700 1 -- 172.21.15.47:0/743444362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012776f500 con 0x56012788cdf0 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17a000700 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x560127892130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17aa00700 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x560127891bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc17b400700 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56012788cdf0 0x560127892670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc1740a8fa0 tx=0x7fc174004f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61705798274dc621 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc164c00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc164c00700 1 -- 172.21.15.47:0/743444362 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740c2020 con 0x56012788cdf0 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc164c00700 1 -- 172.21.15.47:0/743444362 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc1740dfdc0 con 0x56012788cdf0 2024-05-14T12:42:35.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.231+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1740ad650 con 0x56012788cdf0 2024-05-14T12:42:35.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.232+0000 7fc164c00700 1 -- 172.21.15.47:0/743444362 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fc1740ca290 con 0x56012788cdf0 2024-05-14T12:42:35.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.232+0000 7fc19081cb80 10 client.26404 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:35.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.232+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x560127894d40 con 0x56012788cdf0 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.232+0000 7fc164c00700 1 -- 172.21.15.47:0/743444362 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1740ad650 con 0x56012788cdf0 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.232+0000 7fc164c00700 1 -- 172.21.15.47:0/743444362 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7fc1740c3b00 con 0x56012788cdf0 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.232+0000 7fc19081cb80 10 client.26404 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.232+0000 7fc19081cb80 10 client.26404 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.233+0000 7fc19081cb80 20 client.26404 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.233+0000 7fc19081cb80 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x5601278a1d20 0x5601278a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.233+0000 7fc19081cb80 4 client.26404 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.233+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560127854150 con 0x5601278a1d20 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.233+0000 7fc17aa00700 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x5601278a1d20 0x5601278a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.233+0000 7fc17aa00700 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x5601278a1d20 0x5601278a4140 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=21be1e6a8a85f032 server_cookie=ef31fee6b9e7699e in_seq=0 out_seq=0 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.233+0000 7fc164c00700 10 client.26404 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.234+0000 7fc164c00700 1 -- 172.21.15.47:0/743444362 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560127854150 con 0x5601278a1d20 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.234+0000 7fc164c00700 10 client.26404 handle_command_reply: tid=0 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.234+0000 7fc19081cb80 1 client.26404 shutdown 2024-05-14T12:42:35.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56012788cdf0 msgr2=0x560127892670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56012788cdf0 0x560127892670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc1740a8fa0 tx=0x7fc174004f90 comp rx=0 tx=0).stop 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 shutdown_connections 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x5601278a1d20 0x5601278a4140 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56012788cdf0 0x560127892670 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560127709f20 0x560127891bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 --2- 172.21.15.47:0/743444362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x560127892130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 >> 172.21.15.47:0/743444362 conn(0x560127748b60 msgr2=0x560127882a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc164c00700 0 client.26404 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 shutdown_connections 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 1 -- 172.21.15.47:0/743444362 wait complete. 2024-05-14T12:42:35.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.235+0000 7fc19081cb80 20 client.26404 trim_cache size 0 max 16384 2024-05-14T12:42:35.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.255+0000 7fc19081cb80 1 Processor -- start 2024-05-14T12:42:35.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.255+0000 7fc19081cb80 1 -- start start 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560127709f20 0x5601278a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x5601278a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127886de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc19081cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b0c80 con 0x56012788cdf0 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc19081cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b2880 con 0x5601278885f0 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc19081cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b1380 con 0x560127709f20 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560127709f20 0x5601278a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560127709f20 0x5601278a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51796/0 (socket says 172.21.15.47:51796) 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc17aa00700 1 -- 172.21.15.47:0/1895461460 learned_addr learned my addr 172.21.15.47:0/1895461460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc17a000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x5601278a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.256+0000 7fc17b400700 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127886de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc17aa00700 1 -- 172.21.15.47:0/1895461460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 msgr2=0x5601278a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc17aa00700 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x5601278a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc17aa00700 1 -- 172.21.15.47:0/1895461460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 msgr2=0x560127886de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc17aa00700 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127886de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc17aa00700 1 -- 172.21.15.47:0/1895461460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012787db10 con 0x560127709f20 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc17b400700 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127886de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc17aa00700 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560127709f20 0x5601278a9740 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009990 tx=0x7fc16c005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13c5935d5185c776 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:35.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc167400700 1 -- 172.21.15.47:0/1895461460 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c02e030 con 0x560127709f20 2024-05-14T12:42:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc167400700 1 -- 172.21.15.47:0/1895461460 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc16c003680 con 0x560127709f20 2024-05-14T12:42:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.257+0000 7fc167400700 1 -- 172.21.15.47:0/1895461460 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0293b0 con 0x560127709f20 2024-05-14T12:42:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 -- 172.21.15.47:0/1895461460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560127709f20 msgr2=0x5601278a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560127709f20 0x5601278a9740 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009990 tx=0x7fc16c005040 comp rx=0 tx=0).stop 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 -- 172.21.15.47:0/1895461460 shutdown_connections 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127886de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560127709f20 0x5601278a9740 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 --2- 172.21.15.47:0/1895461460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601278885f0 0x5601278a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 -- 172.21.15.47:0/1895461460 >> 172.21.15.47:0/1895461460 conn(0x560127748b60 msgr2=0x56012788c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 -- 172.21.15.47:0/1895461460 shutdown_connections 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.258+0000 7fc19081cb80 1 -- 172.21.15.47:0/1895461460 wait complete. 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.259+0000 7fc19081cb80 1 -- start start 2024-05-14T12:42:35.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.259+0000 7fc19081cb80 1 Processor -- start 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560127709f20 0x560127897db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x5601278982f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc19081cb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127898830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc19081cb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b21b0 con 0x56012788cdf0 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc19081cb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b1ae0 con 0x560127709f20 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc19081cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1aec20 con 0x5601278885f0 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc19081cb80 10 client.0 _ll_register_callbacks cb 0x56012773d460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17a000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x5601278982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560127709f20 0x560127897db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17a000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x5601278982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:51806/0 (socket says 172.21.15.47:51806) 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560127709f20 0x560127897db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:41286/0 (socket says 172.21.15.47:41286) 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17a000700 1 -- 172.21.15.47:0/3464092088 learned_addr learned my addr 172.21.15.47:0/3464092088 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17b400700 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127898830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17aa00700 1 -- 172.21.15.47:0/3464092088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 msgr2=0x5601278982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.260+0000 7fc17aa00700 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x5601278982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc17aa00700 1 -- 172.21.15.47:0/3464092088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 msgr2=0x560127898830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc17aa00700 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127898830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc17aa00700 1 -- 172.21.15.47:0/3464092088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012790b300 con 0x560127709f20 2024-05-14T12:42:35.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc17aa00700 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560127709f20 0x560127897db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0098e0 tx=0x7fc16c005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b8a547d9f5b0d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:35.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc164c00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:35.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc164c00700 1 -- 172.21.15.47:0/3464092088 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c003830 con 0x560127709f20 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc16c003680 con 0x560127709f20 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.261+0000 7fc164c00700 1 -- 172.21.15.47:0/3464092088 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc16c0039d0 con 0x560127709f20 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc164c00700 1 -- 172.21.15.47:0/3464092088 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fc16c003bd0 con 0x560127709f20 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 10 client.26384 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x56012790c510 con 0x560127709f20 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc164c00700 1 -- 172.21.15.47:0/3464092088 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc16c003680 con 0x560127709f20 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc164c00700 1 -- 172.21.15.47:0/3464092088 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7fc16c00f460 con 0x560127709f20 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 10 client.26384 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 10 client.26384 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 20 client.26384 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x56012790cbb0 0x56012790efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 4 client.26384 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.f.json"}] 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.262+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 --> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.f.json"}) -- 0x5601277b74e0 con 0x56012790cbb0 2024-05-14T12:42:35.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.263+0000 7fc17a000700 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x56012790cbb0 0x56012790efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:35.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.263+0000 7fc17a000700 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x56012790cbb0 0x56012790efd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6408aaead9f91623 server_cookie=db72b9ef2452bf52 in_seq=0 out_seq=0 2024-05-14T12:42:35.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.263+0000 7fc164c00700 10 client.26384 ms_handle_connect on v2:172.21.15.73:6834/263909949 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.269+0000 7fc164c00700 1 -- 172.21.15.47:0/3464092088 <== mds.4 v2:172.21.15.73:6834/263909949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x5601277b74e0 con 0x56012790cbb0 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.269+0000 7fc164c00700 10 client.26384 handle_command_reply: tid=0 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.269+0000 7fc19081cb80 1 client.26384 shutdown 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560127709f20 msgr2=0x560127897db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560127709f20 0x560127897db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0098e0 tx=0x7fc16c005760 comp rx=0 tx=0).stop 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 shutdown_connections 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.73:6834/263909949,v1:172.21.15.73:6835/263909949] conn(0x56012790cbb0 0x56012790efd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56012788cdf0 0x560127898830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560127709f20 0x560127897db0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 --2- 172.21.15.47:0/3464092088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5601278885f0 0x5601278982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc164c00700 0 client.26384 ms_handle_reset on v2:172.21.15.73:6834/263909949 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 >> 172.21.15.47:0/3464092088 conn(0x560127748b60 msgr2=0x56012788c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 shutdown_connections 2024-05-14T12:42:35.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 1 -- 172.21.15.47:0/3464092088 wait complete. 2024-05-14T12:42:35.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.270+0000 7fc19081cb80 20 client.26384 trim_cache size 0 max 16384 2024-05-14T12:42:35.272 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:42:35.272 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-3f3d2c55-1-mds.f.json" 2024-05-14T12:42:35.272 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:42:35.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1600b2900 msgr2=0x7fc1600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1600b2900 0x7fc1600b4e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5601278844f0 tx=0x7fc168009cc0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c110a30 msgr2=0x7fc17c1a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c110a30 0x7fc17c1a1680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc17400ef30 tx=0x7fc17400c3a0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 shutdown_connections 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1600b2900 0x7fc1600b4e10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc17c110a30 0x7fc17c1a1680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc17c075ae0 0x7fc17c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 --2- 172.21.15.47:0/3151144710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc17c076430 0x7fc17c19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 >> 172.21.15.47:0/3151144710 conn(0x7fc17c079d10 msgr2=0x7fc17c100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 shutdown_connections 2024-05-14T12:42:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:35.271+0000 7fc17be00700 1 -- 172.21.15.47:0/3151144710 wait complete. 2024-05-14T12:42:36.193 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 3 (c) to a remote file /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.c.json 2024-05-14T12:42:36.193 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 ops --flags=locks --path=/var/run/ceph/ops-3f3d2c55-1-mds.c.json 2024-05-14T12:42:36.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:36 smithi047 ceph-mon[31254]: pgmap v972: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-05-14T12:42:36.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:36 smithi066 ceph-mon[35981]: pgmap v972: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-05-14T12:42:36.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:36 smithi073 ceph-mon[35809]: pgmap v972: 97 pgs: 97 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-05-14T12:42:36.668 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:38.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:38 smithi066 ceph-mon[35981]: pgmap v973: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-05-14T12:42:38.377 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:38 smithi047 ceph-mon[31254]: pgmap v973: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-05-14T12:42:38.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:38 smithi073 ceph-mon[35809]: pgmap v973: 97 pgs: 97 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-05-14T12:42:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 -- 172.21.15.47:0/918861958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c109ba0 msgr2=0x7f7a3c10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 --2- 172.21.15.47:0/918861958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c109ba0 0x7f7a3c10bfc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009860 tx=0x7f7a3402a340 comp rx=0 tx=0).stop 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 -- 172.21.15.47:0/918861958 shutdown_connections 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 --2- 172.21.15.47:0/918861958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c109ba0 0x7f7a3c10bfc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 --2- 172.21.15.47:0/918861958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a3c104ea0 0x7f7a3c1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 --2- 172.21.15.47:0/918861958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a3c103c60 0x7f7a3c104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 -- 172.21.15.47:0/918861958 >> 172.21.15.47:0/918861958 conn(0x7f7a3c0fee70 msgr2=0x7f7a3c101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 -- 172.21.15.47:0/918861958 shutdown_connections 2024-05-14T12:42:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.583+0000 7f7a44800640 1 -- 172.21.15.47:0/918861958 wait complete. 2024-05-14T12:42:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.584+0000 7f7a44800640 1 Processor -- start 2024-05-14T12:42:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.584+0000 7f7a44800640 1 -- start start 2024-05-14T12:42:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.584+0000 7f7a44800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a3c103c60 0x7f7a3c077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.584+0000 7f7a44800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c104ea0 0x7f7a3c076130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.584+0000 7f7a44800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a3c109ba0 0x7f7a3c076670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a44800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c10f770 con 0x7f7a3c103c60 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a44800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c10f5f0 con 0x7f7a3c104ea0 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a44800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c10f8f0 con 0x7f7a3c109ba0 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c104ea0 0x7f7a3c076130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a3c103c60 0x7f7a3c077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c104ea0 0x7f7a3c076130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54270/0 (socket says 172.21.15.47:54270) 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 -- 172.21.15.47:0/2681937737 learned_addr learned my addr 172.21.15.47:0/2681937737 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a42800640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a3c109ba0 0x7f7a3c076670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 -- 172.21.15.47:0/2681937737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a3c109ba0 msgr2=0x7f7a3c076670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a3c109ba0 0x7f7a3c076670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 -- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a3c103c60 msgr2=0x7f7a3c077a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a3c103c60 0x7f7a3c077a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.585+0000 7f7a41400640 1 -- 172.21.15.47:0/2681937737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c076da0 con 0x7f7a3c104ea0 2024-05-14T12:42:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.586+0000 7f7a41400640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c104ea0 0x7f7a3c076130 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00e9c0 tx=0x7f7a2c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.586+0000 7f7a32a00640 1 -- 172.21.15.47:0/2681937737 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00cde0 con 0x7f7a3c104ea0 2024-05-14T12:42:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.586+0000 7f7a32a00640 1 -- 172.21.15.47:0/2681937737 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2c0035f0 con 0x7f7a3c104ea0 2024-05-14T12:42:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.586+0000 7f7a32a00640 1 -- 172.21.15.47:0/2681937737 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c010690 con 0x7f7a3c104ea0 2024-05-14T12:42:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.586+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3c1a42e0 con 0x7f7a3c104ea0 2024-05-14T12:42:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.586+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3c1a47d0 con 0x7f7a3c104ea0 2024-05-14T12:42:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.589+0000 7f7a4b840740 1 Processor -- start 2024-05-14T12:42:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.589+0000 7f7a4b840740 1 -- start start 2024-05-14T12:42:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97321b0 0x562bb9adc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9adce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a4b840740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562bb9a38550 con 0x562bb97092f0 2024-05-14T12:42:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a4b840740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562bb99ddbc0 con 0x562bb97114d0 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a4b840740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562bb9a34510 con 0x562bb97321b0 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a32a00640 1 -- 172.21.15.47:0/2681937737 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7a2c004000 con 0x7f7a3c104ea0 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a41e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9adce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a42800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97321b0 0x562bb9adc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a41400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a41e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9adce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41156/0 (socket says 172.21.15.47:41156) 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.590+0000 7f7a41e00640 1 -- 172.21.15.47:0/1292832911 learned_addr learned my addr 172.21.15.47:0/1292832911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a42800640 1 -- 172.21.15.47:0/1292832911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 msgr2=0x562bb9ae3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a42800640 1 --2- 172.21.15.47:0/1292832911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a42800640 1 -- 172.21.15.47:0/1292832911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 msgr2=0x562bb9adce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a42800640 1 --2- 172.21.15.47:0/1292832911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9adce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a42800640 1 -- 172.21.15.47:0/1292832911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bb974a210 con 0x562bb97321b0 2024-05-14T12:42:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a42800640 1 --2- 172.21.15.47:0/1292832911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97321b0 0x562bb9adc910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a3402a860 tx=0x7f7a34005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=802f9443e6a1b50a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a27000640 1 -- 172.21.15.47:0/1292832911 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34041020 con 0x562bb97321b0 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a27000640 1 -- 172.21.15.47:0/1292832911 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a34004040 con 0x562bb97321b0 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.591+0000 7f7a27000640 1 -- 172.21.15.47:0/1292832911 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34037040 con 0x562bb97321b0 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.592+0000 7f7a32a00640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7a280b2920 0x7f7a280b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.592+0000 7f7a32a00640 1 -- 172.21.15.47:0/2681937737 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7a2c0e24c0 con 0x7f7a3c104ea0 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.592+0000 7f7a4b840740 1 -- 172.21.15.47:0/1292832911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97321b0 msgr2=0x562bb9adc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.592+0000 7f7a4b840740 1 --2- 172.21.15.47:0/1292832911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97321b0 0x562bb9adc910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a3402a860 tx=0x7f7a34005e00 comp rx=0 tx=0).stop 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.592+0000 7f7a41e00640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7a280b2920 0x7f7a280b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 -- 172.21.15.47:0/1292832911 shutdown_connections 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 --2- 172.21.15.47:0/1292832911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 --2- 172.21.15.47:0/1292832911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9adce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 --2- 172.21.15.47:0/1292832911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97321b0 0x562bb9adc910 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 -- 172.21.15.47:0/1292832911 >> 172.21.15.47:0/1292832911 conn(0x562bb9726300 msgr2=0x562bb9acfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 -- 172.21.15.47:0/1292832911 shutdown_connections 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 -- 172.21.15.47:0/1292832911 wait complete. 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a41e00640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7a280b2920 0x7f7a280b4e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x562bb9ad0820 tx=0x7f7a38009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.593+0000 7f7a4b840740 1 -- start start 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 1 Processor -- start 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97092f0 0x562bb9ae63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562bb9ae4780 con 0x562bb97321b0 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562bb99f1660 con 0x562bb97114d0 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562bb9ae4900 con 0x562bb97092f0 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.594+0000 7f7a4b840740 10 client.0 _ll_register_callbacks cb 0x562bb99bb400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a42800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54284/0 (socket says 172.21.15.47:54284) 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 -- 172.21.15.47:0/3931400750 learned_addr learned my addr 172.21.15.47:0/3931400750 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41e00640 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97092f0 0x562bb9ae63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 -- 172.21.15.47:0/3931400750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97092f0 msgr2=0x562bb9ae63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97092f0 0x562bb9ae63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 -- 172.21.15.47:0/3931400750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 msgr2=0x562bb9aed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 -- 172.21.15.47:0/3931400750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bb9816620 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41e00640 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97092f0 0x562bb9ae63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a41400640 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae6920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0a5b60 tx=0x7f7a2c0a5a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9046e3e7fb548a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.595+0000 7f7a1b400640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a1b400640 1 -- 172.21.15.47:0/3931400750 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0a9250 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a1b400640 1 -- 172.21.15.47:0/3931400750 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7a2c0037a0 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a34004040 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a1b400640 1 -- 172.21.15.47:0/3931400750 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f7a2c0042f0 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a4b840740 10 client.26396 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x562bb9af0880 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a1b400640 1 -- 172.21.15.47:0/3931400750 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a34004040 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a1b400640 1 -- 172.21.15.47:0/3931400750 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7f7a2c0e2080 con 0x562bb97114d0 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a4b840740 10 client.26396 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a4b840740 10 client.26396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.596+0000 7f7a4b840740 20 client.26396 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.597+0000 7f7a4b840740 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96f0d80 0x562bb9af3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.597+0000 7f7a4b840740 4 client.26396 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.597+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bb9a46160 con 0x562bb96f0d80 2024-05-14T12:42:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.597+0000 7f7a41e00640 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96f0d80 0x562bb9af3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.598+0000 7f7a41e00640 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96f0d80 0x562bb9af3ea0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ebec67ba2b84c0a server_cookie=590d362580883948 in_seq=0 out_seq=0 2024-05-14T12:42:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.598+0000 7f7a1b400640 10 client.26396 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.598+0000 7f7a1b400640 1 -- 172.21.15.47:0/3931400750 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562bb9a46160 con 0x562bb96f0d80 2024-05-14T12:42:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.598+0000 7f7a1b400640 10 client.26396 handle_command_reply: tid=0 2024-05-14T12:42:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.598+0000 7f7a4b840740 1 client.26396 shutdown 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 msgr2=0x562bb9ae6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae6920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0a5b60 tx=0x7f7a2c0a5a10 comp rx=0 tx=0).stop 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 shutdown_connections 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96f0d80 0x562bb9af3ea0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97114d0 0x562bb9ae6920 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 --2- 172.21.15.47:0/3931400750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97092f0 0x562bb9ae63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a1b400640 0 client.26396 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 >> 172.21.15.47:0/3931400750 conn(0x562bb9726300 msgr2=0x562bb9acea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 shutdown_connections 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 1 -- 172.21.15.47:0/3931400750 wait complete. 2024-05-14T12:42:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.599+0000 7f7a4b840740 20 client.26396 trim_cache size 0 max 16384 2024-05-14T12:42:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 Processor -- start 2024-05-14T12:42:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 -- start start 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9af8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97321b0 0x562bb9af8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1a90b0 con 0x562bb97092f0 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1aacb0 con 0x562bb97321b0 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a4b840740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1a97b0 con 0x562bb97114d0 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a41400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a41400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aed7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38184/0 (socket says 172.21.15.47:38184) 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a41400640 1 -- 172.21.15.47:0/2249414911 learned_addr learned my addr 172.21.15.47:0/2249414911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.617+0000 7f7a41e00640 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9af8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a42800640 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97321b0 0x562bb9af8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a41400640 1 -- 172.21.15.47:0/2249414911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97321b0 msgr2=0x562bb9af8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a41400640 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97321b0 0x562bb9af8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a41400640 1 -- 172.21.15.47:0/2249414911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 msgr2=0x562bb9af8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a41400640 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9af8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a41400640 1 -- 172.21.15.47:0/2249414911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bb9acb280 con 0x562bb97114d0 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a41e00640 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9af8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a41400640 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aed7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0a97e0 tx=0x7f7a2c0e5c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87536f94d065b05 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a26600640 1 -- 172.21.15.47:0/2249414911 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0a9250 con 0x562bb97114d0 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a26600640 1 -- 172.21.15.47:0/2249414911 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2c0a95f0 con 0x562bb97114d0 2024-05-14T12:42:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.618+0000 7f7a26600640 1 -- 172.21.15.47:0/2249414911 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0a98b0 con 0x562bb97114d0 2024-05-14T12:42:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.619+0000 7f7a4b840740 1 -- 172.21.15.47:0/2249414911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 msgr2=0x562bb9aed7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.619+0000 7f7a4b840740 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aed7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0a97e0 tx=0x7f7a2c0e5c70 comp rx=0 tx=0).stop 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.619+0000 7f7a4b840740 1 -- 172.21.15.47:0/2249414911 shutdown_connections 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.619+0000 7f7a4b840740 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97321b0 0x562bb9af8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.619+0000 7f7a4b840740 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aed7a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.619+0000 7f7a4b840740 1 --2- 172.21.15.47:0/2249414911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97092f0 0x562bb9af8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.619+0000 7f7a4b840740 1 -- 172.21.15.47:0/2249414911 >> 172.21.15.47:0/2249414911 conn(0x562bb9726300 msgr2=0x562bb9ae0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.620+0000 7f7a4b840740 1 -- 172.21.15.47:0/2249414911 shutdown_connections 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.620+0000 7f7a4b840740 1 -- 172.21.15.47:0/2249414911 wait complete. 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.620+0000 7f7a4b840740 1 -- start start 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.620+0000 7f7a4b840740 1 Processor -- start 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97092f0 0x562bb9aead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aeb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a4b840740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a4b840740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1aa5e0 con 0x562bb97321b0 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a4b840740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1a9f10 con 0x562bb97092f0 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a4b840740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1a7070 con 0x562bb97114d0 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a4b840740 10 client.0 _ll_register_callbacks cb 0x7f7a2c003d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97092f0 0x562bb9aead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97092f0 0x562bb9aead70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54288/0 (socket says 172.21.15.47:54288) 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 -- 172.21.15.47:0/140136939 learned_addr learned my addr 172.21.15.47:0/140136939 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a42800640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41400640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aeb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 -- 172.21.15.47:0/140136939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 msgr2=0x562bb9aeb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aeb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 -- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 msgr2=0x562bb9aec1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aec1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a41e00640 1 -- 172.21.15.47:0/140136939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bb9aec7a0 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.621+0000 7f7a42800640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aec1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a41e00640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97092f0 0x562bb9aead70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7a38005fd0 tx=0x7f7a38004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41460814b4621cfa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a1b400640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a1b400640 1 -- 172.21.15.47:0/140136939 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3802e070 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a2c0a95f0 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a1b400640 1 -- 172.21.15.47:0/140136939 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7a3802a5c0 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a1b400640 1 -- 172.21.15.47:0/140136939 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f7a3803a050 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a4b840740 10 client.26402 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.622+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x562bb9aedb00 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a1b400640 1 -- 172.21.15.47:0/140136939 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2c0a95f0 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a1b400640 1 -- 172.21.15.47:0/140136939 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7f7a3801ebd0 con 0x562bb97092f0 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a4b840740 10 client.26402 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a4b840740 10 client.26402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a4b840740 20 client.26402 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a4b840740 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96c61c0 0x562bb9b5e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a4b840740 4 client.26402 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:42:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562bb9a3ffd0 con 0x562bb96c61c0 2024-05-14T12:42:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.623+0000 7f7a41400640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96c61c0 0x562bb9b5e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.624+0000 7f7a41400640 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96c61c0 0x562bb9b5e9e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d6cd5bd12d7dc3e server_cookie=a61ba338a885cf68 in_seq=0 out_seq=0 2024-05-14T12:42:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:38.624+0000 7f7a1b400640 10 client.26402 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 -- 172.21.15.47:0/2084959834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 msgr2=0x7f07e8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 --2- 172.21.15.47:0/2084959834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 0x7f07e8104a00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009920 tx=0x7f07d8009c30 comp rx=0 tx=0).stop 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 -- 172.21.15.47:0/2084959834 shutdown_connections 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 --2- 172.21.15.47:0/2084959834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e8109870 0x7f07e81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 --2- 172.21.15.47:0/2084959834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 0x7f07e8104a00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 --2- 172.21.15.47:0/2084959834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 0x7f07e8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 -- 172.21.15.47:0/2084959834 >> 172.21.15.47:0/2084959834 conn(0x7f07e8100040 msgr2=0x7f07e8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.098+0000 7f07ed200700 1 -- 172.21.15.47:0/2084959834 shutdown_connections 2024-05-14T12:42:39.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.099+0000 7f07ed200700 1 -- 172.21.15.47:0/2084959834 wait complete. 2024-05-14T12:42:39.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.100+0000 7f07ed200700 1 Processor -- start 2024-05-14T12:42:39.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07ed200700 1 -- start start 2024-05-14T12:42:39.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07ed200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 0x7f07e819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07ed200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 0x7f07e819b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07ed200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e8109870 0x7f07e819f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07ed200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81144a0 con 0x7f07e8109870 2024-05-14T12:42:39.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07ed200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8114320 con 0x7f07e8108f20 2024-05-14T12:42:39.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07ed200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8114620 con 0x7f07e81045f0 2024-05-14T12:42:39.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07e5400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 0x7f07e819b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07e5400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 0x7f07e819b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54314/0 (socket says 172.21.15.47:54314) 2024-05-14T12:42:39.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07e5400700 1 -- 172.21.15.47:0/1239570029 learned_addr learned my addr 172.21.15.47:0/1239570029 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:39.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.101+0000 7f07e5e00700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 0x7f07e819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.102+0000 7f07e6800700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e8109870 0x7f07e819f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.102+0000 7f07e5400700 1 -- 172.21.15.47:0/1239570029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 msgr2=0x7f07e819aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.102+0000 7f07e5400700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 0x7f07e819aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.102+0000 7f07e5400700 1 -- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e8109870 msgr2=0x7f07e819f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.102+0000 7f07e5400700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e8109870 0x7f07e819f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.102+0000 7f07e5400700 1 -- 172.21.15.47:0/1239570029 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e819fd80 con 0x7f07e8108f20 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.102+0000 7f07e5400700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 0x7f07e819b450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07d400e9f0 tx=0x7f07d400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.103+0000 7f07dea00700 1 -- 172.21.15.47:0/1239570029 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d400c9c0 con 0x7f07e8108f20 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.103+0000 7f07dea00700 1 -- 172.21.15.47:0/1239570029 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d400cb60 con 0x7f07e8108f20 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.103+0000 7f07dea00700 1 -- 172.21.15.47:0/1239570029 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4018680 con 0x7f07e8108f20 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.103+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e81a0070 con 0x7f07e8108f20 2024-05-14T12:42:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.103+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e81a7990 con 0x7f07e8108f20 2024-05-14T12:42:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.106+0000 7f07dea00700 1 -- 172.21.15.47:0/1239570029 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f07d4018a30 con 0x7f07e8108f20 2024-05-14T12:42:39.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 Processor -- start 2024-05-14T12:42:39.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 -- start start 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07dea00700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07cc0b2900 0x7f07cc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0872be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b08773c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b0877d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5639b0794b00 con 0x5639b0873120 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5639b0732840 con 0x5639b0877900 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5639b0790ac0 con 0x5639b06f4f20 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.108+0000 7f07dea00700 1 -- 172.21.15.47:0/1239570029 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f07d40e2610 con 0x7f07e8108f20 2024-05-14T12:42:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e6800700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07cc0b2900 0x7f07cc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e5e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0872be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e6800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b0877d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e5e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0872be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38218/0 (socket says 172.21.15.47:38218) 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e5e00700 1 -- 172.21.15.47:0/2166772942 learned_addr learned my addr 172.21.15.47:0/2166772942 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e5400700 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b08773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e6800700 1 -- 172.21.15.47:0/2166772942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 msgr2=0x5639b0872be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e6800700 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0872be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e6800700 1 -- 172.21.15.47:0/2166772942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 msgr2=0x5639b08773c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e6800700 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b08773c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.109+0000 7f07e6800700 1 -- 172.21.15.47:0/2166772942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639b06e19b0 con 0x5639b0877900 2024-05-14T12:42:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.110+0000 7f07e5e00700 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0872be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.110+0000 7f07e6800700 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b0877d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007c50 tx=0x7f07e0007f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8d941927b5da63c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.110+0000 7f07e6800700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07cc0b2900 0x7f07cc0b4e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007fd0 tx=0x7f07e0012000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.110+0000 7f07d3400700 1 -- 172.21.15.47:0/2166772942 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0009e60 con 0x5639b0877900 2024-05-14T12:42:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.110+0000 7f07d3400700 1 -- 172.21.15.47:0/2166772942 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e0007730 con 0x5639b0877900 2024-05-14T12:42:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.110+0000 7f07d3400700 1 -- 172.21.15.47:0/2166772942 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e00047d0 con 0x5639b0877900 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.111+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2166772942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 msgr2=0x5639b0877d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.111+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b0877d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007c50 tx=0x7f07e0007f60 comp rx=0 tx=0).stop 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.111+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2166772942 shutdown_connections 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.111+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b0877d10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.111+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0872be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.111+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2166772942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b08773c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.111+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2166772942 >> 172.21.15.47:0/2166772942 conn(0x5639b073a050 msgr2=0x5639b086d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.112+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2166772942 shutdown_connections 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.112+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2166772942 wait complete. 2024-05-14T12:42:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.112+0000 7f07fbd12b80 1 -- start start 2024-05-14T12:42:39.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 1 Processor -- start 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b087c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b087cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b087d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5639b0883ba0 con 0x5639b0873120 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5639b06fac00 con 0x5639b0877900 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5639b0883d20 con 0x5639b06f4f20 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.113+0000 7f07fbd12b80 10 client.0 _ll_register_callbacks cb 0x5639b073bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b087cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e6800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b087d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b087cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41208/0 (socket says 172.21.15.47:41208) 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e5400700 1 -- 172.21.15.47:0/1351433396 learned_addr learned my addr 172.21.15.47:0/1351433396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:39.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e5e00700 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b087c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e6800700 1 -- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 msgr2=0x5639b087c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e6800700 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b087c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e6800700 1 -- 172.21.15.47:0/1351433396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 msgr2=0x5639b087cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e6800700 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b087cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e6800700 1 -- 172.21.15.47:0/1351433396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639b075a500 con 0x5639b0877900 2024-05-14T12:42:39.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.114+0000 7f07e5e00700 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b087c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07e6800700 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b087d140 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007560 tx=0x7f07e0004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=581df7bfce723e7c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07c7e00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07c7e00700 1 -- 172.21.15.47:0/1351433396 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0028070 con 0x5639b0877900 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07c7e00700 1 -- 172.21.15.47:0/1351433396 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f07e0004820 con 0x5639b0877900 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07e0007730 con 0x5639b0877900 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07c7e00700 1 -- 172.21.15.47:0/1351433396 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f07e0009e60 con 0x5639b0877900 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07fbd12b80 10 client.26414 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5639b088e850 con 0x5639b0877900 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.115+0000 7f07c7e00700 1 -- 172.21.15.47:0/1351433396 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e0007730 con 0x5639b0877900 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07c7e00700 1 -- 172.21.15.47:0/1351433396 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7f07e0018040 con 0x5639b0877900 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07fbd12b80 10 client.26414 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07fbd12b80 10 client.26414 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-14T12:42:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07fbd12b80 20 client.26414 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0890e90 0x5639b08932b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07fbd12b80 4 client.26414 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639b083f2a0 con 0x5639b0890e90 2024-05-14T12:42:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.116+0000 7f07e5e00700 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0890e90 0x5639b08932b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.117+0000 7f07e5e00700 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0890e90 0x5639b08932b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8df0719611a2f47f server_cookie=ff2e391a6a98e90c in_seq=0 out_seq=0 2024-05-14T12:42:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.117+0000 7f07c7e00700 10 client.26414 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07c7e00700 1 -- 172.21.15.47:0/1351433396 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5639b083f2a0 con 0x5639b0890e90 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07c7e00700 10 client.26414 handle_command_reply: tid=0 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 client.26414 shutdown 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 msgr2=0x5639b087d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b087d140 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007560 tx=0x7f07e0004d10 comp rx=0 tx=0).stop 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 shutdown_connections 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0877900 0x5639b087d140 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0890e90 0x5639b08932b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b087c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/1351433396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b0873120 0x5639b087cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07c7e00700 0 client.26414 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:42:39.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 >> 172.21.15.47:0/1351433396 conn(0x5639b073a050 msgr2=0x5639b0871930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:39.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 shutdown_connections 2024-05-14T12:42:39.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 1 -- 172.21.15.47:0/1351433396 wait complete. 2024-05-14T12:42:39.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.118+0000 7f07fbd12b80 20 client.26414 trim_cache size 0 max 16384 2024-05-14T12:42:39.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.139+0000 7f07fbd12b80 1 Processor -- start 2024-05-14T12:42:39.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.139+0000 7f07fbd12b80 1 -- start start 2024-05-14T12:42:39.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.139+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b086daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.139+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0878bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81acb60 con 0x5639b073a050 2024-05-14T12:42:39.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81ae760 con 0x5639b0873120 2024-05-14T12:42:39.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81ad260 con 0x5639b06f4f20 2024-05-14T12:42:39.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0878bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0878bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38234/0 (socket says 172.21.15.47:38234) 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e6800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b086daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 -- 172.21.15.47:0/115222614 learned_addr learned my addr 172.21.15.47:0/115222614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 -- 172.21.15.47:0/115222614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 msgr2=0x5639b08988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 --2- 172.21.15.47:0/115222614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 -- 172.21.15.47:0/115222614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 msgr2=0x5639b086daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 --2- 172.21.15.47:0/115222614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b086daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.140+0000 7f07e5400700 1 -- 172.21.15.47:0/115222614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639b087f420 con 0x5639b06f4f20 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.141+0000 7f07e5400700 1 --2- 172.21.15.47:0/115222614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0878bc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07d40e00a0 tx=0x7f07d40e2040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d78658790c1eeb8a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.141+0000 7f07d2a00700 1 -- 172.21.15.47:0/115222614 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40c4070 con 0x5639b06f4f20 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.141+0000 7f07d2a00700 1 -- 172.21.15.47:0/115222614 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d40a9700 con 0x5639b06f4f20 2024-05-14T12:42:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.141+0000 7f07d2a00700 1 -- 172.21.15.47:0/115222614 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40c4210 con 0x5639b06f4f20 2024-05-14T12:42:39.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 -- 172.21.15.47:0/115222614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 msgr2=0x5639b0878bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/115222614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0878bc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07d40e00a0 tx=0x7f07d40e2040 comp rx=0 tx=0).stop 2024-05-14T12:42:39.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 -- 172.21.15.47:0/115222614 shutdown_connections 2024-05-14T12:42:39.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/115222614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/115222614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b086daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/115222614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0878bc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 -- 172.21.15.47:0/115222614 >> 172.21.15.47:0/115222614 conn(0x5639b0867030 msgr2=0x5639b08784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:39.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 -- 172.21.15.47:0/115222614 shutdown_connections 2024-05-14T12:42:39.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.142+0000 7f07fbd12b80 1 -- 172.21.15.47:0/115222614 wait complete. 2024-05-14T12:42:39.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.143+0000 7f07fbd12b80 1 -- start start 2024-05-14T12:42:39.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.143+0000 7f07fbd12b80 1 Processor -- start 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0886f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b0887470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07fbd12b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08fa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81ae090 con 0x5639b073a050 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81ad9c0 con 0x5639b0873120 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07fbd12b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81aaac0 con 0x5639b06f4f20 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07fbd12b80 10 client.0 _ll_register_callbacks cb 0x5639b073bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b0887470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0886f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e6800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0886f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38246/0 (socket says 172.21.15.47:38246) 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 -- 172.21.15.47:0/2047160941 learned_addr learned my addr 172.21.15.47:0/2047160941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:39.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 -- 172.21.15.47:0/2047160941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 msgr2=0x5639b08fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 -- 172.21.15.47:0/2047160941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 msgr2=0x5639b0887470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b0887470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.144+0000 7f07e5e00700 1 -- 172.21.15.47:0/2047160941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639b0887d20 con 0x5639b06f4f20 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07e5e00700 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0886f30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d800f8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9130be44e976af6b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07c7e00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07c7e00700 1 -- 172.21.15.47:0/2047160941 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8005520 con 0x5639b06f4f20 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07c7e00700 1 -- 172.21.15.47:0/2047160941 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f07d8003680 con 0x5639b06f4f20 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07d40a9700 con 0x5639b06f4f20 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07c7e00700 1 -- 172.21.15.47:0/2047160941 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f07d8039050 con 0x5639b06f4f20 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07fbd12b80 10 client.26446 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:39.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.145+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5639b08fba00 con 0x5639b06f4f20 2024-05-14T12:42:39.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07c7e00700 1 -- 172.21.15.47:0/2047160941 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d40a9700 con 0x5639b06f4f20 2024-05-14T12:42:39.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07c7e00700 1 -- 172.21.15.47:0/2047160941 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7f07d8031020 con 0x5639b06f4f20 2024-05-14T12:42:39.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07fbd12b80 10 client.26446 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:39.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07fbd12b80 10 client.26446 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-14T12:42:39.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07fbd12b80 20 client.26446 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:39.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0877900 0x5639b08fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:39.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07fbd12b80 4 client.26446 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.c.json"}] 2024-05-14T12:42:39.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 --> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.c.json"}) -- 0x5639b07a24e0 con 0x5639b0877900 2024-05-14T12:42:39.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.146+0000 7f07e5400700 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0877900 0x5639b08fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:39.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.147+0000 7f07e5400700 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0877900 0x5639b08fe240 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=52755c76e43efa94 server_cookie=7340c3a274d672f0 in_seq=0 out_seq=0 2024-05-14T12:42:39.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.147+0000 7f07c7e00700 10 client.26446 ms_handle_connect on v2:172.21.15.73:6836/3629841248 2024-05-14T12:42:39.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.153+0000 7f07c7e00700 1 -- 172.21.15.47:0/2047160941 <== mds.3 v2:172.21.15.73:6836/3629841248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x5639b07a24e0 con 0x5639b0877900 2024-05-14T12:42:39.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.153+0000 7f07c7e00700 10 client.26446 handle_command_reply: tid=0 2024-05-14T12:42:39.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.153+0000 7f07fbd12b80 1 client.26446 shutdown 2024-05-14T12:42:39.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.153+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 msgr2=0x5639b0886f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.153+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0886f30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d800f8e0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 shutdown_connections 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5639b0873120 0x5639b08fa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:6836/3629841248,v1:172.21.15.73:6837/3629841248] conn(0x5639b0877900 0x5639b08fe240 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639b06f4f20 0x5639b0886f30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 --2- 172.21.15.47:0/2047160941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5639b073a050 0x5639b0887470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 >> 172.21.15.47:0/2047160941 conn(0x5639b0867030 msgr2=0x5639b086d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07c7e00700 0 client.26446 ms_handle_reset on v2:172.21.15.73:6836/3629841248 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 shutdown_connections 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 1 -- 172.21.15.47:0/2047160941 wait complete. 2024-05-14T12:42:39.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.154+0000 7f07fbd12b80 20 client.26446 trim_cache size 0 max 16384 2024-05-14T12:42:39.156 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:42:39.156 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-3f3d2c55-1-mds.c.json" 2024-05-14T12:42:39.156 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:42:39.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07cc0b2900 msgr2=0x7f07cc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07cc0b2900 0x7f07cc0b4e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007fd0 tx=0x7f07e0012000 comp rx=0 tx=0).stop 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 msgr2=0x7f07e819b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 0x7f07e819b450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07d400e9f0 tx=0x7f07d400ed00 comp rx=0 tx=0).stop 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 shutdown_connections 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f07cc0b2900 0x7f07cc0b4e10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07e8109870 0x7f07e819f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07e81045f0 0x7f07e819aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 --2- 172.21.15.47:0/1239570029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8108f20 0x7f07e819b450 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 >> 172.21.15.47:0/1239570029 conn(0x7f07e8100040 msgr2=0x7f07e8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 shutdown_connections 2024-05-14T12:42:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:39.155+0000 7f07ed200700 1 -- 172.21.15.47:0/1239570029 wait complete. 2024-05-14T12:42:39.974 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 2 (i) to a remote file /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.i.json 2024-05-14T12:42:39.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 ops --flags=locks --path=/var/run/ceph/ops-3f3d2c55-1-mds.i.json 2024-05-14T12:42:40.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:40 smithi047 ceph-mon[31254]: pgmap v974: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 16 op/s 2024-05-14T12:42:40.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:40 smithi066 ceph-mon[35981]: pgmap v974: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 16 op/s 2024-05-14T12:42:40.460 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:40.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:40 smithi073 ceph-mon[35809]: pgmap v974: 97 pgs: 97 active+clean; 2.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 16 op/s 2024-05-14T12:42:42.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:42 smithi066 ceph-mon[35981]: pgmap v975: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 18 op/s 2024-05-14T12:42:42.371 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:42 smithi047 ceph-mon[31254]: pgmap v975: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 18 op/s 2024-05-14T12:42:42.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:42 smithi073 ceph-mon[35809]: pgmap v975: 97 pgs: 97 active+clean; 2.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 18 op/s 2024-05-14T12:42:42.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.776+0000 7fc1e4000700 1 -- 172.21.15.47:0/1816387547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 msgr2=0x7fc1dc117790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.776+0000 7fc1e4000700 1 --2- 172.21.15.47:0/1816387547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc117790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400b0a0 tx=0x7fc1d400b3b0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.777+0000 7fc1e4000700 1 -- 172.21.15.47:0/1816387547 shutdown_connections 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.777+0000 7fc1e4000700 1 --2- 172.21.15.47:0/1816387547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc117790 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.777+0000 7fc1e4000700 1 --2- 172.21.15.47:0/1816387547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1dc075b60 0x7fc1dc075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.777+0000 7fc1e4000700 1 --2- 172.21.15.47:0/1816387547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0764b0 0x7fc1dc114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.777+0000 7fc1e4000700 1 -- 172.21.15.47:0/1816387547 >> 172.21.15.47:0/1816387547 conn(0x7fc1dc100040 msgr2=0x7fc1dc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.777+0000 7fc1e4000700 1 -- 172.21.15.47:0/1816387547 shutdown_connections 2024-05-14T12:42:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.777+0000 7fc1e4000700 1 -- 172.21.15.47:0/1816387547 wait complete. 2024-05-14T12:42:42.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.778+0000 7fc1e4000700 1 Processor -- start 2024-05-14T12:42:42.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.778+0000 7fc1e4000700 1 -- start start 2024-05-14T12:42:42.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e4000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1dc075b60 0x7fc1dc1a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e4000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0764b0 0x7fc1dc1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e4000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc1a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e4000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc11aad0 con 0x7fc1dc0764b0 2024-05-14T12:42:42.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e4000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc11a950 con 0x7fc1dc075b60 2024-05-14T12:42:42.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e4000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc11ac50 con 0x7fc1dc115370 2024-05-14T12:42:42.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e2000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc1a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e1600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1dc075b60 0x7fc1dc1a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e2000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc1a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38264/0 (socket says 172.21.15.47:38264) 2024-05-14T12:42:42.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e2000700 1 -- 172.21.15.47:0/2766932296 learned_addr learned my addr 172.21.15.47:0/2766932296 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:42.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.779+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0764b0 0x7fc1dc1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e1600700 1 -- 172.21.15.47:0/2766932296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 msgr2=0x7fc1dc1a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e1600700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc1a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e1600700 1 -- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0764b0 msgr2=0x7fc1dc1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e1600700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0764b0 0x7fc1dc1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e1600700 1 -- 172.21.15.47:0/2766932296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc1a6270 con 0x7fc1dc075b60 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e2000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc1a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0764b0 0x7fc1dc1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.780+0000 7fc1e1600700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1dc075b60 0x7fc1dc1a13a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000e9f0 tx=0x7fc1d000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.781+0000 7fc1da000700 1 -- 172.21.15.47:0/2766932296 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000c9c0 con 0x7fc1dc075b60 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.781+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1dc1a6560 con 0x7fc1dc075b60 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.781+0000 7fc1da000700 1 -- 172.21.15.47:0/2766932296 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1d000cb60 con 0x7fc1dc075b60 2024-05-14T12:42:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.781+0000 7fc1da000700 1 -- 172.21.15.47:0/2766932296 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0018680 con 0x7fc1dc075b60 2024-05-14T12:42:42.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.781+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1dc1ade80 con 0x7fc1dc075b60 2024-05-14T12:42:42.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.785+0000 7fc1da000700 1 -- 172.21.15.47:0/2766932296 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc1d0010430 con 0x7fc1dc075b60 2024-05-14T12:42:42.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.786+0000 7fc1f2c0bb80 1 Processor -- start 2024-05-14T12:42:42.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.786+0000 7fc1f2c0bb80 1 -- start start 2024-05-14T12:42:42.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1da000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1c40b2880 0x7fc1c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9aab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1da000700 1 -- 172.21.15.47:0/2766932296 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc1d00e23a0 con 0x7fc1dc075b60 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ab81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c2f99cdb00 con 0x55c2f9aab9f0 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c2f996b840 con 0x55c2f992df20 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c2f99c9ac0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1e0c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1e2000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1c40b2880 0x7fc1c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1e0c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38278/0 (socket says 172.21.15.47:38278) 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1e0c00700 1 -- 172.21.15.47:0/1447945643 learned_addr learned my addr 172.21.15.47:0/1447945643 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.787+0000 7fc1e1600700 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9aab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.788+0000 7fc1e0c00700 1 -- 172.21.15.47:0/1447945643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 msgr2=0x55c2f9aab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.788+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9aab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.788+0000 7fc1e0c00700 1 -- 172.21.15.47:0/1447945643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 msgr2=0x55c2f9ab81f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.788+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ab81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.788+0000 7fc1e0c00700 1 -- 172.21.15.47:0/1447945643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f991a9b0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.788+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5ca0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80114f0 tx=0x7fc1c8011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e78ae6a503186b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.789+0000 7fc1cea00700 1 -- 172.21.15.47:0/1447945643 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8004230 con 0x55c2f9aab5e0 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.789+0000 7fc1cea00700 1 -- 172.21.15.47:0/1447945643 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1c80043d0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.789+0000 7fc1cea00700 1 -- 172.21.15.47:0/1447945643 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800e970 con 0x55c2f9aab5e0 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.789+0000 7fc1e2000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1c40b2880 0x7fc1c40b4d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55c2f9aabe80 tx=0x7fc1d400bf60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/1447945643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 msgr2=0x55c2f9ab5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5ca0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80114f0 tx=0x7fc1c8011800 comp rx=0 tx=0).stop 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/1447945643 shutdown_connections 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ab81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9aab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/1447945643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5ca0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/1447945643 >> 172.21.15.47:0/1447945643 conn(0x55c2f996cb60 msgr2=0x55c2f9aa6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/1447945643 shutdown_connections 2024-05-14T12:42:42.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.790+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/1447945643 wait complete. 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.791+0000 7fc1f2c0bb80 1 -- start start 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.791+0000 7fc1f2c0bb80 1 Processor -- start 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.791+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ab6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9ab8b60 con 0x55c2f9aab9f0 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9933c00 con 0x55c2f992df20 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9ab8ce0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1f2c0bb80 10 client.0 _ll_register_callbacks cb 0x55c2f9961460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54388/0 (socket says 172.21.15.47:54388) 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 -- 172.21.15.47:0/738129453 learned_addr learned my addr 172.21.15.47:0/738129453 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e2000700 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ab6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 -- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 msgr2=0x55c2f9ab5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 -- 172.21.15.47:0/738129453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 msgr2=0x55c2f9ab6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ab6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.792+0000 7fc1e1600700 1 -- 172.21.15.47:0/738129453 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f9993500 con 0x55c2f992df20 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1e1600700 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab56c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0011fd0 tx=0x7fc1d00a9ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f8b3144589695 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1c3400700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1c3400700 1 -- 172.21.15.47:0/738129453 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00a9490 con 0x55c2f992df20 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1c3400700 1 -- 172.21.15.47:0/738129453 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc1d00b2560 con 0x55c2f992df20 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1c80043d0 con 0x55c2f992df20 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1c3400700 1 -- 172.21.15.47:0/738129453 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fc1d00aa080 con 0x55c2f992df20 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1f2c0bb80 10 client.26432 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.793+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55c2f9ac3760 con 0x55c2f992df20 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1c3400700 1 -- 172.21.15.47:0/738129453 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1c80043d0 con 0x55c2f992df20 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1c3400700 1 -- 172.21.15.47:0/738129453 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7fc1d00a52f0 con 0x55c2f992df20 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1f2c0bb80 10 client.26432 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1f2c0bb80 10 client.26432 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1f2c0bb80 20 client.26432 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9ac5cf0 0x55c2f9ac81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1f2c0bb80 4 client.26432 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2f9a78150 con 0x55c2f9ac5cf0 2024-05-14T12:42:42.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.794+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9ac5cf0 0x55c2f9ac81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.795+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9ac5cf0 0x55c2f9ac81a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3319941e5c312408 server_cookie=53e45bc39af8eda9 in_seq=0 out_seq=0 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.795+0000 7fc1c3400700 10 client.26432 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1c3400700 1 -- 172.21.15.47:0/738129453 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c2f9a78150 con 0x55c2f9ac5cf0 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1c3400700 10 client.26432 handle_command_reply: tid=0 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 client.26432 shutdown 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 msgr2=0x55c2f9ab56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab56c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0011fd0 tx=0x7fc1d00a9ec0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 shutdown_connections 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9ac5cf0 0x55c2f9ac81a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ab6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab56c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/738129453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1c3400700 0 client.26432 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:42:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 >> 172.21.15.47:0/738129453 conn(0x55c2f996cb60 msgr2=0x55c2f9aa61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:42.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 shutdown_connections 2024-05-14T12:42:42.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.796+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/738129453 wait complete. 2024-05-14T12:42:42.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.797+0000 7fc1f2c0bb80 20 client.26432 trim_cache size 0 max 16384 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 Processor -- start 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 -- start start 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ac1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc1b5280 con 0x55c2f9aab9f0 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc1b6e80 con 0x55c2f992df20 2024-05-14T12:42:42.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.817+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc1b5980 con 0x55c2f9aab5e0 2024-05-14T12:42:42.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e0c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e2000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ac1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54390/0 (socket says 172.21.15.47:54390) 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e0c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38296/0 (socket says 172.21.15.47:38296) 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 -- 172.21.15.47:0/3531532554 learned_addr learned my addr 172.21.15.47:0/3531532554 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 -- 172.21.15.47:0/3531532554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 msgr2=0x55c2f9ab60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 --2- 172.21.15.47:0/3531532554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 -- 172.21.15.47:0/3531532554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 msgr2=0x55c2f9ac1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 --2- 172.21.15.47:0/3531532554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ac1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 -- 172.21.15.47:0/3531532554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f9ab3c30 con 0x55c2f992df20 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.818+0000 7fc1e1600700 1 --2- 172.21.15.47:0/3531532554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab0f00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0000c00 tx=0x7fc1d0009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=984999fcaf1561e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.819+0000 7fc1ce000700 1 -- 172.21.15.47:0/3531532554 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00a9490 con 0x55c2f992df20 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.819+0000 7fc1ce000700 1 -- 172.21.15.47:0/3531532554 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1d00a9980 con 0x55c2f992df20 2024-05-14T12:42:42.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.819+0000 7fc1ce000700 1 -- 172.21.15.47:0/3531532554 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d006f3c0 con 0x55c2f992df20 2024-05-14T12:42:42.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/3531532554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 msgr2=0x55c2f9ab0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/3531532554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab0f00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0000c00 tx=0x7fc1d0009790 comp rx=0 tx=0).stop 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/3531532554 shutdown_connections 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/3531532554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9ac1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/3531532554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f992df20 0x55c2f9ab0f00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/3531532554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f9aab5e0 0x55c2f9ab60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/3531532554 >> 172.21.15.47:0/3531532554 conn(0x55c2f996cb60 msgr2=0x55c2f9aaeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/3531532554 shutdown_connections 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/3531532554 wait complete. 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.820+0000 7fc1f2c0bb80 1 -- start start 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 1 Processor -- start 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f992df20 0x55c2f9aba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f9aab5e0 0x55c2f9abac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9b28520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc1b67b0 con 0x55c2f9aab9f0 2024-05-14T12:42:42.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc1b60e0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc1b3200 con 0x55c2f992df20 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1f2c0bb80 10 client.0 _ll_register_callbacks cb 0x55c2f9961460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1e0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f9aab5e0 0x55c2f9abac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1e1600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f992df20 0x55c2f9aba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.821+0000 7fc1e0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f9aab5e0 0x55c2f9abac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54406/0 (socket says 172.21.15.47:54406) 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e0c00700 1 -- 172.21.15.47:0/4285862045 learned_addr learned my addr 172.21.15.47:0/4285862045 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e2000700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9b28520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e0c00700 1 -- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f992df20 msgr2=0x55c2f9aba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f992df20 0x55c2f9aba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e0c00700 1 -- 172.21.15.47:0/4285862045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 msgr2=0x55c2f9b28520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9b28520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e0c00700 1 -- 172.21.15.47:0/4285862045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f9b28b60 con 0x55c2f9aab5e0 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e1600700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f992df20 0x55c2f9aba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e2000700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9b28520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1e0c00700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f9aab5e0 0x55c2f9abac30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55c2f9aa8220 tx=0x7fc1c8004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c34f0edb6977b521 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:42.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.822+0000 7fc1c3400700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1c3400700 1 -- 172.21.15.47:0/4285862045 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8005510 con 0x55c2f9aab5e0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1d00a9980 con 0x55c2f9aab5e0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1c3400700 1 -- 172.21.15.47:0/4285862045 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc1c80046c0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1c3400700 1 -- 172.21.15.47:0/4285862045 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fc1c80056b0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 10 client.26438 fetch_fsmap learned FSMap version 59 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55c2f9b31020 con 0x55c2f9aab5e0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1c3400700 1 -- 172.21.15.47:0/4285862045 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1d00a9980 con 0x55c2f9aab5e0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1c3400700 1 -- 172.21.15.47:0/4285862045 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8370+0+0 (secure 0 0 0) 0x7fc1c802bce0 con 0x55c2f9aab5e0 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 10 client.26438 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 10 client.26438 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-14T12:42:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 20 client.26438 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:42.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9b31690 0x55c2f9b33ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:42.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 4 client.26438 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.i.json"}] 2024-05-14T12:42:42.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.823+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 --> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.i.json"}) -- 0x55c2f99db4e0 con 0x55c2f9b31690 2024-05-14T12:42:42.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.824+0000 7fc1e1600700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9b31690 0x55c2f9b33ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:42.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.824+0000 7fc1e1600700 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9b31690 0x55c2f9b33ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b1fffecd736593ad server_cookie=73cca2ff309159bc in_seq=0 out_seq=0 2024-05-14T12:42:42.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.824+0000 7fc1c3400700 10 client.26438 ms_handle_connect on v2:172.21.15.73:6838/2008561705 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.833+0000 7fc1c3400700 1 -- 172.21.15.47:0/4285862045 <== mds.2 v2:172.21.15.73:6838/2008561705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55c2f99db4e0 con 0x55c2f9b31690 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.833+0000 7fc1c3400700 10 client.26438 handle_command_reply: tid=0 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.833+0000 7fc1f2c0bb80 1 client.26438 shutdown 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f9aab5e0 msgr2=0x55c2f9abac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f9aab5e0 0x55c2f9abac30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55c2f9aa8220 tx=0x7fc1c8004410 comp rx=0 tx=0).stop 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 shutdown_connections 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:6838/2008561705,v1:172.21.15.73:6839/2008561705] conn(0x55c2f9b31690 0x55c2f9b33ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2f9aab9f0 0x55c2f9b28520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f992df20 0x55c2f9aba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 --2- 172.21.15.47:0/4285862045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c2f9aab5e0 0x55c2f9abac30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1c3400700 0 client.26438 ms_handle_reset on v2:172.21.15.73:6838/2008561705 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 >> 172.21.15.47:0/4285862045 conn(0x55c2f996cb60 msgr2=0x55c2f9ab5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:42.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 shutdown_connections 2024-05-14T12:42:42.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 1 -- 172.21.15.47:0/4285862045 wait complete. 2024-05-14T12:42:42.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.834+0000 7fc1f2c0bb80 20 client.26438 trim_cache size 0 max 16384 2024-05-14T12:42:42.836 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:42:42.836 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-3f3d2c55-1-mds.i.json" 2024-05-14T12:42:42.836 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:42:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1c40b2880 msgr2=0x7fc1c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1c40b2880 0x7fc1c40b4d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55c2f9aabe80 tx=0x7fc1d400bf60 comp rx=0 tx=0).stop 2024-05-14T12:42:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1dc075b60 msgr2=0x7fc1dc1a13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1dc075b60 0x7fc1dc1a13a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000e9f0 tx=0x7fc1d000ed00 comp rx=0 tx=0).stop 2024-05-14T12:42:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 shutdown_connections 2024-05-14T12:42:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc1c40b2880 0x7fc1c40b4d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1dc115370 0x7fc1dc1a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1dc075b60 0x7fc1dc1a13a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 --2- 172.21.15.47:0/2766932296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0764b0 0x7fc1dc1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 >> 172.21.15.47:0/2766932296 conn(0x7fc1dc100040 msgr2=0x7fc1dc1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 shutdown_connections 2024-05-14T12:42:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:42.835+0000 7fc1e4000700 1 -- 172.21.15.47:0/2766932296 wait complete. 2024-05-14T12:42:43.692 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 1 (b) to a remote file /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.b.json 2024-05-14T12:42:43.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 ops --flags=locks --path=/var/run/ceph/ops-3f3d2c55-1-mds.b.json 2024-05-14T12:42:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:44.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:44 smithi047 ceph-mon[31254]: pgmap v976: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 19 op/s 2024-05-14T12:42:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:44 smithi066 ceph-mon[35981]: pgmap v976: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 19 op/s 2024-05-14T12:42:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:44 smithi073 ceph-mon[35809]: pgmap v976: 97 pgs: 97 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 19 op/s 2024-05-14T12:42:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.616+0000 7f7a1b400640 1 -- 172.21.15.47:0/140136939 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562bb9a3ffd0 con 0x562bb96c61c0 2024-05-14T12:42:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.616+0000 7f7a1b400640 10 client.26402 handle_command_reply: tid=0 2024-05-14T12:42:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.616+0000 7f7a4b840740 1 client.26402 shutdown 2024-05-14T12:42:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.619+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97092f0 msgr2=0x562bb9aead70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.619+0000 7f7a4b840740 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97092f0 0x562bb9aead70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7a38005fd0 tx=0x7f7a38004a40 comp rx=0 tx=0).stop 2024-05-14T12:42:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.620+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 shutdown_connections 2024-05-14T12:42:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.620+0000 7f7a4b840740 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x562bb96c61c0 0x562bb9b5e9e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.620+0000 7f7a4b840740 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562bb97321b0 0x562bb9aec1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.620+0000 7f7a4b840740 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562bb97114d0 0x562bb9aeb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.620+0000 7f7a4b840740 1 --2- 172.21.15.47:0/140136939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562bb97092f0 0x562bb9aead70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.620+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 >> 172.21.15.47:0/140136939 conn(0x562bb9726300 msgr2=0x562bb9ad2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.620+0000 7f7a1b400640 0 client.26402 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.622+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 shutdown_connections 2024-05-14T12:42:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.622+0000 7f7a4b840740 1 -- 172.21.15.47:0/140136939 wait complete. 2024-05-14T12:42:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.624+0000 7f7a4b840740 20 client.26402 trim_cache size 0 max 16384 2024-05-14T12:42:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:42:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:42:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:42:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7a280b2920 msgr2=0x7f7a280b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7a280b2920 0x7f7a280b4e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x562bb9ad0820 tx=0x7f7a38009500 comp rx=0 tx=0).stop 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c104ea0 msgr2=0x7f7a3c076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c104ea0 0x7f7a3c076130 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00e9c0 tx=0x7f7a2c00ee80 comp rx=0 tx=0).stop 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 shutdown_connections 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7a280b2920 0x7f7a280b4e30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a3c109ba0 0x7f7a3c076670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a3c104ea0 0x7f7a3c076130 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 --2- 172.21.15.47:0/2681937737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a3c103c60 0x7f7a3c077a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:45.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.630+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 >> 172.21.15.47:0/2681937737 conn(0x7f7a3c0fee70 msgr2=0x7f7a3c101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.631+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 shutdown_connections 2024-05-14T12:42:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:45.631+0000 7f7a44800640 1 -- 172.21.15.47:0/2681937737 wait complete. 2024-05-14T12:42:46.212 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:46 smithi047 ceph-mon[31254]: pgmap v977: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-05-14T12:42:46.212 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:46 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:42:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:46 smithi066 ceph-mon[35981]: pgmap v977: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-05-14T12:42:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:46 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:42:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.467+0000 7f1409000700 1 -- 172.21.15.47:0/1657953473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 msgr2=0x7f140410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.467+0000 7f1409000700 1 --2- 172.21.15.47:0/1657953473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 0x7f140410c9c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009990 tx=0x7f13f4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.468+0000 7f1409000700 1 -- 172.21.15.47:0/1657953473 shutdown_connections 2024-05-14T12:42:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.468+0000 7f1409000700 1 --2- 172.21.15.47:0/1657953473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1404106ec0 0x7f1404113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.468+0000 7f1409000700 1 --2- 172.21.15.47:0/1657953473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 0x7f140410c9c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.468+0000 7f1409000700 1 --2- 172.21.15.47:0/1657953473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1404106570 0x7f1404106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.468+0000 7f1409000700 1 -- 172.21.15.47:0/1657953473 >> 172.21.15.47:0/1657953473 conn(0x7f1404102050 msgr2=0x7f14041044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.468+0000 7f1409000700 1 -- 172.21.15.47:0/1657953473 shutdown_connections 2024-05-14T12:42:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.468+0000 7f1409000700 1 -- 172.21.15.47:0/1657953473 wait complete. 2024-05-14T12:42:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.469+0000 7f1409000700 1 Processor -- start 2024-05-14T12:42:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.470+0000 7f1409000700 1 -- start start 2024-05-14T12:42:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.470+0000 7f1409000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1404106570 0x7f140419d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.470+0000 7f1409000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1404106ec0 0x7f140419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.470+0000 7f1409000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 0x7f14041a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.470+0000 7f1409000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14041166c0 con 0x7f1404106ec0 2024-05-14T12:42:46.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.470+0000 7f1409000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1404116540 con 0x7f1404106570 2024-05-14T12:42:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.470+0000 7f1409000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1404116840 con 0x7f140410c5b0 2024-05-14T12:42:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1401e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1404106570 0x7f140419d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1402800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 0x7f14041a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1401e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1404106570 0x7f140419d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54424/0 (socket says 172.21.15.47:54424) 2024-05-14T12:42:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1401e00700 1 -- 172.21.15.47:0/1276649181 learned_addr learned my addr 172.21.15.47:0/1276649181 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:46.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f13f9400700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1404106ec0 0x7f140419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1402800700 1 -- 172.21.15.47:0/1276649181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1404106570 msgr2=0x7f140419d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1402800700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1404106570 0x7f140419d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1402800700 1 -- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1404106ec0 msgr2=0x7f140419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1402800700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1404106ec0 0x7f140419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.471+0000 7f1402800700 1 -- 172.21.15.47:0/1276649181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14041a1f80 con 0x7f140410c5b0 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.472+0000 7f1402800700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 0x7f14041a18e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00e970 tx=0x7f13fc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.472+0000 7f13fb400700 1 -- 172.21.15.47:0/1276649181 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc004220 con 0x7f140410c5b0 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.472+0000 7f13fb400700 1 -- 172.21.15.47:0/1276649181 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13fc0043c0 con 0x7f140410c5b0 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.472+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14041a2270 con 0x7f140410c5b0 2024-05-14T12:42:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.472+0000 7f13fb400700 1 -- 172.21.15.47:0/1276649181 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc010700 con 0x7f140410c5b0 2024-05-14T12:42:46.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.472+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14041a9b90 con 0x7f140410c5b0 2024-05-14T12:42:46.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.476+0000 7f13fb400700 1 -- 172.21.15.47:0/1276649181 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f13fc004750 con 0x7f140410c5b0 2024-05-14T12:42:46.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.477+0000 7f1417b6eb80 1 Processor -- start 2024-05-14T12:42:46.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.477+0000 7f1417b6eb80 1 -- start start 2024-05-14T12:42:46.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.477+0000 7f13fb400700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13e80b2900 0x7f13e80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.477+0000 7f13fb400700 1 -- 172.21.15.47:0/1276649181 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f13fc0e1f50 con 0x7f140410c5b0 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a5734f20 0x5579a58b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f13f9400700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13e80b2900 0x7f13e80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b29f0 0x5579a58bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5579a57d4b00 con 0x5579a5734f20 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5579a5772840 con 0x5579a58b29f0 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5579a57d0ac0 con 0x5579a58b25e0 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1402800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b29f0 0x5579a58bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1401e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a5734f20 0x5579a58b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1402800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b29f0 0x5579a58bf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54428/0 (socket says 172.21.15.47:54428) 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1402800700 1 -- 172.21.15.47:0/2253526394 learned_addr learned my addr 172.21.15.47:0/2253526394 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f13f9400700 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1402800700 1 -- 172.21.15.47:0/2253526394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 msgr2=0x5579a58bcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1402800700 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1402800700 1 -- 172.21.15.47:0/2253526394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a5734f20 msgr2=0x5579a58b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.478+0000 7f1402800700 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a5734f20 0x5579a58b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.479+0000 7f1402800700 1 -- 172.21.15.47:0/2253526394 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a57219b0 con 0x5579a58b29f0 2024-05-14T12:42:46.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.479+0000 7f1402800700 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b29f0 0x5579a58bf1f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009230 tx=0x7f13fc0a9110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926f0740a4d07be4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:46.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.479+0000 7f13f9400700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13e80b2900 0x7f13e80b4e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1404105710 tx=0x7f13ec00fc80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.479+0000 7f13f3400700 1 -- 172.21.15.47:0/2253526394 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc01c040 con 0x5579a58b29f0 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.479+0000 7f13f3400700 1 -- 172.21.15.47:0/2253526394 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13fc0ad8e0 con 0x5579a58b29f0 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.479+0000 7f13f3400700 1 -- 172.21.15.47:0/2253526394 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0a99d0 con 0x5579a58b29f0 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2253526394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b29f0 msgr2=0x5579a58bf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b29f0 0x5579a58bf1f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009230 tx=0x7f13fc0a9110 comp rx=0 tx=0).stop 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2253526394 shutdown_connections 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b29f0 0x5579a58bf1f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a5734f20 0x5579a58b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2253526394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2253526394 >> 172.21.15.47:0/2253526394 conn(0x5579a5773b60 msgr2=0x5579a58adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2253526394 shutdown_connections 2024-05-14T12:42:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.480+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2253526394 wait complete. 2024-05-14T12:42:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.481+0000 7f1417b6eb80 1 -- start start 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.481+0000 7f1417b6eb80 1 Processor -- start 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58bc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58bd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5579a58bfb60 con 0x5579a58b29f0 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5579a573ac00 con 0x5579a5734f20 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5579a58bfce0 con 0x5579a58b25e0 2024-05-14T12:42:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1417b6eb80 10 client.0 _ll_register_callbacks cb 0x5579a5768460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1402800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58bd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1401e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f13f9400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1401e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58bc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54444/0 (socket says 172.21.15.47:54444) 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1401e00700 1 -- 172.21.15.47:0/3225887121 learned_addr learned my addr 172.21.15.47:0/3225887121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.482+0000 7f1402800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58bd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41310/0 (socket says 172.21.15.47:41310) 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f13f9400700 1 -- 172.21.15.47:0/3225887121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 msgr2=0x5579a58bc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f13f9400700 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58bc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f13f9400700 1 -- 172.21.15.47:0/3225887121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 msgr2=0x5579a58bd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f13f9400700 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58bd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f13f9400700 1 -- 172.21.15.47:0/3225887121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579a579a500 con 0x5579a58b25e0 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f1402800700 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58bd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f13f9400700 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcd60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5579a58af220 tx=0x7f13ec004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2702cf79b6fbd0ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.483+0000 7f13e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.484+0000 7f13e7e00700 1 -- 172.21.15.47:0/3225887121 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec02a060 con 0x5579a58b25e0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.484+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13fc0ad8e0 con 0x5579a58b25e0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.484+0000 7f13e7e00700 1 -- 172.21.15.47:0/3225887121 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f13ec009230 con 0x5579a58b25e0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.484+0000 7f13e7e00700 1 -- 172.21.15.47:0/3225887121 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f13ec004490 con 0x5579a58b25e0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.484+0000 7f1417b6eb80 10 client.26476 fetch_fsmap learned FSMap version 60 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.484+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5579a58ca8d0 con 0x5579a58b25e0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f13e7e00700 1 -- 172.21.15.47:0/3225887121 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13fc0ad8e0 con 0x5579a58b25e0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f13e7e00700 1 -- 172.21.15.47:0/3225887121 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 60) ==== 8366+0+0 (secure 0 0 0) 0x7f13ec02f070 con 0x5579a58b25e0 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f1417b6eb80 10 client.26476 fetch_fsmap finished waiting for FSMap version 60 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f1417b6eb80 10 client.26476 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f1417b6eb80 20 client.26476 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a58ccf10 0x5579a58cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f1417b6eb80 4 client.26476 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579a587f150 con 0x5579a58ccf10 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.485+0000 7f1401e00700 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a58ccf10 0x5579a58cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.486+0000 7f1401e00700 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a58ccf10 0x5579a58cf330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2cc37102f353e515 server_cookie=d1598a8e55cc5fec in_seq=0 out_seq=0 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.486+0000 7f13e7e00700 10 client.26476 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f13e7e00700 1 -- 172.21.15.47:0/3225887121 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5579a587f150 con 0x5579a58ccf10 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f13e7e00700 10 client.26476 handle_command_reply: tid=0 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 client.26476 shutdown 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 msgr2=0x5579a58bcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcd60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5579a58af220 tx=0x7f13ec004b40 comp rx=0 tx=0).stop 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 shutdown_connections 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58bd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a58ccf10 0x5579a58cf330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/3225887121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bcd60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f13e7e00700 0 client.26476 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:42:46.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 >> 172.21.15.47:0/3225887121 conn(0x5579a5773b60 msgr2=0x5579a58ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:46.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 shutdown_connections 2024-05-14T12:42:46.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 1 -- 172.21.15.47:0/3225887121 wait complete. 2024-05-14T12:42:46.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.487+0000 7f1417b6eb80 20 client.26476 trim_cache size 0 max 16384 2024-05-14T12:42:46.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:46 smithi073 ceph-mon[35809]: pgmap v977: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-05-14T12:42:46.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:46 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:42:46.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.509+0000 7f1417b6eb80 1 Processor -- start 2024-05-14T12:42:46.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1417b6eb80 1 -- start start 2024-05-14T12:42:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14041b0ef0 con 0x5579a58b29f0 2024-05-14T12:42:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14041b2ac0 con 0x5579a5734f20 2024-05-14T12:42:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f14041b15c0 con 0x5579a58b25e0 2024-05-14T12:42:46.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1401e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f13f9400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1401e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:54448/0 (socket says 172.21.15.47:54448) 2024-05-14T12:42:46.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1401e00700 1 -- 172.21.15.47:0/2493651951 learned_addr learned my addr 172.21.15.47:0/2493651951 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:46.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.510+0000 7f1402800700 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f1401e00700 1 -- 172.21.15.47:0/2493651951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 msgr2=0x5579a58bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f1401e00700 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f1401e00700 1 -- 172.21.15.47:0/2493651951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 msgr2=0x5579a58c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f1401e00700 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f1401e00700 1 -- 172.21.15.47:0/2493651951 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a58a5970 con 0x5579a5734f20 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f1402800700 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f1401e00700 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58b80a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000c00 tx=0x7f13f4005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f41d2c917ff078 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f13f2a00700 1 -- 172.21.15.47:0/2493651951 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f402e070 con 0x5579a5734f20 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f13f2a00700 1 -- 172.21.15.47:0/2493651951 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f4003680 con 0x5579a5734f20 2024-05-14T12:42:46.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.511+0000 7f13f2a00700 1 -- 172.21.15.47:0/2493651951 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f40283d0 con 0x5579a5734f20 2024-05-14T12:42:46.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2493651951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 msgr2=0x5579a58b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58b80a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000c00 tx=0x7f13f4005040 comp rx=0 tx=0).stop 2024-05-14T12:42:46.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2493651951 shutdown_connections 2024-05-14T12:42:46.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a5734f20 0x5579a58b80a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/2493651951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a58b25e0 0x5579a58bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2493651951 >> 172.21.15.47:0/2493651951 conn(0x5579a5773b60 msgr2=0x5579a58b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2493651951 shutdown_connections 2024-05-14T12:42:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.513+0000 7f1417b6eb80 1 -- 172.21.15.47:0/2493651951 wait complete. 2024-05-14T12:42:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.514+0000 7f1417b6eb80 1 -- start start 2024-05-14T12:42:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.514+0000 7f1417b6eb80 1 Processor -- start 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a5734f20 0x5579a58c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b25e0 0x5579a58c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1417b6eb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f14041b23f0 con 0x5579a58b29f0 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14041b1d20 con 0x5579a58b25e0 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1417b6eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f14041aee70 con 0x5579a5734f20 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1417b6eb80 10 client.0 _ll_register_callbacks cb 0x5579a5768460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1401e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a5734f20 0x5579a58c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1401e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a5734f20 0x5579a58c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:38374/0 (socket says 172.21.15.47:38374) 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f13f9400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b25e0 0x5579a58c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1401e00700 1 -- 172.21.15.47:0/1167261252 learned_addr learned my addr 172.21.15.47:0/1167261252 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.515+0000 7f1402800700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13f9400700 1 -- 172.21.15.47:0/1167261252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a5734f20 msgr2=0x5579a58c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13f9400700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a5734f20 0x5579a58c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13f9400700 1 -- 172.21.15.47:0/1167261252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 msgr2=0x5579a58c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13f9400700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13f9400700 1 -- 172.21.15.47:0/1167261252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579a5937870 con 0x5579a58b25e0 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f1401e00700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a5734f20 0x5579a58c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f1402800700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13f9400700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b25e0 0x5579a58c22f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00ffd0 tx=0x7f13ec004400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ad8e324deee46f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13e7e00700 1 -- 172.21.15.47:0/1167261252 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec03e030 con 0x5579a58b25e0 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f13e7e00700 1 -- 172.21.15.47:0/1167261252 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f13ec004bb0 con 0x5579a58b25e0 2024-05-14T12:42:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.516+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13f4003680 con 0x5579a58b25e0 2024-05-14T12:42:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f13e7e00700 1 -- 172.21.15.47:0/1167261252 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f13ec035070 con 0x5579a58b25e0 2024-05-14T12:42:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 10 client.26456 fetch_fsmap learned FSMap version 60 2024-05-14T12:42:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5579a5938ab0 con 0x5579a58b25e0 2024-05-14T12:42:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f13e7e00700 1 -- 172.21.15.47:0/1167261252 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f4003680 con 0x5579a58b25e0 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f13e7e00700 1 -- 172.21.15.47:0/1167261252 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 60) ==== 8366+0+0 (secure 0 0 0) 0x7f13ec02f040 con 0x5579a58b25e0 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 10 client.26456 fetch_fsmap finished waiting for FSMap version 60 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 10 client.26456 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 20 client.26456 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a59392b0 0x5579a593b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 4 client.26456 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.b.json"}] 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.517+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 --> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.b.json"}) -- 0x5579a57e24e0 con 0x5579a59392b0 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.518+0000 7f1401e00700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a59392b0 0x5579a593b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.518+0000 7f1401e00700 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a59392b0 0x5579a593b6d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb664595a12efed7 server_cookie=1ba1a1adb275244b in_seq=0 out_seq=0 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.518+0000 7f13e7e00700 10 client.26456 ms_handle_connect on v2:172.21.15.66:6838/2700854370 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.518+0000 7f13e7e00700 1 -- 172.21.15.47:0/1167261252 <== mds.1 v2:172.21.15.66:6838/2700854370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x5579a57e24e0 con 0x5579a59392b0 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.518+0000 7f13e7e00700 10 client.26456 handle_command_reply: tid=0 2024-05-14T12:42:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.518+0000 7f1417b6eb80 1 client.26456 shutdown 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b25e0 msgr2=0x5579a58c22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b25e0 0x5579a58c22f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00ffd0 tx=0x7f13ec004400 comp rx=0 tx=0).stop 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 shutdown_connections 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5579a58b29f0 0x5579a58c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5579a5734f20 0x5579a58c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:6838/2700854370,v1:172.21.15.66:6839/2700854370] conn(0x5579a59392b0 0x5579a593b6d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 --2- 172.21.15.47:0/1167261252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5579a58b25e0 0x5579a58c22f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 >> 172.21.15.47:0/1167261252 conn(0x5579a5773b60 msgr2=0x5579a58c8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f13e7e00700 0 client.26456 ms_handle_reset on v2:172.21.15.66:6838/2700854370 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 shutdown_connections 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 1 -- 172.21.15.47:0/1167261252 wait complete. 2024-05-14T12:42:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.519+0000 7f1417b6eb80 20 client.26456 trim_cache size 0 max 16384 2024-05-14T12:42:46.523 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:42:46.523 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-3f3d2c55-1-mds.b.json" 2024-05-14T12:42:46.523 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13e80b2900 msgr2=0x7f13e80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13e80b2900 0x7f13e80b4e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1404105710 tx=0x7f13ec00fc80 comp rx=0 tx=0).stop 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 msgr2=0x7f14041a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 0x7f14041a18e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00e970 tx=0x7f13fc00ec80 comp rx=0 tx=0).stop 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 shutdown_connections 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f13e80b2900 0x7f13e80b4e10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140410c5b0 0x7f14041a18e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1404106570 0x7f140419d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 --2- 172.21.15.47:0/1276649181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1404106ec0 0x7f140419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 >> 172.21.15.47:0/1276649181 conn(0x7f1404102050 msgr2=0x7f1404103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.520+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 shutdown_connections 2024-05-14T12:42:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:46.521+0000 7f1409000700 1 -- 172.21.15.47:0/1276649181 wait complete. 2024-05-14T12:42:47.279 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 0 (a) to a remote file /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.a.json 2024-05-14T12:42:47.280 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 ops --flags=locks --path=/var/run/ceph/ops-3f3d2c55-1-mds.a.json 2024-05-14T12:42:47.749 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:48.220 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:48 smithi047 ceph-mon[31254]: pgmap v978: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 18 op/s 2024-05-14T12:42:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:48 smithi066 ceph-mon[35981]: pgmap v978: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 18 op/s 2024-05-14T12:42:48.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:48 smithi073 ceph-mon[35809]: pgmap v978: 97 pgs: 97 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 18 op/s 2024-05-14T12:42:49.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:49 smithi047 ceph-mon[31254]: pgmap v979: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-05-14T12:42:49.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:49 smithi073 ceph-mon[35809]: pgmap v979: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-05-14T12:42:49.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:49 smithi066 ceph-mon[35981]: pgmap v979: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-05-14T12:42:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 -- 172.21.15.47:0/2220693981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c0105c80 msgr2=0x7f93c010e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 --2- 172.21.15.47:0/2220693981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c0105c80 0x7f93c010e1d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009990 tx=0x7f93ac009ca0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 -- 172.21.15.47:0/2220693981 shutdown_connections 2024-05-14T12:42:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 --2- 172.21.15.47:0/2220693981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c010e710 0x7f93c0110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 --2- 172.21.15.47:0/2220693981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 0x7f93c0105740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 --2- 172.21.15.47:0/2220693981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c0105c80 0x7f93c010e1d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 -- 172.21.15.47:0/2220693981 >> 172.21.15.47:0/2220693981 conn(0x7f93c0078ac0 msgr2=0x7f93c0078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 -- 172.21.15.47:0/2220693981 shutdown_connections 2024-05-14T12:42:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.044+0000 7f93bf200700 1 -- 172.21.15.47:0/2220693981 wait complete. 2024-05-14T12:42:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 Processor -- start 2024-05-14T12:42:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 -- start start 2024-05-14T12:42:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 0x7f93c019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c0105c80 0x7f93c019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c010e710 0x7f93c01a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93c01142b0 con 0x7f93c0105c80 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f93c0114130 con 0x7f93c010e710 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.046+0000 7f93bf200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93c0114430 con 0x7f93c0105330 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 0x7f93c019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bd400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c0105c80 0x7f93c019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93be800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c010e710 0x7f93c01a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 0x7f93c019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:54058/0 (socket says 172.21.15.47:54058) 2024-05-14T12:42:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 -- 172.21.15.47:0/4285003 learned_addr learned my addr 172.21.15.47:0/4285003 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 -- 172.21.15.47:0/4285003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c010e710 msgr2=0x7f93c01a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c010e710 0x7f93c01a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 -- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c0105c80 msgr2=0x7f93c019d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c0105c80 0x7f93c019d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.047+0000 7f93bde00700 1 -- 172.21.15.47:0/4285003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c01a1d10 con 0x7f93c0105330 2024-05-14T12:42:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.048+0000 7f93bde00700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 0x7f93c019ce40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f93b000eb30 tx=0x7f93b000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.048+0000 7f93b6a00700 1 -- 172.21.15.47:0/4285003 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b000cbd0 con 0x7f93c0105330 2024-05-14T12:42:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.048+0000 7f93b6a00700 1 -- 172.21.15.47:0/4285003 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b00044d0 con 0x7f93c0105330 2024-05-14T12:42:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.048+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c01a2000 con 0x7f93c0105330 2024-05-14T12:42:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.048+0000 7f93b6a00700 1 -- 172.21.15.47:0/4285003 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0003e30 con 0x7f93c0105330 2024-05-14T12:42:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.048+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c01a9920 con 0x7f93c0105330 2024-05-14T12:42:50.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.052+0000 7f93b6a00700 1 -- 172.21.15.47:0/4285003 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f93b0004000 con 0x7f93c0105330 2024-05-14T12:42:50.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.053+0000 7f93b6a00700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f93a40b2900 0x7f93a40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.053+0000 7f93b6a00700 1 -- 172.21.15.47:0/4285003 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f93b00e2540 con 0x7f93c0105330 2024-05-14T12:42:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.054+0000 7f93bd400700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f93a40b2900 0x7f93a40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.054+0000 7f93bd400700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f93a40b2900 0x7f93a40b4e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93c01046d0 tx=0x7f93ac00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:50.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.055+0000 7f93d3530b80 1 Processor -- start 2024-05-14T12:42:50.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.055+0000 7f93d3530b80 1 -- start start 2024-05-14T12:42:50.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.055+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e29f8f20 0x55f6e2b770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.055+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b775f0 0x55f6e2b7b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.055+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.055+0000 7f93d3530b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f6e2a98b00 con 0x55f6e29f8f20 2024-05-14T12:42:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93d3530b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f6e2a36840 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93d3530b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f6e2a94ac0 con 0x55f6e2b775f0 2024-05-14T12:42:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e29f8f20 0x55f6e2b770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e29f8f20 0x55f6e2b770b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60808/0 (socket says 172.21.15.47:60808) 2024-05-14T12:42:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 -- 172.21.15.47:0/4241190773 learned_addr learned my addr 172.21.15.47:0/4241190773 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bd400700 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b775f0 0x55f6e2b7b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93be800700 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 -- 172.21.15.47:0/4241190773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b775f0 msgr2=0x55f6e2b7b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b775f0 0x55f6e2b7b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 -- 172.21.15.47:0/4241190773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 msgr2=0x55f6e2b7c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.056+0000 7f93bde00700 1 -- 172.21.15.47:0/4241190773 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6e29e59b0 con 0x55f6e29f8f20 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.057+0000 7f93bde00700 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e29f8f20 0x55f6e2b770b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a9820 tx=0x7f93b00a5a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c617011d883bc6b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.057+0000 7f93ab400700 1 -- 172.21.15.47:0/4241190773 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b00c3070 con 0x55f6e29f8f20 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.057+0000 7f93ab400700 1 -- 172.21.15.47:0/4241190773 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b00aae50 con 0x55f6e29f8f20 2024-05-14T12:42:50.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.057+0000 7f93ab400700 1 -- 172.21.15.47:0/4241190773 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b00a9fe0 con 0x55f6e29f8f20 2024-05-14T12:42:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 -- 172.21.15.47:0/4241190773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e29f8f20 msgr2=0x55f6e2b770b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e29f8f20 0x55f6e2b770b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a9820 tx=0x7f93b00a5a60 comp rx=0 tx=0).stop 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 -- 172.21.15.47:0/4241190773 shutdown_connections 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e29f8f20 0x55f6e2b770b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 --2- 172.21.15.47:0/4241190773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b775f0 0x55f6e2b7b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 -- 172.21.15.47:0/4241190773 >> 172.21.15.47:0/4241190773 conn(0x55f6e2a37b60 msgr2=0x55f6e2b71dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 -- 172.21.15.47:0/4241190773 shutdown_connections 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.058+0000 7f93d3530b80 1 -- 172.21.15.47:0/4241190773 wait complete. 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.059+0000 7f93d3530b80 1 -- start start 2024-05-14T12:42:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.059+0000 7f93d3530b80 1 Processor -- start 2024-05-14T12:42:50.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e29f8f20 0x55f6e2b80b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b81050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b81590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93d3530b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f6e2b83da0 con 0x55f6e2b775f0 2024-05-14T12:42:50.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93d3530b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f6e29fec00 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93d3530b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f6e2b83f20 con 0x55f6e29f8f20 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93d3530b80 10 client.0 _ll_register_callbacks cb 0x55f6e2a2c460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93bde00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e29f8f20 0x55f6e2b80b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93bde00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e29f8f20 0x55f6e2b80b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:54080/0 (socket says 172.21.15.47:54080) 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93bde00700 1 -- 172.21.15.47:0/2553760064 learned_addr learned my addr 172.21.15.47:0/2553760064 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93be800700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b81590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.060+0000 7f93bd400700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b81050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93bde00700 1 -- 172.21.15.47:0/2553760064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 msgr2=0x55f6e2b81590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93bde00700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b81590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93bde00700 1 -- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 msgr2=0x55f6e2b81050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93bde00700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b81050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93bde00700 1 -- 172.21.15.47:0/2553760064 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6e2a5e500 con 0x55f6e29f8f20 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93bd400700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b81050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93bde00700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e29f8f20 0x55f6e2b80b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a5ba0 tx=0x7f93b00a9f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=511ee7d9c394ecd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:50.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f939fe00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f939fe00700 1 -- 172.21.15.47:0/2553760064 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b00c8070 con 0x55f6e29f8f20 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f939fe00700 1 -- 172.21.15.47:0/2553760064 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f93b00e22e0 con 0x55f6e29f8f20 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.061+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b00aae50 con 0x55f6e29f8f20 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f939fe00700 1 -- 172.21.15.47:0/2553760064 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f93b008e050 con 0x55f6e29f8f20 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 10 client.26494 fetch_fsmap learned FSMap version 61 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55f6e2b83da0 con 0x55f6e29f8f20 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f939fe00700 1 -- 172.21.15.47:0/2553760064 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b00aae50 con 0x55f6e29f8f20 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f939fe00700 1 -- 172.21.15.47:0/2553760064 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 61) ==== 8370+0+0 (secure 0 0 0) 0x7f93b00b2bd0 con 0x55f6e29f8f20 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 10 client.26494 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T12:42:50.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 10 client.26494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 20 client.26494 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2b90cc0 0x55f6e2b930e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 4 client.26494 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.062+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6e2b43150 con 0x55f6e2b90cc0 2024-05-14T12:42:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.063+0000 7f93bd400700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2b90cc0 0x55f6e2b930e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.063+0000 7f93bd400700 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2b90cc0 0x55f6e2b930e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3d3e7d18ae4906b server_cookie=9edc4c2126a594ae in_seq=0 out_seq=0 2024-05-14T12:42:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.063+0000 7f939fe00700 10 client.26494 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:50.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.064+0000 7f939fe00700 1 -- 172.21.15.47:0/2553760064 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f6e2b43150 con 0x55f6e2b90cc0 2024-05-14T12:42:50.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.064+0000 7f939fe00700 10 client.26494 handle_command_reply: tid=0 2024-05-14T12:42:50.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.064+0000 7f93d3530b80 1 client.26494 shutdown 2024-05-14T12:42:50.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e29f8f20 msgr2=0x55f6e2b80b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e29f8f20 0x55f6e2b80b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a5ba0 tx=0x7f93b00a9f90 comp rx=0 tx=0).stop 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 shutdown_connections 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2b90cc0 0x55f6e2b930e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b81590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e29f8f20 0x55f6e2b80b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 --2- 172.21.15.47:0/2553760064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b81050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 >> 172.21.15.47:0/2553760064 conn(0x55f6e2a37b60 msgr2=0x55f6e2b71a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f939fe00700 0 client.26494 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 shutdown_connections 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 1 -- 172.21.15.47:0/2553760064 wait complete. 2024-05-14T12:42:50.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.065+0000 7f93d3530b80 20 client.26494 trim_cache size 0 max 16384 2024-05-14T12:42:50.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.086+0000 7f93d3530b80 1 Processor -- start 2024-05-14T12:42:50.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.086+0000 7f93d3530b80 1 -- start start 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e29f8f20 0x55f6e2b7fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b8d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93d3530b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93c01b0da0 con 0x55f6e2b775f0 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93d3530b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f93c01b29a0 con 0x55f6e29f8f20 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93d3530b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93c01b14a0 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93bde00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e29f8f20 0x55f6e2b7fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93bde00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e29f8f20 0x55f6e2b7fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:49252/0 (socket says 172.21.15.47:49252) 2024-05-14T12:42:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.087+0000 7f93bde00700 1 -- 172.21.15.47:0/931786167 learned_addr learned my addr 172.21.15.47:0/931786167 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:50.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93bd400700 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b8d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93be800700 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93bde00700 1 -- 172.21.15.47:0/931786167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 msgr2=0x55f6e2b7b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93bde00700 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93bde00700 1 -- 172.21.15.47:0/931786167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 msgr2=0x55f6e2b8d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93bde00700 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b8d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93bde00700 1 -- 172.21.15.47:0/931786167 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6e2b6cb10 con 0x55f6e29f8f20 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93be800700 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.088+0000 7f93bde00700 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e29f8f20 0x55f6e2b7fe50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a6d90 tx=0x7f93b00a9ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19aeb3af52731b3a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.089+0000 7f93aaa00700 1 -- 172.21.15.47:0/931786167 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b00c8040 con 0x55f6e29f8f20 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.089+0000 7f93aaa00700 1 -- 172.21.15.47:0/931786167 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b00b7020 con 0x55f6e29f8f20 2024-05-14T12:42:50.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.089+0000 7f93aaa00700 1 -- 172.21.15.47:0/931786167 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b00c3070 con 0x55f6e29f8f20 2024-05-14T12:42:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 -- 172.21.15.47:0/931786167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e29f8f20 msgr2=0x55f6e2b7fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e29f8f20 0x55f6e2b7fe50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a6d90 tx=0x7f93b00a9ca0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 -- 172.21.15.47:0/931786167 shutdown_connections 2024-05-14T12:42:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b7b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e29f8f20 0x55f6e2b7fe50 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a6d90 tx=0x7f93b00a9ca0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 --2- 172.21.15.47:0/931786167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b8d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 -- 172.21.15.47:0/931786167 >> 172.21.15.47:0/931786167 conn(0x55f6e2a37b60 msgr2=0x55f6e2b75de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:50.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 -- 172.21.15.47:0/931786167 shutdown_connections 2024-05-14T12:42:50.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.090+0000 7f93d3530b80 1 -- 172.21.15.47:0/931786167 wait complete. 2024-05-14T12:42:50.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.091+0000 7f93d3530b80 1 -- start start 2024-05-14T12:42:50.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.091+0000 7f93d3530b80 1 Processor -- start 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b94570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b94ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93d3530b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2bf4250 0x55f6e2bf4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93d3530b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93c01b22d0 con 0x55f6e2b775f0 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93d3530b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f93c01b1c00 con 0x55f6e2bf4250 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93d3530b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93c01aed20 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93d3530b80 10 client.0 _ll_register_callbacks cb 0x55f6e2a2c460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:50.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93bd400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b94ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93bde00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b94570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93bd400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b94ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:54102/0 (socket says 172.21.15.47:54102) 2024-05-14T12:42:50.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.092+0000 7f93bd400700 1 -- 172.21.15.47:0/809293849 learned_addr learned my addr 172.21.15.47:0/809293849 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:50.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f93bd400700 1 -- 172.21.15.47:0/809293849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2bf4250 msgr2=0x55f6e2bf4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f93bd400700 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2bf4250 0x55f6e2bf4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f93bd400700 1 -- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 msgr2=0x55f6e2b94570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f93bd400700 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b94570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f93bd400700 1 -- 172.21.15.47:0/809293849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6e2bf4bf0 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f93bde00700 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b94570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f93bd400700 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b94ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009720 tx=0x7f93ac009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd81b3f5e6985acf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.093+0000 7f939fe00700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.094+0000 7f939fe00700 1 -- 172.21.15.47:0/809293849 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac037070 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.094+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b00b7020 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.094+0000 7f939fe00700 1 -- 172.21.15.47:0/809293849 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f93ac0338f0 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.094+0000 7f939fe00700 1 -- 172.21.15.47:0/809293849 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f93ac043050 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.094+0000 7f93d3530b80 10 client.26500 fetch_fsmap learned FSMap version 61 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.094+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55f6e2bfbee0 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.094+0000 7f939fe00700 1 -- 172.21.15.47:0/809293849 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b00b7020 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f939fe00700 1 -- 172.21.15.47:0/809293849 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 61) ==== 8370+0+0 (secure 0 0 0) 0x7f93ac022070 con 0x55f6e2b7bdf0 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f93d3530b80 10 client.26500 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f93d3530b80 10 client.26500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f93d3530b80 20 client.26500 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f93d3530b80 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2bfc690 0x55f6e2bfeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f93d3530b80 4 client.26500 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.a.json"}] 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-3f3d2c55-1-mds.a.json"}) -- 0x55f6e2aa64e0 con 0x55f6e2bfc690 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.095+0000 7f93bde00700 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2bfc690 0x55f6e2bfeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:50.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.096+0000 7f93bde00700 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2bfc690 0x55f6e2bfeab0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791c1fad6658b520 server_cookie=326195f27ff12693 in_seq=0 out_seq=0 2024-05-14T12:42:50.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.096+0000 7f939fe00700 10 client.26500 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:50.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.100+0000 7f939fe00700 1 -- 172.21.15.47:0/809293849 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55f6e2aa64e0 con 0x55f6e2bfc690 2024-05-14T12:42:50.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.100+0000 7f939fe00700 10 client.26500 handle_command_reply: tid=0 2024-05-14T12:42:50.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.100+0000 7f93d3530b80 1 client.26500 shutdown 2024-05-14T12:42:50.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.100+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 msgr2=0x55f6e2b94ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.100+0000 7f93d3530b80 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b94ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009720 tx=0x7f93ac009ca0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.100+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 shutdown_connections 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.100+0000 7f93d3530b80 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55f6e2bfc690 0x55f6e2bfeab0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f93d3530b80 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f6e2bf4250 0x55f6e2bf4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f93d3530b80 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6e2b775f0 0x55f6e2b94570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f93d3530b80 1 --2- 172.21.15.47:0/809293849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f6e2b7bdf0 0x55f6e2b94ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 >> 172.21.15.47:0/809293849 conn(0x55f6e2a37b60 msgr2=0x55f6e2b76570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f939fe00700 0 client.26500 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 shutdown_connections 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f93d3530b80 1 -- 172.21.15.47:0/809293849 wait complete. 2024-05-14T12:42:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.101+0000 7f93d3530b80 20 client.26500 trim_cache size 0 max 16384 2024-05-14T12:42:50.103 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:42:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/var/run/ceph/ops-3f3d2c55-1-mds.a.json" 2024-05-14T12:42:50.103 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:42:50.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f93a40b2900 msgr2=0x7f93a40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f93a40b2900 0x7f93a40b4e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93c01046d0 tx=0x7f93ac00b260 comp rx=0 tx=0).stop 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 msgr2=0x7f93c019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 0x7f93c019ce40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f93b000eb30 tx=0x7f93b000ee40 comp rx=0 tx=0).stop 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 shutdown_connections 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f93a40b2900 0x7f93a40b4e10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93c010e710 0x7f93c01a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93c0105330 0x7f93c019ce40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 --2- 172.21.15.47:0/4285003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c0105c80 0x7f93c019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 >> 172.21.15.47:0/4285003 conn(0x7f93c0078ac0 msgr2=0x7f93c0103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 shutdown_connections 2024-05-14T12:42:50.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:50.102+0000 7f93bf200700 1 -- 172.21.15.47:0/4285003 wait complete. 2024-05-14T12:42:50.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:50 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:42:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:50 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:42:50.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:50 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:42:50.988 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-05-14T12:42:51.002 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.k2QG32M4Xh 2024-05-14T12:42:51.002 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.f.json /tmp/tmp.k2QG32M4Xh 2024-05-14T12:42:51.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.k2QG32M4Xh 2024-05-14T12:42:51.191 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.k2QG32M4Xh is 185KB 2024-05-14T12:42:51.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:51 smithi047 ceph-mon[31254]: pgmap v980: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2024-05-14T12:42:51.245 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.k2QG32M4Xh 2024-05-14T12:42:51.259 DEBUG:tasks.quiescer.fs.[cephfs]:read 189282B of ops from '/var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.f.json' on mds.4 (f) 2024-05-14T12:42:51.278 INFO:tasks.quiescer.fs.[cephfs]:Pulled 71 ops from rank 4 (f) into home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/ops-3f3d2c55-1-mds.f.json 2024-05-14T12:42:51.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -- /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.f.json 2024-05-14T12:42:51.318 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:51 smithi073 ceph-mon[35809]: pgmap v980: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2024-05-14T12:42:51.322 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-05-14T12:42:51.375 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.jqxbRAjmVE 2024-05-14T12:42:51.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.c.json /tmp/tmp.jqxbRAjmVE 2024-05-14T12:42:51.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.jqxbRAjmVE 2024-05-14T12:42:51.558 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.jqxbRAjmVE is 188KB 2024-05-14T12:42:51.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:51 smithi066 ceph-mon[35981]: pgmap v980: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2024-05-14T12:42:51.609 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.jqxbRAjmVE 2024-05-14T12:42:51.623 DEBUG:tasks.quiescer.fs.[cephfs]:read 192440B of ops from '/var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.c.json' on mds.3 (c) 2024-05-14T12:42:51.673 INFO:tasks.quiescer.fs.[cephfs]:Pulled 72 ops from rank 3 (c) into home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/ops-3f3d2c55-1-mds.c.json 2024-05-14T12:42:51.674 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -- /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.c.json 2024-05-14T12:42:51.696 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-05-14T12:42:51.751 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.Kz1poVuGtL 2024-05-14T12:42:51.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.i.json /tmp/tmp.Kz1poVuGtL 2024-05-14T12:42:51.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.Kz1poVuGtL 2024-05-14T12:42:51.934 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.Kz1poVuGtL is 258KB 2024-05-14T12:42:52.000 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.Kz1poVuGtL 2024-05-14T12:42:52.014 DEBUG:tasks.quiescer.fs.[cephfs]:read 264189B of ops from '/var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.i.json' on mds.2 (i) 2024-05-14T12:42:52.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 3f3d2c55-1: 'client_request(client.25103:3048 unlink #0x10000000282/37006e8f0a69ddbf5b383c882beb60cbe04d12 2024-05-14T12:41:57.282713+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})' 2024-05-14T12:42:52.040 INFO:tasks.quiescer.fs.[cephfs]:Pulled 102 ops from rank 2 (i) into home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/ops-3f3d2c55-1-mds.i.json 2024-05-14T12:42:52.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -- /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.i.json 2024-05-14T12:42:52.076 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-05-14T12:42:52.091 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.320vuDxsxK 2024-05-14T12:42:52.091 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.b.json /tmp/tmp.320vuDxsxK 2024-05-14T12:42:52.158 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.320vuDxsxK 2024-05-14T12:42:52.281 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.320vuDxsxK is 22B 2024-05-14T12:42:52.328 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.320vuDxsxK 2024-05-14T12:42:52.342 DEBUG:tasks.quiescer.fs.[cephfs]:read 22B of ops from '/var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.b.json' on mds.1 (b) 2024-05-14T12:42:52.344 INFO:tasks.quiescer.fs.[cephfs]:Pulled 0 ops from rank 1 (b) into home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/ops-3f3d2c55-1-mds.b.json 2024-05-14T12:42:52.344 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -- /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.b.json 2024-05-14T12:42:52.406 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-14T12:42:52.468 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.45RG8VZYig 2024-05-14T12:42:52.468 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.a.json /tmp/tmp.45RG8VZYig 2024-05-14T12:42:52.546 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.45RG8VZYig 2024-05-14T12:42:52.677 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.45RG8VZYig is 51KB 2024-05-14T12:42:52.746 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.45RG8VZYig 2024-05-14T12:42:52.802 DEBUG:tasks.quiescer.fs.[cephfs]:read 52596B of ops from '/var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.a.json' on mds.0 (a) 2024-05-14T12:42:52.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (a) for 3f3d2c55-1: 'client_request(client.25103:3049 rmdir #0x1000000021f/6a 2024-05-14T12:42:45.377721+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})' 2024-05-14T12:42:52.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (a) for 3f3d2c55-1: 'peer_request:mds.2:845' 2024-05-14T12:42:52.808 INFO:tasks.quiescer.fs.[cephfs]:Pulled 2 ops from rank 0 (a) into home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/ops-3f3d2c55-1-mds.a.json 2024-05-14T12:42:52.808 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -- /var/run/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ops-3f3d2c55-1-mds.a.json 2024-05-14T12:42:52.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:42:53.378 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:54.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:53 smithi047 ceph-mon[31254]: pgmap v981: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-05-14T12:42:54.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:53 smithi073 ceph-mon[35809]: pgmap v981: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-05-14T12:42:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:53 smithi066 ceph-mon[35981]: pgmap v981: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-05-14T12:42:55.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 -- 172.21.15.47:0/1197188916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354110c00 msgr2=0x7f8354113020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 --2- 172.21.15.47:0/1197188916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354110c00 0x7f8354113020 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f834c009f90 tx=0x7f834c00b330 comp rx=0 tx=0).stop 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 -- 172.21.15.47:0/1197188916 shutdown_connections 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 --2- 172.21.15.47:0/1197188916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354110c00 0x7f8354113020 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 --2- 172.21.15.47:0/1197188916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8354075b00 0x7f8354075f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 --2- 172.21.15.47:0/1197188916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354076450 0x7f83541106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 -- 172.21.15.47:0/1197188916 >> 172.21.15.47:0/1197188916 conn(0x7f8354100040 msgr2=0x7f8354102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 -- 172.21.15.47:0/1197188916 shutdown_connections 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.742+0000 7f8359e00700 1 -- 172.21.15.47:0/1197188916 wait complete. 2024-05-14T12:42:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.744+0000 7f8359e00700 1 Processor -- start 2024-05-14T12:42:55.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.744+0000 7f8359e00700 1 -- start start 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8359e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354075b00 0x7f835419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8359e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354076450 0x7f835419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8359e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8354110c00 0x7f83541a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8359e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f83541166c0 con 0x7f8354110c00 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8359e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8354116540 con 0x7f8354075b00 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8359e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8354116840 con 0x7f8354076450 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8352a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354075b00 0x7f835419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8352a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354075b00 0x7f835419d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:49280/0 (socket says 172.21.15.47:49280) 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8352a00700 1 -- 172.21.15.47:0/720881506 learned_addr learned my addr 172.21.15.47:0/720881506 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8352000700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354076450 0x7f835419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.745+0000 7f8353400700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8354110c00 0x7f83541a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:55.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8352a00700 1 -- 172.21.15.47:0/720881506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354076450 msgr2=0x7f835419d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8352a00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354076450 0x7f835419d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8352a00700 1 -- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8354110c00 msgr2=0x7f83541a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8352a00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8354110c00 0x7f83541a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8352a00700 1 -- 172.21.15.47:0/720881506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83541a1ee0 con 0x7f8354075b00 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8353400700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8354110c00 0x7f83541a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8352a00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354075b00 0x7f835419d010 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f834400e9a0 tx=0x7f834400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8358a00700 1 -- 172.21.15.47:0/720881506 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834400cbd0 con 0x7f8354075b00 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8358a00700 1 -- 172.21.15.47:0/720881506 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834400cd70 con 0x7f8354075b00 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83541a21d0 con 0x7f8354075b00 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.746+0000 7f8358a00700 1 -- 172.21.15.47:0/720881506 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344018680 con 0x7f8354075b00 2024-05-14T12:42:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.747+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83541a9af0 con 0x7f8354075b00 2024-05-14T12:42:55.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.748+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83540512c0 con 0x7f8354075b00 2024-05-14T12:42:55.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.750+0000 7f8358a00700 1 -- 172.21.15.47:0/720881506 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8344010430 con 0x7f8354075b00 2024-05-14T12:42:55.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.752+0000 7f8358a00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83380b2900 0x7f83380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:55.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.752+0000 7f8358a00700 1 -- 172.21.15.47:0/720881506 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f83440e2460 con 0x7f8354075b00 2024-05-14T12:42:55.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.752+0000 7f8352000700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83380b2900 0x7f83380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:55.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.753+0000 7f8352000700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83380b2900 0x7f83380b4e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8340009750 tx=0x7f8340009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:55.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:55.756+0000 7f8358a00700 1 -- 172.21.15.47:0/720881506 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f83440aa140 con 0x7f8354075b00 2024-05-14T12:42:56.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.051+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f835419e3a0 con 0x7f8354075b00 2024-05-14T12:42:56.052 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:55 smithi047 ceph-mon[31254]: pgmap v982: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.3 KiB/s wr, 18 op/s 2024-05-14T12:42:56.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.052+0000 7f8358a00700 1 -- 172.21.15.47:0/720881506 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+11925 (secure 0 0 0) 0x7f835419e3a0 con 0x7f8354075b00 2024-05-14T12:42:56.053 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:42:56.053 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":61,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:42:49.056327+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24535,24521,24517,24490,24502]},"id":1}]} 2024-05-14T12:42:56.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.056+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83380b2900 msgr2=0x7f83380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:56.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.056+0000 7f8359e00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83380b2900 0x7f83380b4e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8340009750 tx=0x7f8340009310 comp rx=0 tx=0).stop 2024-05-14T12:42:56.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.056+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354075b00 msgr2=0x7f835419d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:56.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.056+0000 7f8359e00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354075b00 0x7f835419d010 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f834400e9a0 tx=0x7f834400ecb0 comp rx=0 tx=0).stop 2024-05-14T12:42:56.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 shutdown_connections 2024-05-14T12:42:56.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f83380b2900 0x7f83380b4e10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:56.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8354110c00 0x7f83541a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:56.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8354075b00 0x7f835419d010 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:56.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 --2- 172.21.15.47:0/720881506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8354076450 0x7f835419d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:56.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 >> 172.21.15.47:0/720881506 conn(0x7f8354100040 msgr2=0x7f8354101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:56.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 shutdown_connections 2024-05-14T12:42:56.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:56.057+0000 7f8359e00700 1 -- 172.21.15.47:0/720881506 wait complete. 2024-05-14T12:42:56.058 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 61 2024-05-14T12:42:56.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:55 smithi073 ceph-mon[35809]: pgmap v982: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.3 KiB/s wr, 18 op/s 2024-05-14T12:42:56.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:55 smithi066 ceph-mon[35981]: pgmap v982: 97 pgs: 97 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.3 KiB/s wr, 18 op/s 2024-05-14T12:42:56.864 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --set-id 3f3d2c55 --await-for 42.0' 2024-05-14T12:42:56.864 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --set-id 3f3d2c55 --await-for 42.0 2024-05-14T12:42:57.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:56 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/720881506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:42:57.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:56 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/720881506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:42:57.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:56 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/720881506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:42:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:42:58.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:57 smithi047 ceph-mon[31254]: pgmap v983: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-05-14T12:42:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:57 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:42:58.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:57 smithi073 ceph-mon[35809]: pgmap v983: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-05-14T12:42:58.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:57 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:42:58.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:57 smithi066 ceph-mon[35981]: pgmap v983: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-05-14T12:42:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:57 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:42:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.865+0000 7fa722e00640 1 -- 172.21.15.47:0/3470923848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c103c60 msgr2=0x7fa71c104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.865+0000 7fa722e00640 1 --2- 172.21.15.47:0/3470923848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c103c60 0x7fa71c104960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009900 tx=0x7fa70c02a3f0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.865+0000 7fa722e00640 1 -- 172.21.15.47:0/3470923848 shutdown_connections 2024-05-14T12:42:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.865+0000 7fa722e00640 1 --2- 172.21.15.47:0/3470923848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa71c109ba0 0x7fa71c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.865+0000 7fa722e00640 1 --2- 172.21.15.47:0/3470923848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c104ea0 0x7fa71c1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.865+0000 7fa722e00640 1 --2- 172.21.15.47:0/3470923848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c103c60 0x7fa71c104960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.865+0000 7fa722e00640 1 -- 172.21.15.47:0/3470923848 >> 172.21.15.47:0/3470923848 conn(0x7fa71c0fee50 msgr2=0x7fa71c101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.866+0000 7fa722e00640 1 -- 172.21.15.47:0/3470923848 shutdown_connections 2024-05-14T12:42:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.866+0000 7fa722e00640 1 -- 172.21.15.47:0/3470923848 wait complete. 2024-05-14T12:42:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 Processor -- start 2024-05-14T12:42:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 -- start start 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c103c60 0x7fa71c19c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c104ea0 0x7fa71c19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa71c109ba0 0x7fa71c1a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c10f7b0 con 0x7fa71c109ba0 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c10f630 con 0x7fa71c104ea0 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.867+0000 7fa722e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c10f930 con 0x7fa71c103c60 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c103c60 0x7fa71c19c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c104ea0 0x7fa71c19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa720e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa71c109ba0 0x7fa71c1a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c104ea0 0x7fa71c19c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40224/0 (socket says 172.21.15.47:40224) 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c103c60 0x7fa71c19c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50486/0 (socket says 172.21.15.47:50486) 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 -- 172.21.15.47:0/414952437 learned_addr learned my addr 172.21.15.47:0/414952437 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 -- 172.21.15.47:0/414952437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c103c60 msgr2=0x7fa71c19c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c103c60 0x7fa71c19c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 -- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa71c109ba0 msgr2=0x7fa71c1a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa71c109ba0 0x7fa71c1a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 -- 172.21.15.47:0/414952437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c1a3fe0 con 0x7fa71c104ea0 2024-05-14T12:42:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.868+0000 7fa71b400640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c104ea0 0x7fa71c19c9e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa70800e9f0 tx=0x7fa70800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.869+0000 7fa718c00640 1 -- 172.21.15.47:0/414952437 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70800cd80 con 0x7fa71c104ea0 2024-05-14T12:42:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.869+0000 7fa718c00640 1 -- 172.21.15.47:0/414952437 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7080054d0 con 0x7fa71c104ea0 2024-05-14T12:42:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.869+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71c1a42d0 con 0x7fa71c104ea0 2024-05-14T12:42:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.869+0000 7fa718c00640 1 -- 172.21.15.47:0/414952437 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708010690 con 0x7fa71c104ea0 2024-05-14T12:42:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.869+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71c1a4820 con 0x7fa71c104ea0 2024-05-14T12:42:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 Processor -- start 2024-05-14T12:42:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 -- start start 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fb5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bea2f0 0x558ed0fb5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 0x558ed0fbc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558ed0f19550 con 0x558ed0bf24d0 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558ed0ebebc0 con 0x558ed0c131b0 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.874+0000 7fa729e03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558ed0f15510 con 0x558ed0bea2f0 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bea2f0 0x558ed0fb5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bea2f0 0x558ed0fb5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50496/0 (socket says 172.21.15.47:50496) 2024-05-14T12:42:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa720e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fb5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 -- 172.21.15.47:0/515995898 learned_addr learned my addr 172.21.15.47:0/515995898 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 -- 172.21.15.47:0/515995898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 msgr2=0x558ed0fb5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 --2- 172.21.15.47:0/515995898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fb5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 -- 172.21.15.47:0/515995898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 msgr2=0x558ed0fbc580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 --2- 172.21.15.47:0/515995898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 0x558ed0fbc580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 -- 172.21.15.47:0/515995898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed0c2b210 con 0x558ed0bea2f0 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa718c00640 1 -- 172.21.15.47:0/414952437 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa708004e90 con 0x7fa71c104ea0 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.875+0000 7fa71be00640 1 --2- 172.21.15.47:0/515995898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bea2f0 0x558ed0fb5680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009900 tx=0x7fa70c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72cea82defcde54e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.876+0000 7fa711600640 1 -- 172.21.15.47:0/515995898 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c035030 con 0x558ed0bea2f0 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.876+0000 7fa711600640 1 -- 172.21.15.47:0/515995898 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa70c040070 con 0x558ed0bea2f0 2024-05-14T12:42:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.876+0000 7fa711600640 1 -- 172.21.15.47:0/515995898 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c031920 con 0x558ed0bea2f0 2024-05-14T12:42:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 -- 172.21.15.47:0/515995898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bea2f0 msgr2=0x558ed0fb5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 --2- 172.21.15.47:0/515995898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bea2f0 0x558ed0fb5680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009900 tx=0x7fa70c004040 comp rx=0 tx=0).stop 2024-05-14T12:42:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 -- 172.21.15.47:0/515995898 shutdown_connections 2024-05-14T12:42:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 --2- 172.21.15.47:0/515995898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 0x558ed0fbc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 --2- 172.21.15.47:0/515995898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bea2f0 0x558ed0fb5680 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 --2- 172.21.15.47:0/515995898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fb5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 -- 172.21.15.47:0/515995898 >> 172.21.15.47:0/515995898 conn(0x558ed0c07300 msgr2=0x558ed0fb0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa718c00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7000b2920 0x7fa7000b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.877+0000 7fa729e03740 1 -- 172.21.15.47:0/515995898 shutdown_connections 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.878+0000 7fa729e03740 1 -- 172.21.15.47:0/515995898 wait complete. 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.878+0000 7fa718c00640 1 -- 172.21.15.47:0/414952437 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa7080e25c0 con 0x7fa71c104ea0 2024-05-14T12:42:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.878+0000 7fa71be00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7000b2920 0x7fa7000b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.878+0000 7fa729e03740 1 -- start start 2024-05-14T12:42:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.879+0000 7fa71be00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7000b2920 0x7fa7000b4e30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0096c0 tx=0x7fa70c047040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.879+0000 7fa729e03740 1 Processor -- start 2024-05-14T12:42:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.879+0000 7fa729e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.879+0000 7fa729e03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fc7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.879+0000 7fa729e03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa729e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558ed0fbcf70 con 0x558ed0bea2f0 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa729e03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558ed0ed2660 con 0x558ed0c131b0 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa729e03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558ed0fbd0f0 con 0x558ed0bf24d0 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa729e03740 10 client.0 _ll_register_callbacks cb 0x558ed0e9c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa71b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fc7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40232/0 (socket says 172.21.15.47:40232) 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa71b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fc7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50510/0 (socket says 172.21.15.47:50510) 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 -- 172.21.15.47:0/2788649940 learned_addr learned my addr 172.21.15.47:0/2788649940 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa71be00640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 -- 172.21.15.47:0/2788649940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 msgr2=0x558ed0fc7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fc7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 -- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bea2f0 msgr2=0x558ed0fc7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa720e00640 1 -- 172.21.15.47:0/2788649940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed0cf7620 con 0x558ed0c131b0 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa71b400640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fc7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.880+0000 7fa71be00640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa720e00640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fce840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa714011d10 tx=0x7fa71400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bd7cc87fa0d22b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa706000640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa706000640 1 -- 172.21.15.47:0/2788649940 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71401a3f0 con 0x558ed0c131b0 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa70c040070 con 0x558ed0c131b0 2024-05-14T12:42:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa706000640 1 -- 172.21.15.47:0/2788649940 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa714017050 con 0x558ed0c131b0 2024-05-14T12:42:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa706000640 1 -- 172.21.15.47:0/2788649940 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fa714004b20 con 0x558ed0c131b0 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa729e03740 10 client.26489 fetch_fsmap learned FSMap version 61 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.881+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x558ed0fd1890 con 0x558ed0c131b0 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa706000640 1 -- 172.21.15.47:0/2788649940 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa70c040070 con 0x558ed0c131b0 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa706000640 1 -- 172.21.15.47:0/2788649940 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8370+0+0 (secure 0 0 0) 0x7fa714022030 con 0x558ed0c131b0 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa729e03740 10 client.26489 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa729e03740 10 client.26489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa729e03740 20 client.26489 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa729e03740 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0bd1d80 0x558ed0fd4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa729e03740 4 client.26489 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ed0f27160 con 0x558ed0bd1d80 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.882+0000 7fa71be00640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0bd1d80 0x558ed0fd4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.883+0000 7fa71be00640 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0bd1d80 0x558ed0fd4fa0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b9863bb15173baa server_cookie=ac99b1660a3737b8 in_seq=0 out_seq=0 2024-05-14T12:42:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.883+0000 7fa706000640 10 client.26489 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.884+0000 7fa706000640 1 -- 172.21.15.47:0/2788649940 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558ed0f27160 con 0x558ed0bd1d80 2024-05-14T12:42:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.884+0000 7fa706000640 10 client.26489 handle_command_reply: tid=0 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.884+0000 7fa729e03740 1 client.26489 shutdown 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 msgr2=0x558ed0fce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fce840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa714011d10 tx=0x7fa71400f790 comp rx=0 tx=0).stop 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 shutdown_connections 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0bd1d80 0x558ed0fd4fa0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0c131b0 0x558ed0fce840 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fc7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa706000640 0 client.26489 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 --2- 172.21.15.47:0/2788649940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 >> 172.21.15.47:0/2788649940 conn(0x558ed0c07300 msgr2=0x558ed0fb39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:58.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 shutdown_connections 2024-05-14T12:42:58.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 1 -- 172.21.15.47:0/2788649940 wait complete. 2024-05-14T12:42:58.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.885+0000 7fa729e03740 20 client.26489 trim_cache size 0 max 16384 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 Processor -- start 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 -- start start 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 0x558ed0fce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0c131b0 0x558ed0fceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c1a9160 con 0x558ed0bf24d0 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c1aad60 con 0x558ed0bea2f0 2024-05-14T12:42:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.907+0000 7fa729e03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c1a9860 con 0x558ed0c131b0 2024-05-14T12:42:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa720e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0c131b0 0x558ed0fceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40234/0 (socket says 172.21.15.47:40234) 2024-05-14T12:42:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 -- 172.21.15.47:0/195853810 learned_addr learned my addr 172.21.15.47:0/195853810 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71b400640 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 0x558ed0fce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 -- 172.21.15.47:0/195853810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0c131b0 msgr2=0x558ed0fceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0c131b0 0x558ed0fceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 -- 172.21.15.47:0/195853810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 msgr2=0x558ed0fce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 0x558ed0fce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 -- 172.21.15.47:0/195853810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed0fac280 con 0x558ed0bea2f0 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa720e00640 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0c131b0 0x558ed0fceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.908+0000 7fa71be00640 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa70c006010 tx=0x7fa70c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1edc8196c20e1bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.909+0000 7fa710c00640 1 -- 172.21.15.47:0/195853810 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c060070 con 0x558ed0bea2f0 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.909+0000 7fa710c00640 1 -- 172.21.15.47:0/195853810 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa70c040040 con 0x558ed0bea2f0 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.909+0000 7fa710c00640 1 -- 172.21.15.47:0/195853810 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c045860 con 0x558ed0bea2f0 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 -- 172.21.15.47:0/195853810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 msgr2=0x558ed0fc7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa70c006010 tx=0x7fa70c004040 comp rx=0 tx=0).stop 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 -- 172.21.15.47:0/195853810 shutdown_connections 2024-05-14T12:42:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0c131b0 0x558ed0fceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0bf24d0 0x558ed0fce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 --2- 172.21.15.47:0/195853810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fc7b20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 -- 172.21.15.47:0/195853810 >> 172.21.15.47:0/195853810 conn(0x558ed0c07300 msgr2=0x558ed0fc7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 -- 172.21.15.47:0/195853810 shutdown_connections 2024-05-14T12:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.910+0000 7fa729e03740 1 -- 172.21.15.47:0/195853810 wait complete. 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 -- start start 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 Processor -- start 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fcbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fcc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0c131b0 0x558ed103b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c1aa690 con 0x558ed0c131b0 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c1a9fc0 con 0x558ed0bea2f0 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.911+0000 7fa729e03740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c1a7140 con 0x558ed0bf24d0 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa729e03740 10 client.0 _ll_register_callbacks cb 0x7fa714009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fcbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fcbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40244/0 (socket says 172.21.15.47:40244) 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 -- 172.21.15.47:0/875586906 learned_addr learned my addr 172.21.15.47:0/875586906 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71b400640 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fcc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa720e00640 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0c131b0 0x558ed103b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 -- 172.21.15.47:0/875586906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 msgr2=0x558ed0fcc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fcc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 -- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0c131b0 msgr2=0x558ed103b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0c131b0 0x558ed103b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 -- 172.21.15.47:0/875586906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed0fb9ab0 con 0x558ed0bea2f0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa71be00640 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fcbe40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa70c003860 tx=0x7fa70c0058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ef24c4ccf488cb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.912+0000 7fa706000640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.913+0000 7fa706000640 1 -- 172.21.15.47:0/875586906 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c060070 con 0x558ed0bea2f0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.913+0000 7fa706000640 1 -- 172.21.15.47:0/875586906 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa70c0319b0 con 0x558ed0bea2f0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.913+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa70c040040 con 0x558ed0bea2f0 2024-05-14T12:42:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.913+0000 7fa706000640 1 -- 172.21.15.47:0/875586906 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fa70c031bb0 con 0x558ed0bea2f0 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.913+0000 7fa729e03740 10 client.26495 fetch_fsmap learned FSMap version 61 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.913+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x558ed103c740 con 0x558ed0bea2f0 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.913+0000 7fa706000640 1 -- 172.21.15.47:0/875586906 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa70c040040 con 0x558ed0bea2f0 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa706000640 1 -- 172.21.15.47:0/875586906 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8370+0+0 (secure 0 0 0) 0x7fa70c067470 con 0x558ed0bea2f0 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa729e03740 10 client.26495 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa729e03740 10 client.26495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa729e03740 20 client.26495 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa729e03740 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0ba71c0 0x558ed103ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa729e03740 4 client.26495 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ed0f20fd0 con 0x558ed0ba71c0 2024-05-14T12:42:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.914+0000 7fa71b400640 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0ba71c0 0x558ed103ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.915+0000 7fa71b400640 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0ba71c0 0x558ed103ecb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5e7d556d7556be server_cookie=66ab8cb5f699802b in_seq=0 out_seq=0 2024-05-14T12:42:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:42:58.915+0000 7fa706000640 10 client.26495 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 -- 172.21.15.47:0/3886500128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 msgr2=0x7f7dec075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 --2- 172.21.15.47:0/3886500128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 0x7f7dec075f70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7de00099c0 tx=0x7f7de0009cd0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 -- 172.21.15.47:0/3886500128 shutdown_connections 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 --2- 172.21.15.47:0/3886500128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7dec1153b0 0x7f7dec1177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 --2- 172.21.15.47:0/3886500128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 0x7f7dec075f70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 --2- 172.21.15.47:0/3886500128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dec0764b0 0x7f7dec114e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 -- 172.21.15.47:0/3886500128 >> 172.21.15.47:0/3886500128 conn(0x7f7dec1000a0 msgr2=0x7f7dec1024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 -- 172.21.15.47:0/3886500128 shutdown_connections 2024-05-14T12:42:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.615+0000 7f7df4000700 1 -- 172.21.15.47:0/3886500128 wait complete. 2024-05-14T12:42:59.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.617+0000 7f7df4000700 1 Processor -- start 2024-05-14T12:42:59.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.617+0000 7f7df4000700 1 -- start start 2024-05-14T12:42:59.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.617+0000 7f7df4000700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 0x7f7dec1a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.617+0000 7f7df4000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dec0764b0 0x7f7dec1a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.617+0000 7f7df4000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7dec1153b0 0x7f7dec1a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df4000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec11aac0 con 0x7f7dec1153b0 2024-05-14T12:42:59.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df4000700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec11a940 con 0x7f7dec0764b0 2024-05-14T12:42:59.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df4000700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec11ac40 con 0x7f7dec075b60 2024-05-14T12:42:59.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dec0764b0 0x7f7dec1a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df1600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 0x7f7dec1a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dec0764b0 0x7f7dec1a1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40250/0 (socket says 172.21.15.47:40250) 2024-05-14T12:42:59.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 -- 172.21.15.47:0/3580352183 learned_addr learned my addr 172.21.15.47:0/3580352183 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:59.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 -- 172.21.15.47:0/3580352183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 msgr2=0x7f7dec1a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 0x7f7dec1a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 -- 172.21.15.47:0/3580352183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7dec1153b0 msgr2=0x7f7dec1a5c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df2000700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7dec1153b0 0x7f7dec1a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7dec1153b0 0x7f7dec1a5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.618+0000 7f7df0c00700 1 -- 172.21.15.47:0/3580352183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dec1a62a0 con 0x7f7dec0764b0 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.619+0000 7f7df1600700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dec075b60 0x7f7dec1a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.619+0000 7f7df2000700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7dec1153b0 0x7f7dec1a5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.619+0000 7f7df0c00700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7dec0764b0 0x7f7dec1a1970 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800e9a0 tx=0x7f7dd800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.619+0000 7f7dea000700 1 -- 172.21.15.47:0/3580352183 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800cbd0 con 0x7f7dec0764b0 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.619+0000 7f7dea000700 1 -- 172.21.15.47:0/3580352183 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd800cd70 con 0x7f7dec0764b0 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.619+0000 7f7dea000700 1 -- 172.21.15.47:0/3580352183 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80186f0 con 0x7f7dec0764b0 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.620+0000 7f7df4000700 1 -- 172.21.15.47:0/3580352183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dec1a6590 con 0x7f7dec0764b0 2024-05-14T12:42:59.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.620+0000 7f7df4000700 1 -- 172.21.15.47:0/3580352183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dec1adeb0 con 0x7f7dec0764b0 2024-05-14T12:42:59.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.625+0000 7f7dea000700 1 -- 172.21.15.47:0/3580352183 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7dd8010a00 con 0x7f7dec0764b0 2024-05-14T12:42:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.627+0000 7f7e02af3b80 1 Processor -- start 2024-05-14T12:42:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.627+0000 7f7e02af3b80 1 -- start start 2024-05-14T12:42:59.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7dea000700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7dd40b2980 0x7f7dd40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba5700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570600 0x5609ba57acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7dea000700 1 -- 172.21.15.47:0/3580352183 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7dd80e2510 con 0x7f7dec0764b0 2024-05-14T12:42:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5609ba492b20 con 0x5609ba570600 2024-05-14T12:42:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5609ba430860 con 0x5609ba570a10 2024-05-14T12:42:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.628+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5609ba48eae0 con 0x5609ba3f2f40 2024-05-14T12:42:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba5700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba5700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:50548/0 (socket says 172.21.15.47:50548) 2024-05-14T12:42:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 -- 172.21.15.47:0/1330816789 learned_addr learned my addr 172.21.15.47:0/1330816789 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df2000700 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df0c00700 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570600 0x5609ba57acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df2000700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7dd40b2980 0x7f7dd40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 -- 172.21.15.47:0/1330816789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 msgr2=0x5609ba57d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 -- 172.21.15.47:0/1330816789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570600 msgr2=0x5609ba57acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570600 0x5609ba57acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df1600700 1 -- 172.21.15.47:0/1330816789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ba3df9d0 con 0x5609ba3f2f40 2024-05-14T12:42:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.629+0000 7f7df0c00700 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570600 0x5609ba57acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T12:42:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.630+0000 7f7df1600700 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba5700c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7de00099c0 tx=0x7f7de0005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf1adb7a9c4e2b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.630+0000 7f7ddea00700 1 -- 172.21.15.47:0/1330816789 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de00052b0 con 0x5609ba3f2f40 2024-05-14T12:42:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.630+0000 7f7df2000700 1 --2- 172.21.15.47:0/3580352183 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f7dd40b2980 0x7f7dd40b4e90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5609ba570ea0 tx=0x7f7de400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.630+0000 7f7ddea00700 1 -- 172.21.15.47:0/1330816789 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7de0003c70 con 0x5609ba3f2f40 2024-05-14T12:42:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.630+0000 7f7ddea00700 1 -- 172.21.15.47:0/1330816789 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de000bb60 con 0x5609ba3f2f40 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1330816789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 msgr2=0x5609ba5700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba5700c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7de00099c0 tx=0x7f7de0005040 comp rx=0 tx=0).stop 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1330816789 shutdown_connections 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba5700c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1330816789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570600 0x5609ba57acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1330816789 >> 172.21.15.47:0/1330816789 conn(0x5609ba431b80 msgr2=0x5609ba56bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1330816789 shutdown_connections 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.632+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1330816789 wait complete. 2024-05-14T12:42:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 -- start start 2024-05-14T12:42:59.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 Processor -- start 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba57acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba57b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5609ba57dac0 con 0x5609ba570a10 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5609ba3f8c20 con 0x5609ba570600 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.633+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5609ba57dc40 con 0x5609ba3f2f40 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7e02af3b80 10 client.0 _ll_register_callbacks cb 0x5609ba426480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba57acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba57acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40272/0 (socket says 172.21.15.47:40272) 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 -- 172.21.15.47:0/742314874 learned_addr learned my addr 172.21.15.47:0/742314874 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df2000700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba57b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df1600700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 -- 172.21.15.47:0/742314874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 msgr2=0x5609ba57a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 -- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 msgr2=0x5609ba57b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba57b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.634+0000 7f7df0c00700 1 -- 172.21.15.47:0/742314874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ba458520 con 0x5609ba570600 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7df1600700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7df0c00700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba57acf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80a5b70 tx=0x7f7dd80aa030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=215de5dcb1c4ecc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7dd3400700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7dd3400700 1 -- 172.21.15.47:0/742314874 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80e2320 con 0x5609ba570600 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7dd3400700 1 -- 172.21.15.47:0/742314874 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7dd80a8d50 con 0x5609ba570600 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7de0003c70 con 0x5609ba570600 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7dd3400700 1 -- 172.21.15.47:0/742314874 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f7dd80aa1f0 con 0x5609ba570600 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7e02af3b80 10 client.26507 fetch_fsmap learned FSMap version 61 2024-05-14T12:42:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.635+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5609ba588700 con 0x5609ba570600 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.636+0000 7f7dd3400700 1 -- 172.21.15.47:0/742314874 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7de0003c70 con 0x5609ba570600 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7dd3400700 1 -- 172.21.15.47:0/742314874 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8370+0+0 (secure 0 0 0) 0x7f7dd80a5460 con 0x5609ba570600 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7e02af3b80 10 client.26507 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7e02af3b80 10 client.26507 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7e02af3b80 20 client.26507 populate_metadata read hostname 'smithi047' 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba58ad40 0x5609ba58d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7e02af3b80 4 client.26507 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609ba53d170 con 0x5609ba58ad40 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.637+0000 7f7df1600700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba58ad40 0x5609ba58d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.638+0000 7f7df1600700 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba58ad40 0x5609ba58d160 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=955c17d94cd7201 server_cookie=3a31cc774e070009 in_seq=0 out_seq=0 2024-05-14T12:42:59.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:42:59.638+0000 7f7dd3400700 10 client.26507 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:59 smithi047 ceph-mon[31254]: pgmap v984: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-05-14T12:43:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:43:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:43:00.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:42:59 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:59 smithi073 ceph-mon[35809]: pgmap v984: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-05-14T12:43:00.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:43:00.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:43:00.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:42:59 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:59 smithi066 ceph-mon[35981]: pgmap v984: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-05-14T12:43:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:00.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:43:00.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:43:00.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:42:59 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:43:02.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:01 smithi047 ceph-mon[31254]: pgmap v985: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-14T12:43:02.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:01 smithi073 ceph-mon[35809]: pgmap v985: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-14T12:43:02.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:01 smithi066 ceph-mon[35981]: pgmap v985: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-14T12:43:04.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:03 smithi047 ceph-mon[31254]: pgmap v986: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 20 op/s 2024-05-14T12:43:04.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:03 smithi073 ceph-mon[35809]: pgmap v986: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 20 op/s 2024-05-14T12:43:04.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:03 smithi066 ceph-mon[35981]: pgmap v986: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 20 op/s 2024-05-14T12:43:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:05 smithi047 ceph-mon[31254]: pgmap v987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.8 KiB/s wr, 18 op/s 2024-05-14T12:43:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:05 smithi073 ceph-mon[35809]: pgmap v987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.8 KiB/s wr, 18 op/s 2024-05-14T12:43:06.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:05 smithi066 ceph-mon[35981]: pgmap v987: 97 pgs: 97 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.8 KiB/s wr, 18 op/s 2024-05-14T12:43:08.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:07 smithi073 ceph-mon[35809]: pgmap v988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-05-14T12:43:08.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:07 smithi066 ceph-mon[35981]: pgmap v988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-05-14T12:43:08.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:07 smithi047 ceph-mon[31254]: pgmap v988: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 21 op/s 2024-05-14T12:43:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:09 smithi073 ceph-mon[35809]: pgmap v989: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 19 op/s 2024-05-14T12:43:10.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:09 smithi066 ceph-mon[35981]: pgmap v989: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 19 op/s 2024-05-14T12:43:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.354+0000 7fa706000640 1 -- 172.21.15.47:0/875586906 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ed0f20fd0 con 0x558ed0ba71c0 2024-05-14T12:43:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.354+0000 7fa706000640 10 client.26495 handle_command_reply: tid=0 2024-05-14T12:43:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.354+0000 7fa729e03740 1 client.26495 shutdown 2024-05-14T12:43:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 msgr2=0x558ed0fcbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fcbe40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa70c003860 tx=0x7fa70c0058e0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 shutdown_connections 2024-05-14T12:43:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x558ed0ba71c0 0x558ed103ecb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ed0c131b0 0x558ed103b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ed0bf24d0 0x558ed0fcc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 --2- 172.21.15.47:0/875586906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558ed0bea2f0 0x558ed0fcbe40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa706000640 0 client.26495 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.355+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 >> 172.21.15.47:0/875586906 conn(0x558ed0c07300 msgr2=0x558ed0fb3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.356+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 shutdown_connections 2024-05-14T12:43:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.356+0000 7fa729e03740 1 -- 172.21.15.47:0/875586906 wait complete. 2024-05-14T12:43:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.356+0000 7fa729e03740 20 client.26495 trim_cache size 0 max 16384 2024-05-14T12:43:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:43:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:43:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:43:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:43:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.356+0000 7f7dd3400700 1 -- 172.21.15.47:0/742314874 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5609ba53d170 con 0x5609ba58ad40 2024-05-14T12:43:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.356+0000 7f7dd3400700 10 client.26507 handle_command_reply: tid=0 2024-05-14T12:43:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.357+0000 7f7e02af3b80 1 client.26507 shutdown 2024-05-14T12:43:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.357+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 msgr2=0x5609ba57acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.357+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba57acf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80a5b70 tx=0x7f7dd80aa030 comp rx=0 tx=0).stop 2024-05-14T12:43:10.358 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:09 smithi047 ceph-mon[31254]: pgmap v989: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 19 op/s 2024-05-14T12:43:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.358+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7000b2920 msgr2=0x7fa7000b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.358+0000 7fa722e00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7000b2920 0x7fa7000b4e30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0096c0 tx=0x7fa70c047040 comp rx=0 tx=0).stop 2024-05-14T12:43:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.358+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c104ea0 msgr2=0x7fa71c19c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.358+0000 7fa722e00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c104ea0 0x7fa71c19c9e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa70800e9f0 tx=0x7fa70800edf0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.358+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 shutdown_connections 2024-05-14T12:43:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.358+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba58ad40 0x5609ba58d160 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.358+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba57b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.358+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.358+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/742314874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba57acf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.358+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 >> 172.21.15.47:0/742314874 conn(0x5609ba431b80 msgr2=0x5609ba56b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.358+0000 7f7dd3400700 0 client.26507 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 shutdown_connections 2024-05-14T12:43:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa7000b2920 0x7fa7000b4e30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa71c109ba0 0x7fa71c1a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71c104ea0 0x7fa71c19c9e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 --2- 172.21.15.47:0/414952437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c103c60 0x7fa71c19c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 >> 172.21.15.47:0/414952437 conn(0x7fa71c0fee50 msgr2=0x7fa71c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:10.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.359+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 shutdown_connections 2024-05-14T12:43:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 shutdown_connections 2024-05-14T12:43:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:10.359+0000 7fa722e00640 1 -- 172.21.15.47:0/414952437 wait complete. 2024-05-14T12:43:10.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.359+0000 7f7e02af3b80 1 -- 172.21.15.47:0/742314874 wait complete. 2024-05-14T12:43:10.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.359+0000 7f7e02af3b80 20 client.26507 trim_cache size 0 max 16384 2024-05-14T12:43:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.402+0000 7f7e02af3b80 1 Processor -- start 2024-05-14T12:43:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.402+0000 7f7e02af3b80 1 -- start start 2024-05-14T12:43:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.402+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:10.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.402+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba572150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.402+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba592920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.402+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1b5320 con 0x5609ba570a10 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.402+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1b6f20 con 0x5609ba570600 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1b5a20 con 0x5609ba3f2f40 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba572150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:54998/0 (socket says 172.21.15.47:54998) 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba572150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:46614/0 (socket says 172.21.15.47:46614) 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 -- 172.21.15.47:0/3733373689 learned_addr learned my addr 172.21.15.47:0/3733373689 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:10.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df2000700 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba592920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 -- 172.21.15.47:0/3733373689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 msgr2=0x5609ba572150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba572150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 -- 172.21.15.47:0/3733373689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 msgr2=0x5609ba592920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba592920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.403+0000 7f7df1600700 1 -- 172.21.15.47:0/3733373689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ba57d740 con 0x5609ba3f2f40 2024-05-14T12:43:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.404+0000 7f7df0c00700 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba572150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:10.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.404+0000 7f7df1600700 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57b070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7de0005010 tx=0x7f7de0003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64c3b8ba481c435e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.404+0000 7f7dde000700 1 -- 172.21.15.47:0/3733373689 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de00050b0 con 0x5609ba3f2f40 2024-05-14T12:43:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.404+0000 7f7dde000700 1 -- 172.21.15.47:0/3733373689 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7de000b790 con 0x5609ba3f2f40 2024-05-14T12:43:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.404+0000 7f7dde000700 1 -- 172.21.15.47:0/3733373689 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de00331e0 con 0x5609ba3f2f40 2024-05-14T12:43:10.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.405+0000 7f7e02af3b80 1 -- 172.21.15.47:0/3733373689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 msgr2=0x5609ba57b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.405+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57b070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7de0005010 tx=0x7f7de0003cf0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 -- 172.21.15.47:0/3733373689 shutdown_connections 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba570a10 0x5609ba592920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba3f2f40 0x5609ba57b070 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/3733373689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570600 0x5609ba572150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 -- 172.21.15.47:0/3733373689 >> 172.21.15.47:0/3733373689 conn(0x5609ba431b80 msgr2=0x5609ba57c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 -- 172.21.15.47:0/3733373689 shutdown_connections 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 -- 172.21.15.47:0/3733373689 wait complete. 2024-05-14T12:43:10.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.406+0000 7f7e02af3b80 1 -- start start 2024-05-14T12:43:10.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 1 Processor -- start 2024-05-14T12:43:10.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba3f2f40 0x5609ba582d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:10.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba570600 0x5609ba583300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:10.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:10.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1b6850 con 0x5609ba3f2f40 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1b6180 con 0x5609ba570a10 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1b32a0 con 0x5609ba570600 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.407+0000 7f7e02af3b80 10 client.0 _ll_register_callbacks cb 0x5609ba56c540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba570600 0x5609ba583300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df1600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba3f2f40 0x5609ba582d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba570600 0x5609ba583300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:55000/0 (socket says 172.21.15.47:55000) 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df2000700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:10.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 -- 172.21.15.47:0/1803126556 learned_addr learned my addr 172.21.15.47:0/1803126556 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:10.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 -- 172.21.15.47:0/1803126556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 msgr2=0x5609ba57f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:10.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 -- 172.21.15.47:0/1803126556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba3f2f40 msgr2=0x5609ba582d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba3f2f40 0x5609ba582d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df0c00700 1 -- 172.21.15.47:0/1803126556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ba57f920 con 0x5609ba570600 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.408+0000 7f7df2000700 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7df0c00700 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba570600 0x5609ba583300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80a9a80 tx=0x7f7dd80a8f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4390d56b2514bdd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7dd3400700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7dd3400700 1 -- 172.21.15.47:0/1803126556 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80e2320 con 0x5609ba570600 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7dd3400700 1 -- 172.21.15.47:0/1803126556 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7dd80cc2e0 con 0x5609ba570600 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7de000b790 con 0x5609ba570600 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7dd3400700 1 -- 172.21.15.47:0/1803126556 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f7dd80a9600 con 0x5609ba570600 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7e02af3b80 10 client.26542 fetch_fsmap learned FSMap version 61 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.409+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5609ba5f5e90 con 0x5609ba570600 2024-05-14T12:43:10.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7dd3400700 1 -- 172.21.15.47:0/1803126556 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7de000b790 con 0x5609ba570600 2024-05-14T12:43:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7dd3400700 1 -- 172.21.15.47:0/1803126556 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 61) ==== 8370+0+0 (secure 0 0 0) 0x7f7dd80af030 con 0x5609ba570600 2024-05-14T12:43:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7e02af3b80 10 client.26542 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T12:43:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7e02af3b80 10 client.26542 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:43:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7e02af3b80 20 client.26542 populate_metadata read hostname 'smithi047' 2024-05-14T12:43:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba5f64e0 0x5609ba5f8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7e02af3b80 4 client.26542 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3f3d2c55", "await_for": 42.0}] 2024-05-14T12:43:10.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3f3d2c55", "await_for": 42.0}) -- 0x5609ba4a0500 con 0x5609ba5f64e0 2024-05-14T12:43:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.410+0000 7f7df1600700 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba5f64e0 0x5609ba5f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.411+0000 7f7dd3400700 10 client.26542 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.411+0000 7f7df1600700 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba5f64e0 0x5609ba5f8900 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3432969879b04a6c server_cookie=acb8dccb866eb3af in_seq=0 out_seq=0 2024-05-14T12:43:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7dd3400700 1 -- 172.21.15.47:0/1803126556 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: -110 ) ==== 8+0+593 (crc 0 0 0) 0x5609ba4a0500 con 0x5609ba5f64e0 2024-05-14T12:43:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7dd3400700 10 client.26542 handle_command_reply: tid=0 2024-05-14T12:43:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 client.26542 shutdown 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba570600 msgr2=0x5609ba583300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba570600 0x5609ba583300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80a9a80 tx=0x7f7dd80a8f80 comp rx=0 tx=0).stop 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 shutdown_connections 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5609ba5f64e0 0x5609ba5f8900 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609ba570a10 0x5609ba57f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609ba3f2f40 0x5609ba582d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 --2- 172.21.15.47:0/1803126556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5609ba570600 0x5609ba583300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7dd3400700 0 client.26542 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 >> 172.21.15.47:0/1803126556 conn(0x5609ba431b80 msgr2=0x5609ba57c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 shutdown_connections 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.412+0000 7f7e02af3b80 1 -- 172.21.15.47:0/1803126556 wait complete. 2024-05-14T12:43:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:10.413+0000 7f7e02af3b80 20 client.26542 trim_cache size 0 max 16384 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 61, 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 34, 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": { 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "3f3d2c55": { 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "version": 34, 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "age_ref": 25.1, 2024-05-14T12:43:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "TIMEDOUT", 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.0 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "timeout": 60.0, 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "expiration": 78.3, 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "members": { 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "file:/": { 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "excluded": false, 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "state": { 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "QUIESCING", 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.0 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:10.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:10.416 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:10.416 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:43:10.416 INFO:teuthology.orchestra.run.smithi047.stderr:Error ETIMEDOUT: 2024-05-14T12:43:11.411 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-05-14T12:43:11.412 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't quiesce root with rc: 110 (ETIMEDOUT), stdout: { "epoch": 61, "leader": 24535, "set_version": 34, "sets": { "3f3d2c55": { "version": 34, "age_ref": 25.1, "state": { "name": "TIMEDOUT", "age": 0.0 }, "timeout": 60.0, "expiration": 78.3, "members": { "file:/": { "excluded": false, "state": { "name": "QUIESCING", "age": 60.0 } } } } } } 2024-05-14T12:43:11.412 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/quiescer.py", line 354, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/quiescer.py", line 310, in do_quiesce raise RuntimeError(f"Error quiescing set '{set_id}': {rcinfo(rc)}") RuntimeError: Error quiescing set '3f3d2c55': 110 (ETIMEDOUT) 2024-05-14T12:43:12.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:11 smithi073 ceph-mon[35809]: pgmap v990: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 22 op/s 2024-05-14T12:43:12.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:11 smithi066 ceph-mon[35981]: pgmap v990: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 22 op/s 2024-05-14T12:43:12.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:11 smithi047 ceph-mon[31254]: pgmap v990: 97 pgs: 97 active+clean; 1.3 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 22 op/s 2024-05-14T12:43:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:14 smithi073 ceph-mon[35809]: pgmap v991: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 22 op/s 2024-05-14T12:43:14.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:14 smithi066 ceph-mon[35981]: pgmap v991: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 22 op/s 2024-05-14T12:43:14.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:14 smithi047 ceph-mon[31254]: pgmap v991: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 22 op/s 2024-05-14T12:43:16.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:16 smithi066 ceph-mon[35981]: pgmap v992: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-05-14T12:43:16.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:16 smithi047 ceph-mon[31254]: pgmap v992: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-05-14T12:43:16.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:16 smithi073 ceph-mon[35809]: pgmap v992: 97 pgs: 97 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-05-14T12:43:18.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:18 smithi066 ceph-mon[35981]: pgmap v993: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 25 op/s 2024-05-14T12:43:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:18 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:18.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:18 smithi047 ceph-mon[31254]: pgmap v993: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 25 op/s 2024-05-14T12:43:18.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:18 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:18.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:18 smithi073 ceph-mon[35809]: pgmap v993: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 25 op/s 2024-05-14T12:43:18.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:18 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:19.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:19 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:19.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:19 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:19.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:19 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:20.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:20 smithi066 ceph-mon[35981]: pgmap v994: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 22 op/s 2024-05-14T12:43:20.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:20 smithi047 ceph-mon[31254]: pgmap v994: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 22 op/s 2024-05-14T12:43:20.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:20 smithi073 ceph-mon[35809]: pgmap v994: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 22 op/s 2024-05-14T12:43:22.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:22 smithi066 ceph-mon[35981]: pgmap v995: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 27 op/s 2024-05-14T12:43:22.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:22 smithi047 ceph-mon[31254]: pgmap v995: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 27 op/s 2024-05-14T12:43:22.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:22 smithi073 ceph-mon[35809]: pgmap v995: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 27 op/s 2024-05-14T12:43:23.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:23 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:23.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:23 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:23.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:23 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.598+0000 7f431a600640 1 -- 172.21.15.47:0/3341465426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 msgr2=0x7f43141067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.598+0000 7f431a600640 1 --2- 172.21.15.47:0/3341465426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f43141067c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4304009860 tx=0x7f430402a340 comp rx=0 tx=0).stop 2024-05-14T12:43:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.598+0000 7f431a600640 1 -- 172.21.15.47:0/3341465426 shutdown_connections 2024-05-14T12:43:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.598+0000 7f431a600640 1 --2- 172.21.15.47:0/3341465426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43141098c0 0x7f431410bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.598+0000 7f431a600640 1 --2- 172.21.15.47:0/3341465426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4314106d90 0x7f4314109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.598+0000 7f431a600640 1 --2- 172.21.15.47:0/3341465426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f43141067c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.598+0000 7f431a600640 1 -- 172.21.15.47:0/3341465426 >> 172.21.15.47:0/3341465426 conn(0x7f43140fdd60 msgr2=0x7f43141001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.599+0000 7f431a600640 1 -- 172.21.15.47:0/3341465426 shutdown_connections 2024-05-14T12:43:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.599+0000 7f431a600640 1 -- 172.21.15.47:0/3341465426 wait complete. 2024-05-14T12:43:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 Processor -- start 2024-05-14T12:43:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 -- start start 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f431419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4314106d90 0x7f431419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43141098c0 0x7f43141a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f431410f720 con 0x7f4314106d90 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f431410f5a0 con 0x7f43141043a0 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f431a600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f431410f8a0 con 0x7f43141098c0 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f4313400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f431419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.600+0000 7f4313400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f431419c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57756/0 (socket says 172.21.15.47:57756) 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313400640 1 -- 172.21.15.47:0/2802645076 learned_addr learned my addr 172.21.15.47:0/2802645076 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4312a00640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4314106d90 0x7f431419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313e00640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43141098c0 0x7f43141a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313400640 1 -- 172.21.15.47:0/2802645076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43141098c0 msgr2=0x7f43141a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313400640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43141098c0 0x7f43141a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313400640 1 -- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4314106d90 msgr2=0x7f431419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313400640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4314106d90 0x7f431419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313400640 1 -- 172.21.15.47:0/2802645076 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43141a4010 con 0x7f43141043a0 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4312a00640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4314106d90 0x7f431419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313e00640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43141098c0 0x7f43141a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.601+0000 7f4313400640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f431419c4d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4304009780 tx=0x7f4304032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.602+0000 7f430be00640 1 -- 172.21.15.47:0/2802645076 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304037040 con 0x7f43141043a0 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.602+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43141a42a0 con 0x7f43141043a0 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.602+0000 7f430be00640 1 -- 172.21.15.47:0/2802645076 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4304030c10 con 0x7f43141043a0 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.602+0000 7f430be00640 1 -- 172.21.15.47:0/2802645076 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304003850 con 0x7f43141043a0 2024-05-14T12:43:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.602+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43141a4780 con 0x7f43141043a0 2024-05-14T12:43:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.605+0000 7f4321578740 1 Processor -- start 2024-05-14T12:43:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.605+0000 7f4321578740 1 -- start start 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4321578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x5589544b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4321578740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4321578740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540f14d0 0x5589544bb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4321578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558954418550 con 0x5589541121b0 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4321578740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5589543bdbc0 con 0x5589540f14d0 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4321578740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558954414510 con 0x5589540e92f0 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4313e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x5589544b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4313e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x5589544b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47712/0 (socket says 172.21.15.47:47712) 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4313e00640 1 -- 172.21.15.47:0/12569977 learned_addr learned my addr 172.21.15.47:0/12569977 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.606+0000 7f4312a00640 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540f14d0 0x5589544bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4313e00640 1 -- 172.21.15.47:0/12569977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 msgr2=0x5589544b4680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T12:43:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4313e00640 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544b4680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4313e00640 1 -- 172.21.15.47:0/12569977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540f14d0 msgr2=0x5589544bb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4313e00640 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540f14d0 0x5589544bb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4313e00640 1 -- 172.21.15.47:0/12569977 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895412a210 con 0x5589541121b0 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4313e00640 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x5589544b4100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f430c009fd0 tx=0x7f430c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425e35a164b0bec server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f430be00640 1 -- 172.21.15.47:0/2802645076 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4304043020 con 0x7f43141043a0 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4308c00640 1 -- 172.21.15.47:0/12569977 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c011760 con 0x5589541121b0 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4308c00640 1 -- 172.21.15.47:0/12569977 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f430c011db0 con 0x5589541121b0 2024-05-14T12:43:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.607+0000 7f4308c00640 1 -- 172.21.15.47:0/12569977 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c00ee70 con 0x5589541121b0 2024-05-14T12:43:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.608+0000 7f4321578740 1 -- 172.21.15.47:0/12569977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 msgr2=0x5589544b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.608+0000 7f4321578740 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x5589544b4100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f430c009fd0 tx=0x7f430c0108e0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 -- 172.21.15.47:0/12569977 shutdown_connections 2024-05-14T12:43:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540f14d0 0x5589544bb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 --2- 172.21.15.47:0/12569977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x5589544b4100 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 -- 172.21.15.47:0/12569977 >> 172.21.15.47:0/12569977 conn(0x558954106300 msgr2=0x5589544afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 -- 172.21.15.47:0/12569977 shutdown_connections 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 -- 172.21.15.47:0/12569977 wait complete. 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f4321578740 1 -- start start 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.609+0000 7f430be00640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f42f80b27b0 0x7f42f80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f430be00640 1 -- 172.21.15.47:0/2802645076 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4304101740 con 0x7f43141043a0 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 1 Processor -- start 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4313e00640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f42f80b27b0 0x7f42f80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540f14d0 0x5589544be1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5589544bbfd0 con 0x5589540f14d0 2024-05-14T12:43:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5589543d1660 con 0x5589541121b0 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5589544bc150 con 0x5589540e92f0 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.610+0000 7f4321578740 10 client.0 _ll_register_callbacks cb 0x55895439b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544bdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:57598/0 (socket says 172.21.15.47:57598) 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 -- 172.21.15.47:0/4219839594 learned_addr learned my addr 172.21.15.47:0/4219839594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313e00640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f42f80b27b0 0x7f42f80b4cc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f430c009e10 tx=0x7f430c009c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4312a00640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540f14d0 0x5589544be1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313e00640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 -- 172.21.15.47:0/4219839594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 msgr2=0x5589544c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 -- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540f14d0 msgr2=0x5589544be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540f14d0 0x5589544be1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 -- 172.21.15.47:0/4219839594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589541f6620 con 0x5589540e92f0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313e00640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f4313400640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544bdc70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f43040c4e30 tx=0x7f43040c88c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e5b26a0ab1f5765 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f42fd600640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f42fd600640 1 -- 172.21.15.47:0/4219839594 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43040df020 con 0x5589540e92f0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.611+0000 7f42fd600640 1 -- 172.21.15.47:0/4219839594 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f43040d16f0 con 0x5589540e92f0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f430c011db0 con 0x5589540e92f0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f42fd600640 1 -- 172.21.15.47:0/4219839594 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f43040d1970 con 0x5589540e92f0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 10 client.26551 fetch_fsmap learned FSMap version 64 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x5589544bbfd0 con 0x5589540e92f0 2024-05-14T12:43:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f42fd600640 1 -- 172.21.15.47:0/4219839594 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f430c011db0 con 0x5589540e92f0 2024-05-14T12:43:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f42fd600640 1 -- 172.21.15.47:0/4219839594 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7f43040cf040 con 0x5589540e92f0 2024-05-14T12:43:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 10 client.26551 fetch_fsmap finished waiting for FSMap version 64 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 10 client.26551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 20 client.26551 populate_metadata read hostname 'smithi047' 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540d0d80 0x5589544cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 4 client.26551 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.612+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558954426160 con 0x5589540d0d80 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.613+0000 7f4312a00640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540d0d80 0x5589544cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.613+0000 7f4312a00640 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540d0d80 0x5589544cb4c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72460176dafe0edc server_cookie=87e59504c3a0b7bd in_seq=0 out_seq=0 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.613+0000 7f42fd600640 10 client.26551 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.614+0000 7f42fd600640 1 -- 172.21.15.47:0/4219839594 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558954426160 con 0x5589540d0d80 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.614+0000 7f42fd600640 10 client.26551 handle_command_reply: tid=0 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.614+0000 7f4321578740 1 client.26551 shutdown 2024-05-14T12:43:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.614+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 msgr2=0x5589544bdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.614+0000 7f4321578740 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544bdc70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f43040c4e30 tx=0x7f43040c88c0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 shutdown_connections 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540d0d80 0x5589544cb4c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540f14d0 0x5589544be1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 --2- 172.21.15.47:0/4219839594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540e92f0 0x5589544bdc70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 >> 172.21.15.47:0/4219839594 conn(0x558954106300 msgr2=0x5589544aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f42fd600640 0 client.26551 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 shutdown_connections 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 1 -- 172.21.15.47:0/4219839594 wait complete. 2024-05-14T12:43:23.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.615+0000 7f4321578740 20 client.26551 trim_cache size 0 max 16384 2024-05-14T12:43:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.632+0000 7f4321578740 1 Processor -- start 2024-05-14T12:43:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.632+0000 7f4321578740 1 -- start start 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4321578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540e92f0 0x5589544bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4321578740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4321578740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4321578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43141ad530 con 0x5589540e92f0 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4321578740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43141af160 con 0x5589541121b0 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4321578740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43141adc30 con 0x5589540f14d0 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540e92f0 0x5589544bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:57778/0 (socket says 172.21.15.47:57778) 2024-05-14T12:43:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 -- 172.21.15.47:0/3750560752 learned_addr learned my addr 172.21.15.47:0/3750560752 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4312a00640 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 -- 172.21.15.47:0/3750560752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 msgr2=0x5589544c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 -- 172.21.15.47:0/3750560752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540e92f0 msgr2=0x5589544bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540e92f0 0x5589544bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313e00640 1 -- 172.21.15.47:0/3750560752 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589544bed00 con 0x5589541121b0 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4312a00640 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.633+0000 7f4313400640 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540e92f0 0x5589544bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.634+0000 7f4313e00640 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544cfcb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f430c01a000 tx=0x7f430c021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2743d79690ef0094 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.634+0000 7f42ffe00640 1 -- 172.21.15.47:0/3750560752 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c00e940 con 0x5589541121b0 2024-05-14T12:43:23.637 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.634+0000 7f42ffe00640 1 -- 172.21.15.47:0/3750560752 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f430c011a10 con 0x5589541121b0 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.634+0000 7f42ffe00640 1 -- 172.21.15.47:0/3750560752 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c005480 con 0x5589541121b0 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 -- 172.21.15.47:0/3750560752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 msgr2=0x5589544cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544cfcb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f430c01a000 tx=0x7f430c021000 comp rx=0 tx=0).stop 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 -- 172.21.15.47:0/3750560752 shutdown_connections 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589541121b0 0x5589544cfcb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 --2- 172.21.15.47:0/3750560752 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589540e92f0 0x5589544bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 -- 172.21.15.47:0/3750560752 >> 172.21.15.47:0/3750560752 conn(0x558954106300 msgr2=0x5589544bd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 -- 172.21.15.47:0/3750560752 shutdown_connections 2024-05-14T12:43:23.638 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.635+0000 7f4321578740 1 -- 172.21.15.47:0/3750560752 wait complete. 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 -- start start 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 Processor -- start 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540e92f0 0x5589544c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x558954531860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43141aea90 con 0x5589541121b0 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43141ae3c0 con 0x5589540e92f0 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43141ab4f0 con 0x5589540f14d0 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.636+0000 7f4321578740 10 client.0 _ll_register_callbacks cb 0x7f430402af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x558954531860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540e92f0 0x5589544c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x558954531860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47720/0 (socket says 172.21.15.47:47720) 2024-05-14T12:43:23.639 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 -- 172.21.15.47:0/868839304 learned_addr learned my addr 172.21.15.47:0/868839304 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4312a00640 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 -- 172.21.15.47:0/868839304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 msgr2=0x5589544c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 -- 172.21.15.47:0/868839304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540e92f0 msgr2=0x5589544c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540e92f0 0x5589544c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 -- 172.21.15.47:0/868839304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558954531da0 con 0x5589541121b0 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313400640 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540e92f0 0x5589544c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f4313e00640 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x558954531860 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f430c0099b0 tx=0x7f430c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abd62cf244f1b90 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:23.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.637+0000 7f42fd600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f42fd600640 1 -- 172.21.15.47:0/868839304 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c011560 con 0x5589541121b0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f42fd600640 1 -- 172.21.15.47:0/868839304 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f430c011700 con 0x5589541121b0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f430c011a10 con 0x5589541121b0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f42fd600640 1 -- 172.21.15.47:0/868839304 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f430c005380 con 0x5589541121b0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f4321578740 10 client.16359 fetch_fsmap learned FSMap version 64 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x558954532f50 con 0x5589541121b0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f42fd600640 1 -- 172.21.15.47:0/868839304 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f430c011a10 con 0x5589541121b0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f42fd600640 1 -- 172.21.15.47:0/868839304 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7f430c01b840 con 0x5589541121b0 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.638+0000 7f4321578740 10 client.16359 fetch_fsmap finished waiting for FSMap version 64 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f4321578740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f4321578740 20 client.16359 populate_metadata read hostname 'smithi047' 2024-05-14T12:43:23.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f4321578740 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540a61c0 0x558954535740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f4321578740 4 client.16359 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:43:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55895441ffd0 con 0x5589540a61c0 2024-05-14T12:43:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f4313400640 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540a61c0 0x558954535740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f4313400640 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540a61c0 0x558954535740 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdfaeeee52cfec81 server_cookie=6123e549f2b68fa1 in_seq=0 out_seq=0 2024-05-14T12:43:23.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:23.639+0000 7f42fd600640 10 client.16359 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:24.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:24 smithi066 ceph-mon[35981]: pgmap v996: 97 pgs: 97 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 26 op/s 2024-05-14T12:43:24.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:24 smithi047 ceph-mon[31254]: pgmap v996: 97 pgs: 97 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 26 op/s 2024-05-14T12:43:24.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:24 smithi073 ceph-mon[35809]: pgmap v996: 97 pgs: 97 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 26 op/s 2024-05-14T12:43:25.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:25 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:25.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:25 smithi047 ceph-mon[31254]: pgmap v997: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 26 op/s 2024-05-14T12:43:25.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:25 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:25.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:25 smithi073 ceph-mon[35809]: pgmap v997: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 26 op/s 2024-05-14T12:43:25.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:25 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:25.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:25 smithi066 ceph-mon[35981]: pgmap v997: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 26 op/s 2024-05-14T12:43:28.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:27 smithi047 ceph-mon[31254]: pgmap v998: 97 pgs: 97 active+clean; 905 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 KiB/s wr, 44 op/s 2024-05-14T12:43:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:27 smithi073 ceph-mon[35809]: pgmap v998: 97 pgs: 97 active+clean; 905 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 KiB/s wr, 44 op/s 2024-05-14T12:43:28.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:27 smithi066 ceph-mon[35981]: pgmap v998: 97 pgs: 97 active+clean; 905 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 KiB/s wr, 44 op/s 2024-05-14T12:43:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.456+0000 7f42fd600640 1 -- 172.21.15.47:0/868839304 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55895441ffd0 con 0x5589540a61c0 2024-05-14T12:43:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.457+0000 7f42fd600640 10 client.16359 handle_command_reply: tid=0 2024-05-14T12:43:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.457+0000 7f4321578740 1 client.16359 shutdown 2024-05-14T12:43:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.457+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 msgr2=0x558954531860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.457+0000 7f4321578740 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x558954531860 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f430c0099b0 tx=0x7f430c005030 comp rx=0 tx=0).stop 2024-05-14T12:43:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 shutdown_connections 2024-05-14T12:43:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x5589540a61c0 0x558954535740 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589541121b0 0x558954531860 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589540f14d0 0x5589544c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 --2- 172.21.15.47:0/868839304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589540e92f0 0x5589544c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f42fd600640 0 client.16359 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 >> 172.21.15.47:0/868839304 conn(0x558954106300 msgr2=0x5589544b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 shutdown_connections 2024-05-14T12:43:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.458+0000 7f4321578740 1 -- 172.21.15.47:0/868839304 wait complete. 2024-05-14T12:43:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.459+0000 7f4321578740 20 client.16359 trim_cache size 0 max 16384 2024-05-14T12:43:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:43:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:43:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:43:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f42f80b27b0 msgr2=0x7f42f80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f42f80b27b0 0x7f42f80b4cc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f430c009e10 tx=0x7f430c009c10 comp rx=0 tx=0).stop 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 msgr2=0x7f431419c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f431419c4d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4304009780 tx=0x7f4304032d50 comp rx=0 tx=0).stop 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 shutdown_connections 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f42f80b27b0 0x7f42f80b4cc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43141098c0 0x7f43141a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4314106d90 0x7f431419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 --2- 172.21.15.47:0/2802645076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43141043a0 0x7f431419c4d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 >> 172.21.15.47:0/2802645076 conn(0x7f43140fdd60 msgr2=0x7f4314103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 shutdown_connections 2024-05-14T12:43:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:28.460+0000 7f431a600640 1 -- 172.21.15.47:0/2802645076 wait complete. 2024-05-14T12:43:30.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:29 smithi047 ceph-mon[31254]: pgmap v999: 97 pgs: 97 active+clean; 857 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 41 op/s 2024-05-14T12:43:30.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:29 smithi073 ceph-mon[35809]: pgmap v999: 97 pgs: 97 active+clean; 857 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 41 op/s 2024-05-14T12:43:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:29 smithi066 ceph-mon[35981]: pgmap v999: 97 pgs: 97 active+clean; 857 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 41 op/s 2024-05-14T12:43:31.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:30 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:31.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:30 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:31.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:30 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:32.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:32 smithi066 ceph-mon[35981]: pgmap v1000: 97 pgs: 97 active+clean; 785 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 61 KiB/s wr, 54 op/s 2024-05-14T12:43:32.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:32 smithi047 ceph-mon[31254]: pgmap v1000: 97 pgs: 97 active+clean; 785 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 61 KiB/s wr, 54 op/s 2024-05-14T12:43:32.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:32 smithi073 ceph-mon[35809]: pgmap v1000: 97 pgs: 97 active+clean; 785 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 61 KiB/s wr, 54 op/s 2024-05-14T12:43:33.085 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-14T12:43:33.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-14T12:43:33.192 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-05-14T12:43:33.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-14T12:43:33.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:33 smithi066 ceph-mon[35981]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:33.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:33 smithi047 ceph-mon[31254]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:33.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:33 smithi073 ceph-mon[35809]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T12:43:34.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:34 smithi066 ceph-mon[35981]: pgmap v1001: 97 pgs: 97 active+clean; 705 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 73 KiB/s wr, 56 op/s 2024-05-14T12:43:34.331 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:34 smithi047 ceph-mon[31254]: pgmap v1001: 97 pgs: 97 active+clean; 705 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 73 KiB/s wr, 56 op/s 2024-05-14T12:43:34.335 DEBUG:teuthology.parallel:result is None 2024-05-14T12:43:34.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-14T12:43:34.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:34 smithi073 ceph-mon[35809]: pgmap v1001: 97 pgs: 97 active+clean; 705 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 73 KiB/s wr, 56 op/s 2024-05-14T12:43:35.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:35 smithi066 ceph-mon[35981]: pgmap v1002: 97 pgs: 97 active+clean; 677 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 68 KiB/s wr, 54 op/s 2024-05-14T12:43:35.445 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:35 smithi047 ceph-mon[31254]: pgmap v1002: 97 pgs: 97 active+clean; 677 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 68 KiB/s wr, 54 op/s 2024-05-14T12:43:35.449 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-14T12:43:35.449 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-14T12:43:35.460 INFO:tasks.quiescer:joining Quiescers 2024-05-14T12:43:35.460 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-14T12:43:35.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:43:35.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:35 smithi073 ceph-mon[35809]: pgmap v1002: 97 pgs: 97 active+clean; 677 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 68 KiB/s wr, 54 op/s 2024-05-14T12:43:35.923 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:43:37.993 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:37 smithi047 ceph-mon[31254]: pgmap v1003: 97 pgs: 97 active+clean; 621 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 62 op/s 2024-05-14T12:43:38.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:37 smithi073 ceph-mon[35809]: pgmap v1003: 97 pgs: 97 active+clean; 621 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 62 op/s 2024-05-14T12:43:38.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:37 smithi066 ceph-mon[35981]: pgmap v1003: 97 pgs: 97 active+clean; 621 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 62 op/s 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.334+0000 7efeb0800700 1 -- 172.21.15.47:0/4011151928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea81045f0 msgr2=0x7efea8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.334+0000 7efeb0800700 1 --2- 172.21.15.47:0/4011151928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea81045f0 0x7efea8104a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009920 tx=0x7efe9c009c30 comp rx=0 tx=0).stop 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.334+0000 7efeb0800700 1 -- 172.21.15.47:0/4011151928 shutdown_connections 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.334+0000 7efeb0800700 1 --2- 172.21.15.47:0/4011151928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea8109870 0x7efea81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.334+0000 7efeb0800700 1 --2- 172.21.15.47:0/4011151928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea81045f0 0x7efea8104a00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.334+0000 7efeb0800700 1 --2- 172.21.15.47:0/4011151928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea8108f20 0x7efea8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.334+0000 7efeb0800700 1 -- 172.21.15.47:0/4011151928 >> 172.21.15.47:0/4011151928 conn(0x7efea8100040 msgr2=0x7efea8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.335+0000 7efeb0800700 1 -- 172.21.15.47:0/4011151928 shutdown_connections 2024-05-14T12:43:38.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.335+0000 7efeb0800700 1 -- 172.21.15.47:0/4011151928 wait complete. 2024-05-14T12:43:38.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.336+0000 7efeb0800700 1 Processor -- start 2024-05-14T12:43:38.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.336+0000 7efeb0800700 1 -- start start 2024-05-14T12:43:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeb0800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea81045f0 0x7efea819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeb0800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea8108f20 0x7efea819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeb0800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea8109870 0x7efea81a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeb0800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efea81144f0 con 0x7efea81045f0 2024-05-14T12:43:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeb0800700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efea8114370 con 0x7efea8109870 2024-05-14T12:43:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeb0800700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efea8114670 con 0x7efea8108f20 2024-05-14T12:43:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeae800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea8109870 0x7efea81a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efead400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea8108f20 0x7efea819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeade00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea81045f0 0x7efea819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeae800700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea8109870 0x7efea81a19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51250/0 (socket says 172.21.15.47:51250) 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.337+0000 7efeae800700 1 -- 172.21.15.47:0/4047633324 learned_addr learned my addr 172.21.15.47:0/4047633324 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efead400700 1 -- 172.21.15.47:0/4047633324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea8109870 msgr2=0x7efea81a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efead400700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea8109870 0x7efea81a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efead400700 1 -- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea81045f0 msgr2=0x7efea819d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efead400700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea81045f0 0x7efea819d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efead400700 1 -- 172.21.15.47:0/4047633324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea81a2050 con 0x7efea8108f20 2024-05-14T12:43:38.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efead400700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea8108f20 0x7efea819d720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efe9800e9c0 tx=0x7efe9800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efea2a00700 1 -- 172.21.15.47:0/4047633324 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9800c9c0 con 0x7efea8108f20 2024-05-14T12:43:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efea2a00700 1 -- 172.21.15.47:0/4047633324 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe9800cb60 con 0x7efea8108f20 2024-05-14T12:43:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea81a2340 con 0x7efea8108f20 2024-05-14T12:43:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.338+0000 7efea2a00700 1 -- 172.21.15.47:0/4047633324 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98018680 con 0x7efea8108f20 2024-05-14T12:43:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.339+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea81a9c60 con 0x7efea8108f20 2024-05-14T12:43:38.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.340+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea80512c0 con 0x7efea8108f20 2024-05-14T12:43:38.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.343+0000 7efea2a00700 1 -- 172.21.15.47:0/4047633324 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efe98010430 con 0x7efea8108f20 2024-05-14T12:43:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.344+0000 7efea2a00700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efe900b2900 0x7efe900b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.345+0000 7efea2a00700 1 -- 172.21.15.47:0/4047633324 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efe980e2370 con 0x7efea8108f20 2024-05-14T12:43:38.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.345+0000 7efeade00700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efe900b2900 0x7efe900b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:38.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.345+0000 7efeade00700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efe900b2900 0x7efe900b4e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0098f0 tx=0x7efe9c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.349+0000 7efea2a00700 1 -- 172.21.15.47:0/4047633324 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efe980aa050 con 0x7efea8108f20 2024-05-14T12:43:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.634+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efea81a9e30 con 0x7efea8108f20 2024-05-14T12:43:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.635+0000 7efea2a00700 1 -- 172.21.15.47:0/4047633324 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+11938 (secure 0 0 0) 0x7efe980b20d0 con 0x7efea8108f20 2024-05-14T12:43:38.636 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:43:38.637 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":67,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":67,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:43:31.996114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24521,24535,24517,24502,24490]},"id":1}]} 2024-05-14T12:43:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efe900b2900 msgr2=0x7efe900b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efe900b2900 0x7efe900b4e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0098f0 tx=0x7efe9c019040 comp rx=0 tx=0).stop 2024-05-14T12:43:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea8108f20 msgr2=0x7efea819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea8108f20 0x7efea819d720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efe9800e9c0 tx=0x7efe9800ecd0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 shutdown_connections 2024-05-14T12:43:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7efe900b2900 0x7efe900b4e10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea8109870 0x7efea81a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efea81045f0 0x7efea819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 --2- 172.21.15.47:0/4047633324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efea8108f20 0x7efea819d720 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 >> 172.21.15.47:0/4047633324 conn(0x7efea8100040 msgr2=0x7efea810a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.639+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 shutdown_connections 2024-05-14T12:43:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:38.640+0000 7efeb0800700 1 -- 172.21.15.47:0/4047633324 wait complete. 2024-05-14T12:43:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 67 2024-05-14T12:43:39.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:38 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/4047633324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:43:39.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:38 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/4047633324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:43:39.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:38 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/4047633324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:43:39.404 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24535 quiesce db --cancel --all' 2024-05-14T12:43:39.404 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24535 quiesce db --cancel --all 2024-05-14T12:43:39.862 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:43:40.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:39 smithi047 ceph-mon[31254]: pgmap v1004: 97 pgs: 97 active+clean; 581 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 45 op/s 2024-05-14T12:43:40.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:39 smithi073 ceph-mon[35809]: pgmap v1004: 97 pgs: 97 active+clean; 581 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 45 op/s 2024-05-14T12:43:40.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:39 smithi066 ceph-mon[35981]: pgmap v1004: 97 pgs: 97 active+clean; 581 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 45 op/s 2024-05-14T12:43:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 -- 172.21.15.47:0/3846421379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 msgr2=0x7f3f4c106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 --2- 172.21.15.47:0/3846421379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c106b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009900 tx=0x7f3f3c02a410 comp rx=0 tx=0).stop 2024-05-14T12:43:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 -- 172.21.15.47:0/3846421379 shutdown_connections 2024-05-14T12:43:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 --2- 172.21.15.47:0/3846421379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f4c109a00 0x7f3f4c10be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 --2- 172.21.15.47:0/3846421379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1070a0 0x7f3f4c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 --2- 172.21.15.47:0/3846421379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c106b60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 -- 172.21.15.47:0/3846421379 >> 172.21.15.47:0/3846421379 conn(0x7f3f4c0fdd40 msgr2=0x7f3f4c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 -- 172.21.15.47:0/3846421379 shutdown_connections 2024-05-14T12:43:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.715+0000 7f3f51e00640 1 -- 172.21.15.47:0/3846421379 wait complete. 2024-05-14T12:43:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.716+0000 7f3f51e00640 1 Processor -- start 2024-05-14T12:43:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.716+0000 7f3f51e00640 1 -- start start 2024-05-14T12:43:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c19c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1070a0 0x7f3f4c19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f4c109a00 0x7f3f4c1a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f51e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c10f780 con 0x7f3f4c109a00 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f51e00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c10f600 con 0x7f3f4c1070a0 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f51e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c10f900 con 0x7f3f4c104740 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f4aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c19c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f4aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c19c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53024/0 (socket says 172.21.15.47:53024) 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f4aa00640 1 -- 172.21.15.47:0/1715161910 learned_addr learned my addr 172.21.15.47:0/1715161910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f4b400640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f4c109a00 0x7f3f4c1a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.719 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.717+0000 7f3f4a000640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1070a0 0x7f3f4c19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f4aa00640 1 -- 172.21.15.47:0/1715161910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1070a0 msgr2=0x7f3f4c19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f4aa00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1070a0 0x7f3f4c19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f4aa00640 1 -- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f4c109a00 msgr2=0x7f3f4c1a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f4aa00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f4c109a00 0x7f3f4c1a39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f4aa00640 1 -- 172.21.15.47:0/1715161910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c1a4030 con 0x7f3f4c104740 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f4a000640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1070a0 0x7f3f4c19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f4aa00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c19c4f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c031440 tx=0x7f3f3c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f50a00640 1 -- 172.21.15.47:0/1715161910 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c03f070 con 0x7f3f4c104740 2024-05-14T12:43:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f50a00640 1 -- 172.21.15.47:0/1715161910 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f3c031c50 con 0x7f3f4c104740 2024-05-14T12:43:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c1a42c0 con 0x7f3f4c104740 2024-05-14T12:43:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f50a00640 1 -- 172.21.15.47:0/1715161910 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c035030 con 0x7f3f4c104740 2024-05-14T12:43:41.721 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.718+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c1a4800 con 0x7f3f4c104740 2024-05-14T12:43:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 Processor -- start 2024-05-14T12:43:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f50a00640 1 -- 172.21.15.47:0/1715161910 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3f3c042070 con 0x7f3f4c104740 2024-05-14T12:43:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 -- start start 2024-05-14T12:43:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3014d0 0x559a2f6cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559a2f628550 con 0x559a2f2f92f0 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a2f5cdbc0 con 0x559a2f3014d0 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.722+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559a2f624510 con 0x559a2f3221b0 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53026/0 (socket says 172.21.15.47:53026) 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 -- 172.21.15.47:0/3541843957 learned_addr learned my addr 172.21.15.47:0/3541843957 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4a000640 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3014d0 0x559a2f6cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4aa00640 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 -- 172.21.15.47:0/3541843957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3014d0 msgr2=0x559a2f6cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3014d0 0x559a2f6cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 -- 172.21.15.47:0/3541843957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 msgr2=0x559a2f6c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 -- 172.21.15.47:0/3541843957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a2f33a210 con 0x559a2f3221b0 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.723+0000 7f3f4b400640 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6c4100 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009f90 tx=0x7f3f440118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd756e8b5b86265a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.724+0000 7f3f37e00640 1 -- 172.21.15.47:0/3541843957 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44004d20 con 0x559a2f3221b0 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.724+0000 7f3f37e00640 1 -- 172.21.15.47:0/3541843957 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f44004050 con 0x559a2f3221b0 2024-05-14T12:43:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.724+0000 7f3f37e00640 1 -- 172.21.15.47:0/3541843957 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44005280 con 0x559a2f3221b0 2024-05-14T12:43:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.724+0000 7f3f50a00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f300b2920 0x7f3f300b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.724+0000 7f3f50a00640 1 -- 172.21.15.47:0/1715161910 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3f3c1029b0 con 0x7f3f4c104740 2024-05-14T12:43:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.724+0000 7f3f4aa00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f300b2920 0x7f3f300b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 -- 172.21.15.47:0/3541843957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 msgr2=0x559a2f6c4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6c4100 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009f90 tx=0x7f3f440118d0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 -- 172.21.15.47:0/3541843957 shutdown_connections 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3014d0 0x559a2f6cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/3541843957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6c4100 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 -- 172.21.15.47:0/3541843957 >> 172.21.15.47:0/3541843957 conn(0x559a2f316300 msgr2=0x559a2f6bfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 -- 172.21.15.47:0/3541843957 shutdown_connections 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 -- 172.21.15.47:0/3541843957 wait complete. 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f4aa00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f300b2920 0x7f3f300b4e30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0c9c90 tx=0x7f3f3c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.725+0000 7f3f58e4a740 1 -- start start 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 1 Processor -- start 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3221b0 0x559a2f6d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559a2f6cbfd0 con 0x559a2f2f92f0 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a2f5e1660 con 0x559a2f3221b0 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559a2f6cc150 con 0x559a2f3014d0 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.726+0000 7f3f58e4a740 10 client.0 _ll_register_callbacks cb 0x559a2f5ab400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53042/0 (socket says 172.21.15.47:53042) 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 -- 172.21.15.47:0/2156673074 learned_addr learned my addr 172.21.15.47:0/2156673074 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3221b0 0x559a2f6d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 -- 172.21.15.47:0/2156673074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3221b0 msgr2=0x559a2f6d50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3221b0 0x559a2f6d50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 -- 172.21.15.47:0/2156673074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 msgr2=0x559a2f6cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 -- 172.21.15.47:0/2156673074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a2f406620 con 0x559a2f3014d0 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3221b0 0x559a2f6d50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f4a000640 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6ce140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f38012700 tx=0x7f3f38012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bebc66380ac746ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.727+0000 7f3f34c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-05-14T12:43:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f34c00640 1 -- 172.21.15.47:0/2156673074 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38004260 con 0x559a2f3014d0 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f34c00640 1 -- 172.21.15.47:0/2156673074 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3f38004400 con 0x559a2f3014d0 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f44004050 con 0x559a2f3014d0 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f34c00640 1 -- 172.21.15.47:0/2156673074 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f3f380119a0 con 0x559a2f3014d0 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f58e4a740 10 client.26575 fetch_fsmap learned FSMap version 67 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x559a2f6d80a0 con 0x559a2f3014d0 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f34c00640 1 -- 172.21.15.47:0/2156673074 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f44004050 con 0x559a2f3014d0 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f34c00640 1 -- 172.21.15.47:0/2156673074 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 67) ==== 8398+0+0 (secure 0 0 0) 0x7f3f3800f440 con 0x559a2f3014d0 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f58e4a740 10 client.26575 fetch_fsmap finished waiting for FSMap version 67 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f58e4a740 10 client.26575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:43:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f58e4a740 20 client.26575 populate_metadata read hostname 'smithi047' 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.728+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2e0d80 0x559a2f6db7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.729+0000 7f3f58e4a740 4 client.26575 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.729+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a2f636160 con 0x559a2f2e0d80 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.729+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2e0d80 0x559a2f6db7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.729+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2e0d80 0x559a2f6db7a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77622708bc5aa64e server_cookie=6836bde122feb92e in_seq=0 out_seq=0 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.729+0000 7f3f34c00640 10 client.26575 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.730+0000 7f3f34c00640 1 -- 172.21.15.47:0/2156673074 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559a2f636160 con 0x559a2f2e0d80 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.730+0000 7f3f34c00640 10 client.26575 handle_command_reply: tid=0 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.730+0000 7f3f58e4a740 1 client.26575 shutdown 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 msgr2=0x559a2f6ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6ce140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f38012700 tx=0x7f3f38012bc0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 shutdown_connections 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2e0d80 0x559a2f6db7a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f3221b0 0x559a2f6d50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6ce140 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2156673074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f2f92f0 0x559a2f6cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 >> 172.21.15.47:0/2156673074 conn(0x559a2f316300 msgr2=0x559a2f6bea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f34c00640 0 client.26575 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 shutdown_connections 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2156673074 wait complete. 2024-05-14T12:43:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.731+0000 7f3f58e4a740 20 client.26575 trim_cache size 0 max 16384 2024-05-14T12:43:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.748+0000 7f3f58e4a740 1 Processor -- start 2024-05-14T12:43:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.748+0000 7f3f58e4a740 1 -- start start 2024-05-14T12:43:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3221b0 0x559a2f6e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1ad600 con 0x559a2f3221b0 2024-05-14T12:43:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1af2c0 con 0x559a2f2f92f0 2024-05-14T12:43:41.749 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1add90 con 0x559a2f3014d0 2024-05-14T12:43:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53054/0 (socket says 172.21.15.47:53054) 2024-05-14T12:43:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51280/0 (socket says 172.21.15.47:51280) 2024-05-14T12:43:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f4a000640 1 -- 172.21.15.47:0/844110362 learned_addr learned my addr 172.21.15.47:0/844110362 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.749+0000 7f3f4b400640 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3221b0 0x559a2f6e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f4a000640 1 -- 172.21.15.47:0/844110362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 msgr2=0x559a2f6c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f4a000640 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f4a000640 1 -- 172.21.15.47:0/844110362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3221b0 msgr2=0x559a2f6e0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f4a000640 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3221b0 0x559a2f6e0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f4a000640 1 -- 172.21.15.47:0/844110362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a2f6c8a60 con 0x559a2f3014d0 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f4a000640 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6c34e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009dc0 tx=0x7f3f380118b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f6dd17647ef983d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f37400640 1 -- 172.21.15.47:0/844110362 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800f5c0 con 0x559a2f3014d0 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f37400640 1 -- 172.21.15.47:0/844110362 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f3800faa0 con 0x559a2f3014d0 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.750+0000 7f3f37400640 1 -- 172.21.15.47:0/844110362 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38003890 con 0x559a2f3014d0 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 -- 172.21.15.47:0/844110362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 msgr2=0x559a2f6c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6c34e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009dc0 tx=0x7f3f380118b0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 -- 172.21.15.47:0/844110362 shutdown_connections 2024-05-14T12:43:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3221b0 0x559a2f6e0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3014d0 0x559a2f6c34e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/844110362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 -- 172.21.15.47:0/844110362 >> 172.21.15.47:0/844110362 conn(0x559a2f316300 msgr2=0x559a2f6c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.751+0000 7f3f58e4a740 1 -- 172.21.15.47:0/844110362 shutdown_connections 2024-05-14T12:43:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.752+0000 7f3f58e4a740 1 -- 172.21.15.47:0/844110362 wait complete. 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.752+0000 7f3f58e4a740 1 -- start start 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.752+0000 7f3f58e4a740 1 Processor -- start 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3014d0 0x559a2f6d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f58e4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6d4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1aebf0 con 0x559a2f3014d0 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1ae520 con 0x559a2f2f92f0 2024-05-14T12:43:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f58e4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1ab5c0 con 0x559a2f3221b0 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f58e4a740 10 client.0 _ll_register_callbacks cb 0x7f3f38009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51288/0 (socket says 172.21.15.47:51288) 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 -- 172.21.15.47:0/2725477850 learned_addr learned my addr 172.21.15.47:0/2725477850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6d4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4a000640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3014d0 0x559a2f6d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 -- 172.21.15.47:0/2725477850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 msgr2=0x559a2f6d4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6d4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 -- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3014d0 msgr2=0x559a2f6d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3014d0 0x559a2f6d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4b400640 1 -- 172.21.15.47:0/2725477850 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a2f6d4be0 con 0x559a2f2f92f0 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.753+0000 7f3f4a000640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3014d0 0x559a2f6d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f4b400640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6d31b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009f30 tx=0x7f3f440118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8352244a7e52ef48 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f34c00640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f34c00640 1 -- 172.21.15.47:0/2725477850 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44032040 con 0x559a2f2f92f0 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f3800faa0 con 0x559a2f2f92f0 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f34c00640 1 -- 172.21.15.47:0/2725477850 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3f440045b0 con 0x559a2f2f92f0 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f34c00640 1 -- 172.21.15.47:0/2725477850 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f3f44004930 con 0x559a2f2f92f0 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f58e4a740 10 client.26555 fetch_fsmap learned FSMap version 67 2024-05-14T12:43:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x559a2f743c10 con 0x559a2f2f92f0 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f34c00640 1 -- 172.21.15.47:0/2725477850 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f3800faa0 con 0x559a2f2f92f0 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.754+0000 7f3f34c00640 1 -- 172.21.15.47:0/2725477850 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 67) ==== 8398+0+0 (secure 0 0 0) 0x7f3f44036060 con 0x559a2f2f92f0 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f58e4a740 10 client.26555 fetch_fsmap finished waiting for FSMap version 67 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f58e4a740 10 client.26555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f58e4a740 20 client.26555 populate_metadata read hostname 'smithi047' 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2b61c0 0x559a2f746400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f58e4a740 4 client.26555 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559a2f62ffd0 con 0x559a2f2b61c0 2024-05-14T12:43:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f4a000640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2b61c0 0x559a2f746400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f4a000640 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2b61c0 0x559a2f746400 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2125217395139ad server_cookie=3a5ae93ee3a3685e in_seq=0 out_seq=0 2024-05-14T12:43:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:41.755+0000 7f3f34c00640 10 client.26555 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:42.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 -- 172.21.15.47:0/2281351892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73410c5c0 msgr2=0x7ff73410c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:42.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 --2- 172.21.15.47:0/2281351892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73410c5c0 0x7ff73410c9d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff724009990 tx=0x7ff724009ca0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.096 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:41 smithi047 ceph-mon[31254]: pgmap v1005: 97 pgs: 97 active+clean; 493 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 48 op/s 2024-05-14T12:43:42.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 -- 172.21.15.47:0/2281351892 shutdown_connections 2024-05-14T12:43:42.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 --2- 172.21.15.47:0/2281351892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734106ed0 0x7ff734113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 --2- 172.21.15.47:0/2281351892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff73410c5c0 0x7ff73410c9d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 --2- 172.21.15.47:0/2281351892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff734106580 0x7ff734106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 -- 172.21.15.47:0/2281351892 >> 172.21.15.47:0/2281351892 conn(0x7ff734102080 msgr2=0x7ff7341044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:42.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 -- 172.21.15.47:0/2281351892 shutdown_connections 2024-05-14T12:43:42.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.095+0000 7ff738e00700 1 -- 172.21.15.47:0/2281351892 wait complete. 2024-05-14T12:43:42.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 Processor -- start 2024-05-14T12:43:42.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 -- start start 2024-05-14T12:43:42.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff734106580 0x7ff73419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734106ed0 0x7ff73419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff73410c5c0 0x7ff7341a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff734116720 con 0x7ff734106ed0 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341165a0 con 0x7ff734106580 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.097+0000 7ff738e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341168a0 con 0x7ff73410c5c0 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff731e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff734106580 0x7ff73419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff731400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734106ed0 0x7ff73419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff732800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff73410c5c0 0x7ff7341a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff731e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff734106580 0x7ff73419d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51306/0 (socket says 172.21.15.47:51306) 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff732800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff73410c5c0 0x7ff7341a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53070/0 (socket says 172.21.15.47:53070) 2024-05-14T12:43:42.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff731e00700 1 -- 172.21.15.47:0/130628886 learned_addr learned my addr 172.21.15.47:0/130628886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff732800700 1 -- 172.21.15.47:0/130628886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff734106580 msgr2=0x7ff73419d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff732800700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff734106580 0x7ff73419d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff732800700 1 -- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734106ed0 msgr2=0x7ff73419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff732800700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734106ed0 0x7ff73419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.098+0000 7ff732800700 1 -- 172.21.15.47:0/130628886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7341a1f40 con 0x7ff73410c5c0 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.099+0000 7ff732800700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff73410c5c0 0x7ff7341a18a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00efc0 tx=0x7ff72c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.099+0000 7ff72aa00700 1 -- 172.21.15.47:0/130628886 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0092e0 con 0x7ff73410c5c0 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.099+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7341a21d0 con 0x7ff73410c5c0 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.099+0000 7ff72aa00700 1 -- 172.21.15.47:0/130628886 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff72c004bb0 con 0x7ff73410c5c0 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.099+0000 7ff72aa00700 1 -- 172.21.15.47:0/130628886 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c004020 con 0x7ff73410c5c0 2024-05-14T12:43:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.099+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7341a9b50 con 0x7ff73410c5c0 2024-05-14T12:43:42.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.103+0000 7ff72aa00700 1 -- 172.21.15.47:0/130628886 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff72c01b030 con 0x7ff73410c5c0 2024-05-14T12:43:42.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.104+0000 7ff747910b80 1 Processor -- start 2024-05-14T12:43:42.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.104+0000 7ff72aa00700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7180b2880 0x7ff7180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.104+0000 7ff747910b80 1 -- start start 2024-05-14T12:43:42.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.104+0000 7ff72aa00700 1 -- 172.21.15.47:0/130628886 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff72c0e1d30 con 0x7ff73410c5c0 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff731400700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7180b2880 0x7ff7180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff747910b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b810bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff747910b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b8110350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff747910b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8110ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff747910b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e3b802da90 con 0x55e3b810c0b0 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff747910b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e3b7fcb7d0 con 0x55e3b7f8deb0 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff747910b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8029a50 con 0x55e3b8110890 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff731e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b810bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff732800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8110ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff731e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b810bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51312/0 (socket says 172.21.15.47:51312) 2024-05-14T12:43:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff731e00700 1 -- 172.21.15.47:0/1400695694 learned_addr learned my addr 172.21.15.47:0/1400695694 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.105+0000 7ff731400700 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b8110350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff731e00700 1 -- 172.21.15.47:0/1400695694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 msgr2=0x55e3b8110ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff731e00700 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8110ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff731e00700 1 -- 172.21.15.47:0/1400695694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 msgr2=0x55e3b8110350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff731e00700 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b8110350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff731e00700 1 -- 172.21.15.47:0/1400695694 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b7f7a940 con 0x55e3b7f8deb0 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff731400700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7180b2880 0x7ff7180b4d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff720009680 tx=0x7ff720011720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:42.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff731e00700 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b810bb70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff7240096d0 tx=0x7ff724009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=768670278e4263bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff71f400700 1 -- 172.21.15.47:0/1400695694 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724027070 con 0x55e3b7f8deb0 2024-05-14T12:43:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff71f400700 1 -- 172.21.15.47:0/1400695694 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff72400bbd0 con 0x55e3b7f8deb0 2024-05-14T12:43:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.106+0000 7ff71f400700 1 -- 172.21.15.47:0/1400695694 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724003d60 con 0x55e3b7f8deb0 2024-05-14T12:43:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 -- 172.21.15.47:0/1400695694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 msgr2=0x55e3b810bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b810bb70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff7240096d0 tx=0x7ff724009700 comp rx=0 tx=0).stop 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 -- 172.21.15.47:0/1400695694 shutdown_connections 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b810bb70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 --2- 172.21.15.47:0/1400695694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b8110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 -- 172.21.15.47:0/1400695694 >> 172.21.15.47:0/1400695694 conn(0x55e3b7fd2fe0 msgr2=0x55e3b81068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.107+0000 7ff747910b80 1 -- 172.21.15.47:0/1400695694 shutdown_connections 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.108+0000 7ff747910b80 1 -- 172.21.15.47:0/1400695694 wait complete. 2024-05-14T12:43:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.108+0000 7ff747910b80 1 -- start start 2024-05-14T12:43:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.108+0000 7ff747910b80 1 Processor -- start 2024-05-14T12:43:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff747910b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7f8deb0 0x55e3b8115600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff747910b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b810c0b0 0x55e3b8115b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff747910b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8116080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff747910b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8118780 con 0x55e3b7f8deb0 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff747910b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e3b7f93b90 con 0x55e3b810c0b0 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff747910b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e3b8118900 con 0x55e3b8110890 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff747910b80 10 client.0 _ll_register_callbacks cb 0x55e3b7fd4ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff731e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7f8deb0 0x55e3b8115600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff731e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7f8deb0 0x55e3b8115600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36890/0 (socket says 172.21.15.47:36890) 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff731400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b810c0b0 0x55e3b8115b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.109+0000 7ff731e00700 1 -- 172.21.15.47:0/4070017756 learned_addr learned my addr 172.21.15.47:0/4070017756 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff732800700 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8116080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff731400700 1 -- 172.21.15.47:0/4070017756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 msgr2=0x55e3b8116080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff731400700 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8116080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff731400700 1 -- 172.21.15.47:0/4070017756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7f8deb0 msgr2=0x55e3b8115600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff731400700 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7f8deb0 0x55e3b8115600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff731400700 1 -- 172.21.15.47:0/4070017756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b7ff3490 con 0x55e3b810c0b0 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff731400700 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b810c0b0 0x55e3b8115b40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff734103c00 tx=0x7ff7200047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17c1abf078f81f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.110+0000 7ff713e00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff713e00700 1 -- 172.21.15.47:0/4070017756 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720017040 con 0x55e3b810c0b0 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff713e00700 1 -- 172.21.15.47:0/4070017756 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff72001e220 con 0x55e3b810c0b0 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff72400bbd0 con 0x55e3b810c0b0 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff713e00700 1 -- 172.21.15.47:0/4070017756 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7ff72000f650 con 0x55e3b810c0b0 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff747910b80 10 client.26567 fetch_fsmap learned FSMap version 67 2024-05-14T12:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55e3b8123490 con 0x55e3b810c0b0 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff713e00700 1 -- 172.21.15.47:0/4070017756 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff72400bbd0 con 0x55e3b810c0b0 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff713e00700 1 -- 172.21.15.47:0/4070017756 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 67) ==== 8398+0+0 (secure 0 0 0) 0x7ff72001d9f0 con 0x55e3b810c0b0 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff747910b80 10 client.26567 fetch_fsmap finished waiting for FSMap version 67 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.111+0000 7ff747910b80 10 client.26567 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.112+0000 7ff747910b80 20 client.26567 populate_metadata read hostname 'smithi047' 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.112+0000 7ff747910b80 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8125a20 0x55e3b8127e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.112+0000 7ff747910b80 4 client.26567 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.112+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3b80d8230 con 0x55e3b8125a20 2024-05-14T12:43:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.112+0000 7ff731e00700 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8125a20 0x55e3b8127e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:42.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.113+0000 7ff731e00700 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8125a20 0x55e3b8127e60 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=155d2ccd5adc7378 server_cookie=4fb3a344767a97a7 in_seq=0 out_seq=0 2024-05-14T12:43:42.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:42.113+0000 7ff713e00700 10 client.26567 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:42.254 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:41 smithi073 ceph-mon[35809]: pgmap v1005: 97 pgs: 97 active+clean; 493 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 48 op/s 2024-05-14T12:43:42.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:41 smithi066 ceph-mon[35981]: pgmap v1005: 97 pgs: 97 active+clean; 493 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 48 op/s 2024-05-14T12:43:44.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:43 smithi073 ceph-mon[35809]: pgmap v1006: 97 pgs: 97 active+clean; 429 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 36 op/s 2024-05-14T12:43:44.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:43 smithi066 ceph-mon[35981]: pgmap v1006: 97 pgs: 97 active+clean; 429 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 36 op/s 2024-05-14T12:43:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:43 smithi047 ceph-mon[31254]: pgmap v1006: 97 pgs: 97 active+clean; 429 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 36 op/s 2024-05-14T12:43:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.509+0000 7f3f34c00640 1 -- 172.21.15.47:0/2725477850 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559a2f62ffd0 con 0x559a2f2b61c0 2024-05-14T12:43:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.509+0000 7f3f34c00640 10 client.26555 handle_command_reply: tid=0 2024-05-14T12:43:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.509+0000 7f3f58e4a740 1 client.26555 shutdown 2024-05-14T12:43:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.509+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 msgr2=0x559a2f6d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.509+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6d31b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009f30 tx=0x7f3f440118d0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 shutdown_connections 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x559a2f2b61c0 0x559a2f746400 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559a2f3221b0 0x559a2f6d4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559a2f3014d0 0x559a2f6d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 --2- 172.21.15.47:0/2725477850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a2f2f92f0 0x559a2f6d31b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f34c00640 0 client.26555 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 >> 172.21.15.47:0/2725477850 conn(0x559a2f316300 msgr2=0x559a2f6c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 shutdown_connections 2024-05-14T12:43:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 1 -- 172.21.15.47:0/2725477850 wait complete. 2024-05-14T12:43:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.510+0000 7f3f58e4a740 20 client.26555 trim_cache size 0 max 16384 2024-05-14T12:43:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-05-14T12:43:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-05-14T12:43:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-05-14T12:43:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-05-14T12:43:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.511+0000 7ff713e00700 1 -- 172.21.15.47:0/4070017756 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e3b80d8230 con 0x55e3b8125a20 2024-05-14T12:43:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.511+0000 7ff713e00700 10 client.26567 handle_command_reply: tid=0 2024-05-14T12:43:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.511+0000 7ff747910b80 1 client.26567 shutdown 2024-05-14T12:43:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f300b2920 msgr2=0x7f3f300b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f300b2920 0x7f3f300b4e30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0c9c90 tx=0x7f3f3c005e50 comp rx=0 tx=0).stop 2024-05-14T12:43:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 msgr2=0x7f3f4c19c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c19c4f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c031440 tx=0x7f3f3c003c10 comp rx=0 tx=0).stop 2024-05-14T12:43:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b810c0b0 msgr2=0x55e3b8115b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b810c0b0 0x55e3b8115b40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff734103c00 tx=0x7ff7200047c0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 shutdown_connections 2024-05-14T12:43:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8125a20 0x55e3b8127e60 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b8110890 0x55e3b8116080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff713e00700 0 client.26567 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 shutdown_connections 2024-05-14T12:43:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f3f300b2920 0x7f3f300b4e30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f4c109a00 0x7f3f4c1a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1070a0 0x7f3f4c19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 --2- 172.21.15.47:0/1715161910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f4c104740 0x7f3f4c19c4f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.518 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.512+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 >> 172.21.15.47:0/1715161910 conn(0x7f3f4c0fdd40 msgr2=0x7f3f4c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7f8deb0 0x55e3b8115600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 --2- 172.21.15.47:0/4070017756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b810c0b0 0x55e3b8115b40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.512+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 >> 172.21.15.47:0/4070017756 conn(0x55e3b7fd2fe0 msgr2=0x55e3b810a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.513+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 shutdown_connections 2024-05-14T12:43:44.519 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-05-14T12:43:44.513+0000 7f3f51e00640 1 -- 172.21.15.47:0/1715161910 wait complete. 2024-05-14T12:43:44.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.513+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 shutdown_connections 2024-05-14T12:43:44.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.513+0000 7ff747910b80 1 -- 172.21.15.47:0/4070017756 wait complete. 2024-05-14T12:43:44.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.513+0000 7ff747910b80 20 client.26567 trim_cache size 0 max 16384 2024-05-14T12:43:44.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.543+0000 7ff747910b80 1 Processor -- start 2024-05-14T12:43:44.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.544+0000 7ff747910b80 1 -- start start 2024-05-14T12:43:44.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.544+0000 7ff747910b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7fd2fe0 0x55e3b810b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:44.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.544+0000 7ff747910b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b8121810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:44.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.544+0000 7ff747910b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b810c0b0 0x55e3b812d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:44.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.544+0000 7ff747910b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b0e70 con 0x55e3b7fd2fe0 2024-05-14T12:43:44.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.544+0000 7ff747910b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b2b30 con 0x55e3b7f8deb0 2024-05-14T12:43:44.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.544+0000 7ff747910b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b1600 con 0x55e3b810c0b0 2024-05-14T12:43:44.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7fd2fe0 0x55e3b810b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b8121810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b8121810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51342/0 (socket says 172.21.15.47:51342) 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff732800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b810c0b0 0x55e3b812d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 -- 172.21.15.47:0/3627936060 learned_addr learned my addr 172.21.15.47:0/3627936060 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 -- 172.21.15.47:0/3627936060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b810c0b0 msgr2=0x55e3b812d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b810c0b0 0x55e3b812d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 -- 172.21.15.47:0/3627936060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7fd2fe0 msgr2=0x55e3b810b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7fd2fe0 0x55e3b810b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731400700 1 -- 172.21.15.47:0/3627936060 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b8107500 con 0x55e3b7f8deb0 2024-05-14T12:43:44.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff732800700 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b810c0b0 0x55e3b812d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:44.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.545+0000 7ff731e00700 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7fd2fe0 0x55e3b810b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:44.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.546+0000 7ff731400700 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b8121810 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff72001de90 tx=0x7ff720009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f88fa4655ab1ff0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:44.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.546+0000 7ff71ea00700 1 -- 172.21.15.47:0/3627936060 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720015070 con 0x55e3b7f8deb0 2024-05-14T12:43:44.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.546+0000 7ff71ea00700 1 -- 172.21.15.47:0/3627936060 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff720019050 con 0x55e3b7f8deb0 2024-05-14T12:43:44.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.546+0000 7ff71ea00700 1 -- 172.21.15.47:0/3627936060 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720017070 con 0x55e3b7f8deb0 2024-05-14T12:43:44.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.547+0000 7ff747910b80 1 -- 172.21.15.47:0/3627936060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 msgr2=0x55e3b8121810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.547+0000 7ff747910b80 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b8121810 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff72001de90 tx=0x7ff720009260 comp rx=0 tx=0).stop 2024-05-14T12:43:44.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.547+0000 7ff747910b80 1 -- 172.21.15.47:0/3627936060 shutdown_connections 2024-05-14T12:43:44.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.547+0000 7ff747910b80 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b810c0b0 0x55e3b812d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.547+0000 7ff747910b80 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b7fd2fe0 0x55e3b810b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.547+0000 7ff747910b80 1 --2- 172.21.15.47:0/3627936060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b8121810 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.547+0000 7ff747910b80 1 -- 172.21.15.47:0/3627936060 >> 172.21.15.47:0/3627936060 conn(0x55e3b80fffc0 msgr2=0x55e3b8115c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:44.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.548+0000 7ff747910b80 1 -- 172.21.15.47:0/3627936060 shutdown_connections 2024-05-14T12:43:44.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.548+0000 7ff747910b80 1 -- 172.21.15.47:0/3627936060 wait complete. 2024-05-14T12:43:44.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.548+0000 7ff747910b80 1 -- start start 2024-05-14T12:43:44.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.548+0000 7ff747910b80 1 Processor -- start 2024-05-14T12:43:44.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff747910b80 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b811a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:44.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff747910b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b7fd2fe0 0x55e3b811ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:44.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff747910b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b811b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff747910b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b2460 con 0x55e3b810c0b0 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff747910b80 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b1d90 con 0x55e3b7f8deb0 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff747910b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341aedf0 con 0x55e3b7fd2fe0 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff747910b80 10 client.0 _ll_register_callbacks cb 0x55e3b7fd4ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff731e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b811a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff731400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b7fd2fe0 0x55e3b811ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff731e00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b811a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51356/0 (socket says 172.21.15.47:51356) 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff731e00700 1 -- 172.21.15.47:0/922546626 learned_addr learned my addr 172.21.15.47:0/922546626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.549+0000 7ff732800700 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b811b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff731e00700 1 -- 172.21.15.47:0/922546626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b7fd2fe0 msgr2=0x55e3b811ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:44.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff731e00700 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b7fd2fe0 0x55e3b811ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff731e00700 1 -- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 msgr2=0x55e3b811b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff731e00700 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b811b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff731e00700 1 -- 172.21.15.47:0/922546626 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b8190260 con 0x55e3b7f8deb0 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff731400700 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b7fd2fe0 0x55e3b811ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff731e00700 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b811a840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff724003910 tx=0x7ff724003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca9bcc764ac7049 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff713e00700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff713e00700 1 -- 172.21.15.47:0/922546626 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724027040 con 0x55e3b7f8deb0 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff713e00700 1 -- 172.21.15.47:0/922546626 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff724003bb0 con 0x55e3b7f8deb0 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.550+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff720019050 con 0x55e3b7f8deb0 2024-05-14T12:43:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff713e00700 1 -- 172.21.15.47:0/922546626 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7ff724003db0 con 0x55e3b7f8deb0 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 10 client.26573 fetch_fsmap learned FSMap version 67 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55e3b81914a0 con 0x55e3b7f8deb0 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff713e00700 1 -- 172.21.15.47:0/922546626 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff720019050 con 0x55e3b7f8deb0 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff713e00700 1 -- 172.21.15.47:0/922546626 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 67) ==== 8398+0+0 (secure 0 0 0) 0x7ff7240229c0 con 0x55e3b7f8deb0 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 10 client.26573 fetch_fsmap finished waiting for FSMap version 67 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 10 client.26573 resolve_mds: validated gid 24535 aka daemon mds.a 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 20 client.26573 populate_metadata read hostname 'smithi047' 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8110890 0x55e3b8193740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 4 client.26573 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.551+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 --> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55e3b803b470 con 0x55e3b8110890 2024-05-14T12:43:44.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.552+0000 7ff731400700 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8110890 0x55e3b8193740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.552+0000 7ff731400700 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8110890 0x55e3b8193740 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2908d173dfbb94ec server_cookie=349ea2f5633f74bd in_seq=0 out_seq=0 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.552+0000 7ff713e00700 10 client.26573 ms_handle_connect on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff713e00700 1 -- 172.21.15.47:0/922546626 <== mds.0 v2:172.21.15.47:6840/3387131427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55e3b803b470 con 0x55e3b8110890 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff713e00700 10 client.26573 handle_command_reply: tid=0 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 client.26573 shutdown 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 msgr2=0x55e3b811a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b811a840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff724003910 tx=0x7ff724003680 comp rx=0 tx=0).stop 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 shutdown_connections 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:6840/3387131427,v1:172.21.15.47:6841/3387131427] conn(0x55e3b8110890 0x55e3b8193740 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e3b810c0b0 0x55e3b811b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e3b7f8deb0 0x55e3b811a840 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 --2- 172.21.15.47:0/922546626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3b7fd2fe0 0x55e3b811ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 >> 172.21.15.47:0/922546626 conn(0x55e3b80fffc0 msgr2=0x55e3b810f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.553+0000 7ff713e00700 0 client.26573 ms_handle_reset on v2:172.21.15.47:6840/3387131427 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.554+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 shutdown_connections 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.554+0000 7ff747910b80 1 -- 172.21.15.47:0/922546626 wait complete. 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.554+0000 7ff747910b80 20 client.26573 trim_cache size 0 max 16384 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 67, 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stdout: "leader": 24535, 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stdout: "set_version": 34, 2024-05-14T12:43:44.557 INFO:teuthology.orchestra.run.smithi047.stdout: "sets": {} 2024-05-14T12:43:44.558 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:43:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7180b2880 msgr2=0x7ff7180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7180b2880 0x7ff7180b4d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff720009680 tx=0x7ff720011720 comp rx=0 tx=0).stop 2024-05-14T12:43:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff73410c5c0 msgr2=0x7ff7341a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff73410c5c0 0x7ff7341a18a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00efc0 tx=0x7ff72c00c3a0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 shutdown_connections 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff7180b2880 0x7ff7180b4d90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff73410c5c0 0x7ff7341a18a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff734106580 0x7ff73419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 --2- 172.21.15.47:0/130628886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734106ed0 0x7ff73419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 >> 172.21.15.47:0/130628886 conn(0x7ff734102080 msgr2=0x7ff7341047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 shutdown_connections 2024-05-14T12:43:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:44.555+0000 7ff738e00700 1 -- 172.21.15.47:0/130628886 wait complete. 2024-05-14T12:43:45.374 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/quiescer.py", line 419, in task stop_all_quiescers(ctx.ceph[cluster_name].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/quiescer.py", line 378, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error quiescing set '3f3d2c55': 110 (ETIMEDOUT) 2024-05-14T12:43:45.375 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-14T12:43:45.386 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T12:43:45.407 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-14T12:43:45.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T12:43:45.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 -- 172.21.15.47:0/2612419390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c079de0 msgr2=0x7f385c07a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 --2- 172.21.15.47:0/2612419390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c079de0 0x7f385c07a1f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3844009900 tx=0x7f384402a410 comp rx=0 tx=0).stop 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 -- 172.21.15.47:0/2612419390 shutdown_connections 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 --2- 172.21.15.47:0/2612419390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c07aae0 0x7f385c07aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 --2- 172.21.15.47:0/2612419390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c079de0 0x7f385c07a1f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 --2- 172.21.15.47:0/2612419390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f385c078b50 0x7f385c0798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 -- 172.21.15.47:0/2612419390 >> 172.21.15.47:0/2612419390 conn(0x7f385c101050 msgr2=0x7f385c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 -- 172.21.15.47:0/2612419390 shutdown_connections 2024-05-14T12:43:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.746+0000 7f3862a00640 1 -- 172.21.15.47:0/2612419390 wait complete. 2024-05-14T12:43:45.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 Processor -- start 2024-05-14T12:43:45.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 -- start start 2024-05-14T12:43:45.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c078b50 0x7f385c1a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:45.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f385c079de0 0x7f385c1a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c07aae0 0x7f385c1a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f385c115da0 con 0x7f385c079de0 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f385c115c20 con 0x7f385c07aae0 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.748+0000 7f3862a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f385c115f20 con 0x7f385c078b50 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c078b50 0x7f385c1a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f3860a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c07aae0 0x7f385c1a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f3860a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c07aae0 0x7f385c1a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51384/0 (socket says 172.21.15.47:51384) 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c078b50 0x7f385c1a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53110/0 (socket says 172.21.15.47:53110) 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f3860a00640 1 -- 172.21.15.47:0/1380646522 learned_addr learned my addr 172.21.15.47:0/1380646522 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385b400640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f385c079de0 0x7f385c1a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 -- 172.21.15.47:0/1380646522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c07aae0 msgr2=0x7f385c1a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c07aae0 0x7f385c1a7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 -- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f385c079de0 msgr2=0x7f385c1a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:45.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f385c079de0 0x7f385c1a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 -- 172.21.15.47:0/1380646522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c1a83c0 con 0x7f385c078b50 2024-05-14T12:43:45.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385b400640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f385c079de0 0x7f385c1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:45.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.749+0000 7f385be00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c078b50 0x7f385c1a0880 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f384c00e9c0 tx=0x7f384c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:45.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.750+0000 7f3858c00640 1 -- 172.21.15.47:0/1380646522 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c00ccc0 con 0x7f385c078b50 2024-05-14T12:43:45.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.750+0000 7f3858c00640 1 -- 172.21.15.47:0/1380646522 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f384c0108e0 con 0x7f385c078b50 2024-05-14T12:43:45.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.750+0000 7f3858c00640 1 -- 172.21.15.47:0/1380646522 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c0187c0 con 0x7f385c078b50 2024-05-14T12:43:45.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.750+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c1a86b0 con 0x7f385c078b50 2024-05-14T12:43:45.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.750+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c1a8c50 con 0x7f385c078b50 2024-05-14T12:43:45.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.751+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385c112b10 con 0x7f385c078b50 2024-05-14T12:43:45.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.753+0000 7f3858c00640 1 -- 172.21.15.47:0/1380646522 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f384c010430 con 0x7f385c078b50 2024-05-14T12:43:45.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.755+0000 7f3858c00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f38400b2920 0x7f38400b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:45.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.755+0000 7f3858c00640 1 -- 172.21.15.47:0/1380646522 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f384c0e25c0 con 0x7f385c078b50 2024-05-14T12:43:45.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.755+0000 7f385b400640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f38400b2920 0x7f38400b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:45.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.756+0000 7f385b400640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f38400b2920 0x7f38400b4e30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3844006010 tx=0x7f3844000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:45.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.757+0000 7f3858c00640 1 -- 172.21.15.47:0/1380646522 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f384c0aa2a0 con 0x7f385c078b50 2024-05-14T12:43:45.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.971+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f385c0638d0 con 0x7f385c078b50 2024-05-14T12:43:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.973+0000 7f3858c00640 1 -- 172.21.15.47:0/1380646522 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7f384c0b2320 con 0x7f385c078b50 2024-05-14T12:43:45.974 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:43:45.974 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:43:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f38400b2920 msgr2=0x7f38400b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f38400b2920 0x7f38400b4e30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3844006010 tx=0x7f3844000bc0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c078b50 msgr2=0x7f385c1a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c078b50 0x7f385c1a0880 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f384c00e9c0 tx=0x7f384c00ee80 comp rx=0 tx=0).stop 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 shutdown_connections 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f38400b2920 0x7f38400b4e30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c07aae0 0x7f385c1a7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f385c079de0 0x7f385c1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 --2- 172.21.15.47:0/1380646522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385c078b50 0x7f385c1a0880 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 >> 172.21.15.47:0/1380646522 conn(0x7f385c101050 msgr2=0x7f385c10fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 shutdown_connections 2024-05-14T12:43:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:45.977+0000 7f3862a00640 1 -- 172.21.15.47:0/1380646522 wait complete. 2024-05-14T12:43:46.009 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T12:15:26.253753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T12:20:53.643900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T12:20:58.482353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T12:43:46.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T12:43:46.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:45 smithi073 ceph-mon[35809]: pgmap v1007: 97 pgs: 97 active+clean; 381 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 32 op/s 2024-05-14T12:43:46.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:45 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1380646522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:43:46.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:45 smithi066 ceph-mon[35981]: pgmap v1007: 97 pgs: 97 active+clean; 381 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 32 op/s 2024-05-14T12:43:46.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:45 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1380646522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 -- 172.21.15.47:0/922834491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 msgr2=0x7f970810ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 --2- 172.21.15.47:0/922834491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f970810ad90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009900 tx=0x7f96f802a3f0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 -- 172.21.15.47:0/922834491 shutdown_connections 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 --2- 172.21.15.47:0/922834491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f970810ffd0 0x7f97081123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 --2- 172.21.15.47:0/922834491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f970810b2d0 0x7f970810b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 --2- 172.21.15.47:0/922834491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f970810ad90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 -- 172.21.15.47:0/922834491 >> 172.21.15.47:0/922834491 conn(0x7f9708078c90 msgr2=0x7f970807b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 -- 172.21.15.47:0/922834491 shutdown_connections 2024-05-14T12:43:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.329+0000 7f970d800640 1 -- 172.21.15.47:0/922834491 wait complete. 2024-05-14T12:43:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.330+0000 7f970d800640 1 Processor -- start 2024-05-14T12:43:46.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f970d800640 1 -- start start 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f970d800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f97081a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f970d800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f970810b2d0 0x7f97081a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f970d800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f970810ffd0 0x7f97081a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f970d800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9708115ba0 con 0x7f970810b2d0 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f970d800640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9708115a20 con 0x7f970810ffd0 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f970d800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9708115d20 con 0x7f970810a400 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f9707e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f97081a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f9707400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f970810b2d0 0x7f97081a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f9707e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f97081a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53136/0 (socket says 172.21.15.47:53136) 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.331+0000 7f9707e00640 1 -- 172.21.15.47:0/175825879 learned_addr learned my addr 172.21.15.47:0/175825879 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f970ce00640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f970810ffd0 0x7f97081a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f9707e00640 1 -- 172.21.15.47:0/175825879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f970810ffd0 msgr2=0x7f97081a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f9707e00640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f970810ffd0 0x7f97081a7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f9707e00640 1 -- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f970810b2d0 msgr2=0x7f97081a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f9707e00640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f970810b2d0 0x7f97081a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f9707e00640 1 -- 172.21.15.47:0/175825879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97081a82c0 con 0x7f970810a400 2024-05-14T12:43:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f9707400640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f970810b2d0 0x7f97081a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:43:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.332+0000 7f9707e00640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f97081a0780 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f96f8031440 tx=0x7f96f8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:46.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.333+0000 7f9704c00640 1 -- 172.21.15.47:0/175825879 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f803f070 con 0x7f970810a400 2024-05-14T12:43:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.333+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97081a8550 con 0x7f970810a400 2024-05-14T12:43:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.333+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97081a8a90 con 0x7f970810a400 2024-05-14T12:43:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.333+0000 7f9704c00640 1 -- 172.21.15.47:0/175825879 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96f8031c50 con 0x7f970810a400 2024-05-14T12:43:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.333+0000 7f9704c00640 1 -- 172.21.15.47:0/175825879 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8049060 con 0x7f970810a400 2024-05-14T12:43:46.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.334+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e80052c0 con 0x7f970810a400 2024-05-14T12:43:46.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.336+0000 7f9704c00640 1 -- 172.21.15.47:0/175825879 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f96f8042070 con 0x7f970810a400 2024-05-14T12:43:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.338+0000 7f9704c00640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f96ec0b27f0 0x7f96ec0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.338+0000 7f9704c00640 1 -- 172.21.15.47:0/175825879 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f96f8102cb0 con 0x7f970810a400 2024-05-14T12:43:46.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.338+0000 7f9707400640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f96ec0b27f0 0x7f96ec0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.339+0000 7f9707400640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f96ec0b27f0 0x7f96ec0b4d00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f97081a1820 tx=0x7f96f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:46.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.340+0000 7f9704c00640 1 -- 172.21.15.47:0/175825879 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f96f80ca340 con 0x7f970810a400 2024-05-14T12:43:46.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:45 smithi047 ceph-mon[31254]: pgmap v1007: 97 pgs: 97 active+clean; 381 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 32 op/s 2024-05-14T12:43:46.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:45 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1380646522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:43:46.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.605+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96e8005880 con 0x7f970810a400 2024-05-14T12:43:46.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.606+0000 7f9704c00640 1 -- 172.21.15.47:0/175825879 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f96f80ce640 con 0x7f970810a400 2024-05-14T12:43:46.606 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f96ec0b27f0 msgr2=0x7f96ec0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f96ec0b27f0 0x7f96ec0b4d00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f97081a1820 tx=0x7f96f4005f90 comp rx=0 tx=0).stop 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 msgr2=0x7f97081a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f97081a0780 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f96f8031440 tx=0x7f96f8003c10 comp rx=0 tx=0).stop 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 shutdown_connections 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f96ec0b27f0 0x7f96ec0b4d00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f970810ffd0 0x7f97081a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f970810b2d0 0x7f97081a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 --2- 172.21.15.47:0/175825879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f970810a400 0x7f97081a0780 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 >> 172.21.15.47:0/175825879 conn(0x7f9708078c90 msgr2=0x7f970810bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 shutdown_connections 2024-05-14T12:43:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.609+0000 7f970d800640 1 -- 172.21.15.47:0/175825879 wait complete. 2024-05-14T12:43:46.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T12:43:46.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.926+0000 7ff35a400640 1 -- 172.21.15.47:0/2907313629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410b2d0 msgr2=0x7ff35410b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.926+0000 7ff35a400640 1 --2- 172.21.15.47:0/2907313629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410b2d0 0x7ff35410b6e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff340009900 tx=0x7ff34002a3f0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.927+0000 7ff35a400640 1 -- 172.21.15.47:0/2907313629 shutdown_connections 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.927+0000 7ff35a400640 1 --2- 172.21.15.47:0/2907313629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff35410ffd0 0x7ff3541123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.927+0000 7ff35a400640 1 --2- 172.21.15.47:0/2907313629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410b2d0 0x7ff35410b6e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.927+0000 7ff35a400640 1 --2- 172.21.15.47:0/2907313629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35410a400 0x7ff35410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.927+0000 7ff35a400640 1 -- 172.21.15.47:0/2907313629 >> 172.21.15.47:0/2907313629 conn(0x7ff354078c90 msgr2=0x7ff35407b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.927+0000 7ff35a400640 1 -- 172.21.15.47:0/2907313629 shutdown_connections 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.927+0000 7ff35a400640 1 -- 172.21.15.47:0/2907313629 wait complete. 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.928+0000 7ff35a400640 1 Processor -- start 2024-05-14T12:43:46.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.928+0000 7ff35a400640 1 -- start start 2024-05-14T12:43:46.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff35a400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410a400 0x7ff3541a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff35a400640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff35410b2d0 0x7ff3541a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff35a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35410ffd0 0x7ff3541a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff35a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff354115b80 con 0x7ff35410ffd0 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff35a400640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff354115a00 con 0x7ff35410b2d0 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff35a400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff354115d00 con 0x7ff35410a400 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff359000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410a400 0x7ff3541a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff353e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff35410b2d0 0x7ff3541a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff359a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35410ffd0 0x7ff3541a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff359000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410a400 0x7ff3541a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:53148/0 (socket says 172.21.15.47:53148) 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff359000640 1 -- 172.21.15.47:0/2353084444 learned_addr learned my addr 172.21.15.47:0/2353084444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff353e00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff35410b2d0 0x7ff3541a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51434/0 (socket says 172.21.15.47:51434) 2024-05-14T12:43:46.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.929+0000 7ff359000640 1 -- 172.21.15.47:0/2353084444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff35410b2d0 msgr2=0x7ff3541a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff359000640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff35410b2d0 0x7ff3541a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff359000640 1 -- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35410ffd0 msgr2=0x7ff3541a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff359000640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35410ffd0 0x7ff3541a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff359000640 1 -- 172.21.15.47:0/2353084444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3541a82a0 con 0x7ff35410a400 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff359000640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410a400 0x7ff3541a0760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e9c0 tx=0x7ff34800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff351600640 1 -- 172.21.15.47:0/2353084444 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800cd80 con 0x7ff35410a400 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff351600640 1 -- 172.21.15.47:0/2353084444 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3480054d0 con 0x7ff35410a400 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff351600640 1 -- 172.21.15.47:0/2353084444 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348010430 con 0x7ff35410a400 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3541a8590 con 0x7ff35410a400 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.930+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3541a8a90 con 0x7ff35410a400 2024-05-14T12:43:46.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.931+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35410ede0 con 0x7ff35410a400 2024-05-14T12:43:46.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.934+0000 7ff351600640 1 -- 172.21.15.47:0/2353084444 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff348004fd0 con 0x7ff35410a400 2024-05-14T12:43:46.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.935+0000 7ff351600640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff33c0b2870 0x7ff33c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:46.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.935+0000 7ff351600640 1 -- 172.21.15.47:0/2353084444 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff3480e25a0 con 0x7ff35410a400 2024-05-14T12:43:46.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.936+0000 7ff353e00640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff33c0b2870 0x7ff33c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:46.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.936+0000 7ff353e00640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff33c0b2870 0x7ff33c0b4d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff340009230 tx=0x7ff340031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:46.940+0000 7ff351600640 1 -- 172.21.15.47:0/2353084444 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff3480aa280 con 0x7ff35410a400 2024-05-14T12:43:47.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.172+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff3540638d0 con 0x7ff35410a400 2024-05-14T12:43:47.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.173+0000 7ff351600640 1 -- 172.21.15.47:0/2353084444 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7ff3480a9b80 con 0x7ff35410a400 2024-05-14T12:43:47.173 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-14T12:43:47.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff33c0b2870 msgr2=0x7ff33c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff33c0b2870 0x7ff33c0b4d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff340009230 tx=0x7ff340031400 comp rx=0 tx=0).stop 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410a400 msgr2=0x7ff3541a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410a400 0x7ff3541a0760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e9c0 tx=0x7ff34800ee80 comp rx=0 tx=0).stop 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 shutdown_connections 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ff33c0b2870 0x7ff33c0b4d80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35410ffd0 0x7ff3541a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff35410b2d0 0x7ff3541a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 --2- 172.21.15.47:0/2353084444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff35410a400 0x7ff3541a0760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 >> 172.21.15.47:0/2353084444 conn(0x7ff354078c90 msgr2=0x7ff35410bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 shutdown_connections 2024-05-14T12:43:47.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.176+0000 7ff35a400640 1 -- 172.21.15.47:0/2353084444 wait complete. 2024-05-14T12:43:47.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T12:43:47.280 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:47 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/175825879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T12:43:47.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:47 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/175825879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T12:43:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 -- 172.21.15.47:0/3035059296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a950 msgr2=0x7f1dfc10b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 --2- 172.21.15.47:0/3035059296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a950 0x7f1dfc10b510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009900 tx=0x7f1de802a3f0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 -- 172.21.15.47:0/3035059296 shutdown_connections 2024-05-14T12:43:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 --2- 172.21.15.47:0/3035059296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc1101e0 0x7f1dfc112600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 --2- 172.21.15.47:0/3035059296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a950 0x7f1dfc10b510 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 --2- 172.21.15.47:0/3035059296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dfc10a450 0x7f1dfc10af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 -- 172.21.15.47:0/3035059296 >> 172.21.15.47:0/3035059296 conn(0x7f1dfc078f10 msgr2=0x7f1dfc07b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:47.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 -- 172.21.15.47:0/3035059296 shutdown_connections 2024-05-14T12:43:47.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.501+0000 7f1e01a00640 1 -- 172.21.15.47:0/3035059296 wait complete. 2024-05-14T12:43:47.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:47 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/175825879' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T12:43:47.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.502+0000 7f1e01a00640 1 Processor -- start 2024-05-14T12:43:47.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1e01a00640 1 -- start start 2024-05-14T12:43:47.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1e01a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a450 0x7f1dfc1a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:47.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1e01a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc10a950 0x7f1dfc1a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1e01a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dfc1101e0 0x7f1dfc1a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1e01a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc115dd0 con 0x7f1dfc10a950 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1e01a00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc115c50 con 0x7f1dfc10a450 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1e01a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc115f50 con 0x7f1dfc1101e0 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1dfaa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a450 0x7f1dfc1a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.503+0000 7f1dfaa00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a450 0x7f1dfc1a0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:51458/0 (socket says 172.21.15.47:51458) 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfaa00640 1 -- 172.21.15.47:0/1554563579 learned_addr learned my addr 172.21.15.47:0/1554563579 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfa000640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc10a950 0x7f1dfc1a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfb400640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dfc1101e0 0x7f1dfc1a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfaa00640 1 -- 172.21.15.47:0/1554563579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dfc1101e0 msgr2=0x7f1dfc1a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfaa00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dfc1101e0 0x7f1dfc1a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfaa00640 1 -- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc10a950 msgr2=0x7f1dfc1a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfaa00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc10a950 0x7f1dfc1a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfaa00640 1 -- 172.21.15.47:0/1554563579 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc1a84d0 con 0x7f1dfc10a450 2024-05-14T12:43:47.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfa000640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc10a950 0x7f1dfc1a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:43:47.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.504+0000 7f1dfaa00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a450 0x7f1dfc1a0a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e9f0 tx=0x7f1dec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:47.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.505+0000 7f1df3400640 1 -- 172.21.15.47:0/1554563579 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00ccc0 con 0x7f1dfc10a450 2024-05-14T12:43:47.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.505+0000 7f1df3400640 1 -- 172.21.15.47:0/1554563579 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dec0054d0 con 0x7f1dfc10a450 2024-05-14T12:43:47.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.505+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc1a87c0 con 0x7f1dfc10a450 2024-05-14T12:43:47.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.505+0000 7f1df3400640 1 -- 172.21.15.47:0/1554563579 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec010430 con 0x7f1dfc10a450 2024-05-14T12:43:47.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.505+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1a8d10 con 0x7f1dfc10a450 2024-05-14T12:43:47.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.506+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc10eff0 con 0x7f1dfc10a450 2024-05-14T12:43:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.508+0000 7f1df3400640 1 -- 172.21.15.47:0/1554563579 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1dec0046c0 con 0x7f1dfc10a450 2024-05-14T12:43:47.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.510+0000 7f1df3400640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1de00b2870 0x7f1de00b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:47.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.510+0000 7f1df3400640 1 -- 172.21.15.47:0/1554563579 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1dec0e2620 con 0x7f1dfc10a450 2024-05-14T12:43:47.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.510+0000 7f1dfa000640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1de00b2870 0x7f1de00b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:47.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.511+0000 7f1dfa000640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1de00b2870 0x7f1de00b4d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1de8006010 tx=0x7f1de8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.512+0000 7f1df3400640 1 -- 172.21.15.47:0/1554563579 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1dec0aa300 con 0x7f1dfc10a450 2024-05-14T12:43:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.730+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1dfc02ddc0 con 0x7f1dfc10a450 2024-05-14T12:43:47.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.731+0000 7f1df3400640 1 -- 172.21.15.47:0/1554563579 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f1dfc02ddc0 con 0x7f1dfc10a450 2024-05-14T12:43:47.731 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1de00b2870 msgr2=0x7f1de00b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1de00b2870 0x7f1de00b4d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1de8006010 tx=0x7f1de8000bc0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a450 msgr2=0x7f1dfc1a0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a450 0x7f1dfc1a0a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00e9f0 tx=0x7f1dec00eeb0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 shutdown_connections 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f1de00b2870 0x7f1de00b4d80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dfc1101e0 0x7f1dfc1a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc10a950 0x7f1dfc1a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 --2- 172.21.15.47:0/1554563579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc10a450 0x7f1dfc1a0a00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 >> 172.21.15.47:0/1554563579 conn(0x7f1dfc078f10 msgr2=0x7f1dfc10c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 shutdown_connections 2024-05-14T12:43:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:47.734+0000 7f1e01a00640 1 -- 172.21.15.47:0/1554563579 wait complete. 2024-05-14T12:43:47.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-14T12:43:48.013 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:48 smithi047 ceph-mon[31254]: pgmap v1008: 97 pgs: 97 active+clean; 329 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 37 op/s 2024-05-14T12:43:48.013 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:48 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2353084444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T12:43:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.052+0000 7fed37200640 1 -- 172.21.15.47:0/1855503747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 msgr2=0x7fed3810be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.052+0000 7fed37200640 1 --2- 172.21.15.47:0/1855503747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 0x7fed3810be20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fed30009900 tx=0x7fed3002a3f0 comp rx=0 tx=0).stop 2024-05-14T12:43:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.052+0000 7fed37200640 1 -- 172.21.15.47:0/1855503747 shutdown_connections 2024-05-14T12:43:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.052+0000 7fed37200640 1 --2- 172.21.15.47:0/1855503747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 0x7fed3810be20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.052+0000 7fed37200640 1 --2- 172.21.15.47:0/1855503747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed38104d00 0x7fed38105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.052+0000 7fed37200640 1 --2- 172.21.15.47:0/1855503747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed38103ac0 0x7fed381047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.052+0000 7fed37200640 1 -- 172.21.15.47:0/1855503747 >> 172.21.15.47:0/1855503747 conn(0x7fed380fecb0 msgr2=0x7fed38101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.053+0000 7fed37200640 1 -- 172.21.15.47:0/1855503747 shutdown_connections 2024-05-14T12:43:48.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.053+0000 7fed37200640 1 -- 172.21.15.47:0/1855503747 wait complete. 2024-05-14T12:43:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 Processor -- start 2024-05-14T12:43:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 -- start start 2024-05-14T12:43:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed38103ac0 0x7fed38076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed38104d00 0x7fed38075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 0x7fed38075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:48.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed3810f5d0 con 0x7fed38104d00 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed3810f450 con 0x7fed38109a00 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.054+0000 7fed37200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fed3810f750 con 0x7fed38103ac0 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed38104d00 0x7fed38075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed36800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 0x7fed38075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed38103ac0 0x7fed38076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed38104d00 0x7fed38075020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48242/0 (socket says 172.21.15.47:48242) 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35400640 1 -- 172.21.15.47:0/64366950 learned_addr learned my addr 172.21.15.47:0/64366950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:43:48.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed36800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 0x7fed38075560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:50744/0 (socket says 172.21.15.47:50744) 2024-05-14T12:43:48.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35e00640 1 -- 172.21.15.47:0/64366950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 msgr2=0x7fed38075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:48.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35e00640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 0x7fed38075560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:48.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35e00640 1 -- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed38104d00 msgr2=0x7fed38075020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:48.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35e00640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed38104d00 0x7fed38075020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.055+0000 7fed35e00640 1 -- 172.21.15.47:0/64366950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed38075c90 con 0x7fed38103ac0 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.056+0000 7fed35e00640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed38103ac0 0x7fed38076980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed38103390 tx=0x7fed2800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.056+0000 7fed2ea00640 1 -- 172.21.15.47:0/64366950 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2800cc40 con 0x7fed38103ac0 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.056+0000 7fed2ea00640 1 -- 172.21.15.47:0/64366950 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed2800cde0 con 0x7fed38103ac0 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.056+0000 7fed2ea00640 1 -- 172.21.15.47:0/64366950 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28010430 con 0x7fed38103ac0 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.056+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed381a4110 con 0x7fed38103ac0 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.056+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed381a45d0 con 0x7fed38103ac0 2024-05-14T12:43:48.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.057+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed38108100 con 0x7fed38103ac0 2024-05-14T12:43:48.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.059+0000 7fed2ea00640 1 -- 172.21.15.47:0/64366950 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fed28003ed0 con 0x7fed38103ac0 2024-05-14T12:43:48.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.061+0000 7fed2ea00640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fed180b28a0 0x7fed180b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:43:48.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.061+0000 7fed2ea00640 1 -- 172.21.15.47:0/64366950 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fed280e2640 con 0x7fed38103ac0 2024-05-14T12:43:48.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.061+0000 7fed35400640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fed180b28a0 0x7fed180b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:43:48.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.062+0000 7fed35400640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fed180b28a0 0x7fed180b4db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fed38076320 tx=0x7fed20009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:43:48.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.066+0000 7fed2ea00640 1 -- 172.21.15.47:0/64366950 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fed280aa320 con 0x7fed38103ac0 2024-05-14T12:43:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:48 smithi066 ceph-mon[35981]: pgmap v1008: 97 pgs: 97 active+clean; 329 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 37 op/s 2024-05-14T12:43:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:48 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2353084444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T12:43:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:48 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1554563579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T12:43:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.336+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fed380638d0 con 0x7fed38103ac0 2024-05-14T12:43:48.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.348+0000 7fed2ea00640 1 -- 172.21.15.47:0/64366950 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+815642 (secure 0 0 0) 0x7fed280a9c20 con 0x7fed38103ac0 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 18, 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "active_gid": 14152, 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "active_name": "x", 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addrs": { 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-05-14T12:43:48.352 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6800", 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1176244093 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6801", 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1176244093 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addr": "172.21.15.47:6801/1176244093", 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "active_change": "2024-05-14T12:12:38.075109+0000", 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "active_mgr_features": 4540701547738038271, 2024-05-14T12:43:48.353 INFO:teuthology.orchestra.run.smithi047.stdout: "available": true, 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "standbys": [ 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24109, 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "z", 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540701547738038271, 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:48.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.355 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.356 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.357 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.358 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.359 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.360 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.361 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.362 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.363 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.364 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.366 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.367 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.368 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.369 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.371 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.372 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.374 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.375 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T12:43:48.375 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.375 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.375 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.375 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T12:43:48.375 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-05-14T12:43:48.377 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.378 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.381 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.382 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.383 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.385 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T12:43:48.386 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.387 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.388 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.390 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.391 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.393 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.394 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T12:43:48.395 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.396 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.397 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.398 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.399 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.400 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-05-14T12:43:48.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-05-14T12:43:48.402 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T12:43:48.404 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.405 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.406 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.407 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.408 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.409 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.410 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.412 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.413 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.414 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-05-14T12:43:48.415 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-05-14T12:43:48.426 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.427 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.428 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.430 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.431 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.432 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.433 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.434 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.437 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.439 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-05-14T12:43:48.440 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-05-14T12:43:48.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-05-14T12:43:48.442 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-05-14T12:43:48.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.444 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.445 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.448 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-05-14T12:43:48.449 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.450 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.451 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-05-14T12:43:48.453 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.454 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.454 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.454 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.454 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.459 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.459 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T12:43:48.459 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.459 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.462 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.463 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.464 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.465 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.466 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-05-14T12:43:48.467 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.468 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-05-14T12:43:48.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.471 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.472 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.474 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.476 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T12:43:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T12:43:48.478 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.479 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.480 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.481 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.483 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.484 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T12:43:48.485 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.487 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.490 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T12:43:48.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T12:43:48.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.498 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.501 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T12:43:48.507 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T12:43:48.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.513 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.514 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.517 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.518 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.520 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.521 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.522 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.523 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.530 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-05-14T12:43:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-05-14T12:43:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.536 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.537 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.541 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T12:43:48.543 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-05-14T12:43:48.544 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-05-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-05-14T12:43:48.549 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.551 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.553 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-05-14T12:43:48.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.557 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.559 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-05-14T12:43:48.561 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.566 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-05-14T12:43:48.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.569 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.571 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-05-14T12:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.574 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.575 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.577 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.578 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.580 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.582 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.583 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.584 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.585 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.586 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.588 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T12:43:48.589 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.591 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.593 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.594 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T12:43:48.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.598 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.599 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.600 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.601 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-05-14T12:43:48.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-05-14T12:43:48.604 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T12:43:48.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.610 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.611 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.612 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.614 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.615 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.620 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.622 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.624 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.625 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T12:43:48.628 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-05-14T12:43:48.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.644 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.646 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.652 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.662 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.664 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.669 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.670 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.671 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-05-14T12:43:48.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.675 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-05-14T12:43:48.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:48.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:48.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.679 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.681 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.683 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.687 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.688 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.689 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.690 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.691 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.692 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.694 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.695 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.696 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.697 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.699 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.700 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.702 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.703 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.704 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.705 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.711 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.714 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.716 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.717 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.718 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.719 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.721 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.722 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-05-14T12:43:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-05-14T12:43:48.724 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-05-14T12:43:48.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-05-14T12:43:48.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-05-14T12:43:48.727 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-05-14T12:43:48.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-05-14T12:43:48.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-05-14T12:43:48.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-05-14T12:43:48.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.732 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-05-14T12:43:48.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-05-14T12:43:48.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.737 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.738 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.740 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.741 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.742 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.743 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.744 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.745 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.747 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.748 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.749 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.752 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.753 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.754 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.755 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.756 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.757 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.758 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.759 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.760 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.762 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.763 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.764 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.766 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.768 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.770 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.772 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.773 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-05-14T12:43:48.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-05-14T12:43:48.775 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-05-14T12:43:48.776 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.777 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.779 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.781 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.782 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.783 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.784 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.785 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.787 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.788 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.791 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.792 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.793 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.796 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.797 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.798 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.801 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.802 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.803 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.804 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.805 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.807 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.808 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-05-14T12:43:48.809 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.810 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.812 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.813 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.814 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.815 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.816 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.818 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.819 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.820 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.823 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24116, 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "y", 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540701547738038271, 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.824 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.826 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.829 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.830 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-05-14T12:43:48.831 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.833 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.837 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.838 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.839 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-05-14T12:43:48.840 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.841 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.842 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.844 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.845 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.847 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.848 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.850 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.851 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.852 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.853 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.855 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.856 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.857 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:48.858 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.859 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.860 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.866 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T12:43:48.867 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.873 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.874 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.875 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-05-14T12:43:48.877 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.878 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.883 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.884 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.889 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.890 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-05-14T12:43:48.891 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.892 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-05-14T12:43:48.893 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-05-14T12:43:48.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.895 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.896 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.898 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.901 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.902 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.903 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.904 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.905 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.906 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.907 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.908 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.909 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.910 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.911 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.915 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-05-14T12:43:48.916 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.917 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.918 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.919 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.920 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.921 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.923 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-05-14T12:43:48.924 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.925 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.926 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.927 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.928 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.929 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.930 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.931 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.933 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.934 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.935 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.936 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.938 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.939 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.941 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.942 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.943 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.947 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.949 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.950 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.951 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.952 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.954 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.955 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.956 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.957 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.959 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.960 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.961 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.962 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.963 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.964 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.965 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.966 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.967 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.968 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.969 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.970 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.971 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.972 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.973 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.974 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.975 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.976 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.977 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-05-14T12:43:48.979 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.980 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.983 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.984 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:48.986 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.987 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.988 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:48.989 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.990 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.991 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:48.992 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.993 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.994 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.995 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.996 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:48.997 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-05-14T12:43:48.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:48.999 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.000 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.001 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.002 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.003 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.004 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.005 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-05-14T12:43:49.006 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T12:43:49.007 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.008 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.011 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.012 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.013 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.014 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.015 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.016 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.017 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.018 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.019 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.020 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-05-14T12:43:49.021 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.022 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.025 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.026 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.027 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.028 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.029 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.030 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.032 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.033 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.034 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.035 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.036 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.037 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.038 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.039 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.040 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.044 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.046 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.047 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.049 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-05-14T12:43:49.050 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.051 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.052 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.053 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.054 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.055 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.056 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.057 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.059 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.060 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.063 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.373+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fed180b28a0 msgr2=0x7fed180b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.373+0000 7fed37200640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fed180b28a0 0x7fed180b4db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fed38076320 tx=0x7fed20009500 comp rx=0 tx=0).stop 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.373+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed38103ac0 msgr2=0x7fed38076980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.373+0000 7fed37200640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed38103ac0 0x7fed38076980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed38103390 tx=0x7fed2800ee50 comp rx=0 tx=0).stop 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 shutdown_connections 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fed180b28a0 0x7fed180b4db0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed38109a00 0x7fed38075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed38104d00 0x7fed38075020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 --2- 172.21.15.47:0/64366950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed38103ac0 0x7fed38076980 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:43:49.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 >> 172.21.15.47:0/64366950 conn(0x7fed380fecb0 msgr2=0x7fed38101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:43:49.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 shutdown_connections 2024-05-14T12:43:49.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:43:48.374+0000 7fed37200640 1 -- 172.21.15.47:0/64366950 wait complete. 2024-05-14T12:43:49.065 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:48 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1554563579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T12:43:49.066 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:48 smithi073 ceph-mon[35809]: pgmap v1008: 97 pgs: 97 active+clean; 329 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 37 op/s 2024-05-14T12:43:49.066 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:48 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2353084444' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T12:43:49.066 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:48 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1554563579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T12:43:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.069 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.070 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.071 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.072 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.074 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.075 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T12:43:49.076 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.080 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.081 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.082 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.083 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.084 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.085 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.090 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.091 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.092 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.093 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.094 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-05-14T12:43:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.096 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.097 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.098 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.099 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.100 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.102 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.104 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.105 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.106 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.107 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.108 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.109 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.110 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.111 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.112 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.113 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.114 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-05-14T12:43:49.115 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.116 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.117 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.118 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.120 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.121 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.122 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.124 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.125 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.126 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.128 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.129 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.130 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-05-14T12:43:49.131 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.133 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.134 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.135 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.136 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.137 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.138 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.139 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.140 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.141 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.142 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.143 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.144 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-05-14T12:43:49.145 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-05-14T12:43:49.146 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.147 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.148 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-05-14T12:43:49.149 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.150 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.151 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.152 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.153 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.154 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.155 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.157 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.158 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.159 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.160 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-05-14T12:43:49.161 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.162 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.163 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.164 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.165 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.166 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.167 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.169 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.171 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.172 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.173 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.174 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.175 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.176 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.177 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.178 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.179 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.180 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.181 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.183 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.184 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.185 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.186 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.187 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.189 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.190 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.191 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.192 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.193 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.194 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.195 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.197 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.197 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.197 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-05-14T12:43:49.197 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-05-14T12:43:49.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-05-14T12:43:49.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.199 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.200 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.201 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.202 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.203 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.204 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.205 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.207 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.209 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.210 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.212 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.214 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.215 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.216 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.218 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.219 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.220 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.221 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.222 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.223 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.224 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.226 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.228 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.229 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.230 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.234 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.235 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.236 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.238 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.239 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.240 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.242 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.243 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.244 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.245 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.246 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.247 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.248 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-05-14T12:43:49.250 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.251 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.252 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.254 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.255 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.256 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.257 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-05-14T12:43:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.260 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.263 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.264 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.265 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.266 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.267 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.269 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.270 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.271 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.272 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.273 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T12:43:49.274 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.275 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-05-14T12:43:49.276 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.277 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.278 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.279 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.280 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.281 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.282 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.283 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.284 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.285 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T12:43:49.286 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "modules": [ 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard", 2024-05-14T12:43:49.287 INFO:teuthology.orchestra.run.smithi047.stdout: "iostat", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "nfs", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "restful" 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:49.288 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.289 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.290 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.291 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.292 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-05-14T12:43:49.294 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-05-14T12:43:49.295 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.296 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.297 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.298 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.299 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.300 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.302 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.303 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:49.304 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-05-14T12:43:49.307 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.308 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T12:43:49.309 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.310 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.311 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.312 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.313 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.314 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.315 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-05-14T12:43:49.316 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.317 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.318 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-05-14T12:43:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-05-14T12:43:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.321 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.322 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T12:43:49.323 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T12:43:49.325 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.327 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.328 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.330 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T12:43:49.331 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.332 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.333 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.334 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.335 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.336 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-05-14T12:43:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.338 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.339 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.340 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-05-14T12:43:49.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.342 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T12:43:49.344 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.345 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.346 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.347 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.348 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T12:43:49.349 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.350 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-05-14T12:43:49.353 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-05-14T12:43:49.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.356 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.357 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-05-14T12:43:49.358 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.359 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.360 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.362 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T12:43:49.363 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.364 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.365 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.366 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.367 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.368 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.369 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T12:43:49.371 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T12:43:49.372 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T12:43:49.373 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.375 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.376 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-05-14T12:43:49.378 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.379 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.381 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.382 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.383 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.384 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.385 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-05-14T12:43:49.387 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.390 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.391 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.392 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.394 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.395 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T12:43:49.397 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T12:43:49.398 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T12:43:49.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T12:43:49.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.402 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.403 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.405 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.406 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.407 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.410 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T12:43:49.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.412 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.416 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T12:43:49.417 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T12:43:49.418 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T12:43:49.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.420 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.422 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.423 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.424 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.425 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T12:43:49.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.427 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.428 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.429 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.430 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.431 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.432 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.433 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.435 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.437 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.438 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.439 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.441 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.442 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-05-14T12:43:49.443 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.445 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-05-14T12:43:49.447 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.448 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.449 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-05-14T12:43:49.450 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-05-14T12:43:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-05-14T12:43:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-05-14T12:43:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-05-14T12:43:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-05-14T12:43:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T12:43:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-05-14T12:43:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-05-14T12:43:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-05-14T12:43:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-05-14T12:43:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-05-14T12:43:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-05-14T12:43:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-05-14T12:43:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.605 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.611 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.615 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.620 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.621 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.622 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.624 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.627 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.628 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.631 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.632 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.633 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-05-14T12:43:49.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-05-14T12:43:49.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.637 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.642 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.643 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.652 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.653 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.659 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.660 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.662 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.663 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.666 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-05-14T12:43:49.667 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.669 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.670 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.671 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.673 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.675 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.677 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-05-14T12:43:49.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.686 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.687 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.688 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.689 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.694 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.697 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.699 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.700 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.702 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.703 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.704 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.706 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.708 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.709 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.711 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.714 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.716 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.717 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.718 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.720 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-05-14T12:43:49.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-05-14T12:43:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-05-14T12:43:49.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.724 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "services": { 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard": "https://172.21.15.47:8443/" 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "always_on_modules": { 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "octopus": [ 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.725 INFO:teuthology.orchestra.run.smithi047.stdout: "pacific": [ 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "quincy": [ 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-05-14T12:43:49.726 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "reef": [ 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-05-14T12:43:49.727 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "squid": [ 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-05-14T12:43:49.728 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "last_failure_osd_epoch": 3, 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "active_clients": [ 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1071422478 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "libcephsqlite", 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2171760509 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 629731935 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2205434082 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:49.731 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-05-14T12:43:49.732 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:43:49.737 DEBUG:tasks.check_counter:Getting stats from a 2024-05-14T12:43:49.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-14T12:43:49.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:49 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/64366950' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T12:43:49.739 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:49 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/64366950' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T12:43:49.739 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:49 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/64366950' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T12:43:50.188 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:43:50.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:50 smithi047 ceph-mon[31254]: pgmap v1009: 97 pgs: 97 active+clean; 245 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.2 KiB/s wr, 28 op/s 2024-05-14T12:43:50.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:50 smithi066 ceph-mon[35981]: pgmap v1009: 97 pgs: 97 active+clean; 245 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.2 KiB/s wr, 28 op/s 2024-05-14T12:43:50.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:50 smithi073 ceph-mon[35809]: pgmap v1009: 97 pgs: 97 active+clean; 245 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.2 KiB/s wr, 28 op/s 2024-05-14T12:43:52.115 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:52 smithi047 ceph-mon[31254]: pgmap v1010: 97 pgs: 97 active+clean; 137 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 30 op/s 2024-05-14T12:43:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:52 smithi066 ceph-mon[35981]: pgmap v1010: 97 pgs: 97 active+clean; 137 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 30 op/s 2024-05-14T12:43:52.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:52 smithi073 ceph-mon[35809]: pgmap v1010: 97 pgs: 97 active+clean; 137 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 30 op/s 2024-05-14T12:43:52.633 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:43:52.633 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:43:52.633 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 7817, 2024-05-14T12:43:52.633 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 8974, 2024-05-14T12:43:52.633 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2123974, 2024-05-14T12:43:52.633 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 14233415, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 32, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 5, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 1.705920803, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.709452890, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 1.041821041, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.207127903, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 8972, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 2.409751885, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000268585 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:43:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 10846, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.006996906, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000645 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 11302, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 13838, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 4072461, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 9613524, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 9, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 6, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 2.225332256, 2024-05-14T12:43:52.635 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.995339298, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 1.387212393, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.201115561, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 13837, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 3.180543530, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000229857 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 19768, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.014038145, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000710 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 877456, 2024-05-14T12:43:52.636 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 237104 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 16278, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 21127, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 5764966, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 16999035, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 130, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 5, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 5.733096785, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 3.451517765, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 2.594191494, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.218436495, 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:43:52.637 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 21126, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 5.141053750, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000243351 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 31732, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.031121852, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000980 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 64560, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 615152 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-05-14T12:43:52.638 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 1, 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-MDSRank": { 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 4645, 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 8.501575474, 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001830263 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-PurgeQueue": { 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-05-14T12:43:52.639 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1778, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.294783494, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000165794 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "request": 2509, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "reply": 2441, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "reply_latency": { 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2441, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 349.765661314, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.143287857 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_reply": 0, 2024-05-14T12:43:52.640 INFO:teuthology.orchestra.run.smithi047.stdout: "forward": 68, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_complete": 2, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_keys": 0, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_commit": 421, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_split": 1, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_merge": 0, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes": 23, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_top": 0, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_bottom": 8, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pin_tail": 15, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pinned": 22, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_expired": 558, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_with_caps": 1, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": 1, 2024-05-14T12:43:52.641 INFO:teuthology.orchestra.run.smithi047.stdout: "subtrees": 2, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse": 3511, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_hit": 3206, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_forward": 11, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_discover": 5, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_remote_ino": 0, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_lock": 43, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "load_cent": 8381, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "q": 7, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "exported": 76, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "exported_inodes": 500, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "imported": 67, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "imported_inodes": 344, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_dir_fetch": 0, 2024-05-14T12:43:52.642 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_peer_discover": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rfiles": 4, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rbytes": 234, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rsnaps": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_set_tag": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_file_inodes": 0, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_inode_file_caps": 165, 2024-05-14T12:43:52.643 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_revoke": 665, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_grant": 3144, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_trunc": 5, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps": 7050, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps_dirty": 6230, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_cap_release": 270, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "process_request_cap_release": 1231 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_cache": { 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update": 341, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update_receipt": 11, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_try_discover": 8, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_send_discover": 54, 2024-05-14T12:43:52.644 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_handle_discover": 936, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_delayed": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_created": 744, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_enqueued": 683, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_reintegrated": 61, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_migrated": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_processing": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_started": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_completed": 0, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_path": 9, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_inode": 1473, 2024-05-14T12:43:52.645 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_exportdir": 77, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_flush": 0, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragmentdir": 1, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragstats": 0, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_inodestats": 0 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_log": { 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "evlrg": 0, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "evadd": 9740, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "evex": 9730, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "evtrm": 9730, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "ev": 10, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "evexg": 0, 2024-05-14T12:43:52.646 INFO:teuthology.orchestra.run.smithi047.stdout: "evexd": 328, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "segadd": 53, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "segex": 52, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "segtrm": 52, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "seg": 1, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "segmjr": 1, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "segexg": 0, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "segexd": 1, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "expos": 24002043, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "wrpos": 24013752, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "rdpos": 0, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "jlat": { 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2205, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 2707.990482032, 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 1.228113597 2024-05-14T12:43:52.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "replayed": 0 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_mem": { 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "ino": 19, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "ino+": 1168, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "ino-": 1149, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "dir": 17, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "dir+": 204, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "dir-": 187, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "dn": 23, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "dn+": 1767, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "dn-": 1744, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "cap": 1, 2024-05-14T12:43:52.648 INFO:teuthology.orchestra.run.smithi047.stdout: "cap+": 1182, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "cap-": 1181, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "rss": 135620, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "heap": 231824 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_server": { 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_client_request": 3518, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_server_request": 1986, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_request": 2509, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_session": 62, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_peer_request": 4425, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "req_create_latency": { 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 745, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1.818802276, 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.002441345 2024-05-14T12:43:52.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getattr_latency": { 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 88, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 15.434265114, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.175389376 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getfilelock_latency": { 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "req_link_latency": { 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 61, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.144300144, 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.002365576 2024-05-14T12:43:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookup_latency": { 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 327, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 18.202999465, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.055666665 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookuphash_latency": { 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupino_latency": { 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.651 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupname_latency": { 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupparent_latency": { 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupsnap_latency": { 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.652 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.653 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lssnap_latency": { 2024-05-14T12:43:52.653 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.653 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.653 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.653 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mkdir_latency": { 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 105, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.338027103, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.003219305 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mknod_latency": { 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mksnap_latency": { 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.654 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "req_open_latency": { 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 84, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.244424551, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.002909816 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "req_readdir_latency": { 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 179, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 3.099926177, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.017318023 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rename_latency": { 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 95, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 34.981003413, 2024-05-14T12:43:52.655 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.368221088 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "req_renamesnap_latency": { 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "req_snapdiff_latency": { 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmdir_latency": { 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 99, 2024-05-14T12:43:52.656 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 273.488925771, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 2.762514401 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmsnap_latency": { 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmxattr_latency": { 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setattr_latency": { 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 6, 2024-05-14T12:43:52.657 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.049472484, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.008245414 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setdirlayout_latency": { 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setfilelock_latency": { 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.003098133, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001549066 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setlayout_latency": { 2024-05-14T12:43:52.658 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setxattr_latency": { 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 7, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.029008955, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.004144136 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "req_symlink_latency": { 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 13, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.016433770, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001264136 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.659 INFO:teuthology.orchestra.run.smithi047.stdout: "req_unlink_latency": { 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 630, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1.914973958, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.003039641 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getvxattr_latency": { 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_sessions": { 2024-05-14T12:43:52.660 INFO:teuthology.orchestra.run.smithi047.stdout: "session_count": 1, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "session_add": 2, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "session_remove": 1, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_open": 1, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_stale": 0, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "total_load": 219, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "average_load": 219, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "avg_session_uptime": 1123, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "mdthresh_evicted": 0 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 360, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 360, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:43:52.661 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:43:52.662 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-05-14T12:43:52.663 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 318743, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 110, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 7624, 2024-05-14T12:43:52.664 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 160, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 90285, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 759, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "objecter": { 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "op_active": 0, 2024-05-14T12:43:52.665 INFO:teuthology.orchestra.run.smithi047.stdout: "op_laggy": 0, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send": 5401, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send_bytes": 21208626, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "op_resend": 31, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "op_reply": 5401, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "op_latency": { 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 5401, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 5923.481168334, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 1.096737857 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "op_inflight": 0, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "oplen_avg": { 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 5401, 2024-05-14T12:43:52.666 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 7673 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "op": 5401, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "op_r": 90, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "op_w": 5311, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "op_rmw": 0, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "op_pg": 0, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_stat": 312, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_create": 624, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_read": 78, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_write": 2286, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writefull": 226, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writesame": 0, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_append": 0, 2024-05-14T12:43:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_zero": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_truncate": 1, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_delete": 1499, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_mapext": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_sparse_read": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_clonerange": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_getxattr": 2, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_setxattr": 1252, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_rmxattr": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_call": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_watch": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_notify": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:43:52.668 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_other": 5, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_active": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_send": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_resend": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_ping": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_active": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_send": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_resend": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_active": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_send": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_resend": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_active": 0, 2024-05-14T12:43:52.669 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_send": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_resend": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "command_active": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "command_send": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "command_resend": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "map_epoch": 84, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "map_full": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "map_inc": 2, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_sessions": 12, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_open": 12, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_close": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_laggy": 0, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_wr": 1186, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_rd": 14, 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_del": 188 2024-05-14T12:43:52.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "oft": { 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_objs": 1, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_updates": 0, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_removes": 0 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "osd-slow-ops": { 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_ops_count": 3211 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "purge_queue": { 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops": 0, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops_high_water": 26, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing": 0, 2024-05-14T12:43:52.671 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_high_water": 6, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed_ops": 979, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed": 683, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_item_in_journal": 0 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 35393, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 8742957, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 35393, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:43:52.672 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 35393, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 8742957, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_bytes": { 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:52.673 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 5401, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 21277267, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 5401, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 21277267, 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:52.674 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_ops": { 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 1024, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 5401, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 5401, 2024-05-14T12:43:52.675 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 5401, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 5401, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 683, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 68991, 2024-05-14T12:43:52.676 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 683, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 81, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 68991, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle-0x55abb447e680": { 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-05-14T12:43:52.677 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 9740, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 19819448, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 9740, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 2205, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 19819448, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.678 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:52.679 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:43:53.653 INFO:tasks.check_counter:Daemon mds.a mds.exported=76 2024-05-14T12:43:53.654 INFO:tasks.check_counter:Daemon mds.a mds.imported=67 2024-05-14T12:43:53.654 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=341 2024-05-14T12:43:53.654 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=11 2024-05-14T12:43:53.654 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=1 2024-05-14T12:43:53.654 DEBUG:tasks.check_counter:Getting stats from d 2024-05-14T12:43:53.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-14T12:43:54.116 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:43:54.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:54 smithi066 ceph-mon[35981]: pgmap v1011: 97 pgs: 97 active+clean; 93 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 26 op/s 2024-05-14T12:43:54.446 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:54 smithi047 ceph-mon[31254]: pgmap v1011: 97 pgs: 97 active+clean; 93 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 26 op/s 2024-05-14T12:43:54.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:54 smithi073 ceph-mon[35809]: pgmap v1011: 97 pgs: 97 active+clean; 93 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 26 op/s 2024-05-14T12:43:56.180 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:56 smithi047 ceph-mon[31254]: pgmap v1012: 97 pgs: 97 active+clean; 65 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 23 op/s 2024-05-14T12:43:56.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:56 smithi066 ceph-mon[35981]: pgmap v1012: 97 pgs: 97 active+clean; 65 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 23 op/s 2024-05-14T12:43:56.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:56 smithi073 ceph-mon[35809]: pgmap v1012: 97 pgs: 97 active+clean; 65 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.2 KiB/s wr, 23 op/s 2024-05-14T12:43:56.568 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:43:56.568 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:43:56.568 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1750, 2024-05-14T12:43:56.568 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 1754, 2024-05-14T12:43:56.568 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 11456242, 2024-05-14T12:43:56.568 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 556661, 2024-05-14T12:43:56.568 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 7, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 3, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.426864242, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.134522751, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.145282559, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.107842488, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1752, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.194920915, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000111256 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.569 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1639, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 1595, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 9541302, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 619878, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 3, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.399126111, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.116809455, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.163950969, 2024-05-14T12:43:56.570 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.096200264, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1594, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.182619015, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000114566 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 845888, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 234400 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.571 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 98, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 383, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 4221326, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 694568, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 7, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 4, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.093111795, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.052427628, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.025660524, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.007224976, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 382, 2024-05-14T12:43:56.572 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.081869695, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000214318 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 665312 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 1, 2024-05-14T12:43:56.573 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-MDSRank": { 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 5162, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.301224357, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000058354 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-PurgeQueue": { 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.574 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "request": 0, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "reply": 0, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "reply_latency": { 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_reply": 0, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "forward": 0, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_complete": 0, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_keys": 0, 2024-05-14T12:43:56.575 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_commit": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_split": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_merge": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes": 66, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_top": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_bottom": 66, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pin_tail": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pinned": 66, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_expired": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_with_caps": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "subtrees": 1, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_hit": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_forward": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_discover": 0, 2024-05-14T12:43:56.576 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_remote_ino": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_lock": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "load_cent": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "q": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "exported": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "exported_inodes": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "imported": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "imported_inodes": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_dir_fetch": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_peer_discover": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rfiles": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rbytes": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rsnaps": 0, 2024-05-14T12:43:56.577 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_set_tag": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_file_inodes": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_grant": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps": 0, 2024-05-14T12:43:56.578 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps_dirty": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_cap_release": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "process_request_cap_release": 0 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_cache": { 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update_receipt": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_try_discover": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_send_discover": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_handle_discover": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_delayed": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_created": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_enqueued": 0, 2024-05-14T12:43:56.579 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_reintegrated": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_migrated": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_processing": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_started": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_completed": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_path": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_inode": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_exportdir": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_flush": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragstats": 0, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_inodestats": 0 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.580 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_log": { 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "evlrg": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "evadd": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "evex": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "evtrm": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "ev": 19105, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "evexg": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "evexd": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "segadd": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "segex": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "segtrm": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "seg": 25, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "segmjr": 3, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "segexg": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "segexd": 0, 2024-05-14T12:43:56.581 INFO:teuthology.orchestra.run.smithi047.stdout: "expos": 4194304, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "wrpos": 27695111, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "rdpos": 27692740, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "jlat": { 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "replayed": 19105 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_mem": { 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "ino": 5, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "ino+": 330, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "ino-": 325, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "dir": 3, 2024-05-14T12:43:56.582 INFO:teuthology.orchestra.run.smithi047.stdout: "dir+": 98, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dir-": 95, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dn": 66, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dn+": 468, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dn-": 402, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "cap": 0, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "cap+": 0, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "cap-": 0, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "rss": 121180, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "heap": 215440 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_server": { 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_client_request": 0, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_server_request": 0, 2024-05-14T12:43:56.583 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_request": 0, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_session": 0, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_peer_request": 0, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "req_create_latency": { 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getattr_latency": { 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getfilelock_latency": { 2024-05-14T12:43:56.584 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "req_link_latency": { 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookup_latency": { 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookuphash_latency": { 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.585 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupino_latency": { 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupname_latency": { 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupparent_latency": { 2024-05-14T12:43:56.586 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupsnap_latency": { 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lssnap_latency": { 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.588 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mkdir_latency": { 2024-05-14T12:43:56.588 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.588 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.588 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mknod_latency": { 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mksnap_latency": { 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "req_open_latency": { 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.589 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "req_readdir_latency": { 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rename_latency": { 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "req_renamesnap_latency": { 2024-05-14T12:43:56.590 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "req_snapdiff_latency": { 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmdir_latency": { 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmsnap_latency": { 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmxattr_latency": { 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setattr_latency": { 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.592 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setdirlayout_latency": { 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setfilelock_latency": { 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setlayout_latency": { 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setxattr_latency": { 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "req_symlink_latency": { 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "req_unlink_latency": { 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.594 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getvxattr_latency": { 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_sessions": { 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "session_count": 1, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "session_add": 1, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "session_remove": 0, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_open": 1, 2024-05-14T12:43:56.595 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_stale": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "total_load": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "average_load": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "avg_session_uptime": 2588, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "mdthresh_evicted": 0 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:43:56.596 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:43:56.597 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 208926, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 65, 2024-05-14T12:43:56.598 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 7624, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 160, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-05-14T12:43:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 62024, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 304, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "objecter": { 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "op_active": 0, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "op_laggy": 0, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send": 3054, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send_bytes": 21, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "op_resend": 3, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "op_reply": 3054, 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "op_latency": { 2024-05-14T12:43:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3054, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 269.943431842, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.088390121 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "op_inflight": 0, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "oplen_avg": { 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3054, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 3055 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "op": 3054, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "op_r": 3054, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "op_w": 0, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "op_rmw": 0, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "op_pg": 0, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_stat": 1831, 2024-05-14T12:43:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_create": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_read": 1221, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_write": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writefull": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writesame": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_append": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_zero": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_truncate": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_delete": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_mapext": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_sparse_read": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_clonerange": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_getxattr": 1, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_setxattr": 0, 2024-05-14T12:43:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_rmxattr": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_call": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_watch": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_notify": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_other": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_active": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_send": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_resend": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_ping": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_active": 0, 2024-05-14T12:43:56.603 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_send": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_resend": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_active": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_send": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_resend": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_active": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_send": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_resend": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "command_active": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "command_send": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "command_resend": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "map_epoch": 84, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "map_full": 0, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "map_inc": 2, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_sessions": 7, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_open": 8, 2024-05-14T12:43:56.604 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_close": 1, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_laggy": 0, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_wr": 0, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_rd": 2, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_del": 0 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "oft": { 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_objs": 0, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_updates": 0, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_removes": 0 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd-slow-ops": { 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_ops_count": 0 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.605 INFO:teuthology.orchestra.run.smithi047.stdout: "purge_queue": { 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_high_water": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed_ops": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_item_in_journal": 0 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 3483, 2024-05-14T12:43:56.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 24880555, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 3483, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 3483, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 24880555, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_bytes": { 2024-05-14T12:43:56.607 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 3054, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 23500896, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 3054, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 23500896, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.608 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_ops": { 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 1024, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 3054, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 3054, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 3054, 2024-05-14T12:43:56.609 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 3054, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:56.610 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle-0x555eda2bc8f0": { 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-05-14T12:43:56.611 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:43:56.612 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:43:57.580 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-05-14T12:43:57.580 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-05-14T12:43:57.581 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update=0 2024-05-14T12:43:57.581 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update_receipt=0 2024-05-14T12:43:57.581 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=0 2024-05-14T12:43:57.581 DEBUG:tasks.check_counter:Getting stats from g 2024-05-14T12:43:57.581 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-14T12:43:58.055 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:43:58.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:43:58 smithi066 ceph-mon[35981]: pgmap v1013: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-05-14T12:43:58.363 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:43:58 smithi047 ceph-mon[31254]: pgmap v1013: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-05-14T12:43:58.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:43:58 smithi073 ceph-mon[35809]: pgmap v1013: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-05-14T12:44:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:00 smithi047 ceph-mon[31254]: pgmap v1014: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 682 B/s wr, 15 op/s 2024-05-14T12:44:00.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:00 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:44:00.304 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:00 smithi073 ceph-mon[35809]: pgmap v1014: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 682 B/s wr, 15 op/s 2024-05-14T12:44:00.304 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:00 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:44:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:00 smithi066 ceph-mon[35981]: pgmap v1014: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 682 B/s wr, 15 op/s 2024-05-14T12:44:00.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:00 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T12:44:00.349 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:44:00.349 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:00.349 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 375, 2024-05-14T12:44:00.349 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 372, 2024-05-14T12:44:00.349 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 558176, 2024-05-14T12:44:00.349 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 230656, 2024-05-14T12:44:00.349 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.148883829, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.071855585, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.047305868, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.016959648, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 371, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.065603474, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000176828 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:00.350 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 558176, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 230656 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 6, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 288, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 3312, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 208288, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-05-14T12:44:00.351 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.054016112, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.043778565, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.004244228, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 287, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.030295694, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000105559 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:00.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 208288 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 0, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 0, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 0, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.001085409, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000000000, 2024-05-14T12:44:00.353 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.000851588, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T12:44:00.354 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:00.355 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:00.356 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 148704, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 29, 2024-05-14T12:44:00.357 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:00.358 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 377, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 505134, 2024-05-14T12:44:00.359 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 377, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 377, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 505134, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:44:00.360 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:44:01.200 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-05-14T12:44:01.200 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-05-14T12:44:01.200 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-05-14T12:44:01.200 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-05-14T12:44:01.200 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-05-14T12:44:01.200 DEBUG:tasks.check_counter:Getting stats from j 2024-05-14T12:44:01.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-14T12:44:01.633 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:02.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.054 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:01 smithi047 ceph-mon[31254]: pgmap v1015: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 14 op/s 2024-05-14T12:44:02.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.055 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:01 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:01 smithi066 ceph-mon[35981]: pgmap v1015: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 14 op/s 2024-05-14T12:44:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:01 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:01 smithi073 ceph-mon[35809]: pgmap v1015: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 14 op/s 2024-05-14T12:44:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:02.253 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:01 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:03.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:03 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:03.986 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:03 smithi047 ceph-mon[31254]: pgmap v1016: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-14T12:44:04.001 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:03 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:03 smithi073 ceph-mon[35809]: pgmap v1016: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-14T12:44:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:03 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:04.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:03 smithi066 ceph-mon[35981]: pgmap v1016: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-14T12:44:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-14T12:44:04.596 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:04.596 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 0, 2024-05-14T12:44:04.596 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 0, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 0, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.005556511, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000000000, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.000703679, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 383, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 380, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 560416, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 235296, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-05-14T12:44:04.598 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.131470719, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.062500265, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.047322238, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.017041153, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 379, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.054565041, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000143971 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:04.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 560416, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 235296 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 6, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 294, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 3312, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 209344, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.054132692, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.043138125, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.004697981, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 293, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.033515944, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000114388 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 209344 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-05-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:04.602 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 149735, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 30, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:04.604 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 928, 2024-05-14T12:44:04.605 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 385, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 506238, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 385, 2024-05-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 385, 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 506238, 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-14T12:44:05.455 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-14T12:44:05.455 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-14T12:44:05.456 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-14T12:44:05.456 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-14T12:44:05.456 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-05-14T12:44:05.456 DEBUG:tasks.check_counter:Getting stats from b 2024-05-14T12:44:05.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-14T12:44:05.713 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:44:06.089 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:05 smithi066 ceph-mon[35981]: pgmap v1017: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-14T12:44:06.089 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:06.089 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:05 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:05 smithi047 ceph-mon[31254]: pgmap v1017: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-14T12:44:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:06.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:05 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:06.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:05 smithi073 ceph-mon[35809]: pgmap v1017: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-14T12:44:06.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:06.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:05 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 20976, 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 21791, 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 7536561, 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 16327584, 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 19, 2024-05-14T12:44:07.413 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 9, 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 1.133313031, 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.448023947, 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.966538934, 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.032480477, 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 21783, 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2.646624977, 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000121499 2024-05-14T12:44:07.414 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 32809, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.007718356, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000235 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 6357, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 5557, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 2674843, 2024-05-14T12:44:07.415 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 4965877, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 9, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 5, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.444939518, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.174721297, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.311174191, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.022044189, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 5561, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.155957348, 2024-05-14T12:44:07.416 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000028044 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 10036, 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.002404519, 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000239 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 580800 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.417 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1851, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1922, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1417345, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 11673803, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 10, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 8, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.194949661, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.077395325, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.077860598, 2024-05-14T12:44:07.418 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.041310430, 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1922, 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.078625235, 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000040908 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1269, 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000292791, 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000230 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.419 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 875632, 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 238640 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 845, 2024-05-14T12:44:07.420 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 3.404691830, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.004029221 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1312, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.042591382, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000032462 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 449, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 415, 2024-05-14T12:44:07.421 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 415, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 250.507394911, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.603632276 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 34, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 11, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 22, 2024-05-14T12:44:07.422 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 4, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 8, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 10, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 13, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 489, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 3, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 1115, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 877, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 25, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 131, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:07.423 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 5, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 338, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 14, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 369, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 325, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 13424230511, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:07.424 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 376, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 544, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 1, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:07.425 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 19133, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 18664, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 34, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 177 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 39, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 425, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 273, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 385, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 75, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:07.426 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 64, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 64, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 9, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 776, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 9, 2024-05-14T12:44:07.427 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 19105, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 19105, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 25, 2024-05-14T12:44:07.428 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 25, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 3, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 27695111, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 0, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 427, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 1257.650526038, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 2.945317391 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 0 2024-05-14T12:44:07.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 26, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 400, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 374, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 25, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 225, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 200, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 22, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 626, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 604, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 309, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 309, 2024-05-14T12:44:07.430 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 140860, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 223632 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 559, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 512, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 449, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 15, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 1351, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 18, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.037808342, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.002100463 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-05-14T12:44:07.431 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 15, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 66.616675872, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 4.441111724 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.432 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 179, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 183.590407363, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 1.025644733 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.433 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.435 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 124, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.105172077, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000848161 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 12, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.007315008, 2024-05-14T12:44:07.436 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000609584 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 18, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.048773296, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.002709627 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.437 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:07.438 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.004743168, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.004743168 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.439 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000601116, 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000300558 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-05-14T12:44:07.440 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 46, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.095898669, 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.002084753 2024-05-14T12:44:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 1, 2024-05-14T12:44:07.442 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 0, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 5, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 5, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 1009, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:07.443 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:07.444 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 280407, 2024-05-14T12:44:07.446 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 105, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 160, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:07.447 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 106173, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 412, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-05-14T12:44:07.448 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 1836, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 23556901, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 28, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 1836, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1836, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 4550.808970556, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 2.478654123 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.449 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1836, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 1986 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 1836, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 3, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 1833, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-05-14T12:44:07.450 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 0, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 10, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 3, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 430, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 62, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 1185, 2024-05-14T12:44:07.451 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 20, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-05-14T12:44:07.452 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 1, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-05-14T12:44:07.453 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 84, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 12, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 12, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-05-14T12:44:07.454 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 196, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 0, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 79 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 1, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "osd-slow-ops": { 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 1260 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.455 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 25, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 6, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 1168, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 64, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:07.456 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 29180, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 8976337, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 29180, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 29180, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 8976337, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:07.457 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 1836, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 23563365, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1836, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 23563365, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.458 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 1836, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 1836, 2024-05-14T12:44:07.459 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1836, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1836, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 64, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 6464, 2024-05-14T12:44:07.460 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 64, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 3, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 6464, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x55fc72f504e0": { 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:07.461 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 19105, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 23500807, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 19105, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 427, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 23500807, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:07.462 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:07.463 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.463 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:07.463 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-14T12:44:08.142 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:07 smithi066 ceph-mon[35981]: pgmap v1018: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-14T12:44:08.142 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:44:08.142 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:44:08.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:07 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:08.146 INFO:tasks.check_counter:Daemon mds.b mds.exported=5 2024-05-14T12:44:08.146 INFO:tasks.check_counter:Daemon mds.b mds.imported=14 2024-05-14T12:44:08.146 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=39 2024-05-14T12:44:08.146 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=425 2024-05-14T12:44:08.147 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-05-14T12:44:08.147 DEBUG:tasks.check_counter:Getting stats from e 2024-05-14T12:44:08.147 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-14T12:44:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:07 smithi073 ceph-mon[35809]: pgmap v1018: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-14T12:44:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:44:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:44:08.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:07 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:44:08.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:07 smithi047 ceph-mon[31254]: pgmap v1018: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-14T12:44:08.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T12:44:08.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T12:44:08.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:07 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' 2024-05-14T12:44:10.129 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-14T12:44:10.129 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:10.129 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 606, 2024-05-14T12:44:10.129 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 606, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 4354955, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 191948, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 7, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.062723632, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.021872829, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.018132862, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.016074280, 2024-05-14T12:44:10.130 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 605, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.023679735, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000039140 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.131 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1235, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1198, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 4162397, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 492937, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.130673210, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.041004674, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.049171885, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.033761929, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1197, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.040155560, 2024-05-14T12:44:10.132 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000033546 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 847040, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 236480 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1353, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1648, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 418436, 2024-05-14T12:44:10.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 1098528, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.152503525, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.053624124, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.036864308, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.046615109, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1646, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.064565926, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000039225 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.134 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 668448 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4776, 2024-05-14T12:44:10.135 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.135440449, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000028358 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-05-14T12:44:10.136 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-05-14T12:44:10.137 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 57, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 57, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 57, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 11, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:10.138 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:10.139 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-05-14T12:44:10.140 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:10.141 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-05-14T12:44:10.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 5719, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-05-14T12:44:10.143 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 8, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 11499513, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 11498375, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 5719 2024-05-14T12:44:10.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 5, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 166, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 161, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 3, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 110, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 107, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 57, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 234, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 177, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 124188, 2024-05-14T12:44:10.145 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 215440 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-05-14T12:44:10.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.147 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.148 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.149 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-05-14T12:44:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-05-14T12:44:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.152 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.153 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.154 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.155 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.156 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-05-14T12:44:10.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 1, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 0, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 2845, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.159 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:10.160 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:10.161 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-05-14T12:44:10.162 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 199793, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 60, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-05-14T12:44:10.163 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 160, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 55688, 2024-05-14T12:44:10.164 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 268, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 2758, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 2758, 2024-05-14T12:44:10.165 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2758, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 419.714833852, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.152180867 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2758, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2759 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 2758, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 2758, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-05-14T12:44:10.166 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1680, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 1076, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-05-14T12:44:10.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-05-14T12:44:10.168 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 84, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 6, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 7, 2024-05-14T12:44:10.169 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 1, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osd-slow-ops": { 2024-05-14T12:44:10.170 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:10.171 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 3190, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 8623635, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 3190, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 3190, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 8623635, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.172 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2758, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 7305214, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2758, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 7305214, 2024-05-14T12:44:10.173 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:10.174 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2758, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2758, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2758, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2758, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:10.175 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:10.176 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x55ff7af6a8f0": { 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:10.177 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:10.178 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:10.178 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.178 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:10.178 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-14T12:44:10.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:09 smithi073 ceph-mon[35809]: pgmap v1019: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:44:10.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:09 smithi066 ceph-mon[35981]: pgmap v1019: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:44:10.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:09 smithi047 ceph-mon[31254]: pgmap v1019: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:44:11.062 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-14T12:44:11.062 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-14T12:44:11.062 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-05-14T12:44:11.062 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-05-14T12:44:11.063 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-05-14T12:44:11.063 DEBUG:tasks.check_counter:Getting stats from h 2024-05-14T12:44:11.063 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-14T12:44:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:44:12.075 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:11 smithi066 ceph-mon[35981]: pgmap v1020: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T12:44:12.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:11 smithi073 ceph-mon[35809]: pgmap v1020: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T12:44:12.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:11 smithi047 ceph-mon[31254]: pgmap v1020: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-14T12:44:13.082 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1901, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1904, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 7791991, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 603935, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 7, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.173059799, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.058972420, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.046422853, 2024-05-14T12:44:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.052320389, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1903, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.067176757, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000035300 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-14T12:44:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 415, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 704, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 8493960, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 880074, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 7, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.055695749, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.019094622, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.019454226, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.012100852, 2024-05-14T12:44:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 701, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.028363042, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000040460 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 748992 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 908, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 864, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 5160239, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 387687, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.105533499, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.033232736, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.041841732, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.025534091, 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 863, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.031559708, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000036569 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 846928, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 236000 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4712, 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.131350586, 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000027875 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-05-14T12:44:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 766, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 521, 2024-05-14T12:44:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 245, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 21, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 2, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-05-14T12:44:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 4, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 234, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-05-14T12:44:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-05-14T12:44:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-05-14T12:44:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 9740, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 49, 2024-05-14T12:44:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 24002043, 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 24013752, 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 24013153, 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 9740 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 22, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 1123, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 1101, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 17, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 201, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 184, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 766, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 1676, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 910, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-05-14T12:44:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 124044, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 215440 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-05-14T12:44:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 2, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-05-14T12:44:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 2848, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 207073, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 61, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 160, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 610154, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 3342, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-05-14T12:44:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 2786, 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 26, 2024-05-14T12:44:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 4, 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 2786, 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2786, 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 532.666072701, 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.191193852 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-05-14T12:44:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2786, 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2787 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 2786, 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 2786, 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-05-14T12:44:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1668, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 1115, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-05-14T12:44:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 2, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-05-14T12:44:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 84, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 7, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 7, 2024-05-14T12:44:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd-slow-ops": { 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 3220, 2024-05-14T12:44:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 21131300, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 3220, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 3220, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 21131300, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2786, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 19819458, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2786, 2024-05-14T12:44:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 19819458, 2024-05-14T12:44:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2786, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2786, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2786, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2786, 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x5562c811c8f0": { 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-05-14T12:44:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-05-14T12:44:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:13.136 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-14T12:44:13.889 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-14T12:44:13.889 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-14T12:44:13.889 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-05-14T12:44:13.889 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-05-14T12:44:13.889 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-05-14T12:44:13.889 DEBUG:tasks.check_counter:Getting stats from k 2024-05-14T12:44:13.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-14T12:44:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T12:44:14.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:14 smithi073 ceph-mon[35809]: pgmap v1021: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:44:14.262 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:14 smithi066 ceph-mon[35981]: pgmap v1021: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:44:14.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:14 smithi047 ceph-mon[31254]: pgmap v1021: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1774, 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1731, 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1265204, 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 665500, 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 5, 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 1, 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.198909719, 2024-05-14T12:44:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.061154299, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.064729780, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.059437019, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1730, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.066922090, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000038683 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 849296, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 240016 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1559, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1866, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 9361296, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 1158618, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.147200242, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.050149174, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.040936393, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.043033139, 2024-05-14T12:44:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1864, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.070657009, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000037906 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 663552 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 4, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 6, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1629, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 1284, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 8, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.003603017, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.000098568, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.003120767, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000112271, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.004746905, 2024-05-14T12:44:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001186726 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-05-14T12:44:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4891, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.140143533, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000028653 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.804 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:15.805 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 28, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 28, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 28, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 4, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-05-14T12:44:15.806 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:15.807 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:44:15.808 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-05-14T12:44:15.809 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:15.810 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 7334, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-05-14T12:44:15.811 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 10, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 13154650, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 13152366, 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-05-14T12:44:15.812 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 7334 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 4, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 64, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 60, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 2, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 37, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 35, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 28, 2024-05-14T12:44:15.813 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 90, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 62, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 124812, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 215440 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-05-14T12:44:15.814 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.815 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.816 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.817 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-05-14T12:44:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.819 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.819 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.819 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.819 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-05-14T12:44:15.819 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.819 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-05-14T12:44:15.820 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.821 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.823 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:15.825 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 2, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-05-14T12:44:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 2852, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:15.827 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:15.828 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:15.829 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 198183, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 54, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 160, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:15.830 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 31768, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 141, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 2895, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-05-14T12:44:15.831 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 2895, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2895, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 453.034577079, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.156488627 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2895, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2896 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 2895, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 2895, 2024-05-14T12:44:15.832 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1822, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 1071, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-05-14T12:44:15.833 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:15.834 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-05-14T12:44:15.835 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 84, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 6, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 9, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 3, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-05-14T12:44:15.836 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "osd-slow-ops": { 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-05-14T12:44:15.837 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 3333, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 10302807, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 3333, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:15.838 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 3333, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 10302807, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:15.839 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2895, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 8960351, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2895, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 8960351, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:15.840 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2895, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2895, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2895, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2895, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.841 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-05-14T12:44:15.842 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x55aecdd9a8f0": { 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-05-14T12:44:15.843 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-05-14T12:44:15.844 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-05-14T12:44:16.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:16 smithi066 ceph-mon[35981]: pgmap v1022: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T12:44:16.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:16 smithi047 ceph-mon[31254]: pgmap v1022: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T12:44:16.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:16 smithi073 ceph-mon[35809]: pgmap v1022: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T12:44:16.699 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-14T12:44:16.699 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-14T12:44:16.699 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-05-14T12:44:16.699 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-05-14T12:44:16.699 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-05-14T12:44:16.699 DEBUG:tasks.check_counter:Getting stats from c 2024-05-14T12:44:16.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-14T12:44:16.944 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:44:18.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:18 smithi066 ceph-mon[35981]: pgmap v1023: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-14T12:44:18.340 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:18 smithi073 ceph-mon[35809]: pgmap v1023: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-14T12:44:18.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:18 smithi047 ceph-mon[31254]: pgmap v1023: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 6639, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 5387, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 2199040, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 9031347, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 13, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 5, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.446013690, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.173762060, 2024-05-14T12:44:18.803 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.316519857, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.035786086, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 5388, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.301770495, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000056007 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 9395, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002089139, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000222 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T12:44:18.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1362, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1519, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 742389, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 8449765, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 9, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.126373970, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.057610471, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.057358225, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.017687165, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1519, 2024-05-14T12:44:18.805 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.088284496, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000058120 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1643, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000438752, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000267 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 585088 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 18061, 2024-05-14T12:44:18.806 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 18386, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 7265920, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 11102335, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 18, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.968793206, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.382413254, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 1.053531854, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.022498239, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 18381, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1.709624015, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000093010 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:18.807 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 26444, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.005146710, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000194 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 867760, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 244912 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:18.808 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 687, 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 2.809375125, 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.004089337 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1093, 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.036618328, 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000033502 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.809 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 324, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 290, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 290, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 17.836074143, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.061503703 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 34, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 11, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-05-14T12:44:18.810 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 24, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 6, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 18, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 0, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 13, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 175, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 2, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 2, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 3, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 805, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 637, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 22, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 88, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:18.811 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 10, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 3, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 10, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 45, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 325, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 13424230511, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:18.812 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 252, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 395, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 16894, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 16582, 2024-05-14T12:44:18.813 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 40, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 103 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 21, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 371, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 228, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 287, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 37, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 44, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 44, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:18.814 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 9, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 805, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 11, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0 2024-05-14T12:44:18.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 16552, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 16552, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 20, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 20, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 3, 2024-05-14T12:44:18.816 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 24338478, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 0, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 343, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 999.050850959, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 2.912684696 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 0 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 28, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 161, 2024-05-14T12:44:18.817 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 133, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 27, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 177, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 150, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 24, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 287, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 263, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 2, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 146, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 144, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 138264, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 223632 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-05-14T12:44:18.818 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 385, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 52, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 324, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 19, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 793, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.006499092, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.003249546 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 4, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 6.081380887, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 1.520345221 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.819 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 123, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 11.500687858, 2024-05-14T12:44:18.820 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.093501527 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000278604, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000139302 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.821 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-05-14T12:44:18.822 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-05-14T12:44:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 108, 2024-05-14T12:44:18.824 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.148335978, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001373481 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 7, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.003590111, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000512873 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:18.825 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.826 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.827 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.828 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 44, 2024-05-14T12:44:18.829 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.095301613, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.002165945 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 2, 2024-05-14T12:44:18.830 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 1, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 21, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 21, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 1118, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:18.832 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-05-14T12:44:18.833 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 287863, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 99, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:18.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 160, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 115245, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 436, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-05-14T12:44:18.835 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 1541, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 20185316, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 33, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 1541, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1541, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 4181.496418987, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 2.713495404 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1541, 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1683 2024-05-14T12:44:18.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 1541, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 6, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 1535, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 0, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 10, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 6, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 350, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 62, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-05-14T12:44:18.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 972, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 20, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:18.838 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-05-14T12:44:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 84, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 12, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 13, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 1, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 193, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 0, 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 70 2024-05-14T12:44:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 1, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "osd-slow-ops": { 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 818 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 25, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 2, 2024-05-14T12:44:18.841 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 956, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 44, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 26058, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 7835248, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 26058, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:18.842 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 26058, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 7835248, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:18.843 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 1541, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 20189760, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 1541, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 20189760, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:18.844 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 1541, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 1541, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 1541, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1541, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.845 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 44, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 4444, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 44, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 7, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 4444, 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:18.846 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x5651cedbc340": { 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 16552, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 20144174, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 16552, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:18.847 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 343, 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 20144174, 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:18.848 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-14T12:44:19.608 INFO:tasks.check_counter:Daemon mds.c mds.exported=10 2024-05-14T12:44:19.608 INFO:tasks.check_counter:Daemon mds.c mds.imported=10 2024-05-14T12:44:19.608 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=21 2024-05-14T12:44:19.608 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=371 2024-05-14T12:44:19.608 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-05-14T12:44:19.609 DEBUG:tasks.check_counter:Getting stats from f 2024-05-14T12:44:19.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-14T12:44:19.852 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:44:20.218 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:20 smithi073 ceph-mon[35809]: pgmap v1024: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-14T12:44:20.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:20 smithi066 ceph-mon[35981]: pgmap v1024: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-14T12:44:20.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:20 smithi047 ceph-mon[31254]: pgmap v1024: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-14T12:44:21.554 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 7788, 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 7947, 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 2744952, 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 6889281, 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 22, 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 5, 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.417556948, 2024-05-14T12:44:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.161797655, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.352510471, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.013047909, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 7939, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.855551961, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000107765 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 11439, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002475071, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000216 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 928, 2024-05-14T12:44:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 736 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 6209, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 5184, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 2256192, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 2162731, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 11, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.385902256, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.153658058, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.283783546, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.012758657, 2024-05-14T12:44:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 5187, 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.217310543, 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000041895 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 9573, 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002374386, 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000248 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 585712 2024-05-14T12:44:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1820, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1660, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1616083, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 5754742, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 9, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 5, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.164733877, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.067997581, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.080949240, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.023557160, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1661, 2024-05-14T12:44:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.071316172, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000042935 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1689, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000448598, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000265 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 861200, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 244752 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 534, 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1.043294558, 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001953735 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 579, 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.018913957, 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000032666 2024-05-14T12:44:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 144, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 144, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 144, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 57.842912097, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.401686889 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 0, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 11, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 24, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 6, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 18, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 0, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 13, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 172, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 0, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 0, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 3, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 540, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 408, 2024-05-14T12:44:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 87, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 10, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 10, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 27, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 325, 2024-05-14T12:44:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 13424230511, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 103, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 158, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 7176, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 7052, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 28, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 55 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 30, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 367, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 226, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 281, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 46, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 27, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 27, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 9, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 748, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 10, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 7334, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 7334, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 10, 2024-05-14T12:44:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 10, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 2, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 13154650, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 0, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 242, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1037.598101875, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 4.287595462 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 0 2024-05-14T12:44:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 28, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 141, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 113, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 27, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 175, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 148, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 24, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 250, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 226, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 0, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 86, 2024-05-14T12:44:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 86, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 134212, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 223632 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 189, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 52, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 144, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 18, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 772, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-05-14T12:44:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 53, 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.027467310, 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000518251 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-05-14T12:44:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 54, 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.035400556, 2024-05-14T12:44:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000655565 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 10, 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.005543648, 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000554364 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-05-14T12:44:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 27, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 57.774500583, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 2.139796317 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 2, 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 1, 2024-05-14T12:44:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 10, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 10, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 2922, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 299903, 2024-05-14T12:44:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 102, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 160, 2024-05-14T12:44:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 114501, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 431, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 902, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 8993032, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 33, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 902, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 902, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 3278.628992224, 2024-05-14T12:44:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 3.634843672 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 902, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 988 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 902, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 7, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 895, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 0, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 10, 2024-05-14T12:44:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 7, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 250, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 61, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 497, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 20, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-05-14T12:44:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 84, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-05-14T12:44:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 12, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 15, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 3, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 104, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 0, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 39 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 1, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-05-14T12:44:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "osd-slow-ops": { 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 766 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 25, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 3, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 483, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 27, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 15813, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 5167208, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 15813, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 15813, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 5167208, 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 902, 2024-05-14T12:44:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 8995759, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 902, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 8995759, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 902, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 902, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 902, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 902, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 27, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 2727, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 27, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 8, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 2727, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x55e6bd3ba5b0": { 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 7334, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 8960346, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 7334, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 242, 2024-05-14T12:44:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 8960346, 2024-05-14T12:44:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:21.606 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-14T12:44:22.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:22 smithi066 ceph-mon[35981]: pgmap v1025: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-14T12:44:22.381 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:22 smithi073 ceph-mon[35809]: pgmap v1025: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-14T12:44:22.406 INFO:tasks.check_counter:Daemon mds.f mds.exported=10 2024-05-14T12:44:22.406 INFO:tasks.check_counter:Daemon mds.f mds.imported=10 2024-05-14T12:44:22.407 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=30 2024-05-14T12:44:22.407 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=367 2024-05-14T12:44:22.407 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-05-14T12:44:22.407 DEBUG:tasks.check_counter:Getting stats from i 2024-05-14T12:44:22.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-14T12:44:22.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:22 smithi047 ceph-mon[31254]: pgmap v1025: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-14T12:44:22.643 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:44:24.322 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:24 smithi073 ceph-mon[35809]: pgmap v1026: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:44:24.323 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-14T12:44:24.323 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:24.323 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 7297, 2024-05-14T12:44:24.323 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 6162, 2024-05-14T12:44:24.323 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 3493257, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 6333332, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 9, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.490877156, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.197044891, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.352526766, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.024006513, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 6166, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.225979114, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000036649 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:24.324 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 11091, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002480937, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000223 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 873568, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 242272 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1269, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1471, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 530572, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 4172642, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 13, 2024-05-14T12:44:24.325 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.108490526, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.045998810, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.049622427, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.015237054, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1468, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.072134616, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000049138 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1399, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000465167, 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000332 2024-05-14T12:44:24.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 752400 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 6156, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 6426, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 2156673, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 2450180, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 21, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 9, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.353254535, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.134971859, 2024-05-14T12:44:24.327 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.288080199, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.010969864, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 6420, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.698795091, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000108846 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 9464, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002039235, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000215 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T12:44:24.328 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 833, 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.973290233, 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001168415 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:24.329 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 541, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.019084964, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000035277 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 210, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 188, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 188, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 48.382982574, 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.257356290 2024-05-14T12:44:24.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 22, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 11, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 23, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 5, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 8, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 10, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 13, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 182, 2024-05-14T12:44:24.331 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 0, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 0, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 3, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 674, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 429, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 18, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 92, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 42, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 3, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 42, 2024-05-14T12:44:24.332 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 59, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 325, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 13424230511, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:24.333 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 183, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 269, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 5449, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 5249, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 61, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 120 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 120, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 312, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 200, 2024-05-14T12:44:24.334 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 223, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 136, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 55, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 55, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-05-14T12:44:24.335 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 9, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 825, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 42, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 5719, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 5719, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-05-14T12:44:24.336 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 8, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 8, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 2, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 11499513, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 0, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 356, 2024-05-14T12:44:24.337 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1129.553285639, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 3.172902487 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 0 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 27, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 173, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 146, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 26, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 152, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 126, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 23, 2024-05-14T12:44:24.338 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 316, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 293, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 0, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 132, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 132, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 130116, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 223632 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 348, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 55, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 210, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 15, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 838, 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-05-14T12:44:24.339 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.340 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 56, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.023404931, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000417945 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.342 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.343 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.344 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 37, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.024417495, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000659932 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 40, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.017848999, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000446224 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.345 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.347 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.348 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-05-14T12:44:24.349 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 55, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 48.317311149, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.878496566 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-05-14T12:44:24.350 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 1, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 0, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 73, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 73, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 1154, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:24.351 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:24.352 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:24.353 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 305629, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 115, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:24.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 160, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 110517, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 440, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.355 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 963, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 7346784, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 28, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 963, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 963, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 2954.494356159, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 3.068010754 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-05-14T12:44:24.356 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 963, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1085 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 963, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 22, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 941, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 0, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 10, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 22, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 380, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 71, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-05-14T12:44:24.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 380, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 20, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-05-14T12:44:24.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-05-14T12:44:24.359 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 84, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 12, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 15, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 3, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 148, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 0, 2024-05-14T12:44:24.360 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 54 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 1, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd-slow-ops": { 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 846 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 25, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-05-14T12:44:24.361 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 6, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 367, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 55, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 14718, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 4829310, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 14718, 2024-05-14T12:44:24.362 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 14718, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 4829310, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:24.363 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 963, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 7352339, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 963, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 7352339, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.364 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 963, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 963, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 963, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 963, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.365 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 55, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 5555, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 55, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:24.366 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 24, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 5555, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x55682a49c4e0": { 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 5719, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 7305209, 2024-05-14T12:44:24.367 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 5719, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 356, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 7305209, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:24.368 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-14T12:44:24.369 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:24 smithi066 ceph-mon[35981]: pgmap v1026: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:44:24.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:24 smithi047 ceph-mon[31254]: pgmap v1026: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-14T12:44:25.117 INFO:tasks.check_counter:Daemon mds.i mds.exported=42 2024-05-14T12:44:25.117 INFO:tasks.check_counter:Daemon mds.i mds.imported=42 2024-05-14T12:44:25.117 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=120 2024-05-14T12:44:25.117 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=312 2024-05-14T12:44:25.117 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-05-14T12:44:25.117 DEBUG:tasks.check_counter:Getting stats from l 2024-05-14T12:44:25.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-14T12:44:25.352 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T12:44:26.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:26 smithi066 ceph-mon[35981]: pgmap v1027: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T12:44:26.471 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:26 smithi073 ceph-mon[35809]: pgmap v1027: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T12:44:26.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:26 smithi047 ceph-mon[31254]: pgmap v1027: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T12:44:27.055 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-05-14T12:44:27.055 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T12:44:27.055 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 2074, 2024-05-14T12:44:27.055 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2033, 2024-05-14T12:44:27.055 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 4726426, 2024-05-14T12:44:27.055 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 762020, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 6, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 2, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.219461430, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.070363808, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.070903880, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.062894590, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2032, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.078784787, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000038772 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:27.056 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 850112, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 241936 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 554, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 851, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 8527785, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 930710, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 7, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2024-05-14T12:44:27.057 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.073252494, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.029851490, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.017752018, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.018673515, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 849, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.037180214, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000043792 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 755424 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1134, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1140, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 8681069, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 360251, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 6, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.104115395, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.036990306, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.028466205, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.029125506, 2024-05-14T12:44:27.059 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1139, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.041227044, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000036195 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-05-14T12:44:27.060 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 5571, 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.159552078, 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000028639 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-05-14T12:44:27.061 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 0, 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 0, 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 45, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 45, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 45, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 1, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 0, 2024-05-14T12:44:27.063 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 1, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 0, 2024-05-14T12:44:27.064 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T12:44:27.065 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 0 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 0, 2024-05-14T12:44:27.066 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-05-14T12:44:27.067 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-05-14T12:44:27.068 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 16552, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 20, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 3, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 24338478, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 24337879, 2024-05-14T12:44:27.069 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 16552 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 4, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 80, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 76, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 2, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 33, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 31, 2024-05-14T12:44:27.070 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 45, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 122, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 77, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 0, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 0, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 0, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 122100, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 215440 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 0, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 0, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 0, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 0, 2024-05-14T12:44:27.071 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 0, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.072 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.073 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-05-14T12:44:27.074 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-05-14T12:44:27.076 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.076 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.076 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.076 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-05-14T12:44:27.076 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-05-14T12:44:27.077 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.078 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-05-14T12:44:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 2, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 1, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 0, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 0, 2024-05-14T12:44:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 2928, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T12:44:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-05-14T12:44:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 207873, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 64, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-05-14T12:44:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 7624, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 160, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 43736, 2024-05-14T12:44:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 209, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 3316, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 21, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 3, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 3316, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3316, 2024-05-14T12:44:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 283.187405186, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.085400303 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3316, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 3317 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 3316, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 3316, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 0, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 2104, 2024-05-14T12:44:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 1210, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 1, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 0, 2024-05-14T12:44:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-05-14T12:44:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 84, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 7, 2024-05-14T12:44:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 8, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 1, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 0, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 2, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 0 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 0, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "osd-slow-ops": { 2024-05-14T12:44:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 0 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 0, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 0, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 0, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 3758, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 21571509, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 3758, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3758, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 21571509, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 3316, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 20147742, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3316, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 20147742, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 3316, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 3316, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3316, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 3316, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x55e4e567a8f0": { 2024-05-14T12:44:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-05-14T12:44:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-05-14T12:44:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-05-14T12:44:27.101 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-05-14T12:44:27.847 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-14T12:44:27.847 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-14T12:44:27.848 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-05-14T12:44:27.848 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-05-14T12:44:27.848 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-05-14T12:44:27.848 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-14T12:44:27.859 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-14T12:44:27.859 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:44:27.859 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T12:44:27.922 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:44:27.922 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T12:44:27.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T12:44:28.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:28 smithi073 ceph-mon[35809]: pgmap v1028: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-14T12:44:28.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:28 smithi066 ceph-mon[35981]: pgmap v1028: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-14T12:44:28.459 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:28.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:28 smithi047 ceph-mon[31254]: pgmap v1028: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-14T12:44:30.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:30 smithi066 ceph-mon[35981]: pgmap v1029: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:44:30.329 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:30 smithi073 ceph-mon[35809]: pgmap v1029: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:44:30.332 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:30 smithi047 ceph-mon[31254]: pgmap v1029: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T12:44:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.908+0000 7f8482400700 1 -- 172.21.15.47:0/1252544316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c108f20 msgr2=0x7f847c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.908+0000 7f8482400700 1 --2- 172.21.15.47:0/1252544316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c108f20 0x7f847c109330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8464009920 tx=0x7f8464009c30 comp rx=0 tx=0).stop 2024-05-14T12:44:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.908+0000 7f8482400700 1 -- 172.21.15.47:0/1252544316 shutdown_connections 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.908+0000 7f8482400700 1 --2- 172.21.15.47:0/1252544316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f847c109870 0x7f847c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.908+0000 7f8482400700 1 --2- 172.21.15.47:0/1252544316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f847c1045f0 0x7f847c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.908+0000 7f8482400700 1 --2- 172.21.15.47:0/1252544316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c108f20 0x7f847c109330 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.909+0000 7f8482400700 1 -- 172.21.15.47:0/1252544316 >> 172.21.15.47:0/1252544316 conn(0x7f847c100040 msgr2=0x7f847c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.909+0000 7f8482400700 1 -- 172.21.15.47:0/1252544316 shutdown_connections 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.909+0000 7f8482400700 1 -- 172.21.15.47:0/1252544316 wait complete. 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.910+0000 7f8482400700 1 Processor -- start 2024-05-14T12:44:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.910+0000 7f8482400700 1 -- start start 2024-05-14T12:44:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f8482400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c1045f0 0x7f847c19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f8482400700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f847c108f20 0x7f847c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f8482400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f847c109870 0x7f847c1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f8482400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f847c1144d0 con 0x7f847c109870 2024-05-14T12:44:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f8482400700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f847c114350 con 0x7f847c108f20 2024-05-14T12:44:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f8482400700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f847c114650 con 0x7f847c1045f0 2024-05-14T12:44:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f847b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c1045f0 0x7f847c19d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f847b400700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c1045f0 0x7f847c19d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:33906/0 (socket says 172.21.15.47:33906) 2024-05-14T12:44:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f847b400700 1 -- 172.21.15.47:0/2406594042 learned_addr learned my addr 172.21.15.47:0/2406594042 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.911+0000 7f847be00700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f847c109870 0x7f847c1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f8472a00700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f847c108f20 0x7f847c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f847b400700 1 -- 172.21.15.47:0/2406594042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f847c108f20 msgr2=0x7f847c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f847b400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f847c108f20 0x7f847c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f847b400700 1 -- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f847c109870 msgr2=0x7f847c1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f847b400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f847c109870 0x7f847c1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f847b400700 1 -- 172.21.15.47:0/2406594042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c1a1fd0 con 0x7f847c1045f0 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f847be00700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f847c109870 0x7f847c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:44:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f847b400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c1045f0 0x7f847c19d100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f846c00e9a0 tx=0x7f846c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:30.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.912+0000 7f8478c00700 1 -- 172.21.15.47:0/2406594042 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c00cbd0 con 0x7f847c1045f0 2024-05-14T12:44:30.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.913+0000 7f8478c00700 1 -- 172.21.15.47:0/2406594042 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f846c00cd70 con 0x7f847c1045f0 2024-05-14T12:44:30.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.913+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847c1a22c0 con 0x7f847c1045f0 2024-05-14T12:44:30.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.913+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847c1a9be0 con 0x7f847c1045f0 2024-05-14T12:44:30.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.913+0000 7f8478c00700 1 -- 172.21.15.47:0/2406594042 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c018680 con 0x7f847c1045f0 2024-05-14T12:44:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.914+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8458005360 con 0x7f847c1045f0 2024-05-14T12:44:30.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.917+0000 7f8478c00700 1 -- 172.21.15.47:0/2406594042 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f846c010430 con 0x7f847c1045f0 2024-05-14T12:44:30.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.918+0000 7f8478c00700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f84600b2900 0x7f84600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:30.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.919+0000 7f8478c00700 1 -- 172.21.15.47:0/2406594042 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f846c0e24f0 con 0x7f847c1045f0 2024-05-14T12:44:30.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.919+0000 7f8472a00700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f84600b2900 0x7f84600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:30.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.920+0000 7f8472a00700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f84600b2900 0x7f84600b4e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f847c107cd0 tx=0x7f8464019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:30.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:30.922+0000 7f8478c00700 1 -- 172.21.15.47:0/2406594042 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f846c0aa1d0 con 0x7f847c1045f0 2024-05-14T12:44:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.188+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8458005650 con 0x7f847c1045f0 2024-05-14T12:44:31.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.189+0000 7f8478c00700 1 -- 172.21.15.47:0/2406594042 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+591 (secure 0 0 0) 0x7f846c0a9ad0 con 0x7f847c1045f0 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3791767528 2024-05-15T12:12:38.074846+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/545134280 2024-05-15T12:12:38.074846+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3930862505 2024-05-15T12:12:38.074846+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3184141127 2024-05-15T12:12:02.805930+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3184141127 2024-05-15T12:12:02.805930+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3791767528 2024-05-15T12:12:38.074846+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2164606567 2024-05-15T12:12:02.805930+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2624675860 2024-05-15T12:12:02.805930+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2731663046 2024-05-15T12:12:02.805930+0000 2024-05-14T12:44:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3380467049 2024-05-15T12:12:38.074846+0000 2024-05-14T12:44:31.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.193+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f84600b2900 msgr2=0x7f84600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:31.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.193+0000 7f8482400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f84600b2900 0x7f84600b4e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f847c107cd0 tx=0x7f8464019040 comp rx=0 tx=0).stop 2024-05-14T12:44:31.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.193+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c1045f0 msgr2=0x7f847c19d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:31.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.193+0000 7f8482400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c1045f0 0x7f847c19d100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f846c00e9a0 tx=0x7f846c00ed60 comp rx=0 tx=0).stop 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 shutdown_connections 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f84600b2900 0x7f84600b4e10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f847c109870 0x7f847c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f847c1045f0 0x7f847c19d100 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 --2- 172.21.15.47:0/2406594042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f847c108f20 0x7f847c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 >> 172.21.15.47:0/2406594042 conn(0x7f847c100040 msgr2=0x7f847c10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 shutdown_connections 2024-05-14T12:44:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:31.194+0000 7f8482400700 1 -- 172.21.15.47:0/2406594042 wait complete. 2024-05-14T12:44:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:listed 10 entries 2024-05-14T12:44:31.982 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-14T12:44:31.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:44:31.982 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-14T12:44:32.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:32 smithi047 ceph-mon[31254]: pgmap v1030: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-14T12:44:32.189 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:32 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/2406594042' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T12:44:32.190 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T12:44:32.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:44:32.191 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-14T12:44:32.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:44:32.269 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-14T12:44:32.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:32 smithi066 ceph-mon[35981]: pgmap v1030: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-14T12:44:32.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:32 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/2406594042' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T12:44:32.349 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T12:44:32.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:44:32.350 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T12:44:32.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:44:32.485 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-14T12:44:32.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:32 smithi073 ceph-mon[35809]: pgmap v1030: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-14T12:44:32.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:32 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/2406594042' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T12:44:32.588 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-14T12:44:32.588 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-14T12:44:32.588 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T12:44:32.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/1bde71c5dd233889cfdcda26ca223d513ccbbe56be7aa49a9bcc71ce325a0958/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/1bde71c5dd233889cfdcda26ca223d513ccbbe56be7aa49a9bcc71ce325a0958/diff,workdir=/var/lib/containers/storage/overlay/1bde71c5dd233889cfdcda26ca223d513ccbbe56be7aa49a9bcc71ce325a0958/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9eddd2ef62a0a8b43fbb11e0fbec0db5580860671f915d8c722c241fb9a8df24/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/9eddd2ef62a0a8b43fbb11e0fbec0db5580860671f915d8c722c241fb9a8df24/diff,workdir=/var/lib/containers/storage/overlay/9eddd2ef62a0a8b43fbb11e0fbec0db5580860671f915d8c722c241fb9a8df24/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/cb8776493846eea59dad027497d669f5827e9a0707c31e5d532ce192bf9d6add/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/cb8776493846eea59dad027497d669f5827e9a0707c31e5d532ce192bf9d6add/diff,workdir=/var/lib/containers/storage/overlay/cb8776493846eea59dad027497d669f5827e9a0707c31e5d532ce192bf9d6add/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f27a17852f1b9fe58fc8d96b08c8f9a3eea981fac568a73ffd5604723c217532/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/f27a17852f1b9fe58fc8d96b08c8f9a3eea981fac568a73ffd5604723c217532/diff,workdir=/var/lib/containers/storage/overlay/f27a17852f1b9fe58fc8d96b08c8f9a3eea981fac568a73ffd5604723c217532/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8a8785aa327865ffdff4f7c8afcb709c3fc90db987c058542da2cb44b902fba4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/8a8785aa327865ffdff4f7c8afcb709c3fc90db987c058542da2cb44b902fba4/diff,workdir=/var/lib/containers/storage/overlay/8a8785aa327865ffdff4f7c8afcb709c3fc90db987c058542da2cb44b902fba4/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3883b01ab23925cb08aa9b3741a94a8cd9659a3620ecc7c94b0bcf103c0845ef/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/3883b01ab23925cb08aa9b3741a94a8cd9659a3620ecc7c94b0bcf103c0845ef/diff,workdir=/var/lib/containers/storage/overlay/3883b01ab23925cb08aa9b3741a94a8cd9659a3620ecc7c94b0bcf103c0845ef/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e581f80a36f1e9c8a8ca970db9080b9cfc4d54bdac6f1fda19e59b6629a84524/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/e581f80a36f1e9c8a8ca970db9080b9cfc4d54bdac6f1fda19e59b6629a84524/diff,workdir=/var/lib/containers/storage/overlay/e581f80a36f1e9c8a8ca970db9080b9cfc4d54bdac6f1fda19e59b6629a84524/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d44987d5ecbfd2094621e303cf56c4cb95d9b7d3742009ad0b9d381913c2c662/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/d44987d5ecbfd2094621e303cf56c4cb95d9b7d3742009ad0b9d381913c2c662/diff,workdir=/var/lib/containers/storage/overlay/d44987d5ecbfd2094621e303cf56c4cb95d9b7d3742009ad0b9d381913c2c662/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/753ce29b2c6c3f4737485097644067802f6cb8c50e2a97b5babb2e3175bfb5a4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/753ce29b2c6c3f4737485097644067802f6cb8c50e2a97b5babb2e3175bfb5a4/diff,workdir=/var/lib/containers/storage/overlay/753ce29b2c6c3f4737485097644067802f6cb8c50e2a97b5babb2e3175bfb5a4/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/4bbf11aa68ab4403adbb3bd590972d6a5116aeae056aa85e9a4c56f1044bd412/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UEKOCVY7WMVE4CQAZUKCK3BVR7:/var/lib/containers/storage/overlay/l/R6O4JANFOTXN5C7A3AYWUGPN7R,upperdir=/var/lib/containers/storage/overlay/4bbf11aa68ab4403adbb3bd590972d6a5116aeae056aa85e9a4c56f1044bd412/diff,workdir=/var/lib/containers/storage/overlay/4bbf11aa68ab4403adbb3bd590972d6a5116aeae056aa85e9a4c56f1044bd412/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 2024-05-14T12:44:32.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:44:32.626 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-14T12:44:32.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T12:44:32.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-14T12:44:32.835 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-05-14T12:44:32.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:44:32.839 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-14T12:44:32.849 INFO:tasks.cephadm:Teardown begin 2024-05-14T12:44:32.849 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T12:44:32.849 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:44:33.289 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:34.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:34 smithi066 ceph-mon[35981]: pgmap v1031: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T12:44:34.477 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:34 smithi047 ceph-mon[31254]: pgmap v1031: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T12:44:34.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:34 smithi073 ceph-mon[35809]: pgmap v1031: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.521+0000 7fbcd7c00700 1 -- 172.21.15.47:0/2129542970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd0110970 msgr2=0x7fbcd0110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.521+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/2129542970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd0110970 0x7fbcd0110d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009990 tx=0x7fbcc4009ca0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.522+0000 7fbcd7c00700 1 -- 172.21.15.47:0/2129542970 shutdown_connections 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.522+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/2129542970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd010b2e0 0x7fbcd0117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.522+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/2129542970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd0110970 0x7fbcd0110d80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.522+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/2129542970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcd010a990 0x7fbcd010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.522+0000 7fbcd7c00700 1 -- 172.21.15.47:0/2129542970 >> 172.21.15.47:0/2129542970 conn(0x7fbcd0077c80 msgr2=0x7fbcd00780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.522+0000 7fbcd7c00700 1 -- 172.21.15.47:0/2129542970 shutdown_connections 2024-05-14T12:44:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.522+0000 7fbcd7c00700 1 -- 172.21.15.47:0/2129542970 wait complete. 2024-05-14T12:44:35.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.523+0000 7fbcd7c00700 1 Processor -- start 2024-05-14T12:44:35.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.524+0000 7fbcd7c00700 1 -- start start 2024-05-14T12:44:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.524+0000 7fbcd7c00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd010a990 0x7fbcd01a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.524+0000 7fbcd7c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd010b2e0 0x7fbcd01a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.524+0000 7fbcd7c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcd0110970 0x7fbcd01a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.524+0000 7fbcd7c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd011aa90 con 0x7fbcd0110970 2024-05-14T12:44:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.524+0000 7fbcd7c00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd011a910 con 0x7fbcd010b2e0 2024-05-14T12:44:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.524+0000 7fbcd7c00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd011ac10 con 0x7fbcd010a990 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd010a990 0x7fbcd01a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd010a990 0x7fbcd01a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:33926/0 (socket says 172.21.15.47:33926) 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 -- 172.21.15.47:0/3047203620 learned_addr learned my addr 172.21.15.47:0/3047203620 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbccfe00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd010b2e0 0x7fbcd01a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5c00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcd0110970 0x7fbcd01a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 -- 172.21.15.47:0/3047203620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd010b2e0 msgr2=0x7fbcd01a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd010b2e0 0x7fbcd01a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 -- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcd0110970 msgr2=0x7fbcd01a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcd0110970 0x7fbcd01a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.525+0000 7fbcd5200700 1 -- 172.21.15.47:0/3047203620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd01a6310 con 0x7fbcd010a990 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.526+0000 7fbcd5200700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd010a990 0x7fbcd01a1440 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4000c00 tx=0x7fbcc4009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.526+0000 7fbccd600700 1 -- 172.21.15.47:0/3047203620 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4026070 con 0x7fbcd010a990 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.526+0000 7fbccd600700 1 -- 172.21.15.47:0/3047203620 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc4021410 con 0x7fbcd010a990 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.526+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd01a65a0 con 0x7fbcd010a990 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.526+0000 7fbccd600700 1 -- 172.21.15.47:0/3047203620 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4017650 con 0x7fbcd010a990 2024-05-14T12:44:35.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.526+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd01a6a80 con 0x7fbcd010a990 2024-05-14T12:44:35.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.527+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd00512c0 con 0x7fbcd010a990 2024-05-14T12:44:35.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.530+0000 7fbccd600700 1 -- 172.21.15.47:0/3047203620 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbcc4029070 con 0x7fbcd010a990 2024-05-14T12:44:35.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.531+0000 7fbccd600700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbcb80b2880 0x7fbcb80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:35.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.532+0000 7fbccd600700 1 -- 172.21.15.47:0/3047203620 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbcc40e32b0 con 0x7fbcd010a990 2024-05-14T12:44:35.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.532+0000 7fbccfe00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbcb80b2880 0x7fbcb80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:35.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.532+0000 7fbccfe00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbcb80b2880 0x7fbcb80b4d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbcd007b060 tx=0x7fbcbc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:35.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.534+0000 7fbccd600700 1 -- 172.21.15.47:0/3047203620 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbcc4013070 con 0x7fbcd010a990 2024-05-14T12:44:35.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.831+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcd002e5f0 con 0x7fbcd010a990 2024-05-14T12:44:35.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.832+0000 7fbccd600700 1 -- 172.21.15.47:0/3047203620 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+11938 (secure 0 0 0) 0x7fbcc40ab0b0 con 0x7fbcd010a990 2024-05-14T12:44:35.832 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:44:35.832 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":67,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":67,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:43:31.996114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24521,24535,24517,24502,24490]},"id":1}]} 2024-05-14T12:44:35.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbcb80b2880 msgr2=0x7fbcb80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:35.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbcb80b2880 0x7fbcb80b4d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbcd007b060 tx=0x7fbcbc009260 comp rx=0 tx=0).stop 2024-05-14T12:44:35.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd010a990 msgr2=0x7fbcd01a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:35.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd010a990 0x7fbcd01a1440 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4000c00 tx=0x7fbcc4009510 comp rx=0 tx=0).stop 2024-05-14T12:44:35.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 shutdown_connections 2024-05-14T12:44:35.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fbcb80b2880 0x7fbcb80b4d90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcd0110970 0x7fbcd01a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd010a990 0x7fbcd01a1440 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 --2- 172.21.15.47:0/3047203620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcd010b2e0 0x7fbcd01a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:35.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 >> 172.21.15.47:0/3047203620 conn(0x7fbcd0077c80 msgr2=0x7fbcd007bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:35.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 shutdown_connections 2024-05-14T12:44:35.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:35.835+0000 7fbcd7c00700 1 -- 172.21.15.47:0/3047203620 wait complete. 2024-05-14T12:44:35.836 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 67 2024-05-14T12:44:36.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:36 smithi047 ceph-mon[31254]: pgmap v1032: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-14T12:44:36.226 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:36 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3047203620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:44:36.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:36 smithi073 ceph-mon[35809]: pgmap v1032: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-14T12:44:36.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:36 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3047203620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:44:36.574 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:36 smithi066 ceph-mon[35981]: pgmap v1032: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-14T12:44:36.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:36 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3047203620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:44:36.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T12:44:37.148 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:37.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:37 smithi047 ceph-mon[31254]: pgmap v1033: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:37.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:37 smithi073 ceph-mon[35809]: pgmap v1033: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:37.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:37 smithi066 ceph-mon[35981]: pgmap v1033: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:39.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 -- 172.21.15.47:0/3396146972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 msgr2=0x7effc8109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:39.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 --2- 172.21.15.47:0/3396146972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 0x7effc8109710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7effb8009990 tx=0x7effb8009ca0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 -- 172.21.15.47:0/3396146972 shutdown_connections 2024-05-14T12:44:39.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 --2- 172.21.15.47:0/3396146972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc81031d0 0x7effc8111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 --2- 172.21.15.47:0/3396146972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 0x7effc8109710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 --2- 172.21.15.47:0/3396146972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc8102880 0x7effc8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 -- 172.21.15.47:0/3396146972 >> 172.21.15.47:0/3396146972 conn(0x7effc80fe6f0 msgr2=0x7effc8100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:39.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.619+0000 7effcda00700 1 -- 172.21.15.47:0/3396146972 shutdown_connections 2024-05-14T12:44:39.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.620+0000 7effcda00700 1 -- 172.21.15.47:0/3396146972 wait complete. 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 Processor -- start 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 -- start start 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc8102880 0x7effc819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc81031d0 0x7effc819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 0x7effc819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7effc8114590 con 0x7effc8109300 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7effc8114410 con 0x7effc8102880 2024-05-14T12:44:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.621+0000 7effcda00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7effc8114710 con 0x7effc81031d0 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc8102880 0x7effc819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc8102880 0x7effc819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:32808/0 (socket says 172.21.15.47:32808) 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 -- 172.21.15.47:0/429625407 learned_addr learned my addr 172.21.15.47:0/429625407 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc7400700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 0x7effc819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6000700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc81031d0 0x7effc819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 -- 172.21.15.47:0/429625407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc81031d0 msgr2=0x7effc819b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc81031d0 0x7effc819b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 -- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 msgr2=0x7effc819f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 0x7effc819f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.622+0000 7effc6a00700 1 -- 172.21.15.47:0/429625407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc819fe10 con 0x7effc8102880 2024-05-14T12:44:39.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.623+0000 7effc6a00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc8102880 0x7effc819af40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7effb8006010 tx=0x7effb80057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:39.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.623+0000 7effbf400700 1 -- 172.21.15.47:0/429625407 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8027070 con 0x7effc8102880 2024-05-14T12:44:39.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.623+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc81a00a0 con 0x7effc8102880 2024-05-14T12:44:39.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.623+0000 7effbf400700 1 -- 172.21.15.47:0/429625407 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb8022470 con 0x7effc8102880 2024-05-14T12:44:39.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.623+0000 7effbf400700 1 -- 172.21.15.47:0/429625407 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8017650 con 0x7effc8102880 2024-05-14T12:44:39.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.623+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81a7a20 con 0x7effc8102880 2024-05-14T12:44:39.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.625+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc810c8a0 con 0x7effc8102880 2024-05-14T12:44:39.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.627+0000 7effbf400700 1 -- 172.21.15.47:0/429625407 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7effb802a070 con 0x7effc8102880 2024-05-14T12:44:39.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.629+0000 7effbf400700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effac0b2900 0x7effac0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:39.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.629+0000 7effbf400700 1 -- 172.21.15.47:0/429625407 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7effb80e3170 con 0x7effc8102880 2024-05-14T12:44:39.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.629+0000 7effc6000700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effac0b2900 0x7effac0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:39.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.630+0000 7effc6000700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effac0b2900 0x7effac0b4e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7effc8102190 tx=0x7effb4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:39.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.631+0000 7effbf400700 1 -- 172.21.15.47:0/429625407 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7effb8013070 con 0x7effc8102880 2024-05-14T12:44:39.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.920+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effc80512c0 con 0x7effc8102880 2024-05-14T12:44:39.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.921+0000 7effbf400700 1 -- 172.21.15.47:0/429625407 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+11938 (secure 0 0 0) 0x7effb80aaee0 con 0x7effc8102880 2024-05-14T12:44:39.922 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:44:39.922 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":67,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/683389749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":683389749},{"type":"v1","addr":"172.21.15.47:6835","nonce":683389749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1063467558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1063467558},{"type":"v1","addr":"172.21.15.47:6839","nonce":1063467558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":67,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T12:21:02.642705+0000","modified":"2024-05-14T12:43:31.996114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24535,"mds_1":24521,"mds_2":24517,"mds_3":24502,"mds_4":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3730098623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3730098623},{"type":"v1","addr":"172.21.15.66:6833","nonce":3730098623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1120434141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1120434141},{"type":"v1","addr":"172.21.15.73:6833","nonce":1120434141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/2635749889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2635749889},{"type":"v1","addr":"172.21.15.66:6835","nonce":2635749889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/1559121259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1559121259},{"type":"v1","addr":"172.21.15.47:6837","nonce":1559121259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/2588925145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2588925145},{"type":"v1","addr":"172.21.15.66:6837","nonce":2588925145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.73:6835/263909949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":263909949},{"type":"v1","addr":"172.21.15.73:6835","nonce":263909949}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6837/3629841248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3629841248},{"type":"v1","addr":"172.21.15.73:6837","nonce":3629841248}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":14,"addr":"172.21.15.73:6839/2008561705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":2008561705},{"type":"v1","addr":"172.21.15.73:6839","nonce":2008561705}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.66:6839/2700854370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2700854370},{"type":"v1","addr":"172.21.15.66:6839","nonce":2700854370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24535":{"gid":24535,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.47:6841/3387131427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":3387131427},{"type":"v1","addr":"172.21.15.47:6841","nonce":3387131427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24535,"qdb_cluster":[24521,24535,24517,24502,24490]},"id":1}]} 2024-05-14T12:44:39.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effac0b2900 msgr2=0x7effac0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effac0b2900 0x7effac0b4e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7effc8102190 tx=0x7effb4009260 comp rx=0 tx=0).stop 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc8102880 msgr2=0x7effc819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc8102880 0x7effc819af40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7effb8006010 tx=0x7effb80057c0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 shutdown_connections 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7effac0b2900 0x7effac0b4e10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effc8109300 0x7effc819f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effc8102880 0x7effc819af40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 --2- 172.21.15.47:0/429625407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effc81031d0 0x7effc819b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:39.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.926+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 >> 172.21.15.47:0/429625407 conn(0x7effc80fe6f0 msgr2=0x7effc810a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:39.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.927+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 shutdown_connections 2024-05-14T12:44:39.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:39.927+0000 7effcda00700 1 -- 172.21.15.47:0/429625407 wait complete. 2024-05-14T12:44:39.928 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 67 2024-05-14T12:44:40.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:39 smithi047 ceph-mon[31254]: pgmap v1034: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T12:44:40.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:39 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/429625407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:44:40.251 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:39 smithi073 ceph-mon[35809]: pgmap v1034: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T12:44:40.252 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:39 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/429625407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:44:40.278 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:39 smithi066 ceph-mon[35981]: pgmap v1034: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-14T12:44:40.278 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:39 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/429625407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T12:44:40.790 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T12:44:41.268 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:42.228 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:42 smithi047 ceph-mon[31254]: pgmap v1035: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:42.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:42 smithi066 ceph-mon[35981]: pgmap v1035: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:42.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:42 smithi073 ceph-mon[35809]: pgmap v1035: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:43.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.778+0000 7fa02a600700 1 -- 172.21.15.47:0/10604962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa02410af50 msgr2=0x7fa02410b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.778+0000 7fa02a600700 1 --2- 172.21.15.47:0/10604962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa02410af50 0x7fa02410b360 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa0100098f0 tx=0x7fa010009c00 comp rx=0 tx=0).stop 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.778+0000 7fa02a600700 1 -- 172.21.15.47:0/10604962 shutdown_connections 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.778+0000 7fa02a600700 1 --2- 172.21.15.47:0/10604962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02410b8a0 0x7fa024113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.778+0000 7fa02a600700 1 --2- 172.21.15.47:0/10604962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa024106620 0x7fa024106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.778+0000 7fa02a600700 1 --2- 172.21.15.47:0/10604962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa02410af50 0x7fa02410b360 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.778+0000 7fa02a600700 1 -- 172.21.15.47:0/10604962 >> 172.21.15.47:0/10604962 conn(0x7fa024102030 msgr2=0x7fa024104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.779+0000 7fa02a600700 1 -- 172.21.15.47:0/10604962 shutdown_connections 2024-05-14T12:44:43.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.779+0000 7fa02a600700 1 -- 172.21.15.47:0/10604962 wait complete. 2024-05-14T12:44:43.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.780+0000 7fa02a600700 1 Processor -- start 2024-05-14T12:44:43.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.780+0000 7fa02a600700 1 -- start start 2024-05-14T12:44:43.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.780+0000 7fa02a600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa024106620 0x7fa02419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.780+0000 7fa02a600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02410af50 0x7fa02419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa02a600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02410b8a0 0x7fa0241a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa02a600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa024116500 con 0x7fa02410af50 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa02a600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa024116380 con 0x7fa024106620 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa02a600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa024116680 con 0x7fa02410b8a0 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa024106620 0x7fa02419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa024106620 0x7fa02419ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:32832/0 (socket says 172.21.15.47:32832) 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 -- 172.21.15.47:0/419283623 learned_addr learned my addr 172.21.15.47:0/419283623 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa023e00700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02410af50 0x7fa02419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:43.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029c00700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02410b8a0 0x7fa0241a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:43.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 -- 172.21.15.47:0/419283623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02410b8a0 msgr2=0x7fa0241a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:43.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02410b8a0 0x7fa0241a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:43.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 -- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02410af50 msgr2=0x7fa02419d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:43.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02410af50 0x7fa02419d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:43.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.781+0000 7fa029200700 1 -- 172.21.15.47:0/419283623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0241a1da0 con 0x7fa024106620 2024-05-14T12:44:43.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.782+0000 7fa029200700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa024106620 0x7fa02419ced0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa01800e9c0 tx=0x7fa01800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.782+0000 7fa021600700 1 -- 172.21.15.47:0/419283623 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018004a30 con 0x7fa024106620 2024-05-14T12:44:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.782+0000 7fa021600700 1 -- 172.21.15.47:0/419283623 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa01800cc70 con 0x7fa024106620 2024-05-14T12:44:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.782+0000 7fa021600700 1 -- 172.21.15.47:0/419283623 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018005490 con 0x7fa024106620 2024-05-14T12:44:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.782+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0241a2090 con 0x7fa024106620 2024-05-14T12:44:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.782+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0241a99b0 con 0x7fa024106620 2024-05-14T12:44:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.783+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0240512c0 con 0x7fa024106620 2024-05-14T12:44:43.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.786+0000 7fa021600700 1 -- 172.21.15.47:0/419283623 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa018004bd0 con 0x7fa024106620 2024-05-14T12:44:43.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.788+0000 7fa021600700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa00c0b2900 0x7fa00c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:43.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.788+0000 7fa021600700 1 -- 172.21.15.47:0/419283623 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa0180e2470 con 0x7fa024106620 2024-05-14T12:44:43.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.788+0000 7fa023e00700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa00c0b2900 0x7fa00c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:43.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.789+0000 7fa023e00700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa00c0b2900 0x7fa00c0b4e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa010009fd0 tx=0x7fa010019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:43.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:43.790+0000 7fa021600700 1 -- 172.21.15.47:0/419283623 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa018054df0 con 0x7fa024106620 2024-05-14T12:44:44.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.039+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa02419e260 con 0x7fa024106620 2024-05-14T12:44:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.042+0000 7fa021600700 1 -- 172.21.15.47:0/419283623 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22629 (secure 0 0 0) 0x7fa02419e260 con 0x7fa024106620 2024-05-14T12:44:44.042 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-14T12:44:44.042 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":84,"fsid":"e5959f02-11ea-11ef-bc98-c7b262605968","created":"2024-05-14T12:11:28.507275+0000","modified":"2024-05-14T12:21:39.488185+0000","last_up_change":"2024-05-14T12:19:45.788226+0000","last_in_change":"2024-05-14T12:19:26.262398+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T12:15:26.253753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T12:20:53.643900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T12:20:58.482353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93dfcb55-8853-4f03-845b-ba543a595731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6803","nonce":2686634727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6805","nonce":2686634727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6809","nonce":2686634727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2686634727},{"type":"v1","addr":"172.21.15.47:6807","nonce":2686634727}]},"public_addr":"172.21.15.47:6803/2686634727","cluster_addr":"172.21.15.47:6805/2686634727","heartbeat_back_addr":"172.21.15.47:6809/2686634727","heartbeat_front_addr":"172.21.15.47:6807/2686634727","state":["exists","up"]},{"osd":1,"uuid":"a5f87079-8c21-4289-bb99-2969ef95c1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6801","nonce":3104926440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6803","nonce":3104926440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6807","nonce":3104926440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":3104926440},{"type":"v1","addr":"172.21.15.66:6805","nonce":3104926440}]},"public_addr":"172.21.15.66:6801/3104926440","cluster_addr":"172.21.15.66:6803/3104926440","heartbeat_back_addr":"172.21.15.66:6807/3104926440","heartbeat_front_addr":"172.21.15.66:6805/3104926440","state":["exists","up"]},{"osd":2,"uuid":"1131b486-8220-4f69-85d2-b249ded3392f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6801","nonce":4201489932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6803","nonce":4201489932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6807","nonce":4201489932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4201489932},{"type":"v1","addr":"172.21.15.73:6805","nonce":4201489932}]},"public_addr":"172.21.15.73:6801/4201489932","cluster_addr":"172.21.15.73:6803/4201489932","heartbeat_back_addr":"172.21.15.73:6807/4201489932","heartbeat_front_addr":"172.21.15.73:6805/4201489932","state":["exists","up"]},{"osd":3,"uuid":"0cdbf6ec-880b-4a04-9411-baf21e5daf0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6811","nonce":2176301728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6813","nonce":2176301728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6817","nonce":2176301728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2176301728},{"type":"v1","addr":"172.21.15.47:6815","nonce":2176301728}]},"public_addr":"172.21.15.47:6811/2176301728","cluster_addr":"172.21.15.47:6813/2176301728","heartbeat_back_addr":"172.21.15.47:6817/2176301728","heartbeat_front_addr":"172.21.15.47:6815/2176301728","state":["exists","up"]},{"osd":4,"uuid":"c6a73cfc-0b02-4d92-b2c0-7d5289970c22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6809","nonce":1977323226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6811","nonce":1977323226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6815","nonce":1977323226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1977323226},{"type":"v1","addr":"172.21.15.66:6813","nonce":1977323226}]},"public_addr":"172.21.15.66:6809/1977323226","cluster_addr":"172.21.15.66:6811/1977323226","heartbeat_back_addr":"172.21.15.66:6815/1977323226","heartbeat_front_addr":"172.21.15.66:6813/1977323226","state":["exists","up"]},{"osd":5,"uuid":"73764d93-e78d-4398-a314-f5d3fafdbb3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6809","nonce":3780521249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6811","nonce":3780521249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6815","nonce":3780521249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3780521249},{"type":"v1","addr":"172.21.15.73:6813","nonce":3780521249}]},"public_addr":"172.21.15.73:6809/3780521249","cluster_addr":"172.21.15.73:6811/3780521249","heartbeat_back_addr":"172.21.15.73:6815/3780521249","heartbeat_front_addr":"172.21.15.73:6813/3780521249","state":["exists","up"]},{"osd":6,"uuid":"589bf07a-e38e-486f-b8b7-4beeb4f937dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6819","nonce":1409128354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6821","nonce":1409128354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6825","nonce":1409128354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1409128354},{"type":"v1","addr":"172.21.15.47:6823","nonce":1409128354}]},"public_addr":"172.21.15.47:6819/1409128354","cluster_addr":"172.21.15.47:6821/1409128354","heartbeat_back_addr":"172.21.15.47:6825/1409128354","heartbeat_front_addr":"172.21.15.47:6823/1409128354","state":["exists","up"]},{"osd":7,"uuid":"3bc811ec-06ad-4f6a-a8ca-5b199ba4cb41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6817","nonce":1666910569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6819","nonce":1666910569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6823","nonce":1666910569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1666910569},{"type":"v1","addr":"172.21.15.66:6821","nonce":1666910569}]},"public_addr":"172.21.15.66:6817/1666910569","cluster_addr":"172.21.15.66:6819/1666910569","heartbeat_back_addr":"172.21.15.66:6823/1666910569","heartbeat_front_addr":"172.21.15.66:6821/1666910569","state":["exists","up"]},{"osd":8,"uuid":"8df95850-ff70-4fb9-a2c4-bcd51a5e3762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6817","nonce":1194835774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6819","nonce":1194835774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6823","nonce":1194835774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1194835774},{"type":"v1","addr":"172.21.15.73:6821","nonce":1194835774}]},"public_addr":"172.21.15.73:6817/1194835774","cluster_addr":"172.21.15.73:6819/1194835774","heartbeat_back_addr":"172.21.15.73:6823/1194835774","heartbeat_front_addr":"172.21.15.73:6821/1194835774","state":["exists","up"]},{"osd":9,"uuid":"be5d9c5f-765b-43b6-a77c-8976ed5a443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6827","nonce":3151826793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6829","nonce":3151826793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6833","nonce":3151826793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3151826793},{"type":"v1","addr":"172.21.15.47:6831","nonce":3151826793}]},"public_addr":"172.21.15.47:6827/3151826793","cluster_addr":"172.21.15.47:6829/3151826793","heartbeat_back_addr":"172.21.15.47:6833/3151826793","heartbeat_front_addr":"172.21.15.47:6831/3151826793","state":["exists","up"]},{"osd":10,"uuid":"248e33b6-d8dd-49ac-9ec5-f9b0741b49b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6825","nonce":609811860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6827","nonce":609811860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6831","nonce":609811860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":609811860},{"type":"v1","addr":"172.21.15.66:6829","nonce":609811860}]},"public_addr":"172.21.15.66:6825/609811860","cluster_addr":"172.21.15.66:6827/609811860","heartbeat_back_addr":"172.21.15.66:6831/609811860","heartbeat_front_addr":"172.21.15.66:6829/609811860","state":["exists","up"]},{"osd":11,"uuid":"f80cffd5-cb0c-46c4-9cc3-704730531566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6825","nonce":4073821208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6827","nonce":4073821208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6831","nonce":4073821208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":4073821208},{"type":"v1","addr":"172.21.15.73:6829","nonce":4073821208}]},"public_addr":"172.21.15.73:6825/4073821208","cluster_addr":"172.21.15.73:6827/4073821208","heartbeat_back_addr":"172.21.15.73:6831/4073821208","heartbeat_front_addr":"172.21.15.73:6829/4073821208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:33.588472+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:14:58.985734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:23.813649+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:15:58.316319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:24.424502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:16:49.271712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:24.530262+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:17:50.713239+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:15.951721+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:18:51.314777+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:18.925131+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T12:19:44.363050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6800/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/545134280":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/3930862505":"2024-05-15T12:12:38.074846+0000","172.21.15.47:6800/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3184141127":"2024-05-15T12:12:02.805930+0000","172.21.15.47:6801/3791767528":"2024-05-15T12:12:38.074846+0000","172.21.15.47:0/2164606567":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2624675860":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/2731663046":"2024-05-15T12:12:02.805930+0000","172.21.15.47:0/3380467049":"2024-05-15T12:12:38.074846+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T12:44:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa00c0b2900 msgr2=0x7fa00c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa00c0b2900 0x7fa00c0b4e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa010009fd0 tx=0x7fa010019040 comp rx=0 tx=0).stop 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa024106620 msgr2=0x7fa02419ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa024106620 0x7fa02419ced0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa01800e9c0 tx=0x7fa01800ecd0 comp rx=0 tx=0).stop 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 shutdown_connections 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fa00c0b2900 0x7fa00c0b4e10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa02410b8a0 0x7fa0241a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa024106620 0x7fa02419ced0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 --2- 172.21.15.47:0/419283623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa02410af50 0x7fa02419d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 >> 172.21.15.47:0/419283623 conn(0x7fa024102030 msgr2=0x7fa02410a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:44.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 shutdown_connections 2024-05-14T12:44:44.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:44.045+0000 7fa02a600700 1 -- 172.21.15.47:0/419283623 wait complete. 2024-05-14T12:44:44.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:44 smithi066 ceph-mon[35981]: pgmap v1036: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:44.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:44 smithi047 ceph-mon[31254]: pgmap v1036: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:44.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:44 smithi073 ceph-mon[35809]: pgmap v1036: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-14T12:44:44.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs fail cephfs 2024-05-14T12:44:45.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:45 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/419283623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:44:45.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:45 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/419283623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:44:45.401 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:45.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:45 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/419283623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T12:44:46.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:46 smithi047 ceph-mon[31254]: pgmap v1037: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 10 op/s 2024-05-14T12:44:46.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:46 smithi066 ceph-mon[35981]: pgmap v1037: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 10 op/s 2024-05-14T12:44:46.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:46 smithi073 ceph-mon[35809]: pgmap v1037: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 10 op/s 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 -- 172.21.15.47:0/2855579979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 msgr2=0x7f6ba41111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 --2- 172.21.15.47:0/2855579979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 0x7f6ba41111b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00b0d0 tx=0x7f6b9c00b3e0 comp rx=0 tx=0).stop 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 -- 172.21.15.47:0/2855579979 shutdown_connections 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 --2- 172.21.15.47:0/2855579979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 0x7f6ba41111b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 --2- 172.21.15.47:0/2855579979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba41045d0 0x7f6ba41049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 --2- 172.21.15.47:0/2855579979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba4108f00 0x7f6ba4109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 -- 172.21.15.47:0/2855579979 >> 172.21.15.47:0/2855579979 conn(0x7f6ba40ffea0 msgr2=0x7f6ba41022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:47.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 -- 172.21.15.47:0/2855579979 shutdown_connections 2024-05-14T12:44:47.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.814+0000 7f6bab600700 1 -- 172.21.15.47:0/2855579979 wait complete. 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.816+0000 7f6bab600700 1 Processor -- start 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.816+0000 7f6bab600700 1 -- start start 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.816+0000 7f6bab600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba41045d0 0x7f6ba419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.816+0000 7f6bab600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba4108f00 0x7f6ba419d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.816+0000 7f6bab600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 0x7f6ba41a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6bab600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4114480 con 0x7f6ba4109850 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6bab600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4114300 con 0x7f6ba41045d0 2024-05-14T12:44:47.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6bab600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4114600 con 0x7f6ba4108f00 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba41045d0 0x7f6ba419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba41045d0 0x7f6ba419cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:32840/0 (socket says 172.21.15.47:32840) 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3762179584 learned_addr learned my addr 172.21.15.47:0/3762179584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba3e00700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba4108f00 0x7f6ba419d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba9600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 0x7f6ba41a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3762179584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba4108f00 msgr2=0x7f6ba419d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba4108f00 0x7f6ba419d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 msgr2=0x7f6ba41a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 0x7f6ba41a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba8c00700 1 -- 172.21.15.47:0/3762179584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba41a1ec0 con 0x7f6ba41045d0 2024-05-14T12:44:47.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.817+0000 7f6ba9600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 0x7f6ba41a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:44:47.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.818+0000 7f6ba8c00700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba41045d0 0x7f6ba419cff0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800e9a0 tx=0x7f6b9800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:47.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.818+0000 7f6ba1600700 1 -- 172.21.15.47:0/3762179584 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800cbd0 con 0x7f6ba41045d0 2024-05-14T12:44:47.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.818+0000 7f6ba1600700 1 -- 172.21.15.47:0/3762179584 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b9800cd70 con 0x7f6ba41045d0 2024-05-14T12:44:47.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.818+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba41a21b0 con 0x7f6ba41045d0 2024-05-14T12:44:47.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.818+0000 7f6ba1600700 1 -- 172.21.15.47:0/3762179584 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98018680 con 0x7f6ba41045d0 2024-05-14T12:44:47.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.818+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba41a9ad0 con 0x7f6ba41045d0 2024-05-14T12:44:47.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.819+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba40512c0 con 0x7f6ba41045d0 2024-05-14T12:44:47.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.822+0000 7f6ba1600700 1 -- 172.21.15.47:0/3762179584 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6b98010430 con 0x7f6ba41045d0 2024-05-14T12:44:47.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.824+0000 7f6ba1600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b8c0b2900 0x7f6b8c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:47.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.824+0000 7f6ba1600700 1 -- 172.21.15.47:0/3762179584 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6b980e2900 con 0x7f6ba41045d0 2024-05-14T12:44:47.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.824+0000 7f6ba3e00700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b8c0b2900 0x7f6b8c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:47.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.825+0000 7f6ba3e00700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b8c0b2900 0x7f6b8c0b4e10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009680 tx=0x7f6b90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:47.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:47.826+0000 7f6ba1600700 1 -- 172.21.15.47:0/3762179584 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b980aa5e0 con 0x7f6ba41045d0 2024-05-14T12:44:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.116+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6ba41a9ca0 con 0x7f6ba41045d0 2024-05-14T12:44:48.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:48 smithi047 ceph-mon[31254]: pgmap v1038: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T12:44:48.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.132+0000 7f6ba1600700 1 -- 172.21.15.47:0/3762179584 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) ==== 161+0+0 (secure 0 0 0) 0x7f6b980a9ee0 con 0x7f6ba41045d0 2024-05-14T12:44:48.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.136+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b8c0b2900 msgr2=0x7f6b8c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:48.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.136+0000 7f6bab600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b8c0b2900 0x7f6b8c0b4e10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009680 tx=0x7f6b90009260 comp rx=0 tx=0).stop 2024-05-14T12:44:48.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.136+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba41045d0 msgr2=0x7f6ba419cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:48.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.136+0000 7f6bab600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba41045d0 0x7f6ba419cff0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800e9a0 tx=0x7f6b9800ecb0 comp rx=0 tx=0).stop 2024-05-14T12:44:48.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 shutdown_connections 2024-05-14T12:44:48.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f6b8c0b2900 0x7f6b8c0b4e10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:48.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ba4109850 0x7f6ba41a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:48.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ba41045d0 0x7f6ba419cff0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:48.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 --2- 172.21.15.47:0/3762179584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba4108f00 0x7f6ba419d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:48.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 >> 172.21.15.47:0/3762179584 conn(0x7f6ba40ffea0 msgr2=0x7f6ba4110eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:48.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 shutdown_connections 2024-05-14T12:44:48.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:48.137+0000 7f6bab600700 1 -- 172.21.15.47:0/3762179584 wait complete. 2024-05-14T12:44:48.138 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-14T12:44:48.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:48 smithi066 ceph-mon[35981]: pgmap v1038: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T12:44:48.325 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b[66117]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.325 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b[66117]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.326 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:44:48 smithi066 ceph-mds[66121]: -- 172.21.15.66:0/438988186 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f60989da40 con 0x55f6098e5600 2024-05-14T12:44:48.326 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b[66117]: starting mds.b at 2024-05-14T12:44:48.326 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e[65500]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.326 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e[65500]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.327 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:44:48 smithi066 ceph-mds[65504]: -- 172.21.15.66:0/2686224283 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c61f6f9a40 con 0x55c61f741180 2024-05-14T12:44:48.327 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e[65500]: starting mds.e at 2024-05-14T12:44:48.327 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h[65804]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.327 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h[65804]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.327 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:44:48 smithi066 ceph-mds[65808]: -- 172.21.15.66:0/1623259855 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5626ef74fa40 con 0x5626ef797600 2024-05-14T12:44:48.327 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h[65804]: starting mds.h at 2024-05-14T12:44:48.328 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k[65188]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.328 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k[65188]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.328 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:44:48 smithi066 ceph-mds[65192]: -- 172.21.15.66:0/1112038882 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557198111a40 con 0x557198159a80 2024-05-14T12:44:48.328 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:44:48 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k[65188]: starting mds.k at 2024-05-14T12:44:48.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:48 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a[31250]: 2024-05-14T12:44:48.119+0000 7f9824600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T12:44:48.485 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:44:48 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d[69767]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.486 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:44:48 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d[69767]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.486 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:44:48 smithi047 ceph-mds[69775]: -- 172.21.15.47:0/812334869 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d826541a40 con 0x55d826589a80 2024-05-14T12:44:48.486 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:44:48 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d[69767]: starting mds.d at 2024-05-14T12:44:48.486 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:44:48 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.486 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:44:48 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.486 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:44:48 smithi047 ceph-mds[70932]: -- 172.21.15.47:0/1029165085 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b81a03fa40 con 0x55b81a087600 2024-05-14T12:44:48.486 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:44:48 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: starting mds.a at 2024-05-14T12:44:48.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:48 smithi073 ceph-mon[35809]: pgmap v1038: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-14T12:44:48.502 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.502 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:44:48 smithi073 ceph-mds[67019]: -- 172.21.15.73:0/2716250827 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe7b6d3a40 con 0x55fe7b71b180 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: starting mds.c at 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: 2024-05-14T12:44:48.199+0000 7f7be63fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: 2024-05-14T12:44:48.199+0000 7f7be63fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f[66714]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f[66714]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:44:48 smithi073 ceph-mds[66718]: -- 172.21.15.73:0/298728728 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b44430ba40 con 0x55b444353180 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f[66714]: starting mds.f at 2024-05-14T12:44:48.503 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f[66714]: 2024-05-14T12:44:48.199+0000 7fe32e1af700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-14T12:44:48.504 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i[67330]: ignoring --setuser ceph since I am not root 2024-05-14T12:44:48.504 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i[67330]: ignoring --setgroup ceph since I am not root 2024-05-14T12:44:48.504 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:44:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i[67330]: starting mds.i at 2024-05-14T12:44:48.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-14T12:44:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:49 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/3762179584' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-14T12:44:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:49 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-14T12:44:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:49 smithi047 ceph-mon[31254]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-14T12:44:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:49 smithi047 ceph-mon[31254]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T12:44:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:49 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-14T12:44:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:49 smithi047 ceph-mon[31254]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T12:44:49.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:49 smithi047 ceph-mon[31254]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-14T12:44:49.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:49 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/3762179584' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-14T12:44:49.406 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:49 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-14T12:44:49.406 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:49 smithi066 ceph-mon[35981]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-14T12:44:49.406 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:49 smithi066 ceph-mon[35981]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T12:44:49.406 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:49 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-14T12:44:49.406 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:49 smithi066 ceph-mon[35981]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T12:44:49.406 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:49 smithi066 ceph-mon[35981]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-14T12:44:49.432 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:49.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:49 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/3762179584' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-14T12:44:49.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:49 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-14T12:44:49.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:49 smithi073 ceph-mon[35809]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-14T12:44:49.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:49 smithi073 ceph-mon[35809]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T12:44:49.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:49 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-14T12:44:49.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:49 smithi073 ceph-mon[35809]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T12:44:49.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:49 smithi073 ceph-mon[35809]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: pgmap v1040: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6834/1641168263,v1:172.21.15.73:6832/1641168263] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6833/4276339669,v1:172.21.15.73:6835/4276339669] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6832/2562769626,v1:172.21.15.66:6834/2562769626] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6833/3171236253,v1:172.21.15.66:6835/3171236253] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6836/3664529285,v1:172.21.15.73:6837/3664529285] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.73:6838/2290819875,v1:172.21.15.73:6839/2290819875] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6836/3339551524,v1:172.21.15.66:6837/3339551524] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.66:6838/2828009114,v1:172.21.15.66:6839/2828009114] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.47:6836/3332819600,v1:172.21.15.47:6840/3332819600] up:boot 2024-05-14T12:44:50.236 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: mds.? [v2:172.21.15.47:6837/283667804,v1:172.21.15.47:6841/283667804] up:boot 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T12:44:50.237 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:50 smithi047 ceph-mon[31254]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: pgmap v1040: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6834/1641168263,v1:172.21.15.73:6832/1641168263] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6833/4276339669,v1:172.21.15.73:6835/4276339669] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6832/2562769626,v1:172.21.15.66:6834/2562769626] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6833/3171236253,v1:172.21.15.66:6835/3171236253] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6836/3664529285,v1:172.21.15.73:6837/3664529285] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.73:6838/2290819875,v1:172.21.15.73:6839/2290819875] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6836/3339551524,v1:172.21.15.66:6837/3339551524] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.66:6838/2828009114,v1:172.21.15.66:6839/2828009114] up:boot 2024-05-14T12:44:50.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.47:6836/3332819600,v1:172.21.15.47:6840/3332819600] up:boot 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: mds.? [v2:172.21.15.47:6837/283667804,v1:172.21.15.47:6841/283667804] up:boot 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T12:44:50.326 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:50 smithi066 ceph-mon[35981]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T12:44:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: pgmap v1040: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T12:44:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6834/1641168263,v1:172.21.15.73:6832/1641168263] up:boot 2024-05-14T12:44:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6833/4276339669,v1:172.21.15.73:6835/4276339669] up:boot 2024-05-14T12:44:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6832/2562769626,v1:172.21.15.66:6834/2562769626] up:boot 2024-05-14T12:44:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6833/3171236253,v1:172.21.15.66:6835/3171236253] up:boot 2024-05-14T12:44:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6836/3664529285,v1:172.21.15.73:6837/3664529285] up:boot 2024-05-14T12:44:50.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.73:6838/2290819875,v1:172.21.15.73:6839/2290819875] up:boot 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6836/3339551524,v1:172.21.15.66:6837/3339551524] up:boot 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.66:6838/2828009114,v1:172.21.15.66:6839/2828009114] up:boot 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.47:6836/3332819600,v1:172.21.15.47:6840/3332819600] up:boot 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: mds.? [v2:172.21.15.47:6837/283667804,v1:172.21.15.47:6841/283667804] up:boot 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T12:44:50.503 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T12:44:50.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T12:44:50.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T12:44:50.504 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:50 smithi073 ceph-mon[35809]: from='mgr.14152 172.21.15.47:0/296861857' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T12:44:51.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.680+0000 7ffbaca00700 1 -- 172.21.15.47:0/1016519329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8076680 msgr2=0x7ffba8110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:51.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.680+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1016519329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8076680 0x7ffba8110660 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009990 tx=0x7ffb94009ca0 comp rx=0 tx=0).stop 2024-05-14T12:44:51.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.681+0000 7ffbaca00700 1 -- 172.21.15.47:0/1016519329 shutdown_connections 2024-05-14T12:44:51.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.681+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1016519329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffba8110ba0 0x7ffba8113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:51.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.681+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1016519329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8075d30 0x7ffba8076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:51.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.681+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1016519329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8076680 0x7ffba8110660 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:51.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.681+0000 7ffbaca00700 1 -- 172.21.15.47:0/1016519329 >> 172.21.15.47:0/1016519329 conn(0x7ffba8100040 msgr2=0x7ffba8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:51.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.681+0000 7ffbaca00700 1 -- 172.21.15.47:0/1016519329 shutdown_connections 2024-05-14T12:44:51.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.681+0000 7ffbaca00700 1 -- 172.21.15.47:0/1016519329 wait complete. 2024-05-14T12:44:51.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.682+0000 7ffbaca00700 1 Processor -- start 2024-05-14T12:44:51.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.682+0000 7ffbaca00700 1 -- start start 2024-05-14T12:44:51.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffbaca00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8075d30 0x7ffba819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:51.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffbaca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8076680 0x7ffba819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:51.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffbaca00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffba8110ba0 0x7ffba81a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:51.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffbaca00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81166f0 con 0x7ffba8076680 2024-05-14T12:44:51.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffbaca00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffba8116570 con 0x7ffba8110ba0 2024-05-14T12:44:51.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffbaca00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffba8116870 con 0x7ffba8075d30 2024-05-14T12:44:51.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffba5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8076680 0x7ffba819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:51.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffba5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8076680 0x7ffba819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55842/0 (socket says 172.21.15.47:55842) 2024-05-14T12:44:51.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffba5400700 1 -- 172.21.15.47:0/1278425674 learned_addr learned my addr 172.21.15.47:0/1278425674 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:51.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffba5e00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8075d30 0x7ffba819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:51.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.683+0000 7ffba6800700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffba8110ba0 0x7ffba81a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:51.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.684+0000 7ffba5400700 1 -- 172.21.15.47:0/1278425674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8075d30 msgr2=0x7ffba819d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:51.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.684+0000 7ffba5400700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8075d30 0x7ffba819d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:51.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.684+0000 7ffba5400700 1 -- 172.21.15.47:0/1278425674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffba8110ba0 msgr2=0x7ffba81a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:51.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.684+0000 7ffba5400700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffba8110ba0 0x7ffba81a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:51.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.684+0000 7ffba5400700 1 -- 172.21.15.47:0/1278425674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba81a1f50 con 0x7ffba8076680 2024-05-14T12:44:51.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.684+0000 7ffba5e00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8075d30 0x7ffba819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:44:51.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.684+0000 7ffba5400700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8076680 0x7ffba819d620 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb94000c00 tx=0x7ffb940057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:51.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.685+0000 7ffb9ea00700 1 -- 172.21.15.47:0/1278425674 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94027070 con 0x7ffba8076680 2024-05-14T12:44:51.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.685+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba81a21e0 con 0x7ffba8076680 2024-05-14T12:44:51.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.685+0000 7ffb9ea00700 1 -- 172.21.15.47:0/1278425674 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb94022470 con 0x7ffba8076680 2024-05-14T12:44:51.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.685+0000 7ffb9ea00700 1 -- 172.21.15.47:0/1278425674 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94017650 con 0x7ffba8076680 2024-05-14T12:44:51.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.685+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba81a26c0 con 0x7ffba8076680 2024-05-14T12:44:51.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.686+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba80512c0 con 0x7ffba8076680 2024-05-14T12:44:51.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.689+0000 7ffb9ea00700 1 -- 172.21.15.47:0/1278425674 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ffb9402a070 con 0x7ffba8076680 2024-05-14T12:44:51.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.691+0000 7ffb9ea00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb8c0b2880 0x7ffb8c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:51.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.691+0000 7ffb9ea00700 1 -- 172.21.15.47:0/1278425674 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8670+0+0 (secure 0 0 0) 0x7ffb940e3410 con 0x7ffba8076680 2024-05-14T12:44:51.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.691+0000 7ffba5e00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb8c0b2880 0x7ffb8c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:51.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.692+0000 7ffba5e00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb8c0b2880 0x7ffb8c0b4d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb98011490 tx=0x7ffb98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.693+0000 7ffb9ea00700 1 -- 172.21.15.47:0/1278425674 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffb94013070 con 0x7ffba8076680 2024-05-14T12:44:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:51.979+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ffba802e5f0 con 0x7ffba8076680 2024-05-14T12:44:52.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.036+0000 7ffb9ea00700 1 -- 172.21.15.47:0/1278425674 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) ==== 104+0+0 (secure 0 0 0) 0x7ffb940aafb0 con 0x7ffba8076680 2024-05-14T12:44:52.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb8c0b2880 msgr2=0x7ffb8c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:52.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb8c0b2880 0x7ffb8c0b4d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb98011490 tx=0x7ffb98009260 comp rx=0 tx=0).stop 2024-05-14T12:44:52.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8076680 msgr2=0x7ffba819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:52.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8076680 0x7ffba819d620 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb94000c00 tx=0x7ffb940057c0 comp rx=0 tx=0).stop 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 shutdown_connections 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7ffb8c0b2880 0x7ffb8c0b4d90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffba8110ba0 0x7ffba81a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffba8075d30 0x7ffba819d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 --2- 172.21.15.47:0/1278425674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffba8076680 0x7ffba819d620 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.041+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 >> 172.21.15.47:0/1278425674 conn(0x7ffba8100040 msgr2=0x7ffba81006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.042+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 shutdown_connections 2024-05-14T12:44:52.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:52.042+0000 7ffbaca00700 1 -- 172.21.15.47:0/1278425674 wait complete. 2024-05-14T12:44:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:52 smithi047 ceph-mon[31254]: pgmap v1041: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-05-14T12:44:52.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:52 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1278425674' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:44:52.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:52 smithi066 ceph-mon[35981]: pgmap v1041: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-05-14T12:44:52.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:52 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1278425674' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:44:52.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:52 smithi073 ceph-mon[35809]: pgmap v1041: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-05-14T12:44:52.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:52 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1278425674' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T12:44:52.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-14T12:44:53.302 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:53.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:53 smithi066 ceph-mon[35981]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-14T12:44:53.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:53 smithi066 ceph-mon[35981]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-14T12:44:53.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:53 smithi066 ceph-mon[35981]: Cluster is now healthy 2024-05-14T12:44:53.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:53 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1278425674' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-14T12:44:53.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:53 smithi066 ceph-mon[35981]: fsmap 12 up:standby 2024-05-14T12:44:53.463 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:53 smithi047 ceph-mon[31254]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-14T12:44:53.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:53 smithi047 ceph-mon[31254]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-14T12:44:53.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:53 smithi047 ceph-mon[31254]: Cluster is now healthy 2024-05-14T12:44:53.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:53 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1278425674' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-14T12:44:53.464 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:53 smithi047 ceph-mon[31254]: fsmap 12 up:standby 2024-05-14T12:44:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:53 smithi073 ceph-mon[35809]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-14T12:44:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:53 smithi073 ceph-mon[35809]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-14T12:44:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:53 smithi073 ceph-mon[35809]: Cluster is now healthy 2024-05-14T12:44:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:53 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1278425674' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-14T12:44:53.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:53 smithi073 ceph-mon[35809]: fsmap 12 up:standby 2024-05-14T12:44:54.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:54 smithi066 ceph-mon[35981]: pgmap v1042: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-05-14T12:44:54.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:54 smithi047 ceph-mon[31254]: pgmap v1042: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-05-14T12:44:54.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:54 smithi073 ceph-mon[35809]: pgmap v1042: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-05-14T12:44:55.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 -- 172.21.15.47:0/1778038708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83181045f0 msgr2=0x7f8318104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:55.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 --2- 172.21.15.47:0/1778038708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83181045f0 0x7f8318104a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83080099c0 tx=0x7f8308009cd0 comp rx=0 tx=0).stop 2024-05-14T12:44:55.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 -- 172.21.15.47:0/1778038708 shutdown_connections 2024-05-14T12:44:55.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 --2- 172.21.15.47:0/1778038708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8318109870 0x7f83181111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:55.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 --2- 172.21.15.47:0/1778038708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83181045f0 0x7f8318104a00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:55.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 --2- 172.21.15.47:0/1778038708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8318108f20 0x7f8318109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:55.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 -- 172.21.15.47:0/1778038708 >> 172.21.15.47:0/1778038708 conn(0x7f8318100040 msgr2=0x7f8318102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:55.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.497+0000 7f831d600700 1 -- 172.21.15.47:0/1778038708 shutdown_connections 2024-05-14T12:44:55.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.498+0000 7f831d600700 1 -- 172.21.15.47:0/1778038708 wait complete. 2024-05-14T12:44:55.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.499+0000 7f831d600700 1 Processor -- start 2024-05-14T12:44:55.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.499+0000 7f831d600700 1 -- start start 2024-05-14T12:44:55.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f831d600700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83181045f0 0x7f8318075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:55.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f831d600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8318108f20 0x7f8318076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:55.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f831d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8318109870 0x7f8318076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:55.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f831d600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f83181144f0 con 0x7f8318109870 2024-05-14T12:44:55.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f831d600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8318114370 con 0x7f8318108f20 2024-05-14T12:44:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f831d600700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8318114670 con 0x7f83181045f0 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f8316a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83181045f0 0x7f8318075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f8316a00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83181045f0 0x7f8318075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.47:39804/0 (socket says 172.21.15.47:39804) 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f8316a00700 1 -- 172.21.15.47:0/1217117796 learned_addr learned my addr 172.21.15.47:0/1217117796 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f8316000700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8318108f20 0x7f8318076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.500+0000 7f8317400700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8318109870 0x7f8318076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f8316a00700 1 -- 172.21.15.47:0/1217117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8318108f20 msgr2=0x7f8318076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f8316a00700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8318108f20 0x7f8318076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f8316a00700 1 -- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8318109870 msgr2=0x7f8318076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f8316a00700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8318109870 0x7f8318076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f8316a00700 1 -- 172.21.15.47:0/1217117796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83181a9260 con 0x7f83181045f0 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f8317400700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8318109870 0x7f8318076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f8316a00700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83181045f0 0x7f8318075ac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8308006010 tx=0x7f8308005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f830f400700 1 -- 172.21.15.47:0/1217117796 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308026070 con 0x7f83181045f0 2024-05-14T12:44:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83181a94f0 con 0x7f83181045f0 2024-05-14T12:44:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.501+0000 7f830f400700 1 -- 172.21.15.47:0/1217117796 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8308003c70 con 0x7f83181045f0 2024-05-14T12:44:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.502+0000 7f830f400700 1 -- 172.21.15.47:0/1217117796 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830800fb40 con 0x7f83181045f0 2024-05-14T12:44:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.502+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181a9950 con 0x7f83181045f0 2024-05-14T12:44:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.503+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83180512c0 con 0x7f83181045f0 2024-05-14T12:44:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.505+0000 7f830f400700 1 -- 172.21.15.47:0/1217117796 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8308029070 con 0x7f83181045f0 2024-05-14T12:44:55.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.507+0000 7f830f400700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f82fc0b2880 0x7f82fc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:55.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.507+0000 7f830f400700 1 -- 172.21.15.47:0/1217117796 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8670+0+0 (secure 0 0 0) 0x7f83080e3370 con 0x7f83181045f0 2024-05-14T12:44:55.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.507+0000 7f8316000700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f82fc0b2880 0x7f82fc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:55.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.508+0000 7f8316000700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f82fc0b2880 0x7f82fc0b4d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f83181034c0 tx=0x7f8304009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:55.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.509+0000 7f830f400700 1 -- 172.21.15.47:0/1217117796 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8308030080 con 0x7f83181045f0 2024-05-14T12:44:55.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:55.750+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f831802e5f0 con 0x7f83181045f0 2024-05-14T12:44:56.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.083+0000 7f830f400700 1 -- 172.21.15.47:0/1217117796 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7f8308013070 con 0x7f83181045f0 2024-05-14T12:44:56.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f82fc0b2880 msgr2=0x7f82fc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f82fc0b2880 0x7f82fc0b4d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f83181034c0 tx=0x7f8304009260 comp rx=0 tx=0).stop 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83181045f0 msgr2=0x7f8318075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83181045f0 0x7f8318075ac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8308006010 tx=0x7f8308005280 comp rx=0 tx=0).stop 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 shutdown_connections 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7f82fc0b2880 0x7f82fc0b4d90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8318109870 0x7f8318076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83181045f0 0x7f8318075ac0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.088+0000 7f831d600700 1 --2- 172.21.15.47:0/1217117796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8318108f20 0x7f8318076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.089+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 >> 172.21.15.47:0/1217117796 conn(0x7f8318100040 msgr2=0x7f8318108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:56.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.090+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 shutdown_connections 2024-05-14T12:44:56.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:56.090+0000 7f831d600700 1 -- 172.21.15.47:0/1217117796 wait complete. 2024-05-14T12:44:56.094 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-05-14T12:44:56.324 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:56 smithi066 ceph-mon[35981]: pgmap v1043: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-14T12:44:56.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:56 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/1217117796' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:44:56.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:56 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:44:56.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:56 smithi047 ceph-mon[31254]: pgmap v1043: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-14T12:44:56.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:56 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/1217117796' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:44:56.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:56 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:44:56.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:56 smithi073 ceph-mon[35809]: pgmap v1043: 97 pgs: 97 active+clean; 61 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-14T12:44:56.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:56 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/1217117796' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:44:56.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:56 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:44:56.927 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid e5959f02-11ea-11ef-bc98-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-14T12:44:57.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:57 smithi047 ceph-mon[31254]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-14T12:44:57.234 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:57 smithi047 ceph-mon[31254]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T12:44:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T12:44:57.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:57 smithi073 ceph-mon[35809]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-14T12:44:57.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:57 smithi073 ceph-mon[35809]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T12:44:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:57 smithi066 ceph-mon[35981]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-14T12:44:57.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:57 smithi066 ceph-mon[35981]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T12:44:58.235 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:58 smithi047 ceph-mon[31254]: pgmap v1045: 65 pgs: 65 active+clean; 577 KiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:44:58.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:58 smithi073 ceph-mon[35809]: pgmap v1045: 65 pgs: 65 active+clean; 577 KiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:44:58.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:58 smithi066 ceph-mon[35981]: pgmap v1045: 65 pgs: 65 active+clean; 577 KiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:44:59.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:44:59 smithi047 ceph-mon[31254]: pgmap v1046: 65 pgs: 65 active+clean; 577 KiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:44:59.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:44:59 smithi073 ceph-mon[35809]: pgmap v1046: 65 pgs: 65 active+clean; 577 KiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:44:59.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:44:59 smithi066 ceph-mon[35981]: pgmap v1046: 65 pgs: 65 active+clean; 577 KiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:44:59.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 -- 172.21.15.47:0/507546271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 msgr2=0x7fc534117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:59.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 --2- 172.21.15.47:0/507546271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 0x7fc534117810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00b0a0 tx=0x7fc52c00b3b0 comp rx=0 tx=0).stop 2024-05-14T12:44:59.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 -- 172.21.15.47:0/507546271 shutdown_connections 2024-05-14T12:44:59.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 --2- 172.21.15.47:0/507546271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 0x7fc534117810 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:59.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 --2- 172.21.15.47:0/507546271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc534110970 0x7fc534110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:59.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 --2- 172.21.15.47:0/507546271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 0x7fc53410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:59.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 -- 172.21.15.47:0/507546271 >> 172.21.15.47:0/507546271 conn(0x7fc534077c80 msgr2=0x7fc5340780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:44:59.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 -- 172.21.15.47:0/507546271 shutdown_connections 2024-05-14T12:44:59.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.594+0000 7fc53be00700 1 -- 172.21.15.47:0/507546271 wait complete. 2024-05-14T12:44:59.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.595+0000 7fc53be00700 1 Processor -- start 2024-05-14T12:44:59.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.595+0000 7fc53be00700 1 -- start start 2024-05-14T12:44:59.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc53be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 0x7fc5341a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:59.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc53be00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 0x7fc5341a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:59.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc53be00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc534110970 0x7fc5341a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc53be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc53411aae0 con 0x7fc53410a990 2024-05-14T12:44:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc53be00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc53411a960 con 0x7fc53410b2e0 2024-05-14T12:44:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc53be00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc53411ac60 con 0x7fc534110970 2024-05-14T12:44:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc539400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 0x7fc5341a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc538a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 0x7fc5341a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc539400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 0x7fc5341a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50970/0 (socket says 172.21.15.47:50970) 2024-05-14T12:44:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc538a00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 0x7fc5341a19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.47:40554/0 (socket says 172.21.15.47:40554) 2024-05-14T12:44:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc539400700 1 -- 172.21.15.47:0/250465328 learned_addr learned my addr 172.21.15.47:0/250465328 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-14T12:44:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.596+0000 7fc539e00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc534110970 0x7fc5341a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc539400700 1 -- 172.21.15.47:0/250465328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc534110970 msgr2=0x7fc5341a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc539400700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc534110970 0x7fc5341a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc539400700 1 -- 172.21.15.47:0/250465328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 msgr2=0x7fc5341a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:44:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc539400700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 0x7fc5341a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:44:59.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc539400700 1 -- 172.21.15.47:0/250465328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5341a6300 con 0x7fc53410a990 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc539e00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc534110970 0x7fc5341a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc539400700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 0x7fc5341a1430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e970 tx=0x7fc52800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc532000700 1 -- 172.21.15.47:0/250465328 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528004a30 con 0x7fc53410a990 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5341a65f0 con 0x7fc53410a990 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.597+0000 7fc532000700 1 -- 172.21.15.47:0/250465328 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc52800cc90 con 0x7fc53410a990 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.598+0000 7fc532000700 1 -- 172.21.15.47:0/250465328 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528005610 con 0x7fc53410a990 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.598+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5341adf10 con 0x7fc53410a990 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.599+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53410c080 con 0x7fc53410a990 2024-05-14T12:44:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.602+0000 7fc532000700 1 -- 172.21.15.47:0/250465328 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc52800c7e0 con 0x7fc53410a990 2024-05-14T12:44:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.603+0000 7fc532000700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc51c0b2880 0x7fc51c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T12:44:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.603+0000 7fc532000700 1 -- 172.21.15.47:0/250465328 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8087+0+0 (secure 0 0 0) 0x7fc5280e2500 con 0x7fc53410a990 2024-05-14T12:44:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.604+0000 7fc538a00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc51c0b2880 0x7fc51c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T12:44:59.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.604+0000 7fc538a00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc51c0b2880 0x7fc51c0b4d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc534109810 tx=0x7fc520009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T12:44:59.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.606+0000 7fc532000700 1 -- 172.21.15.47:0/250465328 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc528054df0 con 0x7fc53410a990 2024-05-14T12:44:59.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:44:59.857+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc5341a2790 con 0x7fc53410a990 2024-05-14T12:45:00.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.123+0000 7fc532000700 1 -- 172.21.15.47:0/250465328 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7fc5280aa260 con 0x7fc53410a990 2024-05-14T12:45:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc51c0b2880 msgr2=0x7fc51c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:45:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc51c0b2880 0x7fc51c0b4d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc534109810 tx=0x7fc520009260 comp rx=0 tx=0).stop 2024-05-14T12:45:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 msgr2=0x7fc5341a1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T12:45:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 0x7fc5341a1430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e970 tx=0x7fc52800ec80 comp rx=0 tx=0).stop 2024-05-14T12:45:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 shutdown_connections 2024-05-14T12:45:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:6800/1176244093,v1:172.21.15.47:6801/1176244093] conn(0x7fc51c0b2880 0x7fc51c0b4d90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:45:00.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc534110970 0x7fc5341a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:45:00.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc53410a990 0x7fc5341a1430 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:45:00.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 --2- 172.21.15.47:0/250465328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc53410b2e0 0x7fc5341a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T12:45:00.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.129+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 >> 172.21.15.47:0/250465328 conn(0x7fc534077c80 msgr2=0x7fc53407b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T12:45:00.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.130+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 shutdown_connections 2024-05-14T12:45:00.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-14T12:45:00.130+0000 7fc53be00700 1 -- 172.21.15.47:0/250465328 wait complete. 2024-05-14T12:45:00.132 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-05-14T12:45:00.403 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:00 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/250465328' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:45:00.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:00 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/250465328' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:45:00.575 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:00 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/250465328' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-14T12:45:00.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:45:01.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:45:01.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:45:01.106 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-14T12:45:01.106 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T12:45:01.168 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T12:45:01.185 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T12:45:01.200 INFO:tasks.cephadm:Stopping all daemons... 2024-05-14T12:45:01.201 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-14T12:45:01.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a 2024-05-14T12:45:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:01 smithi066 ceph-mon[35981]: from='client.? 172.21.15.47:0/250465328' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-14T12:45:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:01 smithi066 ceph-mon[35981]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T12:45:01.325 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:01 smithi066 ceph-mon[35981]: pgmap v1048: 1 pgs: 1 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:45:01.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:01 smithi047 ceph-mon[31254]: from='client.? 172.21.15.47:0/250465328' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-14T12:45:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:01 smithi047 ceph-mon[31254]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T12:45:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:01 smithi047 ceph-mon[31254]: pgmap v1048: 1 pgs: 1 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:45:01.486 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:01 smithi047 systemd[1]: Stopping Ceph mon.a for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:01.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:01 smithi073 ceph-mon[35809]: from='client.? 172.21.15.47:0/250465328' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-14T12:45:01.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:01 smithi073 ceph-mon[35809]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T12:45:01.501 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:01 smithi073 ceph-mon[35809]: pgmap v1048: 1 pgs: 1 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T12:45:02.169 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:01 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a[31250]: 2024-05-14T12:45:01.819+0000 7f982b400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:02.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:01 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a[31250]: 2024-05-14T12:45:01.820+0000 7f982b400700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-14T12:45:02.170 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:01 smithi047 podman[106746]: 2024-05-14 12:45:01.933512134 +0000 UTC m=+0.248726961 container died cfed7abc41f9c67624eec45431a5b15dbcc83bba5f31f470f53d981d81b30698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-14T12:45:02.484 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:02 smithi047 podman[106746]: 2024-05-14 12:45:02.371745842 +0000 UTC m=+0.686960699 container cleanup cfed7abc41f9c67624eec45431a5b15dbcc83bba5f31f470f53d981d81b30698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:45:02.485 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:02 smithi047 bash[106746]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a 2024-05-14T12:45:02.874 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:02 smithi047 podman[106758]: 2024-05-14 12:45:02.67317756 +0000 UTC m=+0.724455670 container remove cfed7abc41f9c67624eec45431a5b15dbcc83bba5f31f470f53d981d81b30698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:45:03.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service' 2024-05-14T12:45:03.178 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:03 smithi047 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-14T12:45:03.178 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:03 smithi047 systemd[1]: Stopped Ceph mon.a for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:45:03.178 INFO:journalctl@ceph.mon.a.smithi047.stdout:May 14 12:45:03 smithi047 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.a.service: Consumed 1min 1.504s CPU time. 2024-05-14T12:45:03.230 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:03.230 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-14T12:45:03.230 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-14T12:45:03.231 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.b 2024-05-14T12:45:03.540 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:03 smithi066 systemd[1]: Stopping Ceph mon.b for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:03 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-b[35976]: 2024-05-14T12:45:03.539+0000 7f9377d7d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:03 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-b[35976]: 2024-05-14T12:45:03.539+0000 7f9377d7d700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-14T12:45:03.825 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:03 smithi066 podman[72876]: 2024-05-14 12:45:03.60217433 +0000 UTC m=+0.171848706 container died 334e228c20bc30802533889174aad9498a2f401c9caf544a2d5e3a34f8329f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-b, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-14T12:45:04.224 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:03 smithi066 podman[72876]: 2024-05-14 12:45:03.957963803 +0000 UTC m=+0.527638179 container cleanup 334e228c20bc30802533889174aad9498a2f401c9caf544a2d5e3a34f8329f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5) 2024-05-14T12:45:04.225 INFO:journalctl@ceph.mon.b.smithi066.stdout:May 14 12:45:03 smithi066 bash[72876]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-b 2024-05-14T12:45:04.359 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.b.service' 2024-05-14T12:45:04.401 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:04.402 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-14T12:45:04.402 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-14T12:45:04.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.c 2024-05-14T12:45:04.725 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:04 smithi073 systemd[1]: Stopping Ceph mon.c for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:04 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-c[35805]: 2024-05-14T12:45:04.725+0000 7f25e3f09700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:04 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-c[35805]: 2024-05-14T12:45:04.725+0000 7f25e3f09700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-14T12:45:05.002 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:04 smithi073 podman[73903]: 2024-05-14 12:45:04.960335199 +0000 UTC m=+0.354161579 container died fbe503225835af113586b70e3040562cbd0fd2fd6f8397ef1e6fd0191d00998e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:45:05.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:05 smithi073 podman[73903]: 2024-05-14 12:45:05.32595961 +0000 UTC m=+0.719786011 container cleanup fbe503225835af113586b70e3040562cbd0fd2fd6f8397ef1e6fd0191d00998e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-14T12:45:05.502 INFO:journalctl@ceph.mon.c.smithi073.stdout:May 14 12:45:05 smithi073 bash[73903]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mon-c 2024-05-14T12:45:05.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mon.c.service' 2024-05-14T12:45:05.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:05.746 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-14T12:45:05.746 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-14T12:45:05.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.x 2024-05-14T12:45:06.234 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:45:05 smithi047 systemd[1]: Stopping Ceph mgr.x for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:06.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:45:06 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x[31479]: 2024-05-14T12:45:06.365+0000 7f869e600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:06.735 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:45:06 smithi047 podman[106879]: 2024-05-14 12:45:06.500795872 +0000 UTC m=+0.282382706 container died d74a48a5c6e7448d1901da42bddebd8819413d29c6f302c312f6010a18998520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-14T12:45:07.396 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:45:07 smithi047 podman[106879]: 2024-05-14 12:45:07.085140265 +0000 UTC m=+0.866727124 container cleanup d74a48a5c6e7448d1901da42bddebd8819413d29c6f302c312f6010a18998520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-14T12:45:07.396 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:45:07 smithi047 bash[106879]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x 2024-05-14T12:45:07.734 INFO:journalctl@ceph.mgr.x.smithi047.stdout:May 14 12:45:07 smithi047 podman[106892]: 2024-05-14 12:45:07.395897996 +0000 UTC m=+0.883815575 container remove d74a48a5c6e7448d1901da42bddebd8819413d29c6f302c312f6010a18998520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-x, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-14T12:45:07.927 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.x.service' 2024-05-14T12:45:08.044 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:08.044 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-14T12:45:08.044 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-14T12:45:08.044 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.y 2024-05-14T12:45:08.325 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:45:08 smithi066 systemd[1]: Stopping Ceph mgr.y for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:08.770 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:45:08 smithi066 podman[73001]: 2024-05-14 12:45:08.366348722 +0000 UTC m=+0.118792131 container stop 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:45:08.770 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:45:08 smithi066 podman[73001]: 2024-05-14 12:45:08.392212106 +0000 UTC m=+0.144655525 container died 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:45:09.074 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:45:08 smithi066 podman[73001]: 2024-05-14 12:45:08.853989303 +0000 UTC m=+0.606432721 container cleanup 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-14T12:45:09.075 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:45:08 smithi066 bash[73001]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y 2024-05-14T12:45:09.075 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:45:09 smithi066 podman[73015]: 2024-05-14 12:45:09.013473985 +0000 UTC m=+0.637509684 container remove 9856deffc4ccc8bc6d681d8b892548ba06a4daeb87ce8d7a003d83373471be07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-14T12:45:09.075 INFO:journalctl@ceph.mgr.y.smithi066.stdout:May 14 12:45:09 smithi066 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-14T12:45:09.239 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.y.service' 2024-05-14T12:45:09.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:09.274 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-14T12:45:09.274 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-14T12:45:09.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.z 2024-05-14T12:45:09.614 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:45:09 smithi073 systemd[1]: Stopping Ceph mgr.z for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:09.880 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:45:09 smithi073 podman[74027]: 2024-05-14 12:45:09.61444336 +0000 UTC m=+0.135972263 container died ebff4ec15e40806ac993dd41934f6aafd33f6e0aace70525c7678f3131e9e994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:45:10.231 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:45:09 smithi073 podman[74027]: 2024-05-14 12:45:09.971999448 +0000 UTC m=+0.493528349 container cleanup ebff4ec15e40806ac993dd41934f6aafd33f6e0aace70525c7678f3131e9e994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True) 2024-05-14T12:45:10.231 INFO:journalctl@ceph.mgr.z.smithi073.stdout:May 14 12:45:09 smithi073 bash[74027]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mgr-z 2024-05-14T12:45:10.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mgr.z.service' 2024-05-14T12:45:10.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:10.439 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-14T12:45:10.440 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-14T12:45:10.440 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.0 2024-05-14T12:45:10.985 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:10 smithi047 systemd[1]: Stopping Ceph osd.0 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:11.485 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:11 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0[43618]: 2024-05-14T12:45:11.063+0000 7fe86e200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:11.486 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:11 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0[43618]: 2024-05-14T12:45:11.063+0000 7fe86e200700 -1 osd.0 87 *** Got signal Terminated *** 2024-05-14T12:45:11.486 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:11 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0[43618]: 2024-05-14T12:45:11.063+0000 7fe86e200700 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:45:16.985 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:16 smithi047 podman[106998]: 2024-05-14 12:45:16.777452048 +0000 UTC m=+5.866014231 container died f0dd86e9f1e28c89da80fc7781d2de2954e6fd7e67af3532c7224b589525b3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-14T12:45:17.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:17 smithi047 podman[106998]: 2024-05-14 12:45:17.23274028 +0000 UTC m=+6.321302462 container cleanup f0dd86e9f1e28c89da80fc7781d2de2954e6fd7e67af3532c7224b589525b3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-14T12:45:17.459 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:17 smithi047 bash[106998]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0 2024-05-14T12:45:17.735 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:17 smithi047 podman[107021]: 2024-05-14 12:45:17.459318382 +0000 UTC m=+0.670742520 container remove f0dd86e9f1e28c89da80fc7781d2de2954e6fd7e67af3532c7224b589525b3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-14T12:45:18.732 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:18 smithi047 podman[107106]: 2024-05-14 12:45:18.306348679 +0000 UTC m=+0.043333824 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:45:18.733 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:18 smithi047 podman[107106]: 2024-05-14 12:45:18.418772468 +0000 UTC m=+0.155757617 container create 2f0b145d2eb8937bfeea9bd69b23aa982529b7a881df37ea3cd7bec94ee2a84e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-14T12:45:18.985 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:18 smithi047 podman[107106]: 2024-05-14 12:45:18.732054522 +0000 UTC m=+0.469039714 container init 2f0b145d2eb8937bfeea9bd69b23aa982529b7a881df37ea3cd7bec94ee2a84e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS) 2024-05-14T12:45:18.985 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:18 smithi047 podman[107106]: 2024-05-14 12:45:18.746131607 +0000 UTC m=+0.483116740 container start 2f0b145d2eb8937bfeea9bd69b23aa982529b7a881df37ea3cd7bec94ee2a84e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-14T12:45:18.985 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:18 smithi047 podman[107106]: 2024-05-14 12:45:18.821379546 +0000 UTC m=+0.558364745 container attach 2f0b145d2eb8937bfeea9bd69b23aa982529b7a881df37ea3cd7bec94ee2a84e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:45:19.484 INFO:journalctl@ceph.osd.0.smithi047.stdout:May 14 12:45:19 smithi047 podman[107106]: 2024-05-14 12:45:19.220014131 +0000 UTC m=+0.956999330 container died 2f0b145d2eb8937bfeea9bd69b23aa982529b7a881df37ea3cd7bec94ee2a84e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True) 2024-05-14T12:45:20.013 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.0.service' 2024-05-14T12:45:20.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:20.131 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-14T12:45:20.131 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-14T12:45:20.131 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.1 2024-05-14T12:45:20.449 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:20 smithi066 systemd[1]: Stopping Ceph osd.1 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:20.825 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:20 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1[40558]: 2024-05-14T12:45:20.448+0000 7f30868cb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:20.825 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:20 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1[40558]: 2024-05-14T12:45:20.448+0000 7f30868cb700 -1 osd.1 87 *** Got signal Terminated *** 2024-05-14T12:45:20.825 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:20 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1[40558]: 2024-05-14T12:45:20.448+0000 7f30868cb700 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:45:26.325 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:26 smithi066 podman[73135]: 2024-05-14 12:45:26.016049065 +0000 UTC m=+5.673572644 container died c3affc1f20ecb21227676d04d7f22b3d1bfd8ceb3f17559687ad0c77eaa6ba7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-14T12:45:26.633 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:26 smithi066 podman[73135]: 2024-05-14 12:45:26.441595916 +0000 UTC m=+6.099119487 container cleanup c3affc1f20ecb21227676d04d7f22b3d1bfd8ceb3f17559687ad0c77eaa6ba7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-14T12:45:26.633 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:26 smithi066 bash[73135]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1 2024-05-14T12:45:27.074 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:26 smithi066 podman[73150]: 2024-05-14 12:45:26.634333579 +0000 UTC m=+0.615124960 container remove c3affc1f20ecb21227676d04d7f22b3d1bfd8ceb3f17559687ad0c77eaa6ba7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-14T12:45:27.412 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:27 smithi066 podman[73240]: 2024-05-14 12:45:27.076802249 +0000 UTC m=+0.113436544 container create 871d6250096983cd13973c3acaf2460330e18ccf540ec09485fb37d6ea8aceb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-14T12:45:27.412 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:27 smithi066 podman[73240]: 2024-05-14 12:45:26.980883237 +0000 UTC m=+0.017517552 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:45:27.735 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:27 smithi066 podman[73240]: 2024-05-14 12:45:27.413254568 +0000 UTC m=+0.449888877 container init 871d6250096983cd13973c3acaf2460330e18ccf540ec09485fb37d6ea8aceb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T12:45:27.736 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:27 smithi066 podman[73240]: 2024-05-14 12:45:27.416785504 +0000 UTC m=+0.453419800 container start 871d6250096983cd13973c3acaf2460330e18ccf540ec09485fb37d6ea8aceb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:45:27.736 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:27 smithi066 podman[73240]: 2024-05-14 12:45:27.487645468 +0000 UTC m=+0.524279770 container attach 871d6250096983cd13973c3acaf2460330e18ccf540ec09485fb37d6ea8aceb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-14T12:45:28.024 INFO:journalctl@ceph.osd.1.smithi066.stdout:May 14 12:45:27 smithi066 podman[73240]: 2024-05-14 12:45:27.737011224 +0000 UTC m=+0.773645525 container died 871d6250096983cd13973c3acaf2460330e18ccf540ec09485fb37d6ea8aceb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T12:45:28.310 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.1.service' 2024-05-14T12:45:28.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:28.349 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-14T12:45:28.349 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-14T12:45:28.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.2 2024-05-14T12:45:28.667 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:28 smithi073 systemd[1]: Stopping Ceph osd.2 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:29.001 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:28 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2[40923]: 2024-05-14T12:45:28.666+0000 7fe6aef77700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:29.002 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:28 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2[40923]: 2024-05-14T12:45:28.666+0000 7fe6aef77700 -1 osd.2 87 *** Got signal Terminated *** 2024-05-14T12:45:29.002 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:28 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2[40923]: 2024-05-14T12:45:28.666+0000 7fe6aef77700 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:45:34.408 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:34 smithi073 podman[74155]: 2024-05-14 12:45:34.118656888 +0000 UTC m=+5.575880108 container died 120cb12a58166485230e4c6d4c48ea810c97ba5bf78e40a11d98786cd384998e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2) 2024-05-14T12:45:34.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:34 smithi073 podman[74155]: 2024-05-14 12:45:34.450298545 +0000 UTC m=+5.907521757 container cleanup 120cb12a58166485230e4c6d4c48ea810c97ba5bf78e40a11d98786cd384998e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T12:45:34.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:34 smithi073 bash[74155]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2 2024-05-14T12:45:34.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:34 smithi073 podman[74173]: 2024-05-14 12:45:34.642992602 +0000 UTC m=+0.520743183 container remove 120cb12a58166485230e4c6d4c48ea810c97ba5bf78e40a11d98786cd384998e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-14T12:45:35.396 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:35 smithi073 podman[74260]: 2024-05-14 12:45:34.973998621 +0000 UTC m=+0.017137905 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:45:35.396 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:35 smithi073 podman[74260]: 2024-05-14 12:45:35.102485033 +0000 UTC m=+0.145624322 container create 603b01b777bec71f64b73780a2724615a8e268362c4a0a80ece787b95b2f385e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-14T12:45:35.396 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:35 smithi073 podman[74260]: 2024-05-14 12:45:35.304741214 +0000 UTC m=+0.347880480 container init 603b01b777bec71f64b73780a2724615a8e268362c4a0a80ece787b95b2f385e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-14T12:45:35.396 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:35 smithi073 podman[74260]: 2024-05-14 12:45:35.307745991 +0000 UTC m=+0.350885259 container start 603b01b777bec71f64b73780a2724615a8e268362c4a0a80ece787b95b2f385e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-05-14T12:45:35.396 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:35 smithi073 podman[74260]: 2024-05-14 12:45:35.396497266 +0000 UTC m=+0.439636536 container attach 603b01b777bec71f64b73780a2724615a8e268362c4a0a80ece787b95b2f385e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-14T12:45:35.752 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:35 smithi073 podman[74260]: 2024-05-14 12:45:35.601676632 +0000 UTC m=+0.644815906 container died 603b01b777bec71f64b73780a2724615a8e268362c4a0a80ece787b95b2f385e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS) 2024-05-14T12:45:36.140 INFO:journalctl@ceph.osd.2.smithi073.stdout:May 14 12:45:36 smithi073 podman[74286]: 2024-05-14 12:45:36.12462544 +0000 UTC m=+0.517281998 container remove 603b01b777bec71f64b73780a2724615a8e268362c4a0a80ece787b95b2f385e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-14T12:45:36.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.2.service' 2024-05-14T12:45:36.183 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:36.183 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-14T12:45:36.184 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-14T12:45:36.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.3 2024-05-14T12:45:36.735 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:36 smithi047 systemd[1]: Stopping Ceph osd.3 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:37.235 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3[50287]: 2024-05-14T12:45:36.783+0000 7f5362800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:37.235 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3[50287]: 2024-05-14T12:45:36.783+0000 7f5362800700 -1 osd.3 87 *** Got signal Terminated *** 2024-05-14T12:45:37.235 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:36 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3[50287]: 2024-05-14T12:45:36.783+0000 7f5362800700 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:45:42.585 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:42 smithi047 podman[107211]: 2024-05-14 12:45:42.297215842 +0000 UTC m=+5.626785734 container died f598532d06df4dddf2a1a06588b818bc477f5dcbc9c8dce5c298475df304193e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-14T12:45:42.945 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:42 smithi047 podman[107211]: 2024-05-14 12:45:42.702404827 +0000 UTC m=+6.031974717 container cleanup f598532d06df4dddf2a1a06588b818bc477f5dcbc9c8dce5c298475df304193e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:45:42.945 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:42 smithi047 bash[107211]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3 2024-05-14T12:45:43.234 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:42 smithi047 podman[107240]: 2024-05-14 12:45:42.945201521 +0000 UTC m=+0.634900438 container remove f598532d06df4dddf2a1a06588b818bc477f5dcbc9c8dce5c298475df304193e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-14T12:45:44.125 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:43 smithi047 podman[107325]: 2024-05-14 12:45:43.787862159 +0000 UTC m=+0.123104587 container create d31b1812104d7bf64c47d247194648dd555e93b347cd2de3f2e4e6f5abf7ed21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:45:44.125 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:43 smithi047 podman[107325]: 2024-05-14 12:45:43.698971359 +0000 UTC m=+0.034213750 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:45:44.125 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:44 smithi047 podman[107325]: 2024-05-14 12:45:44.125080794 +0000 UTC m=+0.460323202 container init d31b1812104d7bf64c47d247194648dd555e93b347cd2de3f2e4e6f5abf7ed21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-14T12:45:44.485 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:44 smithi047 podman[107325]: 2024-05-14 12:45:44.137157655 +0000 UTC m=+0.472400077 container start d31b1812104d7bf64c47d247194648dd555e93b347cd2de3f2e4e6f5abf7ed21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-05-14T12:45:44.485 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:44 smithi047 podman[107325]: 2024-05-14 12:45:44.282086747 +0000 UTC m=+0.617329146 container attach d31b1812104d7bf64c47d247194648dd555e93b347cd2de3f2e4e6f5abf7ed21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2) 2024-05-14T12:45:44.985 INFO:journalctl@ceph.osd.3.smithi047.stdout:May 14 12:45:44 smithi047 podman[107325]: 2024-05-14 12:45:44.610075812 +0000 UTC m=+0.945318247 container died d31b1812104d7bf64c47d247194648dd555e93b347cd2de3f2e4e6f5abf7ed21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:45:45.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.3.service' 2024-05-14T12:45:45.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:45.519 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-14T12:45:45.520 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-14T12:45:45.520 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.4 2024-05-14T12:45:45.824 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:45 smithi066 systemd[1]: Stopping Ceph osd.4 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:46.324 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:45 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4[47056]: 2024-05-14T12:45:45.842+0000 7fbfd0422700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:46.325 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:45 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4[47056]: 2024-05-14T12:45:45.842+0000 7fbfd0422700 -1 osd.4 87 *** Got signal Terminated *** 2024-05-14T12:45:46.325 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:45 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4[47056]: 2024-05-14T12:45:45.842+0000 7fbfd0422700 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:45:51.575 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:51 smithi066 podman[73359]: 2024-05-14 12:45:51.230611053 +0000 UTC m=+5.498746260 container died 49b2cea31001e6c5d163040b88356b4dc5e4f9d7e4b7155eca4aa119e38c6bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-14T12:45:51.935 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:51 smithi066 podman[73359]: 2024-05-14 12:45:51.693687316 +0000 UTC m=+5.961822511 container cleanup 49b2cea31001e6c5d163040b88356b4dc5e4f9d7e4b7155eca4aa119e38c6bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-14T12:45:51.936 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:51 smithi066 bash[73359]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4 2024-05-14T12:45:52.282 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:51 smithi066 podman[73388]: 2024-05-14 12:45:51.936615281 +0000 UTC m=+0.708490065 container remove 49b2cea31001e6c5d163040b88356b4dc5e4f9d7e4b7155eca4aa119e38c6bd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-14T12:45:52.564 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:52 smithi066 podman[73478]: 2024-05-14 12:45:52.186000078 +0000 UTC m=+0.017947311 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:45:52.564 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:52 smithi066 podman[73478]: 2024-05-14 12:45:52.28750078 +0000 UTC m=+0.119448000 container create 0909f2e3a8d71abc8707506482dbd15d59e19cde7c3e7a164a6bf626c854ce65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.build-date=20240507) 2024-05-14T12:45:52.564 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:52 smithi066 podman[73478]: 2024-05-14 12:45:52.490267036 +0000 UTC m=+0.322214265 container init 0909f2e3a8d71abc8707506482dbd15d59e19cde7c3e7a164a6bf626c854ce65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:45:52.564 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:52 smithi066 podman[73478]: 2024-05-14 12:45:52.493670045 +0000 UTC m=+0.325617274 container start 0909f2e3a8d71abc8707506482dbd15d59e19cde7c3e7a164a6bf626c854ce65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:45:52.825 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:52 smithi066 podman[73478]: 2024-05-14 12:45:52.56460933 +0000 UTC m=+0.396556576 container attach 0909f2e3a8d71abc8707506482dbd15d59e19cde7c3e7a164a6bf626c854ce65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True) 2024-05-14T12:45:52.825 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:52 smithi066 podman[73478]: 2024-05-14 12:45:52.802802446 +0000 UTC m=+0.634749670 container died 0909f2e3a8d71abc8707506482dbd15d59e19cde7c3e7a164a6bf626c854ce65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-14T12:45:53.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.4.service' 2024-05-14T12:45:53.519 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:53 smithi066 podman[73504]: 2024-05-14 12:45:53.468110849 +0000 UTC m=+0.659211207 container remove 0909f2e3a8d71abc8707506482dbd15d59e19cde7c3e7a164a6bf626c854ce65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-14T12:45:53.520 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:53 smithi066 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.4.service: Deactivated successfully. 2024-05-14T12:45:53.520 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:53 smithi066 systemd[1]: Stopped Ceph osd.4 for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:45:53.520 INFO:journalctl@ceph.osd.4.smithi066.stdout:May 14 12:45:53 smithi066 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.4.service: Consumed 4min 2.469s CPU time. 2024-05-14T12:45:53.539 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:45:53.539 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-14T12:45:53.539 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-14T12:45:53.540 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.5 2024-05-14T12:45:53.984 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:45:53 smithi073 systemd[1]: Stopping Ceph osd.5 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:45:54.252 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:45:53 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5[47840]: 2024-05-14T12:45:53.984+0000 7f922c62d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:45:54.252 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:45:53 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5[47840]: 2024-05-14T12:45:53.984+0000 7f922c62d700 -1 osd.5 87 *** Got signal Terminated *** 2024-05-14T12:45:54.252 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:45:53 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5[47840]: 2024-05-14T12:45:53.984+0000 7f922c62d700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:45:59.718 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:45:59 smithi073 podman[74379]: 2024-05-14 12:45:59.425921018 +0000 UTC m=+5.683427503 container died 4567af15bc5a39828bc321d6bc035770191776f0747adf58e78beea744a97a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-14T12:46:00.001 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:45:59 smithi073 podman[74379]: 2024-05-14 12:45:59.792756126 +0000 UTC m=+6.050262601 container cleanup 4567af15bc5a39828bc321d6bc035770191776f0747adf58e78beea744a97a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-05-14T12:46:00.002 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:45:59 smithi073 bash[74379]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5 2024-05-14T12:46:00.363 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:46:00 smithi073 podman[74394]: 2024-05-14 12:46:00.036126579 +0000 UTC m=+0.608795757 container remove 4567af15bc5a39828bc321d6bc035770191776f0747adf58e78beea744a97a3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-14T12:46:00.730 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:46:00 smithi073 podman[74487]: 2024-05-14 12:46:00.26651411 +0000 UTC m=+0.017444864 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:46:00.730 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:46:00 smithi073 podman[74487]: 2024-05-14 12:46:00.387068299 +0000 UTC m=+0.137999057 container create b31545b3b40e904557ab57a1011364a1760f553189bd5bb4d04ae976dac8d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-14T12:46:00.730 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:46:00 smithi073 podman[74487]: 2024-05-14 12:46:00.589408238 +0000 UTC m=+0.340338979 container init b31545b3b40e904557ab57a1011364a1760f553189bd5bb4d04ae976dac8d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-14T12:46:00.730 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:46:00 smithi073 podman[74487]: 2024-05-14 12:46:00.592501798 +0000 UTC m=+0.343432537 container start b31545b3b40e904557ab57a1011364a1760f553189bd5bb4d04ae976dac8d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2) 2024-05-14T12:46:00.731 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:46:00 smithi073 podman[74487]: 2024-05-14 12:46:00.73111829 +0000 UTC m=+0.482049045 container attach b31545b3b40e904557ab57a1011364a1760f553189bd5bb4d04ae976dac8d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-14T12:46:01.001 INFO:journalctl@ceph.osd.5.smithi073.stdout:May 14 12:46:00 smithi073 podman[74487]: 2024-05-14 12:46:00.89367564 +0000 UTC m=+0.644606377 container died b31545b3b40e904557ab57a1011364a1760f553189bd5bb4d04ae976dac8d7db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-14T12:46:01.536 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.5.service' 2024-05-14T12:46:01.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:01.574 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-14T12:46:01.574 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-14T12:46:01.574 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.6 2024-05-14T12:46:01.984 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:01 smithi047 systemd[1]: Stopping Ceph osd.6 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:02.485 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:02 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6[56765]: 2024-05-14T12:46:02.177+0000 7f7880200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:02.485 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:02 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6[56765]: 2024-05-14T12:46:02.177+0000 7f7880200700 -1 osd.6 87 *** Got signal Terminated *** 2024-05-14T12:46:02.485 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:02 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6[56765]: 2024-05-14T12:46:02.177+0000 7f7880200700 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:46:08.143 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:07 smithi047 podman[107431]: 2024-05-14 12:46:07.817119151 +0000 UTC m=+5.777596819 container died 2ad03bce2189398b8ae82fae04530eaaeaf3415271cf3daa081ef095bb8b9d32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-05-14T12:46:08.415 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:08 smithi047 podman[107431]: 2024-05-14 12:46:08.27096579 +0000 UTC m=+6.231443459 container cleanup 2ad03bce2189398b8ae82fae04530eaaeaf3415271cf3daa081ef095bb8b9d32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-14T12:46:08.415 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:08 smithi047 bash[107431]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6 2024-05-14T12:46:08.734 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:08 smithi047 podman[107448]: 2024-05-14 12:46:08.505691058 +0000 UTC m=+0.671662680 container remove 2ad03bce2189398b8ae82fae04530eaaeaf3415271cf3daa081ef095bb8b9d32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-14T12:46:09.522 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:09 smithi047 podman[107547]: 2024-05-14 12:46:09.172765515 +0000 UTC m=+0.035400708 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:46:09.522 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:09 smithi047 podman[107547]: 2024-05-14 12:46:09.356792484 +0000 UTC m=+0.219427714 container create f036645dbb068a73a62d95233983abd9b880fafc80d57ea320cd7a3d377f92dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=) 2024-05-14T12:46:09.985 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:09 smithi047 podman[107547]: 2024-05-14 12:46:09.609964397 +0000 UTC m=+0.472599634 container init f036645dbb068a73a62d95233983abd9b880fafc80d57ea320cd7a3d377f92dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True) 2024-05-14T12:46:09.985 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:09 smithi047 podman[107547]: 2024-05-14 12:46:09.620916839 +0000 UTC m=+0.483552076 container start f036645dbb068a73a62d95233983abd9b880fafc80d57ea320cd7a3d377f92dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-14T12:46:09.985 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:09 smithi047 podman[107547]: 2024-05-14 12:46:09.692222581 +0000 UTC m=+0.554857778 container attach f036645dbb068a73a62d95233983abd9b880fafc80d57ea320cd7a3d377f92dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T12:46:10.449 INFO:journalctl@ceph.osd.6.smithi047.stdout:May 14 12:46:10 smithi047 podman[107547]: 2024-05-14 12:46:10.087412253 +0000 UTC m=+0.950047490 container died f036645dbb068a73a62d95233983abd9b880fafc80d57ea320cd7a3d377f92dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-14T12:46:10.817 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.6.service' 2024-05-14T12:46:10.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:10.941 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-14T12:46:10.941 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-14T12:46:10.941 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.7 2024-05-14T12:46:11.253 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:10 smithi066 systemd[1]: Stopping Ceph osd.7 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:11.575 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:11 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7[53880]: 2024-05-14T12:46:11.254+0000 7fdc5f2f0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:11.575 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:11 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7[53880]: 2024-05-14T12:46:11.254+0000 7fdc5f2f0700 -1 osd.7 87 *** Got signal Terminated *** 2024-05-14T12:46:11.575 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:11 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7[53880]: 2024-05-14T12:46:11.254+0000 7fdc5f2f0700 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:46:16.981 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:16 smithi066 podman[73585]: 2024-05-14 12:46:16.633781161 +0000 UTC m=+5.492639284 container died 69599756b03666849805f1a8f21e4af5e3ed21fde803de755637230607e0c5bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-14T12:46:17.325 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:17 smithi066 podman[73585]: 2024-05-14 12:46:17.18672593 +0000 UTC m=+6.045584052 container cleanup 69599756b03666849805f1a8f21e4af5e3ed21fde803de755637230607e0c5bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:46:17.325 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:17 smithi066 bash[73585]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7 2024-05-14T12:46:17.812 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:17 smithi066 podman[73601]: 2024-05-14 12:46:17.454591296 +0000 UTC m=+0.823082719 container remove 69599756b03666849805f1a8f21e4af5e3ed21fde803de755637230607e0c5bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-14T12:46:18.074 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:17 smithi066 podman[73688]: 2024-05-14 12:46:17.81367136 +0000 UTC m=+0.114320594 container create 603d1c84262724168791d7026941048f23d35a6a153972767f4f2c85bd4bdfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-14T12:46:18.074 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:17 smithi066 podman[73688]: 2024-05-14 12:46:17.717155756 +0000 UTC m=+0.017805012 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:46:18.074 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:18 smithi066 podman[73688]: 2024-05-14 12:46:18.016004142 +0000 UTC m=+0.316653383 container init 603d1c84262724168791d7026941048f23d35a6a153972767f4f2c85bd4bdfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-14T12:46:18.074 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:18 smithi066 podman[73688]: 2024-05-14 12:46:18.019080117 +0000 UTC m=+0.319729357 container start 603d1c84262724168791d7026941048f23d35a6a153972767f4f2c85bd4bdfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T12:46:18.074 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:18 smithi066 podman[73688]: 2024-05-14 12:46:18.074304561 +0000 UTC m=+0.374953810 container attach 603d1c84262724168791d7026941048f23d35a6a153972767f4f2c85bd4bdfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-14T12:46:18.575 INFO:journalctl@ceph.osd.7.smithi066.stdout:May 14 12:46:18 smithi066 podman[73688]: 2024-05-14 12:46:18.325214872 +0000 UTC m=+0.625864112 container died 603d1c84262724168791d7026941048f23d35a6a153972767f4f2c85bd4bdfc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:46:18.881 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.7.service' 2024-05-14T12:46:18.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:18.919 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-14T12:46:18.919 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-14T12:46:18.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.8 2024-05-14T12:46:19.252 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:18 smithi073 systemd[1]: Stopping Ceph osd.8 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:19.567 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:19 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8[54576]: 2024-05-14T12:46:19.294+0000 7f6212301700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:19.567 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:19 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8[54576]: 2024-05-14T12:46:19.294+0000 7f6212301700 -1 osd.8 87 *** Got signal Terminated *** 2024-05-14T12:46:19.567 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:19 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8[54576]: 2024-05-14T12:46:19.294+0000 7f6212301700 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:46:20.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:20 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:20.464+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:21.485 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:21 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:21.121+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:21.575 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:21 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:21.183+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:21.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:21 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:21.499+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:22.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:22 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:22.127+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:22.574 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:22 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:22.186+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:22.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:22 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:22.482+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:23.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:23 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:23.118+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:23.574 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:23 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:23.147+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:23.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:23 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:23.439+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:24.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:24 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:24.147+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:24.574 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:24 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:24.174+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:24.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:24 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:24.390+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:25.086 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:24 smithi073 podman[74594]: 2024-05-14 12:46:24.810036228 +0000 UTC m=+5.697627438 container died 0a89bb4bd6fdf1967428ef2f3ea3efc4cd58876f64a153a0341a6676b80733a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:46:25.405 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:25 smithi073 podman[74594]: 2024-05-14 12:46:25.169369879 +0000 UTC m=+6.056961087 container cleanup 0a89bb4bd6fdf1967428ef2f3ea3efc4cd58876f64a153a0341a6676b80733a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS) 2024-05-14T12:46:25.406 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:25 smithi073 bash[74594]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8 2024-05-14T12:46:25.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:25 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:25.174+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:25.574 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:25 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:25.199+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:25.751 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:25 smithi073 podman[74625]: 2024-05-14 12:46:25.445626745 +0000 UTC m=+0.629081370 container remove 0a89bb4bd6fdf1967428ef2f3ea3efc4cd58876f64a153a0341a6676b80733a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0) 2024-05-14T12:46:25.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:25 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:25.405+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:26.089 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:25 smithi073 podman[74712]: 2024-05-14 12:46:25.685044275 +0000 UTC m=+0.016891206 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:46:26.090 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:25 smithi073 podman[74712]: 2024-05-14 12:46:25.821527502 +0000 UTC m=+0.153374406 container create 49bdd21aa9fe55d4cadb8e53270fc02f64591b53f78e6155a61951051c5d64ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-14T12:46:26.090 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:26 smithi073 podman[74712]: 2024-05-14 12:46:26.015704122 +0000 UTC m=+0.347551030 container init 49bdd21aa9fe55d4cadb8e53270fc02f64591b53f78e6155a61951051c5d64ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD) 2024-05-14T12:46:26.090 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:26 smithi073 podman[74712]: 2024-05-14 12:46:26.018762141 +0000 UTC m=+0.350609062 container start 49bdd21aa9fe55d4cadb8e53270fc02f64591b53f78e6155a61951051c5d64ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-14T12:46:26.090 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:26 smithi073 podman[74712]: 2024-05-14 12:46:26.090642327 +0000 UTC m=+0.422489261 container attach 49bdd21aa9fe55d4cadb8e53270fc02f64591b53f78e6155a61951051c5d64ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=) 2024-05-14T12:46:26.437 INFO:journalctl@ceph.osd.8.smithi073.stdout:May 14 12:46:26 smithi073 podman[74712]: 2024-05-14 12:46:26.31575421 +0000 UTC m=+0.647601137 container died 49bdd21aa9fe55d4cadb8e53270fc02f64591b53f78e6155a61951051c5d64ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:46:26.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:26 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:26.212+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:26.574 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:26 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:26.214+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:26.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:26 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:26.437+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:26.987 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.8.service' 2024-05-14T12:46:27.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:27.024 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-14T12:46:27.024 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-14T12:46:27.024 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.9 2024-05-14T12:46:27.485 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:27 smithi047 systemd[1]: Stopping Ceph osd.9 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:27.486 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:27 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:27.237+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:27.574 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:27 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:27.243+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:27.575 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:27 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:27.243+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:27.755 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:27 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:27.415+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:27.985 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:27 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:27.639+0000 7fcd13e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:27.985 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:27 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:27.639+0000 7fcd13e00700 -1 osd.9 87 *** Got signal Terminated *** 2024-05-14T12:46:27.985 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:27 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:27.639+0000 7fcd13e00700 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:46:28.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:28 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:28.207+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:28.574 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:28 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:28.264+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:28.575 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:28 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:28.264+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:28.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:28 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:28.453+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:28.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:28 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:28.453+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:29.325 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:29 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:29.308+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:29.325 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:29 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:29.308+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:29.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:29 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:29.176+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:29.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:29 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:29.427+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:29.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:29 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:29.427+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:30.484 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:30 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:30.202+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:30.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:30 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:30.385+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:30.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:30 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:30.385+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:30.824 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:30 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:30.337+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:30.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:30 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:30.337+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:31.485 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:31 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:31.229+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:31.485 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:31 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:31.229+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:24.698479+0000 front 2024-05-14T12:45:24.698146+0000 (oldest deadline 2024-05-14T12:46:30.598367+0000) 2024-05-14T12:46:31.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:31 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:31.346+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:31.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:31 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:31.346+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:31.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:31 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:31.380+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:31.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:31 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:31.380+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:32.485 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:32 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:32.192+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.695650+0000 front 2024-05-14T12:45:14.696778+0000 (oldest deadline 2024-05-14T12:46:20.595830+0000) 2024-05-14T12:46:32.485 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:32 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9[63736]: 2024-05-14T12:46:32.192+0000 7fcd0f600700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:24.698479+0000 front 2024-05-14T12:45:24.698146+0000 (oldest deadline 2024-05-14T12:46:30.598367+0000) 2024-05-14T12:46:32.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:32 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:32.362+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:32.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:32 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:32.362+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:32.824 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:32 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:32.345+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:32.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:32 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:32.345+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:33.622 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:33 smithi047 podman[107653]: 2024-05-14 12:46:33.270440496 +0000 UTC m=+5.759675400 container died b3afe11e4142299caff349d1acf8283039d9b890c7de9811856051026aa58595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:46:33.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:33 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:33.377+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:33.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:33 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:33.378+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:33.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:33 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:33.363+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:33.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:33 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:33.364+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:33.985 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:33 smithi047 podman[107653]: 2024-05-14 12:46:33.8229814 +0000 UTC m=+6.312216301 container cleanup b3afe11e4142299caff349d1acf8283039d9b890c7de9811856051026aa58595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-14T12:46:33.985 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:33 smithi047 bash[107653]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9 2024-05-14T12:46:34.485 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:33 smithi047 podman[107671]: 2024-05-14 12:46:33.990915696 +0000 UTC m=+0.706015836 container remove b3afe11e4142299caff349d1acf8283039d9b890c7de9811856051026aa58595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:46:34.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:34 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:34.413+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:34.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:34 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:34.413+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:34.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:34 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:34.326+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:34.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:34 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:34.326+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:35.162 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:34 smithi047 podman[107760]: 2024-05-14 12:46:34.793153634 +0000 UTC m=+0.038604625 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:46:35.162 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:34 smithi047 podman[107760]: 2024-05-14 12:46:34.900025029 +0000 UTC m=+0.145476035 container create d356fe82f8da4b1b8637403e445016b13b4d103f9fbb463e9c876a0bf17ebc8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T12:46:35.162 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:35 smithi047 podman[107760]: 2024-05-14 12:46:35.161718595 +0000 UTC m=+0.407169586 container init d356fe82f8da4b1b8637403e445016b13b4d103f9fbb463e9c876a0bf17ebc8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T12:46:35.419 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:35 smithi047 podman[107760]: 2024-05-14 12:46:35.173725457 +0000 UTC m=+0.419176478 container start d356fe82f8da4b1b8637403e445016b13b4d103f9fbb463e9c876a0bf17ebc8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:46:35.419 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:35 smithi047 podman[107760]: 2024-05-14 12:46:35.260949331 +0000 UTC m=+0.506400323 container attach d356fe82f8da4b1b8637403e445016b13b4d103f9fbb463e9c876a0bf17ebc8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:46:35.721 INFO:journalctl@ceph.osd.9.smithi047.stdout:May 14 12:46:35 smithi047 podman[107760]: 2024-05-14 12:46:35.654485668 +0000 UTC m=+0.899936659 container died d356fe82f8da4b1b8637403e445016b13b4d103f9fbb463e9c876a0bf17ebc8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-14T12:46:35.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:35 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:35.459+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:35.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:35 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:35.459+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:35.824 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:35 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:35.354+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:35.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:35 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:35.354+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:36.376 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.9.service' 2024-05-14T12:46:36.475 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:36.475 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-14T12:46:36.476 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-14T12:46:36.476 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.10 2024-05-14T12:46:36.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:36 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:36.492+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:36.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:36 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:36.492+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:36.805 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:36 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:36.347+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:36.805 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:36 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:36.347+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:36.805 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:36 smithi066 systemd[1]: Stopping Ceph osd.10 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:37.074 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:36 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:36.805+0000 7f4747175700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:37.075 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:36 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:36.805+0000 7f4747175700 -1 osd.10 87 *** Got signal Terminated *** 2024-05-14T12:46:37.075 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:36 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:36.805+0000 7f4747175700 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:46:37.824 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:37 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:37.376+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:37.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:37 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:37.376+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:38.001 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:37 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:37.539+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:38.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:37 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:37.539+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:38.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:37 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:37.539+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:38.824 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:38 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:38.373+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:38.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:38 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:38.373+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:39.001 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:38 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:38.535+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:39.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:38 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:38.535+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:39.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:38 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:38.535+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:39.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:39 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:39.501+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:39.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:39 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:39.501+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:39.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:39 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:39.501+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:39.824 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:39 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:39.375+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:39.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:39 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:39.375+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:39.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:39 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:39.375+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:33.312966+0000 front 2024-05-14T12:45:33.312924+0000 (oldest deadline 2024-05-14T12:46:39.213103+0000) 2024-05-14T12:46:40.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:40 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:40.492+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:40.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:40 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:40.492+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:40.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:40 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:40.492+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:40.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:40 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:40.394+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:40.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:40 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:40.394+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:40.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:40 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:40.394+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:33.312966+0000 front 2024-05-14T12:45:33.312924+0000 (oldest deadline 2024-05-14T12:46:39.213103+0000) 2024-05-14T12:46:41.824 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:41 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:41.427+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:15.810321+0000 front 2024-05-14T12:45:15.810066+0000 (oldest deadline 2024-05-14T12:46:21.109721+0000) 2024-05-14T12:46:41.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:41 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:41.427+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:22.810968+0000 front 2024-05-14T12:45:22.810997+0000 (oldest deadline 2024-05-14T12:46:26.311150+0000) 2024-05-14T12:46:41.825 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:41 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10[60473]: 2024-05-14T12:46:41.427+0000 7f474372b700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:33.312966+0000 front 2024-05-14T12:45:33.312924+0000 (oldest deadline 2024-05-14T12:46:39.213103+0000) 2024-05-14T12:46:42.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:41 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:41.539+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:42.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:41 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:41.539+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:42.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:41 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:41.539+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:42.447 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:42 smithi066 podman[73807]: 2024-05-14 12:46:42.180438985 +0000 UTC m=+5.496849420 container died 30490efb5ad4c99c5a51607c7873b9aa187156e1385c1bb26231eaf968c91d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T12:46:42.790 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:42 smithi066 podman[73807]: 2024-05-14 12:46:42.538938038 +0000 UTC m=+5.855348471 container cleanup 30490efb5ad4c99c5a51607c7873b9aa187156e1385c1bb26231eaf968c91d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:46:42.790 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:42 smithi066 bash[73807]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10 2024-05-14T12:46:43.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:42 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:42.516+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:43.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:42 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:42.516+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:43.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:42 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:42.516+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:43.075 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:42 smithi066 podman[73825]: 2024-05-14 12:46:42.79001146 +0000 UTC m=+0.600322061 container remove 30490efb5ad4c99c5a51607c7873b9aa187156e1385c1bb26231eaf968c91d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:46:43.417 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:43 smithi066 podman[73913]: 2024-05-14 12:46:43.027291993 +0000 UTC m=+0.018128490 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:46:43.417 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:43 smithi066 podman[73913]: 2024-05-14 12:46:43.132433754 +0000 UTC m=+0.123270272 container create c249d6064165a3de89d09d8ec17cc7cc09fbccc1b73d1a208e7ddaca57ed4c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:46:43.417 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:43 smithi066 podman[73913]: 2024-05-14 12:46:43.417825038 +0000 UTC m=+0.408661535 container init c249d6064165a3de89d09d8ec17cc7cc09fbccc1b73d1a208e7ddaca57ed4c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0) 2024-05-14T12:46:43.722 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:43 smithi066 podman[73913]: 2024-05-14 12:46:43.421278386 +0000 UTC m=+0.412114887 container start c249d6064165a3de89d09d8ec17cc7cc09fbccc1b73d1a208e7ddaca57ed4c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:46:43.723 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:43 smithi066 podman[73913]: 2024-05-14 12:46:43.492771877 +0000 UTC m=+0.483608390 container attach c249d6064165a3de89d09d8ec17cc7cc09fbccc1b73d1a208e7ddaca57ed4c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-14T12:46:43.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:43 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:43.486+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:43.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:43 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:43.486+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:43.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:43 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:43.486+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:44.003 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:43 smithi066 podman[73913]: 2024-05-14 12:46:43.723768074 +0000 UTC m=+0.714604571 container died c249d6064165a3de89d09d8ec17cc7cc09fbccc1b73d1a208e7ddaca57ed4c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-14T12:46:44.250 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.10.service' 2024-05-14T12:46:44.273 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:44 smithi066 podman[73939]: 2024-05-14 12:46:44.231163054 +0000 UTC m=+0.501048189 container remove c249d6064165a3de89d09d8ec17cc7cc09fbccc1b73d1a208e7ddaca57ed4c64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-14T12:46:44.273 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:44 smithi066 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.10.service: Deactivated successfully. 2024-05-14T12:46:44.273 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:44 smithi066 systemd[1]: Stopped Ceph osd.10 for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:46:44.273 INFO:journalctl@ceph.osd.10.smithi066.stdout:May 14 12:46:44 smithi066 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.10.service: Consumed 4min 30.307s CPU time. 2024-05-14T12:46:44.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:44.288 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-14T12:46:44.288 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-14T12:46:44.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.11 2024-05-14T12:46:44.604 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:44 smithi073 systemd[1]: Stopping Ceph osd.11 for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:44.604 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:44.504+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:44.604 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:44.504+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:44.604 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:44.504+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:44.604 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:44.604+0000 7f5629287700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:44.604 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:44.604+0000 7f5629287700 -1 osd.11 87 *** Got signal Terminated *** 2024-05-14T12:46:44.604 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:44 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:44.604+0000 7f5629287700 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T12:46:46.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:45 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:45.543+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:46.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:45 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:45.543+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:46.003 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:45 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:45.543+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:47.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:46 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:46.530+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:47.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:46 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:46.530+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:47.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:46 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:46.530+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:47.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:47 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:47.497+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:47.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:47 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:47.497+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:47.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:47 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:47.497+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:49.001 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:48.544+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:49.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:48.544+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:49.002 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:48 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:48.544+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:49.903 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:49 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:49.540+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-05-14T12:45:14.887405+0000 front 2024-05-14T12:45:14.887391+0000 (oldest deadline 2024-05-14T12:46:20.187256+0000) 2024-05-14T12:46:49.903 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:49 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:49.540+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-05-14T12:45:20.187847+0000 front 2024-05-14T12:45:20.188011+0000 (oldest deadline 2024-05-14T12:46:28.388420+0000) 2024-05-14T12:46:49.903 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:49 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11[61597]: 2024-05-14T12:46:49.540+0000 7f562583d700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-05-14T12:45:28.388919+0000 front 2024-05-14T12:45:28.389009+0000 (oldest deadline 2024-05-14T12:46:36.589461+0000) 2024-05-14T12:46:50.445 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:50 smithi073 podman[74817]: 2024-05-14 12:46:50.154355696 +0000 UTC m=+5.668420667 container died 9c39db316a2cfd93555029d29ede1eb38a14d4bbfd576f53879df3e119597873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-14T12:46:50.751 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:50 smithi073 podman[74817]: 2024-05-14 12:46:50.446069588 +0000 UTC m=+5.960134559 container cleanup 9c39db316a2cfd93555029d29ede1eb38a14d4bbfd576f53879df3e119597873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-05-14T12:46:50.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:50 smithi073 bash[74817]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11 2024-05-14T12:46:50.752 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:50 smithi073 podman[74834]: 2024-05-14 12:46:50.663996884 +0000 UTC m=+0.509158501 container remove 9c39db316a2cfd93555029d29ede1eb38a14d4bbfd576f53879df3e119597873 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux ) 2024-05-14T12:46:51.252 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:50 smithi073 podman[74932]: 2024-05-14 12:46:50.981390155 +0000 UTC m=+0.103775141 container create a4b0f65cc01990092238ab243c995f99a85e27faa73ede6cd17427ba7de6e92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-14T12:46:51.252 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:50 smithi073 podman[74932]: 2024-05-14 12:46:50.894742894 +0000 UTC m=+0.017127888 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T12:46:51.551 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:51 smithi073 podman[74932]: 2024-05-14 12:46:51.258679869 +0000 UTC m=+0.381064854 container init a4b0f65cc01990092238ab243c995f99a85e27faa73ede6cd17427ba7de6e92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:46:51.551 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:51 smithi073 podman[74932]: 2024-05-14 12:46:51.26182515 +0000 UTC m=+0.384210135 container start a4b0f65cc01990092238ab243c995f99a85e27faa73ede6cd17427ba7de6e92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:46:51.551 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:51 smithi073 podman[74932]: 2024-05-14 12:46:51.342150905 +0000 UTC m=+0.464535892 container attach a4b0f65cc01990092238ab243c995f99a85e27faa73ede6cd17427ba7de6e92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:46:51.893 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:51 smithi073 podman[74932]: 2024-05-14 12:46:51.552142546 +0000 UTC m=+0.674527539 container died a4b0f65cc01990092238ab243c995f99a85e27faa73ede6cd17427ba7de6e92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-05-14T12:46:52.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.11.service' 2024-05-14T12:46:52.159 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:52 smithi073 podman[74958]: 2024-05-14 12:46:52.112079728 +0000 UTC m=+0.550661170 container remove a4b0f65cc01990092238ab243c995f99a85e27faa73ede6cd17427ba7de6e92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-05-14T12:46:52.160 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:52 smithi073 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.11.service: Deactivated successfully. 2024-05-14T12:46:52.160 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:52 smithi073 systemd[1]: Stopped Ceph osd.11 for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:46:52.160 INFO:journalctl@ceph.osd.11.smithi073.stdout:May 14 12:46:52 smithi073 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@osd.11.service: Consumed 4min 57.437s CPU time. 2024-05-14T12:46:52.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:52.177 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-14T12:46:52.177 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-14T12:46:52.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.a 2024-05-14T12:46:52.732 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:46:52 smithi047 systemd[1]: Stopping Ceph mds.a for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:52.984 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:46:52 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: 2024-05-14T12:46:52.731+0000 7f991d800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:52.984 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:46:52 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a[70928]: 2024-05-14T12:46:52.731+0000 7f991d800700 -1 mds.a *** got signal Terminated *** 2024-05-14T12:46:56.654 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:46:56 smithi047 podman[107881]: 2024-05-14 12:46:56.344384496 +0000 UTC m=+3.747966429 container died ce3db125857dd0d62bc2300b20c6e1f2a3079e06938cf3c5d3daa16f19547e91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-14T12:46:56.918 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:46:56 smithi047 podman[107881]: 2024-05-14 12:46:56.783024851 +0000 UTC m=+4.186606777 container cleanup ce3db125857dd0d62bc2300b20c6e1f2a3079e06938cf3c5d3daa16f19547e91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-14T12:46:56.918 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:46:56 smithi047 bash[107881]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a 2024-05-14T12:46:57.235 INFO:journalctl@ceph.mds.a.smithi047.stdout:May 14 12:46:57 smithi047 podman[107894]: 2024-05-14 12:46:57.051287466 +0000 UTC m=+0.692253589 container remove ce3db125857dd0d62bc2300b20c6e1f2a3079e06938cf3c5d3daa16f19547e91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-14T12:46:57.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.a.service' 2024-05-14T12:46:57.768 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:46:57.769 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-14T12:46:57.769 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-14T12:46:57.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.d 2024-05-14T12:46:58.234 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:46:57 smithi047 systemd[1]: Stopping Ceph mds.d for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:46:58.734 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:46:58 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d[69767]: 2024-05-14T12:46:58.402+0000 7f45dee00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:46:58.735 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:46:58 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d[69767]: 2024-05-14T12:46:58.402+0000 7f45dee00700 -1 mds.d *** got signal Terminated *** 2024-05-14T12:47:00.616 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:47:00 smithi047 podman[107999]: 2024-05-14 12:47:00.341941259 +0000 UTC m=+2.076848929 container died c41f7e11b3e65a013dffaca4d0ced90ca70e29dd4ffa16d2c1950542651ca4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-14T12:47:00.985 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:47:00 smithi047 podman[107999]: 2024-05-14 12:47:00.762155036 +0000 UTC m=+2.497062741 container cleanup c41f7e11b3e65a013dffaca4d0ced90ca70e29dd4ffa16d2c1950542651ca4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-14T12:47:00.985 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:47:00 smithi047 bash[107999]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d 2024-05-14T12:47:01.464 INFO:journalctl@ceph.mds.d.smithi047.stdout:May 14 12:47:00 smithi047 podman[108013]: 2024-05-14 12:47:00.988234474 +0000 UTC m=+0.627850056 container remove c41f7e11b3e65a013dffaca4d0ced90ca70e29dd4ffa16d2c1950542651ca4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:47:01.498 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.d.service' 2024-05-14T12:47:01.609 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:01.609 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-14T12:47:01.609 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-14T12:47:01.609 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.g 2024-05-14T12:47:02.222 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:01 smithi047 systemd[1]: Stopping Ceph mds.g for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:02.484 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:02 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g[70545]: 2024-05-14T12:47:02.222+0000 7f300aa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:02.485 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:02 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g[70545]: 2024-05-14T12:47:02.222+0000 7f300aa00700 -1 mds.g *** got signal Terminated *** 2024-05-14T12:47:05.136 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:04 smithi047 podman[108120]: 2024-05-14 12:47:04.809459249 +0000 UTC m=+2.715264046 container stop 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-14T12:47:05.136 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:04 smithi047 podman[108120]: 2024-05-14 12:47:04.835914089 +0000 UTC m=+2.741718875 container died 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-14T12:47:05.485 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:05 smithi047 podman[108120]: 2024-05-14 12:47:05.24933972 +0000 UTC m=+3.155144535 container cleanup 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-14T12:47:05.485 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:05 smithi047 bash[108120]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g 2024-05-14T12:47:05.976 INFO:journalctl@ceph.mds.g.smithi047.stdout:May 14 12:47:05 smithi047 podman[108135]: 2024-05-14 12:47:05.500264799 +0000 UTC m=+0.667907915 container remove 3ab1902ab70f8ef6affeb65159192957f20f76964e18563f04f95a535d105e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, io.buildah.version=1.33.5) 2024-05-14T12:47:06.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.g.service' 2024-05-14T12:47:06.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:06.110 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-14T12:47:06.111 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-14T12:47:06.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.j 2024-05-14T12:47:06.484 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:47:06 smithi047 systemd[1]: Stopping Ceph mds.j for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:06.985 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:47:06 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j[69357]: 2024-05-14T12:47:06.726+0000 7f5be8e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:06.985 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:47:06 smithi047 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j[69357]: 2024-05-14T12:47:06.726+0000 7f5be8e00700 -1 mds.j *** got signal Terminated *** 2024-05-14T12:47:09.233 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:47:08 smithi047 podman[108242]: 2024-05-14 12:47:08.938620077 +0000 UTC m=+2.338447873 container died 71dacb13a5b04b7465d2ac6d79e3e329bc8d11fa9ce8abc28d69237a9ac52a37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:47:09.484 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:47:09 smithi047 podman[108242]: 2024-05-14 12:47:09.345080804 +0000 UTC m=+2.744908593 container cleanup 71dacb13a5b04b7465d2ac6d79e3e329bc8d11fa9ce8abc28d69237a9ac52a37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True) 2024-05-14T12:47:09.485 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:47:09 smithi047 bash[108242]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j 2024-05-14T12:47:09.984 INFO:journalctl@ceph.mds.j.smithi047.stdout:May 14 12:47:09 smithi047 podman[108268]: 2024-05-14 12:47:09.595856236 +0000 UTC m=+0.643521883 container remove 71dacb13a5b04b7465d2ac6d79e3e329bc8d11fa9ce8abc28d69237a9ac52a37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:47:10.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.j.service' 2024-05-14T12:47:10.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:10.264 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-14T12:47:10.264 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-14T12:47:10.264 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.b 2024-05-14T12:47:10.573 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:47:10 smithi066 systemd[1]: Stopping Ceph mds.b for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:10.825 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:47:10 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b[66117]: 2024-05-14T12:47:10.572+0000 7fc3a2e30700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:10.825 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:47:10 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b[66117]: 2024-05-14T12:47:10.572+0000 7fc3a2e30700 -1 mds.b *** got signal Terminated *** 2024-05-14T12:47:12.545 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:47:12 smithi066 podman[74018]: 2024-05-14 12:47:12.23851758 +0000 UTC m=+1.770439553 container died 35a40c749e6301556ae3f878ff3d48d0cf2af2d8ee34dc269233fb9a80d84c71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-14T12:47:12.824 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:47:12 smithi066 podman[74018]: 2024-05-14 12:47:12.681607366 +0000 UTC m=+2.213529336 container cleanup 35a40c749e6301556ae3f878ff3d48d0cf2af2d8ee34dc269233fb9a80d84c71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-14T12:47:12.825 INFO:journalctl@ceph.mds.b.smithi066.stdout:May 14 12:47:12 smithi066 bash[74018]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-b 2024-05-14T12:47:13.065 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.b.service' 2024-05-14T12:47:13.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:13.101 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-14T12:47:13.101 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-14T12:47:13.101 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.e 2024-05-14T12:47:13.443 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:47:13 smithi066 systemd[1]: Stopping Ceph mds.e for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:13.824 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:47:13 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e[65500]: 2024-05-14T12:47:13.443+0000 7f4609e43700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:13.824 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:47:13 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e[65500]: 2024-05-14T12:47:13.443+0000 7f4609e43700 -1 mds.e *** got signal Terminated *** 2024-05-14T12:47:16.493 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:47:16 smithi066 podman[74151]: 2024-05-14 12:47:16.234087939 +0000 UTC m=+2.905673240 container died a07a0bc8a3aa3bbdd22c1ff06d8682f68dfc4fb864028023e31f90973649f761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-05-14T12:47:16.824 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:47:16 smithi066 podman[74151]: 2024-05-14 12:47:16.593766831 +0000 UTC m=+3.265352131 container cleanup a07a0bc8a3aa3bbdd22c1ff06d8682f68dfc4fb864028023e31f90973649f761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-14T12:47:16.825 INFO:journalctl@ceph.mds.e.smithi066.stdout:May 14 12:47:16 smithi066 bash[74151]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-e 2024-05-14T12:47:17.024 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.e.service' 2024-05-14T12:47:17.058 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:17.058 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-14T12:47:17.058 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-14T12:47:17.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.h 2024-05-14T12:47:17.388 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:47:17 smithi066 systemd[1]: Stopping Ceph mds.h for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:17.824 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:47:17 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h[65804]: 2024-05-14T12:47:17.388+0000 7f14b0dc4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:17.825 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:47:17 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h[65804]: 2024-05-14T12:47:17.388+0000 7f14b0dc4700 -1 mds.h *** got signal Terminated *** 2024-05-14T12:47:20.488 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:47:20 smithi066 podman[74273]: 2024-05-14 12:47:20.231877974 +0000 UTC m=+2.938773010 container died 8fd6117631c40d0df86616ca80d21cbca37a26634b13bf0e46086672e2608b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-14T12:47:20.825 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:47:20 smithi066 podman[74273]: 2024-05-14 12:47:20.580565176 +0000 UTC m=+3.287460212 container cleanup 8fd6117631c40d0df86616ca80d21cbca37a26634b13bf0e46086672e2608b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-14T12:47:20.825 INFO:journalctl@ceph.mds.h.smithi066.stdout:May 14 12:47:20 smithi066 bash[74273]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-h 2024-05-14T12:47:21.023 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.h.service' 2024-05-14T12:47:21.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:21.055 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-14T12:47:21.055 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-14T12:47:21.055 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.k 2024-05-14T12:47:21.375 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:47:21 smithi066 systemd[1]: Stopping Ceph mds.k for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:21.825 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:47:21 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k[65188]: 2024-05-14T12:47:21.374+0000 7fee983fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:21.825 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:47:21 smithi066 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k[65188]: 2024-05-14T12:47:21.374+0000 7fee983fd700 -1 mds.k *** got signal Terminated *** 2024-05-14T12:47:24.492 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:47:24 smithi066 podman[74395]: 2024-05-14 12:47:24.230512529 +0000 UTC m=+2.954337379 container died 4fcc12ac5f10b56114a2fb2ecc50846e15e8923479838c89c18beea1fa8c7c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:47:24.825 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:47:24 smithi066 podman[74395]: 2024-05-14 12:47:24.584407565 +0000 UTC m=+3.308232412 container cleanup 4fcc12ac5f10b56114a2fb2ecc50846e15e8923479838c89c18beea1fa8c7c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD) 2024-05-14T12:47:24.825 INFO:journalctl@ceph.mds.k.smithi066.stdout:May 14 12:47:24 smithi066 bash[74395]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-k 2024-05-14T12:47:24.951 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.k.service' 2024-05-14T12:47:24.983 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:24.984 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-14T12:47:24.984 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-14T12:47:24.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.c 2024-05-14T12:47:25.361 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:25 smithi073 systemd[1]: Stopping Ceph mds.c for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:25.625 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:25 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: 2024-05-14T12:47:25.361+0000 7f7be43f9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:25.626 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:25 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c[67015]: 2024-05-14T12:47:25.361+0000 7f7be43f9700 -1 mds.c *** got signal Terminated *** 2024-05-14T12:47:28.502 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:28 smithi073 podman[75037]: 2024-05-14 12:47:28.220386143 +0000 UTC m=+3.046544815 container died d3538bf0807a19354ed6a0e3943584e7ee13f606a1eb2323454a28a3699847b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-14T12:47:28.853 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:28 smithi073 podman[75037]: 2024-05-14 12:47:28.661303457 +0000 UTC m=+3.487462128 container cleanup d3538bf0807a19354ed6a0e3943584e7ee13f606a1eb2323454a28a3699847b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T12:47:28.853 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:28 smithi073 bash[75037]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c 2024-05-14T12:47:29.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.c.service' 2024-05-14T12:47:29.166 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:28 smithi073 podman[75061]: 2024-05-14 12:47:28.854125451 +0000 UTC m=+0.629027835 container remove d3538bf0807a19354ed6a0e3943584e7ee13f606a1eb2323454a28a3699847b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-05-14T12:47:29.167 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:29 smithi073 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.c.service: Deactivated successfully. 2024-05-14T12:47:29.167 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:29 smithi073 systemd[1]: Stopped Ceph mds.c for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:47:29.167 INFO:journalctl@ceph.mds.c.smithi073.stdout:May 14 12:47:29 smithi073 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.c.service: Consumed 18.954s CPU time. 2024-05-14T12:47:29.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:29.180 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-14T12:47:29.180 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-14T12:47:29.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.f 2024-05-14T12:47:29.498 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:47:29 smithi073 systemd[1]: Stopping Ceph mds.f for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:29.751 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:47:29 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f[66714]: 2024-05-14T12:47:29.497+0000 7fe32c1ab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:29.752 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:47:29 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f[66714]: 2024-05-14T12:47:29.497+0000 7fe32c1ab700 -1 mds.f *** got signal Terminated *** 2024-05-14T12:47:32.502 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:47:32 smithi073 podman[75168]: 2024-05-14 12:47:32.224498635 +0000 UTC m=+2.830777230 container died ded613d13e8d11c0ca724b6726d8a700f6df016a5c63f1b47899f073f778e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-14T12:47:32.998 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:47:32 smithi073 podman[75168]: 2024-05-14 12:47:32.53204337 +0000 UTC m=+3.138321964 container cleanup ded613d13e8d11c0ca724b6726d8a700f6df016a5c63f1b47899f073f778e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-14T12:47:32.998 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:47:32 smithi073 bash[75168]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f 2024-05-14T12:47:32.998 INFO:journalctl@ceph.mds.f.smithi073.stdout:May 14 12:47:32 smithi073 podman[75180]: 2024-05-14 12:47:32.774890419 +0000 UTC m=+0.549987701 container remove ded613d13e8d11c0ca724b6726d8a700f6df016a5c63f1b47899f073f778e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-14T12:47:33.015 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.f.service' 2024-05-14T12:47:33.046 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:33.047 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-14T12:47:33.047 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-14T12:47:33.047 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.i 2024-05-14T12:47:33.501 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:47:33 smithi073 systemd[1]: Stopping Ceph mds.i for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:34.001 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:47:33 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i[67330]: 2024-05-14T12:47:33.510+0000 7f8130306700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:34.002 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:47:33 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i[67330]: 2024-05-14T12:47:33.510+0000 7f8130306700 -1 mds.i *** got signal Terminated *** 2024-05-14T12:47:36.493 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:47:36 smithi073 podman[75292]: 2024-05-14 12:47:36.22510146 +0000 UTC m=+2.962052285 container died 4575e4da0fbf0733d766788098e1b1f7bd63e73156bc980fbf6671c42e7fb87d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-05-14T12:47:36.751 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:47:36 smithi073 podman[75292]: 2024-05-14 12:47:36.610927893 +0000 UTC m=+3.347878727 container cleanup 4575e4da0fbf0733d766788098e1b1f7bd63e73156bc980fbf6671c42e7fb87d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:47:36.752 INFO:journalctl@ceph.mds.i.smithi073.stdout:May 14 12:47:36 smithi073 bash[75292]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-i 2024-05-14T12:47:36.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.i.service' 2024-05-14T12:47:37.011 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:37.011 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-14T12:47:37.011 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-14T12:47:37.011 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.l 2024-05-14T12:47:37.251 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:37 smithi073 systemd[1]: Stopping Ceph mds.l for e5959f02-11ea-11ef-bc98-c7b262605968... 2024-05-14T12:47:37.751 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:37 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-l[66411]: 2024-05-14T12:47:37.364+0000 7f90e3ba2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T12:47:37.752 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:37 smithi073 ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-l[66411]: 2024-05-14T12:47:37.364+0000 7f90e3ba2700 -1 mds.l *** got signal Terminated *** 2024-05-14T12:47:40.481 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:40 smithi073 podman[75412]: 2024-05-14 12:47:40.23143611 +0000 UTC m=+3.002527189 container died 3152981b0c9180a9d40a25eb42072d54d11bae6f53b1e75a396808725aa23913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-l, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5) 2024-05-14T12:47:40.731 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:40 smithi073 podman[75412]: 2024-05-14 12:47:40.54806938 +0000 UTC m=+3.319160459 container cleanup 3152981b0c9180a9d40a25eb42072d54d11bae6f53b1e75a396808725aa23913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-l, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T12:47:40.731 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:40 smithi073 bash[75412]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-l 2024-05-14T12:47:40.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.l.service' 2024-05-14T12:47:40.991 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:40 smithi073 podman[75424]: 2024-05-14 12:47:40.732342812 +0000 UTC m=+0.501334049 container remove 3152981b0c9180a9d40a25eb42072d54d11bae6f53b1e75a396808725aa23913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-e5959f02-11ea-11ef-bc98-c7b262605968-mds-l, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T12:47:40.991 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:40 smithi073 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.l.service: Deactivated successfully. 2024-05-14T12:47:40.992 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:40 smithi073 systemd[1]: Stopped Ceph mds.l for e5959f02-11ea-11ef-bc98-c7b262605968. 2024-05-14T12:47:40.992 INFO:journalctl@ceph.mds.l.smithi073.stdout:May 14 12:47:40 smithi073 systemd[1]: ceph-e5959f02-11ea-11ef-bc98-c7b262605968@mds.l.service: Consumed 4.719s CPU time. 2024-05-14T12:47:41.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T12:47:41.003 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-14T12:47:41.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e5959f02-11ea-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T12:47:41.339 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:47:46.537 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e5959f02-11ea-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T12:47:46.735 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:47:49.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e5959f02-11ea-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T12:47:49.409 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:47:51.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:47:51.864 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:47:51.896 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T12:47:51.922 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-14T12:47:51.924 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi047/crash 2024-05-14T12:47:51.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash -- . 2024-05-14T12:47:52.038 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T12:47:52.039 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-05-14T12:47:52.043 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi066/crash 2024-05-14T12:47:52.044 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash -- . 2024-05-14T12:47:52.081 INFO:teuthology.orchestra.run.smithi066.stderr:tar: /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T12:47:52.081 INFO:teuthology.orchestra.run.smithi066.stderr:tar: Error is not recoverable: exiting now 2024-05-14T12:47:52.083 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi073/crash 2024-05-14T12:47:52.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash -- . 2024-05-14T12:47:52.121 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T12:47:52.121 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now 2024-05-14T12:47:52.122 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-14T12:47:52.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-14T12:47:52.235 INFO:tasks.cephadm:Compressing logs... 2024-05-14T12:47:52.235 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T12:47:52.239 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T12:47:52.242 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T12:47:52.265 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log 2024-05-14T12:47:52.265 INFO:teuthology.orchestra.run.smithi073.stderr:: No such file or directory 2024-05-14T12:47:52.265 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.2.log 2024-05-14T12:47:52.265 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.f.log 2024-05-14T12:47:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T12:47:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.5.log 2024-05-14T12:47:52.267 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.c.log 2024-05-14T12:47:52.268 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log: /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.c.log 2024-05-14T12:47:52.268 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.z.log 2024-05-14T12:47:52.268 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.i.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:gzip/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log: -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.7.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.b.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.4.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.1.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.y.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.h.log 2024-05-14T12:47:52.275 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.10.log 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.h.log: 90.4% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi066.stderr:gzip 87.3% -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.z.log: 87.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi073.stderr: 90.4% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.11.log 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log: 83.1% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T12:47:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.8.log 2024-05-14T12:47:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.11.log: 93.4% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.z.log.gz 2024-05-14T12:47:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T12:47:52.279 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.10.log: 93.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.y.log.gz 2024-05-14T12:47:52.289 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.e.log 2024-05-14T12:47:52.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T12:47:52.289 INFO:teuthology.orchestra.run.smithi066.stderr: 83.1% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T12:47:52.290 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.b.log 2024-05-14T12:47:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.l.log 2024-05-14T12:47:52.296 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-05-14T12:47:52.296 INFO:teuthology.orchestra.run.smithi047.stderr: /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log 2024-05-14T12:47:52.297 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T12:47:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T12:47:52.299 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.g.log 2024-05-14T12:47:52.299 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.j.log 2024-05-14T12:47:52.300 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.3.log 2024-05-14T12:47:52.302 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.g.log: /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.j.log: 87.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T12:47:52.302 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.0.log 2024-05-14T12:47:52.303 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.k.log 2024-05-14T12:47:52.303 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.3.log: 90.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T12:47:52.303 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.x.log 2024-05-14T12:47:52.305 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T12:47:52.305 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T12:47:52.306 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.a.log 2024-05-14T12:47:52.306 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.6.log 2024-05-14T12:47:52.309 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.a.log: /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.6.log: 94.4% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.j.log.gz 2024-05-14T12:47:52.309 INFO:teuthology.orchestra.run.smithi047.stderr: 94.5% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.g.log.gz 2024-05-14T12:47:52.309 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T12:47:52.310 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.a.log 2024-05-14T12:47:52.312 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log: 83.1% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T12:47:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T12:47:52.315 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.a.log: /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.d.log 2024-05-14T12:47:52.318 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T12:47:52.319 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T12:47:52.319 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T12:47:52.320 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.9.log 2024-05-14T12:47:52.328 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T12:47:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/cephadm.log: 90.9% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T12:47:52.358 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T12:47:52.689 INFO:teuthology.orchestra.run.smithi066.stderr: 96.2% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.k.log.gz 2024-05-14T12:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr: 95.8% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.e.log.gz 2024-05-14T12:47:52.973 INFO:teuthology.orchestra.run.smithi066.stderr: 95.0% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.h.log.gz 2024-05-14T12:47:52.995 INFO:teuthology.orchestra.run.smithi047.stderr: 90.4% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mgr.x.log.gz 2024-05-14T12:47:53.060 INFO:teuthology.orchestra.run.smithi073.stderr: 91.8% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.c.log.gz 2024-05-14T12:47:53.088 INFO:teuthology.orchestra.run.smithi066.stderr: 91.8% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.b.log.gz 2024-05-14T12:47:53.161 INFO:teuthology.orchestra.run.smithi073.stderr: 96.7% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.l.log.gz 2024-05-14T12:47:53.319 INFO:teuthology.orchestra.run.smithi047.stderr: 96.5% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.d.log.gz 2024-05-14T12:47:54.227 INFO:teuthology.orchestra.run.smithi047.stderr: 90.2% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mon.a.log.gz 2024-05-14T12:47:54.599 INFO:teuthology.orchestra.run.smithi073.stderr: 95.9% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.i.log.gz 2024-05-14T12:47:54.893 INFO:teuthology.orchestra.run.smithi073.stderr: 96.0% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.f.log.gz 2024-05-14T12:47:57.618 INFO:teuthology.orchestra.run.smithi073.stderr: 96.2% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.c.log.gz 2024-05-14T12:47:57.767 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.4.log.gz 2024-05-14T12:47:58.595 INFO:teuthology.orchestra.run.smithi066.stderr: 96.1% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.b.log.gz 2024-05-14T12:47:58.702 INFO:teuthology.orchestra.run.smithi047.stderr: 93.2% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.9.log.gz 2024-05-14T12:47:58.916 INFO:teuthology.orchestra.run.smithi047.stderr: 94.2% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-mds.a.log.gz 2024-05-14T12:47:59.209 INFO:teuthology.orchestra.run.smithi073.stderr: 93.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.8.log.gz 2024-05-14T12:47:59.925 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.10.log.gz 2024-05-14T12:48:00.714 INFO:teuthology.orchestra.run.smithi073.stderr: 93.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.5.log.gz 2024-05-14T12:48:01.117 INFO:teuthology.orchestra.run.smithi073.stderr: 93.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.2.log.gz 2024-05-14T12:48:02.394 INFO:teuthology.orchestra.run.smithi047.stderr: 93.2% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.6.log.gz 2024-05-14T12:48:02.595 INFO:teuthology.orchestra.run.smithi066.stderr: 93.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.7.log.gz 2024-05-14T12:48:02.646 INFO:teuthology.orchestra.run.smithi073.stderr: 93.3% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.11.log.gz 2024-05-14T12:48:02.648 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-05-14T12:48:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m10.392s 2024-05-14T12:48:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m44.197s 2024-05-14T12:48:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m1.554s 2024-05-14T12:48:02.931 INFO:teuthology.orchestra.run.smithi066.stderr: 93.2% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.1.log.gz 2024-05-14T12:48:02.932 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-05-14T12:48:02.932 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m10.676s 2024-05-14T12:48:02.932 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m41.043s 2024-05-14T12:48:02.933 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m1.373s 2024-05-14T12:48:03.657 INFO:teuthology.orchestra.run.smithi047.stderr: 93.1% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.0.log.gz 2024-05-14T12:48:04.537 INFO:teuthology.orchestra.run.smithi047.stderr: 93.1% -- replaced with /var/log/ceph/e5959f02-11ea-11ef-bc98-c7b262605968/ceph-osd.3.log.gz 2024-05-14T12:48:04.541 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-05-14T12:48:04.541 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m12.269s 2024-05-14T12:48:04.541 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m46.060s 2024-05-14T12:48:04.542 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m3.575s 2024-05-14T12:48:04.542 INFO:tasks.cephadm:Archiving logs... 2024-05-14T12:48:04.543 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi047/log 2024-05-14T12:48:04.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T12:48:10.535 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi066/log 2024-05-14T12:48:10.536 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T12:48:15.732 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi073/log 2024-05-14T12:48:15.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T12:48:21.160 INFO:tasks.cephadm:Removing cluster... 2024-05-14T12:48:21.160 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e5959f02-11ea-11ef-bc98-c7b262605968 --force 2024-05-14T12:48:21.495 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:48:22.210 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e5959f02-11ea-11ef-bc98-c7b262605968 --force 2024-05-14T12:48:22.413 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:48:22.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e5959f02-11ea-11ef-bc98-c7b262605968 --force 2024-05-14T12:48:22.907 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: e5959f02-11ea-11ef-bc98-c7b262605968 2024-05-14T12:48:23.260 INFO:tasks.cephadm:Removing cephadm ... 2024-05-14T12:48:23.260 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T12:48:23.323 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T12:48:23.341 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T12:48:23.356 INFO:tasks.cephadm:Teardown complete 2024-05-14T12:48:23.357 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-14T12:48:23.368 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-14T12:48:23.368 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T12:48:23.374 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T12:48:23.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T12:48:23.535 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-14T12:48:23.545 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-14T12:48:23.545 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:48:23.553 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:48:23.556 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:48:23.570 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-05-14T12:48:23.571 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-05-14T12:48:23.574 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T12:48:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-05-14T12:48:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +1112us[+1280us] +/- 38ms 2024-05-14T12:48:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 -866us[ -866us] +/- 72ms 2024-05-14T12:48:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -774us[ -606us] +/- 60ms 2024-05-14T12:48:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:48:23.576 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T12:48:23.576 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-05-14T12:48:23.576 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +1060us[+1249us] +/- 38ms 2024-05-14T12:48:23.576 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -912us[ -724us] +/- 72ms 2024-05-14T12:48:23.576 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -832us[ -644us] +/- 60ms 2024-05-14T12:48:23.576 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:48:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-05-14T12:48:23.613 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T12:48:23.613 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-14T12:48:23.613 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +1079us[+1261us] +/- 38ms 2024-05-14T12:48:23.613 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -921us[ -739us] +/- 72ms 2024-05-14T12:48:23.613 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -835us[ -653us] +/- 60ms 2024-05-14T12:48:23.613 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T12:48:23.615 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-14T12:48:23.626 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-14T12:48:23.626 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-14T12:48:23.650 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T12:48:23.880 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T12:48:23.954 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T12:48:24.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T12:48:24.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:48:24.125 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T12:48:24.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:48:24.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T12:48:24.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:48:24.185 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-14T12:48:24.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-14T12:48:24.239 INFO:teuthology.task.internal:Duration was 2806.118785 seconds 2024-05-14T12:48:24.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-14T12:48:24.305 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-14T12:48:24.306 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T12:48:24.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T12:48:24.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T12:48:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T12:48:24.358 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T12:48:24.453 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T12:48:24.881 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-14T12:48:24.881 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-05-14T12:48:24.881 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T12:48:24.948 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-05-14T12:48:24.948 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T12:48:24.984 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-05-14T12:48:24.985 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T12:48:25.006 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-14T12:48:25.006 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T12:48:25.014 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T12:48:25.027 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T12:48:25.093 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-14T12:48:25.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T12:48:25.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T12:48:25.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T12:48:26.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-14T12:48:26.029 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-14T12:48:26.029 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T12:48:26.103 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T12:48:26.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T12:48:26.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-14T12:48:26.168 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:48:26.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:48:26.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:48:26.201 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-05-14T12:48:26.222 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-05-14T12:48:26.266 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-05-14T12:48:26.312 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:48:26.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:48:26.361 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:48:26.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:48:26.377 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:48:26.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:48:26.392 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-14T12:48:26.407 INFO:teuthology.task.internal:Transferring archived files... 2024-05-14T12:48:26.407 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi047 2024-05-14T12:48:26.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T12:48:26.530 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi066 2024-05-14T12:48:26.531 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T12:48:26.570 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770/remote/smithi073 2024-05-14T12:48:26.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T12:48:26.608 INFO:teuthology.task.internal:Removing archive directory... 2024-05-14T12:48:26.608 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T12:48:26.616 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T12:48:26.619 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T12:48:26.671 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-14T12:48:26.684 INFO:teuthology.task.internal:Not uploading archives. 2024-05-14T12:48:26.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-14T12:48:26.748 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-14T12:48:26.749 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T12:48:26.756 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T12:48:26.759 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T12:48:26.772 INFO:teuthology.orchestra.run.smithi066.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 12:48 /home/ubuntu/cephtest 2024-05-14T12:48:26.776 INFO:teuthology.orchestra.run.smithi073.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 12:48 /home/ubuntu/cephtest 2024-05-14T12:48:26.809 INFO:teuthology.orchestra.run.smithi047.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 12:48 /home/ubuntu/cephtest 2024-05-14T12:48:26.813 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-14T12:48:26.825 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-14T12:48:26.932 INFO:teuthology.nuke:Checking targets against current locks 2024-05-14T12:48:26.958 DEBUG:teuthology.nuke:shortname: smithi047 2024-05-14T12:48:26.958 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T12:48:26.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 11:51:36.424736', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIzKtlXFHDHk17XHGZXVA1Zq/qXEFGWG8oYM+rDzNzlm6zbK/zURy9JiPcC3v+r5YYkJy3gIoAtgXDDwwLspebk='} 2024-05-14T12:48:26.986 DEBUG:teuthology.nuke:shortname: smithi066 2024-05-14T12:48:26.986 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T12:48:27.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 11:51:36.426755', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQVPhvmCDpxdqug4SajaMXX6Zs0/RF3KkRa501KmSvUgYnHhsq4g9KX+NdxZrNiLjE7WLlMB7EfPmoojbgCoYQ='} 2024-05-14T12:48:27.011 DEBUG:teuthology.nuke:shortname: smithi073 2024-05-14T12:48:27.011 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T12:48:27.039 INFO:teuthology.orchestra.console.smithi047:Power off 2024-05-14T12:48:27.040 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T12:48:27.058 INFO:teuthology.orchestra.console.smithi066:Power off 2024-05-14T12:48:27.059 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T12:48:27.067 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 11:51:36.428518', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsVQaov3vxA+nxdLol/3+lofBWffPe3HP/9qnEuzhJ/7215RYjXdkqYFopNPg7ED2WupDiQBkS7e3DaqHr+TPQ='} 2024-05-14T12:48:27.071 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-05-14T12:48:27.071 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:27.081 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-05-14T12:48:27.082 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:27.094 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-05-14T12:48:27.104 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-05-14T12:48:27.127 INFO:teuthology.orchestra.console.smithi073:Power off 2024-05-14T12:48:27.127 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T12:48:27.155 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-05-14T12:48:27.155 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:27.181 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-05-14T12:48:31.095 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:31.104 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:31.182 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:31.207 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-05-14T12:48:31.214 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-05-14T12:48:31.295 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-05-14T12:48:35.210 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:35.218 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:35.296 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:48:35.320 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-05-14T12:48:35.328 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-05-14T12:48:35.405 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-05-14T12:48:35.421 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-05-14T12:48:35.429 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-05-14T12:48:35.506 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-05-14T12:48:35.611 INFO:teuthology.run:Summary data: client.0-kernel-sha1: e8b10e4a18b1bb5760aa273548d0a7e626b2532f description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} duration: 2806.1187846660614 failure_reason: 'error during quiesce thrashing: Error quiescing set ''3f3d2c55'': 110 (ETIMEDOUT)' flavor: default owner: scheduled_vshankar@teuthology status: fail success: false 2024-05-14T12:48:35.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T12:48:35.697 INFO:teuthology.run:FAIL